Rheumatoid arthritis is a chronic autoimmune-inflammatory disease characterized by joint destruction and physical disability. The present treatment options in rheumatoid arthritis include nonsteroidal anti-inflammatory drugs, glucocorticoids, and synthetic and biological disease-modifying antirheumatic drugs. However, all these classes of medications have disadvantages associated with severe adverse reactions, patients' low adherence to treatment, and numerous drug interactions. These drawbacks emphasize the need to identify novel anti-inflammatory agents to replace or support standard therapy and improve treatment compliance. This mini-review focuses on herbal preparations whose efficacy was evaluated in clinical trials. Extracts of various plant species (Tripterygium wilfordii Hook F, Paeonia lactiflora Pallas, Olea europea L., Silybum marianum (L.) Gaertn., Hippophaë rhamnoides L., Punica granatum L., Vaccinium macrocarpon Aiton) and powdered plant parts (Allium sativum L., Rosa canina L.) significantly improved the clinical parameters, disease activity indices, and biochemical markers in rheumatoid arthritis patients when they were administered as supportive therapy alongside the standard medication or, more rarely, as monotherapy. The bioactive compounds have been only partially identified and further research is required to fully elucidate the phytochemical profile of these herbal preparations. Although the clinical studies performed up to now support the benefits of herbal supplementation in rheumatoid arthritis, there is a strong need for more human trials to validate the efficacy and safety of herbal preparations.