I read with interest the article by Dr Montemuro on treatments for menopausal symptoms [BCMJ 2001;43(8):452-457], but I cannot agree with her assessment of the evidence in favor of the clinical use of St. John’s wort, black cohosh, ginkgo, or valerian.
Two key elements in the critical evaluation of any therapeutic agent are the plausibility of the supportive evidence and the assessment of potential harm from its use. Convincing evidence of safety and effectiveness does not exist for any of the four agents listed above.
In the case of black cohosh the most recent (and only) RCT for menopausal symptoms found it to be no better than placebo.
The three English-language RCTs on valerian paint a murky picture, with the most rigorous tests showing no effect:
Donath and colleagues reported multiple endpoints in a study of valerian extract on sleep structure. While some of the endpoints showed statistical significance in favor of valerian, the clinical significance is far from clear. A more powerful finding would have been clear statistical and clinical significance demonstrated on an a priori endpoint.
Schulz and colleagues also measured multiple endpoints when comparing placebo to valerian. While positive effects were noted for slow wave sleep, no effect was seen on subjective sleep quality, time to sleep onset, or REM sleep.
Balderer reported a mild sedative effect of valerian over placebo, however the trial numbers were small (n=18) and the part of the trial conducted under the most rigorous conditions showed no significant effect.
The case of St. John’s wort is instructive in that it illustrates how poorly done studies may give the appearance of a credible body of evidence without actually comprising one. As Dr Montemuro points out, there are over 20 RCTs supportive of St. John’s wort’s effectiveness in the treatment of depression. What critical appraisers will find disturbing, however, is the lack of long-term safety data, the generally poor case definitions, the small numbers involved, the failure to control for duration of illness, and the relative lack of replication of these studies by people other than herbal proponents. Independent reviewers have been concerned about the quality of the so-called “body of evidence” behind St. John’s wort, and excellent discussions of the experimental design flaws seen in these papers can be found in Deltito and Field. Of even greater concern is the fact that the one study that employed the greatest scientific rigor found there to be no efficacy greater than placebo.
The literature on Ginkgo biloba paints a picture most consistent with a remedy in search of a condition to treat. Although ginkgo is alleged to be of use for ADHD, depression, poor sleep, and sexual libido, the relevant studies are either negative (tinnitus, depression) or of such poor quality as to make conclusions about efficacy impossible (poor sleep, sexual libido). tinnitus,
For example, the RCT by Hemmeter and colleagues on sleep employed neither blinding nor controls. The study by Waynberg reporting increased libido in pre- and post-menopausal women was conducted without the benefit of randomization, blinding, or a placebo group.
Presumably, the rationale for the use of ginkgo in menopause would be to address symptoms of depression, poor sleep, and decreased libido. Even if one were to consider the RCTs in which ginkgo is said to improve memory loss,[13-21] the quality of the studies leaves much to be desired. In general, the studies suffer from low numbers (13, 16, 18, and 20 to 22), or the use of multiple endpoints (13, 17, and 22). Three of the studies report discernable small improvements on certain cognitive scoring scales but do not establish the clinical significance of these results (14, 15, 17, and 19). Also weighing against these papers are the essentially negative studies of Moulton and Mix and the large RCT by van Dongen, which found no effect.
Similarly, the evidence of the cardioprotective effect of a low-fat diet, far from being difficult to overemphasize, is quite tenuous and indicates that a strict low-fat diet could at best add 2 months to one’s life expectancy.
Dr Montemuro asserts that “Women at high risk for breast cancer will need to avoid hormones and use lifestyle modification and complementary and alternative therapies almost exclusively.” This statement fails on two counts:
The therapies advocated need rigorous proof before being used in clinical practice.
It does not make sense to assume that biologically active herbal remedies can have only good long-term effects if no studies have been done specifically looking for the undesirable endpoints that are alleged to be the result of conventional therapy.
Patients with chronic or incurable conditions are especially attracted to unproven treatments. Physicians need to know not only what supportive evidence exists for these therapies, but also how to rate its quality.
—Lloyd Oppel, MD
Thank you for inviting me to respond to Dr Oppel’s letter regarding the article I wrote, “Relieving the symptoms of menopause: From herbs to hormones.”
I based the article on information gathered at the SOGC (Society of Obstetricians and Gynaecologists of Canada) Consensus on Menopause and Osteoporosis, the meetings of which I attended during the winter/spring 2001. The members of the SOGC Menopause and Osteoporosis Consensus included gynecologists, internists, endocrinologists, a nurse, a pharmacologist, a family physician, a medical researcher, and members of the public. I also referred to the Canadian Medical Association reference book Herbs: Everyday Reference for Health Professionals.
During the SOGC meetings we examined the quality of evidence for all therapeutic interventions including lifestyle, vitamins, hormones, antidepressants, oral contraceptives, osteoporosis medication, and herbal remedies. The members of the Consensus assigned levels of evidence to the research we examined. The proceeding of these meetings were printed in the SOGC’s Journal of Obstetrics and Gynaecology Canada September-December 2001. I have referenced some of the chapters from the Consensus below.
I certainly share Dr Oppel’s concern about the widespread and often inappropriate use of herbal remedies for which there is scant scientific data. The purpose of including information about herbal as well as traditional therapies in this article was to inform physicians about a select few herbs, including warnings about their interactions and side effects. These select herbs have randomized control trials, although of short duration, therefore short-term use was advised. By reviewing the relevant data on a select number of herbs I hoped to give physicians some useful tools to help them answer women’s questions about alternative management of menopausal symptoms.
I am concerned that Dr Oppel felt there was not enough scientific data to recommend a low-fat diet for cardioprotection. Is he suggesting we stop trying to convince our patients to improve their diets? The Nurses Health Study showed an 83% reduction in coronary events in women who adhered to a healthy lifestyle (low-fat diet, exercise, and non-smoking). Unfortunately only 3% of the nurses actually fit the criteria for a healthy lifestyle. This finding underscores the enormous potential for intervention in this area.
I refer all readers with questions to the Consensus on Menopause and Osteoporosis.
—Suzanne Montemuro, MD
Chandler F (ed). Herbs: Everyday Reference for Health Professionals. Ottawa, ON: Canadian Medical Association and Canadian Pharmacists Association, 2000.
Derzko C, Fluker M, Montemuro S, et al. Menopause: Healthy Living: Canadian Consensus on Menopause and Osteoporosis. J Obstet Gynecol Can 2001;23:14-20. Full Text
Fluker M, Montemuro S. Complementary Approaches: Canadian Consensus on Menopause and Osteoporosis. J Obstet Gynecol Can 2001;23:70-79. Full Text
1. Jacobson JS, et al. Randomized trial of black cohosh for the treatment of hot flashes among women with a history of breast cancer. J Clin Oncol 2001;19:2739-2745.PubMed Abstract
2. Donath F, et al. Critical evaluation of the effect of valerian extract on sleep structure and sleep quality. Pharmacopsychiatry 2000;33:47-53.PubMed Abstract
3. Schulz H, Stolz C, Muller J. The effect of valerian extract on sleep polygraphy in poor sleepers: A pilot study. Pharmacopsychiatry 1994;27:147-151.PubMed Abstract
4. Balderer G, Borbely AA. Effect of valerian on human sleep. Psychopharmacology 1985;87:406-409.PubMed Abstract
5. Deltito J, Beyer D. The scientific, quasi-scientific and popular literature on the use of St. John’s wort in the treatment of depression. J Affect Disord 1998;51:345-351.PubMed Abstract
6. Field HL, et al. St. John’s wort. Int J Psychiatry Med 2000;30:203-219.PubMed Abstract
7. Shelton RC, et al. Effectiveness of St John’s wort in major depression: A randomized controlled trial. JAMA 2001;285:1978-1986.PubMed Abstract
8. Lyon MR, Cline JC, Totosy de Zepetnek J, et al. Effect of the herbal extract combination Panax quinquefolium and Ginkgo biloba on attention-deficit hyperactivity disorder: A pilot study. J Psychiatry Neurosci 2001;26:221-228.PubMed Abstract Full Text
9. Lingaerde O, Foreland AR, Magnusson A. Can winter depression be prevented by Ginkgo biloba extract? A placebo-controlled trial. Acta Psychiatr Scand 1999;100:62-66.PubMed Abstract
10. Drew S, Davies E. Effectiveness of Ginkgo biloba in treating tinnitus: Double blind, placebo controlled trial. BMJ 2001;322:73.PubMed Abstract Full Text
11. Hemmeter U, et al. Polysomnographic effects of adjuvant Ginkgo biloba therapy in patients with major depression medicated with trimipramine. Pharmacopsychiatry 2001;34:50-59.PubMed Abstract
12. Waynberg J, Brewer S. Effects of Herbal vX on libido and sexual activity in premenopausal and postmenopausal women. Adv Ther 2000;17:255-262.PubMed Abstract
13. Stough C, et al. Neuropsychological changes after 30-day Ginkgo biloba administration in healthy participants. Int J Neuropsychopharmacol 2001;4:131-134.PubMed Abstract
14. Le Bars PL, Kieser M, Itil KZ. A 26-week analysis of a double-blind, placebo-controlled trial of the Ginkgo biloba extract EGb 761 in dementia. Dement Geriatr Cogn Disord 2000;11:230-237.PubMed Abstract
15. Le Bars PL, Kastelan J. Efficacy and safety of a Ginkgo biloba extract. Public Health Nutr 2000;3:495-499.PubMed Abstract
16. Kennedy DO, Scholey AB, Wesnes KA. The dose-dependent cognitive effects of acute administration of Ginkgo biloba to healthy young volunteers. Psychopharmacology (Berl) 2000;151:416-423. PubMed Abstract
17. Wesnes KA, et al. The memory enhancing effects of a Ginkgo biloba/Panax ginseng combination in healthy middle-aged volunteers. Psychopharmacology (Berl) 2000;152:353-361.PubMed Abstract
18. Rigney U, Kimber S, Hindmarch I. The effects of acute doses of standardized Ginkgo biloba extract on memory and psychomotor performance in volunteers. Phytother Res 1999;13:408-415.PubMed Abstract
19. Le Bars PL, et al. A placebo-controlled, double-blind, randomized trial of an extract of Ginkgo biloba for dementia. North American EGb Study Group. JAMA 1997;278:1327-1332.PubMed Abstract
20. Haase J, Halama P, Horr R. Effectiveness of brief infusions with Ginkgo biloba Special Extract EGb 761 in dementia of the vascular and Alzheimer type. Z Gerontol Geriatr 1996;29:302-309.PubMed Abstract
21. Hofferberth, B. The effect of Ginkgo biloba extract on neurophysiological and psychometric measurement results in patients with psychotic organic brain syndrome. A double-blind study against placebo. Arzneimittelforschung 1989;39:918-922.PubMed Abstract
22. Mix JA, Crews WD Jr. An examination of the efficacy of Ginkgo biloba extract EGb761 on the neuropsychologic functioning of cognitively intact older adults. J Altern Complement Med 2000;6:219-229.PubMed Abstract
23. Moulton PL, et al. The effect of Ginkgo biloba on memory in healthy male volunteers. Physiol Behav 2001;73:659-665.PubMed Abstract
24. van Dongen MC, et al. The efficacy of ginkgo for elderly people with dementia and age-associated memory impairment: New results of a randomized clinical trial. J Am Geriatr Soc 2000;48:1183-1194.PubMed Abstract
25. Taubes G. Nutrition. The soft science of dietary fat. Science 2001;291:2536-2545.PubMed Citation
Above is the information needed to cite this article in your paper or presentation. The International Committee
of Medical Journal Editors (ICMJE) recommends the following citation style, which is the now nearly universally
accepted citation style for scientific papers:
Halpern SD, Ubel PA, Caplan AL, Marion DW, Palmer AM, Schiding JK, et al. Solid-organ transplantation in HIV-infected patients. N Engl J Med. 2002;347:284-7.
About the ICMJE and citation styles
The ICMJE is small group of editors of general medical journals who first met informally in Vancouver, British Columbia, in 1978 to establish guidelines for the format of manuscripts submitted to their journals. The group became known as the Vancouver Group. Its requirements for manuscripts, including formats for bibliographic references developed by the U.S. National Library of Medicine (NLM), were first published in 1979. The Vancouver Group expanded and evolved into the International Committee of Medical Journal Editors (ICMJE), which meets annually. The ICMJE created the Recommendations for the Conduct, Reporting, Editing, and Publication of Scholarly Work in Medical Journals to help authors and editors create and distribute accurate, clear, easily accessible reports of biomedical studies.
An alternate version of ICMJE style is to additionally list the month an issue number, but since most journals use continuous pagination, the shorter form provides sufficient information to locate the reference. The NLM now lists all authors.
BCMJ standard citation style is a slight modification of the ICMJE/NLM style, as follows:
- Only the first three authors are listed, followed by "et al."
- There is no period after the journal name.
- Page numbers are not abbreviated.
For more information on the ICMJE Recommendations for the Conduct, Reporting, Editing, and Publication of Scholarly Work in Medical Journals, visit www.icmje.org