Sep 03 2013

The 1996 WHO Acupuncture Report

One interesting effects of social media is that news items can have a second life – someone posts an item from years ago on their Facebook page, for example, and it makes the rounds as if it’s something new. Those of us who spend time analyzing science news reports and correcting misreporting or misleading information often refers to such items as zombies. They keep rising from the dead and have to be staked all over again.

The World Health Organization (WHO) 1996 report on acupuncture has recently risen from the grave and is haunting online acupuncture discussions. The fact that the data on which this report is based is over 17 years out of date does not seem to be a problem for those referencing it. The allure seems to be the apparent authority of the WHO.

The WHO report is generally positive toward acupuncture, reviewing clinical evidence and listing many conditions for which acupuncture is apparently effective. The report, however, is also deeply flawed.

The underlying problem with the report is that it was put in the hands of highly biased acupuncture proponents. The acknowledgements are very revealing:

Special thanks are due to Dr Zhu-Fan Xie, Honorary Director of the Institute of Integrated Medicines, First Hospital of Beijing Medical University, China, who drafted, revised and updated this report. Further, Dr Xie made numerous Chinese language documents available in English. We also thank Dr Hongguang Dong, Geneva University Hospital, Switzerland for providing additional information.

The report itself reads like a piece of propaganda, not a critical scientific review. This begins right from the first line, which is nothing but an appeal to antiquity:

Over its 2500 years of development, a wealth of experience has accumulated in the practice of acupuncture, attesting to the wide range of diseases and conditions that can be effectively treated with this approach.

Completely absent in the report is anything critical. The section on safety does not even mention potential adverse effects (including serious effects, such as infection or pneumothorax).  There are howlers throughout the report, include the insistence that acupuncture is as effective as morphine in the treatment of pain.

The fact that the architects of this review are all Chinese and clearly relied heavily upon Chinese research is not relevant because of the documented bias in the Chinese literature. A 1998 review found that 99% of papers published on Acupuncture in China were positive. This defies the odds, even for a highly effective treatment, which we know acupuncture is not. The only explanation for such results is extreme researcher and publication bias. Any systematic review that relies on Chinese acupuncture studies without taking this into consideration is therefore fatally flawed.

The WHO review lists conditions for which acupuncture has been proven, those for which there is evidence of efficacy but further research is needed, those for which there is some evidence, and those for which it is reasonable for an experienced practitioner to try acupuncture. Missing is a list of conditions for which acupuncture has been shown not to work – a curious omission, but consistent with the pseudoscientific advocacy approach of this report.

Under the proven category (meaning no further research is necessary, in the opinion of the authors) there are many pain conditions but also stroke. The authors concluded that the evidence in 1996 was sufficient to conclude that acupuncture is effective for stroke. Meanwhile, a 2005 Cochrane review found:

Five trials (368 patients) met the inclusion criteria. Methodological quality was considered inadequate in all trials.

And concluded:

Currently there is no clear evidence on the effects of acupuncture on subacute or chronic stroke. Large, methodologically-sound trials are required.

And another 2005 review for acute stroke:

Acupuncture appeared to be safe but without clear evidence of benefit. The number of patients is too small to be certain whether acupuncture is effective for treatment of acute ischaemic or haemorrhagic stroke. Larger, methodologically-sound trials are required.

Apparently the authors of the WHO study believe that a small number of methodolically flawed studies with mixed results is sufficient to conclude that a treatment works, without even the need for further research.

The same is true of all the other alleged indications – the research at the time was methodologically poor, and those studies that were better designed tended to be negative. Now we have 17 years more of research, often with more rigorous methodology, and that is what we find.

In a recent analysis by Colquhoun and myself of acupuncture for pain we argued (convincingly, in my opinion) that the evidence is consistent with the conclusion that the pain relieving effects of acupuncture are insignificant to nonexistent.

What the scientific evidence shows is that acupuncture is highly implausible and it does not work – this despite a documented favorable bias in the literature.

Conclusion

The 1996 WHO report on acupuncture is a highly flawed pro-acupuncture piece of propaganda, not a scientific review of evidence. It was worthless in 1996, and now it has the added burden of being outdated.

Systematic review of acupuncture (themselves highly variable in technique) tend to show that acupuncture does not work or that there is simply insufficient evidence to conclude that there is any effect.

A best evidence analysis, however, as reflected in the paper by myself and Colquhoun, shows that the most rigorous studies in acupuncture consistently show a lack of specific benefit from needle placement or insertion. This pattern of evidence is consistent with an intervention with no specific effect surrounded by the usual noise of placebo effects, researcher bias, and publication bias.

 

Share

6 responses so far

6 Responses to “The 1996 WHO Acupuncture Report”

  1. Lumen2222on 03 Sep 2013 at 5:18 pm

    Has the WHO re-examined the issue of acupuncture at all since then? I’m curious if as an organization this kind of bias is common, as I’m not overly familiar with their recommendations.

  2. evhantheinfidelon 04 Sep 2013 at 5:12 pm

    Old studies are always so hard to deal with. If they’re good, I’d like for them to be referenced. Is there an easy way to check and see if research is outdated?

  3. TheFlyingPigon 04 Sep 2013 at 7:25 pm

    “They keep rising from the dead and have to be staked all over again.”

    You “stake” vampires. Zombies, you shoot them in the head. The next line has them “haunting” online discussions. I’m reeling from the mismash of metaphors.

  4. Bruce Woodwardon 05 Sep 2013 at 4:39 am

    Pig,

    I actually think Vampire is more accurate in that they do rise from coffins… this and other stories (Wakefield and Flouridation are doing the rounds on my ‘friends’ walls at the moment) get nailed down and buried. We hammer the nail in the coffin and a year or two later there they are again sucking the intelligence out of our lives again.

    But yeah… bad Steve for mixing undead metaphors. Bob would never have made such errors.

  5. PharmD28on 05 Sep 2013 at 4:51 pm

    oh, I got to do my first alt med skepticism talk at a local skeptical meetup in my area last night….a couple folks were pro-acupuncture – not knowledgeable about the research but on their experience for some sholder pain after a surgery they reported good results…much discussion about the problems of anecdotal evidence….defining placebo effects…it was pretty productive.

    I have gotten into long debates with some members of the local atheist meetup on the subject of acupuncture and had to drag out all of the larger more quality RCT’s and some of the meta-analysis to hammer down my point…

    WHO when that was debated was brought up…as was the NYT science writing in favor of acupuncture (jeez, if NYT writes about positive evidence consistently then….argument from authority…had to shoot that down)….

    Having to discuss with someone that already thinks it works and nuance our discussion about the WHO 1996 statement…about “pragmatic research” in the area of acupuncture and how that is screwy….it can take a while for folks that have no background in science/medicine….

    When it comes to the topic of medicine…the term “skeptic” in general does not guarantee a properly skeptical view about CAM for example or how we figure out what works in medicine….they are do not deny evolution, the big bang, but somehow it tends to take me alot of work to explain why I need RCT’s of good quality and repetition to reach a conclusion of “it works”…

    Based on my review of the acupuncture studies….I honestly think they should just move on….nothin’ to see here folks…some argued I was too close minded with this suggestion….

  6. Eric Tergersonon 10 Sep 2013 at 3:33 am

    Funny, this just came up days ago in our local skeptics in the pub Facebook page. Someone (troll, mostly) was pointing to the WHO report, and no one had taken the time and/or had the expertise to parse the details of the study and it’s background.

    Thank you again Dr. Novella-

    I don’t mean to spam, but PharmD28 and any others, if you wanted to get in contact with me, look up “PDX Skeptics in the Pub” on Facebook or “Portland Skeptics in the Pub” on meetup.com.

    I’d love to collaborate with some other groups, and share your experiences with presenting topics and such-

Trackback URI | Comments RSS

Leave a Reply

You must be logged in to post a comment.