Sep 04 2008

An Acupuncture Debate

Published by under Uncategorized
Comments: 18

Recently I was invited to write my views on acupuncture for a website called Opposing Views. I pre-published (with permission) my side of the debate on “Does Acupuncture Work” here at NeuroLogica. Taking the pro-acupuncture side is Bill Reddy – his profile states that he is “currently serving on the Executive Committee of the American Association of Acupuncture and Oriental Medicine.”

The format of the website allows for moderated comments, which are intended to allow for a written debate with the two sides. Here are my responses to the first round of arguments.

Bill Reddy wrote:

The National Center for Complementary and Alternative Medicine (NCCAM) of the National Institutes of Health (NIH) worked with the World Health Organization (WHO) in 1983 to develop a consensus on the use of Acupuncture to treat a number of common illnesses.

He then give a long list of medical conditions acupuncture is supposed to treat.

Bill Reddy asserts that the WHO and NCCAM in 1983 have reviewed the evidence and support acupuncture as safe and effective for a number of medical conditions, but this assertion is simply wrong. Bill does not provide a specific reference or any quotes.

One reason to doubt the claim is that the NCCAM did not exist in 1983. It began its existence as the Office of Alternative Medicine in 1993.

The WHO had this to say about acupuncture in 2002:

“Since the methodology of clinical research on acupuncture is still under debate, it is very difficult to evaluate acupuncture practice by any generally accepted measure.”

and

“Only national health authorities can determine the diseases, symptoms and conditions for which acupuncture treatment can be recommended.”

Finally, reviews of the acupuncture literature performed by scientists and academics, rather than political organizations, have consistently found that there is no compelling evidence that acupuncture is effective for any condition.

Even politically motivated and biased panels, when constrained by the scientific evidence, must admit that the evidence does not support any specific effect from acupuncture. The 1997 NIH consensus conference on acupuncture was packed with acupuncture proponents and did not contain any skeptics or scientists who had found negative results. Despite this obvious bias the panel had to concede that the best controlled trials showed no difference between “sham” acupuncture and “true” acupuncture for any indication, but then tried to spin these results by saying that well-controlled trials must therefore be unreliable.

Bill’s strategy is ultimately deceptive. He cites a 25 year old political assessment of acupuncture, then vaguely refers to later research. In fact later better-designed trials of acupuncture have been essentially negative.

In his next point he writes:

As a former Aerospace Engineer who flight tested helicopters and performed cutting-edge research in the field of turbulent aerodynamics, I can honestly say that acupuncture is a thoroughly proven system of healthcare. Proving acupuncture efficacy is relatively easy – western medicine and modern science are having a difficult time understanding the underlying mechanisms as to how acupuncture works.

If you type in the key word “acupuncture” into the NIH national library of medicine “PubMed” database, it will return over 13,000 peer reviewed journal articles.

This argument shows very poor scientific reasoning. Arguments concerning mechanism of action and efficacy are mixed together in a confusing way. The lack of a plausible mechanism makes acupuncture very suspect, and raises the bar for an appropriate level of evidence before accepting acupuncture as a treatment. But the clinical evidence of acupuncture stands on its own – and is convincingly negative.

Bill Reddy gives us his anecdotal experience (combined with an argument from authority logical fallacy) and cherry-picked studies to support his claims for acupuncture effectiveness in fertility. However, systematic reviews of the evidence are negative. Most recently, this review of acupuncture for fertility rates following IVF was completely negative. (A systematic review and meta-analysis of acupuncture in in vitro fertilisation. BJOG. 2008 Sep;115(10):1203-13. Epub 2008 Jul 23.)

In response to this study, Paul Robin, the chairman of the Acupuncture Society, said:

“I’m really surprised by these findings. I’ve been treating people for 20 years and in my experience treatment does seem to improve their chances of becoming pregnant. This study has shown that there’s no proof that acupuncture can help – so that suggests that there should be lots more studies to examine the question. I’m convinced it can help.”

Robin shows the closed-mindedness of dedicated proponents. He is perplexed that the scientific evidence does not support his personal anecdotal experience, and concludes that therefore we need more evidence. Rather he should conclude that anecdotal experience is unreliable – something the scientific community has learned long ago.

Bill concludes with the argument that because there is a great deal of research going on there must be something to acupuncture, but this is a flawed argument ad populi. The research reflects cultural interest and belief, not necessarily scientific validity. If you actually review that research, as many have, it is clearly negative.

Bill Reddy next launches into the tired argument that scientific medicine is dangerous and acupuncture is at least safe, writing:

In a Japanese survey of 55,291 acupuncture treatments given over five years by 73 acupuncturists, 99.8% of them were performed with no significant minor adverse effects and zero major adverse incidents (Hitoshi Yamashita, Bac, Hiroshi Tsukayama, BA, Yasuo Tanno, MD, PhD. Kazushi Nishijo, PhD, JAMA).

According to wikipedia “A recent study by Healthgrades found that an average of 195,000 hospital deaths in each of the years 2000, 2001 and 2002 in the U.S. were due to potentially preventable medical errors.

This argument is yet another logical fallacy – a non sequitur. The state of modern science-based medicine says nothing about the purported mechanisms and effectiveness of acupuncture. You could use the same line of argument to falsely support any medical claim. The data cited, which is now a standard argument among proponents of dubious health claims, are also highly misleading. They only consider the risk of medical intervention, not the benefit. A proper assessment of any intervention should include risk vs benefit. This is the standard calculation of science-based medicine, and treatments are only considered justified if they can demonstrate benefit in excess of risk. Focusing only on risk is designed to create a misleading impression.Direct risk is generally a function of the invasiveness of any intervention. No one doubts the fact that less invasive interventions are less directly risky. But if only risk were considered then doing nothing would always be the best option – and it clearly isn’t. Acupuncture is certainly closer to doing nothing than many legitimate medical interventions, but even the small risk of acupuncture is not justified until there is compelling evidence of benefit – and there isn’t.

Further, indirect risk must also be considered. While direct harm from acupuncture is rare (but does occur) there is the potential for tremendous indirect harm, including the delay in proper medical assessment and treatment.

Bill concludes with a classic argument ad populi:

If you had a severe case of tennis elbow, and you went to see an oriental medicine practitioner and he stuck needles in you and you didn’t get better, would you ever go back to see him again? Probably not.

1.3 billion Chinese are hard to argue with. The system of healing would not last over 5000 years if it weren’t effective.

This is nothing more than an argument ad populi and appeal to anecdotal evidence. As I have already argued, blood letting survived for over 2,000 years as the standard accepted practice. The placebo effect is well documented, as well as a variety of psychological effects, such as confirmation bias. There are also statistical effects, such as regression to the mean (the tendency for any ailment to get better if one seeks treatment during an exacerbation). All of these combine to create the illusion that ineffective treatments have some effect.

The scientific method as applied to medicine evolved to address this potential for self-deception. Appealing to anecdotes is a decidedly unscientific approach to any medical question, and defies the well-documented history of medicine – which gives countless examples of treatments that were believed to work but failed to show any effect when properly studied.

Bill concludes with a discussion of the limitations of acupuncture:

Musculoskeletal pain, internal conditions, dermatological and neurological conditions all respond favorably to acupuncture.  Where the modality falls short is in structural problems such as spinal stenosis (gradual narrowing of the spinal canal leading to nerve compression).  All the needles in the world won’t remove the built-up calcifications to relieve the pressure on a nerve root.

I certainly agree with this point – acupuncture does not treat any anatomical or mechanical medical problem. However, this does not imply that it does treat non-mechanical problems, nor does it render any of the other arguments put forth for acupuncture more reasonable.

I would also point out that this is a common feature of dubious medical interventions – they do not treat anything which is objectively demonstrable. They thrive in the realm of subjective symptoms where anecdotes and placebo effects are strong and carefully controlled trials more difficult. They tend to thrive where the data is poor. Eventually, when well-controlled data is obtained, any alleged effects vanish.

Conclusion

I only gave representative quotes from Bill Reddy’s arguments here, not wanting to reprint the entire debate. Go to Oppossing Views to take a look at the full debate and even leave a comment if you wish.

Share

18 responses so far

18 Responses to “An Acupuncture Debate”

  1. Oracon 04 Sep 2008 at 11:40 am

    I was invited to be an “expert” on Opposing Views over the vaccine/autism manufactroversy. I declined. Your experience only reinforces my view that I made the right decision.

  2. Mueroon 04 Sep 2008 at 1:25 pm

    Man, that was really bad. Was there anything he wrote that wasn’t a logical fallacy?

    By the way, I sent your original article to a friend who has been undergoing acupuncture for a few years. He’s a pretty smart guy, but I’m afraid he might be in too deep to change his mind about this. There’s nothing like saying “You’ve been wrong for years, and you’ve been wasting lots of money on what’s essentially snake oil.” The theory of cognitive dissonance (if I understand it correctly) suggests he will reject the scientific evidence, rationalizing that acupuncture must work, or else he wouldn’t have kept paying so much for it all these years.

  3. droachon 04 Sep 2008 at 2:15 pm

    Steve,

    This was a very interesting post. Your mention of bloodletting as a long-standing (but false) belief got me trying to think of other examples. Failing to do so, I was excited to read “…the well-documented history of medicine – which gives countless examples of treatments that were believed to work but failed to show any effect when properly studied…”, but disappointed that you didn’t cite any. Could you tick off a few just for my edification?
    Many thank,

    David

  4. mpicancoon 04 Sep 2008 at 2:53 pm

    Great responses all across the board.. but don’t forget the most common fallacy defense of acupuncture which was mentioned in Bill’s penultimate conclusion along with the 1.3 billion argument ad populi: argument from antiquity (5000 years of service can’t be wrong.)

  5. Steven Novellaon 04 Sep 2008 at 3:02 pm

    sure
    - radioactive tonics
    - the Abrams dynamyzer
    - Mesmerism
    - hydropathy
    - electropathy
    - spectro-chrome therapy

    This is not including therapies that are still promoted today, like homeopathy, but clearly do not work

    There are also countless mainstream therapies that failed to survive blinded study, like mammary artery ligation for angina. In mainstream medicine, therapies fall by the wayside all the time. They make sense and early experience is positive, but then definitive studies are negative so they are abandoned.

  6. Oracon 04 Sep 2008 at 6:49 pm

    Another abandoned “conventional” therapy: Poudrage for revascularizing the heart and treating angina. The idea was that irritating the pericardium would provoke an inflammatory response that would lead to the influx of blood vessels into the heart muscle, and this irritation was accomplished by opening the chest and sprinkling sterile talcum powder in the pericardial sac surrounding the heart. Results looked good–in uncontrolled studies. Poudrage was the rage as a treatment for angina for at least a decade.

    Then, in the late 1950s, a randomized trial was performed with a sham surgery control arm in which one group of patients had their chests opened, but no powder sprinkled in the pericardial sac around the heart. (Try getting that trial through approved by your local IRB in today’s climate!) The other got standard poudrage. There was no difference in symptoms or other measures of cardiac symptomatology between the two groups. (Surgery itself is a very powerful placebo.) This was one of the very first and most famous randomized trials of a surgical intervention with sham surgery as the control.

    Poudrage was abandoned, and it is now relegated to being a historical curiosity in the history of surgery. As I frequently say, scientific medicine may hold on to ineffective treatments longer than it should, but eventually science will out and they will be abandoned. This virtually never happens in the world of “alternative” medicine. Heck, there are even alties out there still using laetrile.

  7. droachon 04 Sep 2008 at 11:44 pm

    Steve (and Orac),

    Many thanks! Now with a little more research, I’ll be better armed to tackle any future debates with the various ‘true believers’.

    Best,
    David

  8. Cronanon 05 Sep 2008 at 8:23 am

    Another great article. Paul Robin was quoted at length in the British press, I certainly remember reading his perplexed comment on the BBC news website.

  9. Hubbubon 05 Sep 2008 at 9:53 am

    Now I’m curious to see “Bill Reddy Objects”.

    “OH YEAH!?!”

  10. mindmeon 05 Sep 2008 at 10:38 am

    I noticed on that site there’s a debate about vaccines cause autism. I noticed someone claiming to be a doctor (doctor of what?) cited the Polling settlement as the government has admitted vaccines cause autism. Geez. Some things just escape people.

  11. mindmeon 05 Sep 2008 at 10:42 am

    Another thing I noticed that Bill guy objected to nothing you said, while you had counters to all his points.

  12. mindmeon 05 Sep 2008 at 2:11 pm

    Regarding medical treatments believed to work, in the science based medicine blog Harriet Hall noted about traction:

    ||they’re just a fancy technological gimmick for providing old-fashioned traction. The same traction that has been rejected by mainstream medicine because it does nothing to change the outcome and seldom even does anything to temporarily relieve symptoms.||

    There’s a good example of something we’ve all heard about (it’s always good for a little comedic quip) but it turns out doesn’t really work.

  13. [...] Accupuncture for babies – “When Savannah was diagnosed with autism a few months ago, Mary turned to acupuncture, in addition to more traditional therapies, to see if it would help. She said since the treatment began 10 weeks ago, the results have been encouraging.” -Does this article make anyone else feel like vomiting? As I reported before, acupuncture does not work! [...]

  14. wertyson 08 Sep 2008 at 4:16 am

    Well done knocking those pesky yellows ducks under the water one more time Dr Novella !

  15. eiskrystalon 08 Sep 2008 at 7:28 am

    -As a former Aerospace Engineer who flight tested helicopters and performed cutting-edge research in the field of turbulent aerodynamics, I can honestly say that acupuncture is a thoroughly proven system of healthcare.-

    One wonders how big the acupuncture needles were that he used on those helicopters he tested.

  16. [...] Acupuncture more effective than drug treatment for hot flashes? My friend Brian sent me this article from MSNBC’s website about a recent study that seems to indicate that acupuncture was more effective than drug treatments for hot flashes. Of course my first instinct was to be very skeptical. Acupuncturists have made lots of medical claims over the years and cited many studies that allegedly supported their case that have all turned out highly unreliable. But for every study that allegedly supported acupuncture, there has been tons of better controlled studies that have proven acupuncture totally useless for anything other than wallet weight loss. There was even a very recent study where test subjects in the “sham acupuncture” (although it sounds like a redundant phrase this just means acupuncture where the needles were placed at random points rather than the specific locations acupuncturists claim the needles must go) showed the greatest improvement over “real” acupuncture. And just a few weeks ago Steve Novella reviewed the literature on acupuncture on his blog. [...]

  17. [...] months ago Dr. Steven Novella, who writes at NeuroLogicaBlog, was invited to be an expert on an acupuncture debate, and directed readers of his blog there to see more and comment. I [...]

  18. acupuncture practitioner Melbourneon 05 Jul 2011 at 2:25 am

    Hi Steven,

    It seems that, as with a lot of other treatments/beliefs, that a leap of faith is required when it comes to acupuncture. Having researched thoroughly on the internet as part of my work it seems that it has helped psychologically on countless occasions. This begs the question – does it maybe if it has physiological effects?

    Thanks

    David

Trackback URI | Comments RSS

Leave a Reply

You must be logged in to post a comment.