Archive for the 'General Science' Category

Jun 16 2015

The Debate over Nutrition Research

Can you recall everything you ate yesterday, including those little snacks you snuck, with reasonably accurate estimates of amounts? How about two days ago? Most people, it turns out, have a hard time recalling with good fidelity their recent food intake, or they have a hard time reporting it accurately not only because of the fallibility of memory but because of biases and denial.

Despite this, a great deal of nutrition research is based upon subjects recalling and accurately reporting what they ate. A recent article in Mayo Clinic Proceedings by Edward Archer et al challenges the legitimacy of this research. They write:

The reliance on M-BMs to inform dietary policy continues despite decades of unequivocal evidence that M-BM (memory-based dietary assessment methods ) data bear little relation to actual energy and nutrient consumption.

This is pretty damming. They charge that the current dietary guidelines are based upon fatally flawed data. They specifically state that such data is based upon fallible memory, uses data collecting techniques known to promote false recall, cannot be independently verified, and often does not contain objective data on physical activity. They go as far as to call such research an, “unscientific and major misuse of research resources.”

Continue Reading »


16 responses so far

Jun 08 2015

More Quantum Weirdness

Published by under General Science

Science news outlets are reporting:

“It proves that measurement is everything. At the quantum level, reality does not exist if you are not looking at it,” lead researcher and physicist Andrew Truscott said in a press release.

What scientific understanding gets distilled down to the public consciousness is important, and that is one of the primary missions of good science news reporting. What is the bottom line, “take-home” message that the average person should walk away with regarding any particular experiment or scientific question. This often requires translating complex technical science into accessible every-day concepts without sacrificing accuracy. Obviously technical detail must be watered down, and doing this without making the result wrong is part of the skill of good science reporting.

One of the pitfalls of science reporting is distilling down a complex scientific concept to something that is cool, engaging, and sensational, but fundamentally wrong or at least highly misleading. The public then latches onto the sensational myth and forever misunderstands the actual science.

That is, I believe, what has happened with quantum mechanics, which is perhaps the most challenging science to explain to a non-technical audience. It’s hard enough for scientists to wrap their minds around, even with a highly technical understanding of what the experiments are actually showing. It seems to me that Truscott is perpetuating the greatest myth about quantum mechanics with a very poor choice of words to characterize what his recent experiment has shown.

Continue Reading »


91 responses so far

Jun 01 2015

Citation Bias – Confirmation Bias for Scientists

Published by under General Science

I’m a big fan of science for many reasons. Not only is the subject matter of science often incredibly interesting, but the process of science seems to work better than any other method humans have developed for knowing about the universe in which we live. Any fair-minded and knowledgeable view of human history cannot avoid this conclusion.

It’s therefore worthwhile thinking about and exploring the science of science itself, what we might call metascience. It is, in fact, a common narrative among skeptics and science communicators that, while science is awesome, it is practiced by biased and flawed humans. The history of science is one of error, bias, and ego that manages to slowly grind toward the truth.

Metascience is as important as metacognition, or thinking about thinking, and I write about both topics often. These are core knowledge-bases for any critical thinking skeptic. Here is a list I compiled of the most important issues with the quality of science. The goal here is not to criticize science, but to improve its practice, make it more efficient, minimize wasted resources, and help the public sift the reliable from the nonsense.

I’m now going to add another important concept to the list – citation bias.

Continue Reading »


3 responses so far

May 29 2015

A Chocolate Science Sting

John Bohannon is at it again. In 2013 he published the results of a sting operation in which he submitted terrible papers with fake credentials to 304 open access journals. Over half of the journals accepted the paper for publication. He published his results in Science magazine, and it caused a bit of a stir, although arguably not as much as it should have.

Bohannon was asked to repeat this feat, this time to expose the schlocky science of the diet industry. He was asked to do this for a documentary film which will be release shortly, but he has already published his reveal. You can read his full account for details, but here is the quick summary.

He collaborated with others to perform a real (although crappy) scientific study. His researchers recruited 16 people, with one drop out, the remaining 15 were divided into three groups: low carb diet for three weeks, low carb diet plus daily chocolate for three weeks, and no change in diet. The results were not surprising in that the two diet groups lost 5 pounds on average, while the no diet group did not. However, they also found that the chocolate group lost 10% more weight. He explains:
Continue Reading »


32 responses so far

May 12 2015

In Defense of Prior Probability

This post is a follow up to one from last week about reproducibility in science. An e-mailer had a problem with the following statement:

“I tend to accept claims based upon published rigorous evidence that shows a consistent robust result with reasonable effect sizes with evidence in proportion to the plausibility. “

In response they wrote:

“I think this might open up for arbitrary amounts of discrimination based on gut feelings. As an example, if it really was so that aliens regularly conducted semi-stealthy visits to planet earth (as the proponents seems to suggest), we might actually never realise so, because there could be a double standard demanding arbitrarily high levels of evidence based on gut feelings about prior probability.

Allowing prior conceptions this power could even open up for psychological effects such as post hoc adapting the prior judgement such that it is just low enough to allow to discard the presented evidence.”

This is a common reaction, especially when prior probability is used as part of an argument for rejecting a scientific claim (to be clear, I don’t think the e-mailer is doing this, they just seem to have an honest question). I am a strong proponent of prior probability, used as part of a Bayesian analysis. That is, in fact, at the heart of the difference between science-based medicine (a term I coined to reflect my approach) and evidence-based medicine.

Continue Reading »


33 responses so far

May 08 2015

A Reproducibility Experiment

Published by under General Science

I have been writing quite a bit here and on Science-Based Medicine about metascience – the study of science itself. When you think about it, science is perhaps the most critical and broadly applicable technology of our modern civilization. It is the one endeavor from which all other technologies derive.

It therefore is very important that we understand how the institutions and processes of science are functioning. If there are any inefficiencies or biases in the system they can cause great harm, a waste of resources and a slowing of progress.

A recent metascience project called, The Reproducibility Project: Psychology, asks a very important question:

Do normative scientific practices and incentive structures produce a biased body of research evidence?

The project focuses on one specific aspect of this question – how reproducible are published psychological studies? They looked at 100 studies published in prominent psychology journals with positive results that have been generally accepted. They then crowdsourced scientists conducting replications of these studies, with 270 authors participating.

Continue Reading »


11 responses so far

May 05 2015

Open Science

Published by under General Science

There is a movement to open access to scientific information, and with the relatively new resources provided by the internet and social media, we may be heading rapidly in that direction. However, I don’t think this will be an easy transition and we should consider the possible unintended consequences.

A 2012 commentary by Nosek and Bar-Anan outlined the changes that would open science:

We call for six changes: (1) full embrace of digital communication, (2) open access to all published research, (3) disentangling publication from evaluation, (4) breaking the “one article, one journal” model with a grading system for evaluation and diversified dissemination outlets, (5) publishing peer review, and, (6) allowing open, continuous peer review. We address conceptual and practical barriers to change, and provide examples showing how the suggested practices are being used already.

The Center for Open Science outlines a similar mission:

1-Increase prevalence of scientific values – openness, reproducibility – in scientific practice
2-Develop and maintain infrastructure for documentation, archiving, sharing, and registering research materials
3-Join infrastructures to support the entire scientific workflow in a common framework
4-Foster an interdisciplinary community of open source developers, scientists, and organizations
5-Adjust incentives to make “getting it right” more competitive with “getting it published”
6-Make all academic research discoverable and accessible

Continue Reading »


9 responses so far

Apr 30 2015

Neonicotinoids, GMOs, and Colony Collapse Disorder

Published by under General Science

A new propaganda point has entered the anti-GMO repertoire – that GMOs are killing the honey bees. This claim, like many of their claims, is highly misleading, as the actual cause is incidental to the technology of genetic modification or even its use. This hasn’t stopped headlines like this one from GMOs Are Killing the Bees, Butterflies, Birds and . . . ?

This story follows a common strategy among the intellectually dishonest anti-GMO propaganda machine. The fact is, producing enough food to feed over 7 billion people (and growing) is not easy, and requires intensive high-yield farming. Farming, not surprisingly, is having an impact on the ecosystem. Just cutting down forests to make room for crops can have a huge effect, in addition to displacing native species. Perhaps the most challenging aspect of farming’s effect on the environment is that anytime you want to grow millions or even billions of something, critters will evolve to exploit that food source. Any attempt you make to fight back against those critters will inevitably result in resistance.

We face the same challenge with antibiotics. Crowding into cities, and the growing population of humans meant that bacteria who use humans for their lifecycle exploded, leading to outbreaks and epidemics of infectious diseases. Antibiotics have been a powerful weapon against bacterial infections, but evolution is relentless and has led increasingly to antibiotic resistance among bacteria pathogenic to humans and our livestock. This is a genuine dilemma, as we struggle to come up with new antibiotics, and enforce practices that reduce the emergence of resistance.

Continue Reading »


28 responses so far

Mar 30 2015

Peer-Review Scandal

Published by under General Science

Biomed Central, a UK company that publishes 277 peer-reviewed journals, announced that it is retracting 43 articles because of “fabricated” peer-review.

Peer-review is a process that many scientific journals use to vet submitted articles. Typically an editor will review the article but also send it out to two or three experts in the subject matter and have them take a close look at the article to make sure everything is high quality. Most submitted articles will come back with required changes before acceptance. Of course many articles are rejected outright.

The process is not perfect, but it is one critical layer of quality control. The “peer-reviewed literature” is therefore a body of evaluated knowledge that has met at least a minimal standard of quality.

Of course, your mileage may vary. Not all peer-reviewed journals are as rigorous. Also, whenever there is any system in place to separate the wheat from the chaff, someone will try to game the system for their own advantage. There also needs to be some monitoring or policing in place to ensure the integrity of the system.

Continue Reading »


7 responses so far

Mar 16 2015

FOIA Requests to Biotech Scientists

On the SGU this week we interviewed Kevin Folta, who is a biotechnology scientist at the University of Florida. His specialty is strawberries – he is trying to identify which genes are responsible for the intense flavor of wild strawberry varieties. Some of this flavor was inadvertently lost over decades of cultivating strawberries to be big, attractive, and have a good shelf life. He sent me some of the wild varieties he is working with. They produce small (really small) unattractive strawberries that taste amazing. Ideally he would like to figure out how to combine the incredible flavor of some of the wild strawberries with the marketable cultivated varieties.

Kevin is also a science communicator. He does outreach to help the public understand his science, the science of plant genetics, which includes genetic modification. He is publicly funded and so all of his funding sources are fully disclosed. He has no funding from industry, no conflicts of interest.

However, because he is an outspoken critic of unscientific anti-GMO propaganda he has been targeted by the anti-GMO crowd. Their latest strategy is to go on a fishing expedition using freedom of information act (FOIA) requests. The anti-GMO lobby, of course, is not monolithic, and this is one group who is undertaking this approach – US Right to Know (funded by the Organic Consumers Association). They have issued FOIA requests to obtain all the e-mails of 14 senior biotech scientists.

Continue Reading »


21 responses so far

« Prev - Next »