Oct 18 2010

The Burger “Experiments”

We have been getting a great deal of e-mail asking about the various “experiments” on YouTube (inspired by events on Fast Food Nation) in which a McDonald’s hamburger and fries are left out for weeks or months. To the surprise of some, the food does not rot away to nothing but instead shrivels a little and becomes hard and shiny, but does not get moldy or rotten. The implication is that there is something wrong and unnatural about food that doesn’t rot when left out.

Unfortunately this is what passes for “science” on the interwebs. But it does provide a teaching moment – with lessons about scientific methodology and how the logic of interpreting evidence.

The first thing I need to point out is that none of these “experiments” are actually experiments. They are simply observations. Observation is an important component of experiments, but the raw act of observing is not sufficient to establish an experiment. In fact, in medicine we divide clinical evidence into “observational” and “experimental.”

In order to conduct a scientific experiment you have to control for some variables. There has to be a comparison between different groups so that variables can be isolated. Setting out a hamburger and seeing what happens is an observation – but there is no controlling for variables, so it is not an experiment.

I don’t think I am being pedantic. There is much that passes for science on television and the internet that is a gross distortion of science and teaches the public misinformation about what science actually is. Every ghost hunting show, for example, makes the same mistake as the hamburger videos – they make observations and then draw highly speculative, fanciful, and unwarranted conclusions from those observations. They think they are doing science because sometimes they are making those observations with fancy equipment. But I have never seen a ghost hunter actually do an experiment, and control for variables that might help determine what the nature of the phenomena they are observing is.

Let’s consider what variables might be interesting to control for with the “rotting hamburger” question. The most obvious one would be to set out McDonald’s hamburgers (more than one so that we can at least do some statistics) and compare them to a group of hamburgers that are home cooked with known ingredients vs hamburgers from another restaurant chain. But there are other variables also. How well are the hamburgers cooked (which relates to their moisture content at the beginning of the experiment)? There are many environmental conditions that should also be controlled for, if not varied to see their effect: humidity, temperature, ventilation, and light exposure.

An experiment looking at these variables for comparison would be an actual experiment and would tell us something – unlike the videos on YouTube.

This raises another point – the best experiments are designed to test specific hypotheses, and you should have some idea beforehand how the results will affect each hypothesis. For example, there are two primary hypotheses with the hamburger question: what determines the result of the left-out hamburger – is it primarily characteristics of the hamburger or characteristics of the environment, and which ones.

My hypothesis (we discussed this on the SGU this week, but to extend that discussion a bit) is that environmental factors, specifically temperature and humidity, are the most important. But also the beginning moisture of the hamburger and the thickness of the hamburger are likely important because these variables will determine how long it takes for the burger to dry out. Is that amount of time enough for mold to form? I note that McDonald’s hamburgers are thin and thoroughly cooked, and will therefore dry out quickly (especially in a dry environment) – too quickly for mold to form. Thoroughly cooked meat should also be free of bacteria to cause rotting. So in the end you will have a dried hard patty, but it will not become moldy nor will it rot.

I do not think there is anything inherent to the ingredients of the hamburger that will significantly affect whether or not it molds or rots – which is the exact implication of these YouTube videos. In order to conclude that it is the hamburger ingredients that are to blame, experiments that control for thickness, degree of cooking, and environment need to be done so that the property of the burger itself is isolated as a variable. And then you will need to spend some time scratching your head to see if you can think of any other variables you forgot, while your colleagues specializing in the natural history of left-out hamburgers do the same, until we can be reasonably sure that every plausible variable was accounted for (I say plausible, because there are in unlimited number of implausible variables, like the phase of the moon when the burger was cooked).

If this question were taken seriously, it is probably true that a complex picture will emerge. Perhaps environment is the key factor, along with thickness and juiciness of the burger. But more subtle variables may emerge, such as the leanness of the beef, or the amount of salt added. Genuine controversies may emerge over conflicting or ambiguous evidence, making for some lively scientific meetings.

But in the end I believe the evidence will speak and a consensus of scientific opinion will emerge. Sure, there will be deniers – perhaps some genuine scientific dissenters, but also those with an anti-fast food ideological agenda, for example. They may even form a community of deniers, creating their own websites, and doing their own dubious experiments that science bloggers will then have to spend time criticizing and pointing out all the flaws. The political parties will likely come down on opposite sides of the question, each accusing the other of “junk science.” The news media will always cover the story as a genuine scientific controversy, long after a solid consensus has emerged, and will interview the same few cranks on the denier side for “balance”.

OK – maybe I got a little carried away with this analogy, but you get the idea.

15 responses so far

15 Responses to “The Burger “Experiments””

  1. MWSlettenon 18 Oct 2010 at 9:12 am

    Smoking and/or cooking meat over very low heat until it is nearly dry has been used for millenia as a means of preservation. I learned how to do it years ago in military survival school. Who doesn’t like a little teriyaki beef jerky?

  2. garnercxon 18 Oct 2010 at 9:45 am

    “Unfortunately this is what passes for “science” on the interwebs.”

    I’m going to have to pick you up on a minor technicality there; the correct name is ‘the interblags’. The term ‘interwebs’ was deprecated last month.

  3. eeanon 18 Oct 2010 at 10:12 am

    Doesn’t the same thing happen when people die in an air conditioned house and aren’t discovered until days later? It’s called mummification.

  4. eeanon 18 Oct 2010 at 10:21 am

    The real question is: do mummified burgers get cancer?

  5. ChrisHon 18 Oct 2010 at 10:56 am

    I listened to SGU this weekend, and it amused me. Especially since I can go down to the waterfront and check out Sylvester the Mummy, who was found in the desert in Arizona. Though it looks like he did not die from cancer (referencing earlier post), but of lead poisoning (from a bullet).

    I also have a dehydrator. I have made beef jerky, though right now I am working on fruit leather and apple slices.

  6. Calli Arcaleon 18 Oct 2010 at 11:27 am

    It’s a mummy burger! 😀

    I wasn’t amazed by how many people were taken in by this “experiment” — I’ve grown cynical about how little people these days know about food. Ironically, the ones who were taken in by this (thinking it demonstrated something shocking about McDonald’s food) were trumpeting how it showed that people didn’t know what was in their food. Well, they were right, but not in the way they meant.

    There’s this myth that McDonald’s food isn’t real food, or is loaded with chemicals to disguise something sinister, but McDonald’s has never actually made a secret of their ingredients. They’re also one of the easiest to get ingredient lists out of (though I think they’re still cagey about the actual quantities and preparation method for the Big Mac secret sauce). The hamburger is made of 100% ground beef. Nothing else. The ketchup is normal ketchup. The mustard is normal mustard. The pickles are normal pickles. The onions are . . . well, onions. Those aren’t even cooked; all they do to them is wash ’em and cut ’em up. The bun’s a bun — same stuff you’d find in just about any commercially-prepared white bread.

    I hate fake science. Shows how badly we’re failing our children as a society.

  7. theshortearedowlon 18 Oct 2010 at 11:49 am

    There are plenty of loathsome things about McDonalds – using happy clowns to sell high-fat/sugar/salt food to children; denying workers union rights; those horrendous advertising jingles – but the food is, at least, real food.

    I think there’s a whole other problem; most people don’t understand how ridiculously and damagingly cheap it is to produce meat by more-or-less inhumane means, and how this state of affairs is artificially maintained by farming subsidies that combine to hurt the environment, human health, small farmers in developed countries and the economies of developing countries. But damn, do I want a burger after reading this article…

  8. Minon 18 Oct 2010 at 12:39 pm

    Steve, what do you think of the science in this experiment?

    http://www.youtube.com/watch?v=NUHSUA2v0O0

  9. Todd W.on 18 Oct 2010 at 12:40 pm

    until we can be reasonably sure that every plausible variable was accounted for…like the phase of the moon when the burger was cooked

    Creative quote mining reveals that Steve Novella believes the phase of the moon affects how quickly a burger will rot. (Sorry, couldn’t resist).

    This raised up a lot of points that I didn’t really think about. I discussed this with someone who wondered about what was in these burgers. I tried to make the point that the conclusions being drawn can’t actually be drawn from this one observation.

    Thanks for the post, Dr. Novella!

  10. Steven Novellaon 18 Oct 2010 at 12:44 pm

    Min – yeah, the author e-mailed me with that video. Looks like he did not control properly for the feline variable.

  11. superdaveon 18 Oct 2010 at 1:04 pm

    Ha that second youtube video was great but sadly steve I agree with you about not being pendantic. I wonder if you have heard the news about Obama filming a segment for mythbusters and how you feel about that?

  12. sonicon 18 Oct 2010 at 4:26 pm

    Pointing out the difference between observation and experiment is not pedantic.

  13. JGordonon 18 Oct 2010 at 6:08 pm

    One of the food blogs I read is taking on this experiment right now:
    http://aht.seriouseats.com/archives/2010/10/the-burger-lab-the-myth-of-the-12-year-old-mcdonalds-hamburger.html

    Hopefully they will have something to report in a few weeks or months. I’d like to see a larger sample size of burgers, but I probably wouldn’t be willing to leave dozens of burgers lying out around my house either.

  14. HHCon 18 Oct 2010 at 11:12 pm

    What if the feline variable in experimental video 2 was introduced into experimental video 1? Would the feline consume the jerky burger and dried fries from the coffee table only to polish off the meal with a Big Gulp from the toilet bowl?

  15. RaymondCorriganon 07 Nov 2010 at 5:14 pm

    Hey Dr. Novella,
    You guys at the SGU inspired me to make a video testing this.
    I tested for 2 weeks, controlled for moisture and burger thickness and used 12 burgers in total. As you guessed, it was all about the moisture in the end and the Mcdonald`s burger performed almost exactly the same as the home made one.

    http://www.youtube.com/watch?v=9ya9HRE6cYk

    Hope you like it,

Trackback URI | Comments RSS

Leave a Reply

You must be logged in to post a comment.