News ArchivesRead News

In studies of human populations, don't believe everything you read

Thursday March 25, 2010

Rosie Mestel

Los Angeles Times - All those studies linking broccoli, fiber, blueberries, wine, fat, sugar, this, that, with a greater or lower risk for cancer, heart disease, Parkinson's, Alzheimer's, headache, earache, you name it. Perhaps you sometimes wonder: How big of an effect are we talking about? Or even: Should I believe this?

If so, you might enjoy an NPR interview with Stanley Young, assistant director of bioinformatics at the National Institute of Statistical Sciences, that ran a few days ago.

The interview starts out with radio news segments -- not sure if they're real or mock-ups -- on two items that seem to come up often in media reports (the former especially around Valentine's Day): chocolate and coffee. ("People who eat dark chocolate have less heart disease." "People who drink coffee are less likely to develop Alzheimer's." Etcetera.)

The problem, Young says in the NPR interview, is if you collect lots of information about people's habits and number-crunch the bejabbers out of them, you'll find associations of some kind. And then, "If you can put a good story around the probably random finding that you found, you got a paper," he says.

The studies often end up in very reputable journals, he says. One of his favorite was a report -- published in the respected Proceedings of the Royal Society B -- that people who ate breakfast cereal in the morning around the time of conception were more likely to have baby boys than baby girls.

Young says the problem lies with observational studies -- the kind where you go into a population and collect information about the people's habits and diseases and such, then try to see what lifestyle factors are linked with what outcomes. Young's point is that many of the associations kicked up by such analyses are just plain random. (And even if they aren't, the associations certainly aren't proof of cause and effect, though that is not a point he makes in this interview.)

Much of the data scientists accumulate about human habits is of exactly this kind, because it's very expensive to conduct randomized clinical trials -- the kind where a group of people is randomly assigned to take either a drug or placebo and everything else is kept the same. You might see the money fall into place for a potential blockbuster drug -- not for broccoli, though.

Here's a technical paper of the issue as Young sees it, taken from a 2008 lecture he gave, which I accessed at his website. Among other things, he states: "The NIH has funded a large number of randomized clinical trials testing the claims coming from observational studies. Of 20 claims coming from observational studies only one replicated when tested in [randomized clinical trials]. The overall picture is one of crisis."

Here's a 2007 article we ran on the issue, written by freelance writer Andreas Von Bubnoff (Young is one of the scientists quoted in the article). In it, you'll see what epidemiologists have to say in defense of their science.

Recent News

Sep 12 - Australian Researchers Develop New Diagnostic Tool to Spot Early Signs of Parkinson’s
Sep 11 - GeneFo Webinar to Focus on Using Humor to Manage Parkinson’s Disease
Sep 6 - Parkinson’s and the ‘D’ word
Sep 6 - Compounds in Asthma Drugs Might Be Used as Parkinson’s Treatment
Sep 5 - AstraZeneca Joins Takeda, Berg to Advance Development of Parkinson’s Disease Therapies
Sep 1 - Stem Cell Transplant Trial in Parkinson’s Patients Planned After Test in Japan Succeeds in Monkeys
Sep 1 - Titan to Start Phase 1/2 Study of Subdermal Implant to Deliver Requip to Parkinson’s Patients
Aug 30 - FDA Refuses Acorda’s Inbrija New Drug Application Due to Manufacturing Questions
Aug 23 - Support Groups: Are They for You?
Aug 22 - Internet Visits with Parkinson’s Specialist Can Be as Effective as In-person Visits, Trial Finds
Aug 21 - Cavion’s New CMO to Lead Cav3 Platform Development for Neurological Diseases
Aug 15 - Singing Helps Early-stage Parkinson’s Patients Retain Speech, Respiratory Control, Studies Show
Aug 14 - 16 Tips to Increase Your Mobility Confidence While Living With Parkinson’s Disease
Aug 10 - Boxers are fighting back against Parkinson’s
Aug 9 - Parkinson’s Experiment to Be Aboard Next Flight to International Space Station
Aug 9 - Parkinson’s Disease and Sleeping with the Enemy
Aug 7 - The Importance of Oral Health in Parkinson’s Disease
Aug 7 - Researchers Gain Better Insight Into Alpha-Synuclein’s Role in Parkinson’s Disease
Jul 31 - New Digital Cognitive Assessment Tool Receives Positive FDA Review
Jul 20 - Parkinson’s DREAM Challenge Uses Mobile Sensor Data to Monitor Health Based on Movement