Podcast: Epidemiologist Geoffrey Kabat explains how junk science gets published—and how to spot it in the headlines

, | November 18, 2019
sepkowitz nigeria mystery tease pr vql
Image: Emil Lendof/The Daily Beast
This article or excerpt is included in the GLP’s daily curated selection of ideologically diverse news, opinion and analysis of biotechnology innovation.

Bad scientific research is everywhere. There are junk studies suggesting that the same foods cause and prevent cancer, Darwinian evolution is false and, most infamously, vaccines are linked to autism. Such low-quality studies are frequently retracted by the journals that publish them, but most research found in reputable science journals still turns out to be wrong.  These studies are typically evaluated by independent scientists to make sure the results are valid, a process known as peer review, so we’re prompted to ask an obvious question: how do we end up with so much questionable, exaggerated and even fraudulent data?

Well, peer reviewthough a necessary part of the publishing processisn’t always the powerful junk science filter it was designed to be. As cancer epidemiologist Geoffrey Kabat pointed out in a recent story for the Genetic Literacy Project:

Epidemiologists, statisticians, and other health researchers need to publish in order to advance in their careers. But, the public and journalists – the consumers of information about health – need to be aware of something that researchers know well – there is no paper that is so dreadful that it cannot be published somewhere.

There are several important reasons “dreadful” research gets published, Kabat says. Sometimes reviewers aren’t experts on the studies they’re assigned to evaluate. In other instances, the authors of a new study get to select who reviews their paper, encouraging them to pick scientists who will green light the research for publication. But these are just two examples of the biases that can cripple the peer-review process. As the authors of an August 2019 article explained:

Bias may relate not only to author characteristics such as geography, nationality, language, specialty, gender and affiliation or prestige but also reviewer characteristics, such as preferences for type of content (e.g., by topic), type of study (e.g., bias against observational work), bias for or against interdisciplinary research, confirmation bias (i.e., tendency to endorse work in line with one’s own beliefs) and publication bias (i.e., a well-documented trend for trials with negative results to not be published and, correspondingly, for trials with positive results to be published).

This isn’t just an academic issue. Bad research can put people’s lives at risk, so addressing problems with peer review is essential. On this episode of Biotech Facts and Fallacies, Kabat joins GLP editor Cameron English to offer an inside look at peer review and answer two important questions: Can peer review be fixed, and in the meantime, how can average people learn to spot bad science when it hits the headlines?

Related article:  Some animal species never get cancer. What can we learn from them?

Geoffrey Kabat is an epidemiologist, the author of over 150 peer-reviewed scientific papers, and, most recently, of the book Getting Risk Right: Understanding the Science of Elusive Health Risks. Visit his website and follow him on Twitter @GeoKabat

Cameron J. English is the GLP’s special projects editor. He is a science writer and podcast host. Follow him on Twitter @camjenglish

The GLP featured this article to reflect the diversity of news, opinion and analysis. The viewpoint is the author’s own. The GLP’s goal is to stimulate constructive discourse on challenging science issues.

Outbreak Daily Digest
Biotech Facts & Fallacies
Talking Biotech
Genetics Unzipped
a a b b a f ac a

Video: Death by COVID: The projected grim toll in historical context

The latest statistics, as of July 10, show COVID-19-related deaths in U.S. are just under 1,000 per day nationally, which is ...
mag insects image superjumbo v

Disaster interrupted: Which farming system better preserves insect populations: Organic or conventional?

A three-year run of fragmentary Armageddon-like studies had primed the journalism pumps and settled the media framing about the future ...
dead bee desolate city

Are we facing an ‘Insect Apocalypse’ caused by ‘intensive, industrial’ farming and agricultural chemicals? The media say yes; Science says ‘no’

The media call it the “Insect Apocalypse”. In the past three years, the phrase has become an accepted truth of ...
types of oak trees

Infographic: Power of evolution? How oak trees came to dominate North American forests

Over the course of some 56 million years, oaks, which all belong to the genus Quercus, evolved from a single undifferentiated ...
biotechnology worker x

Can GMOs rescue threatened plants and crops?

Some scientists and ecologists argue that humans are in the midst of an "extinction crisis" — the sixth wave of ...
food globe x

Are GMOs necessary to feed the world?

Experts estimate that agricultural production needs to roughly double in the coming decades. How can that be achieved? ...
eating gmo corn on the cob x

Are GMOs safe?

In 2015, 15 scientists and activists issued a statement, "No Scientific consensus on GMO safety," in the journal Environmental Sciences ...
Screen Shot at PM

Charles Benbrook: Agricultural economist and consultant for the organic industry and anti-biotechnology advocacy groups

Independent scientists rip Benbrook's co-authored commentary in New England Journal calling for reassessment of dangers of all GMO crops and herbicides ...
Screen Shot at PM

ETC Group: ‘Extreme’ biotechnology critic campaigns against synthetic biology and other forms of ‘extreme genetic engineering’

The ETC Group is an international environmental non-governmental organization (NGO) based in Canada whose stated purpose is to monitor "the impact of emerging technologies and ...
Share via
News on human & agricultural genetics and biotechnology delivered to your inbox.
Optional. Mail on special occasions.
Send this to a friend