talking biotech

Podcast: The misused meta-analysis—How statistical trickery yields impressive but bogus study results

, | April 8, 2020
HOST OVERVIEW
Kevin Folta: University of Florida plant geneticist Kevin Folta launched Talking Biotech in 2015.    More details

A meta-analysis allows researchers to compile data from many smaller studies and, hopefully, find more conclusive answers to critical public health questions. Their implicit power to generate significant results places these studies in the headlines, where they are often used to sway public policy and reshape how consumers think about a variety of issues—pesticides, tobacco and cell phones are all relevant examples.

Over the past three decades, there has been an explosion in meta-analyses. Unsurprisingly, this has facilitated widespread abuse of the study design, allowing researchers to make inappropriate comparisons, massage inconvenient statistics and overstep the data to draw sensational conclusions that generate attention and more research funding.

On this episode of Talking Biotech, cancer epidemiologist Geoffrey Kabat offers a critical look at the phenomenon of headline-grabbing but ultimately flawed meta-analyses, and offers some possible solutions to bring this gross misuse of an important scientific tool to an end.

Related article:  'Cancer vaccine' boosts survival rates when combined with immunotherapy drugs in small study

Geoffrey Kabat is a cancer epidemiologist and the author of Hyping Health Risks: Environmental Hazards in Daily Life and the Science of Epidemiology and Getting Risk Right: Understanding the Science of Elusive Health Risks. He is a GLP board member. Follow him on Twitter @GeoKabat

Kevin M. Folta is a professor in the Horticultural Sciences Department at the University of Florida. Follow professor Folta on Twitter @kevinfolta

The Talking Biotech podcast, produced by Kevin Folta, is available for listening or subscription:

Apple Podcasts | Android | Email | Google Podcasts | Stitcher | RSS | Player FM | Pod Directory | TuneIn

GLP Podcast Hosts

Listen to more episodes

News on human & agricultural genetics and biotechnology delivered to your inbox.
Optional. Mail on special occasions.
Send this to a friend