Social science ‘reproducibility crisis’: Only 13 of 21 prestigious studies replicable

replication
Image credit: Shout

The “reproducibility crisis” in [social] science is erupting again. A research project attempted to replicate 21 social science experiments published between 2010 and 2015 in the prestigious journals Science and Nature. Only 13 replication attempts succeeded. The other eight were duds, with no observed effects consistent with the original findings.

The researchers conclude that there is a systematic bias in published findings, “partly due to false positives and partly due to the overestimated effect sizes of true positives.”

One of the studies that didn’t replicate attempted to study whether self-reported religiosity would change among test subjects who had first been asked to look at an image of the famous Auguste Rodin sculpture “The Thinker.” The study found that people became less religious after exposure to that image.

Related article:  Video: Breaking the COVID genetic code: How genetic data revealed a secret coronavirus outbreak

“Our study in hindsight was outright silly,” said Will Gervais, an associate professor of psychology at the University of Kentucky. Gervais said that his original study oversold a “random flip in the data,” although other parts of his paper did replicate.

A statement issued by the journal Science pointed out that all the experiments scrutinized in this latest effort were published before a decision several years ago by Science, Nature and other journals to adopt new guidelines designed to increase reproducibility, in part by greater sharing of data. “Our editorial standards have tightened,” said the statement from Science.

Read full, original post: Researchers replicate just 13 of 21 social science experiments published in top journals

Outbreak
Outbreak Daily Digest
Biotech Facts & Fallacies
Talking Biotech
Genetics Unzipped
Video: Test everyone – Slovakia goes its own way to control COVID

Video: Test everyone – Slovakia goes its own way to control COVID

As Europe sees record coronavirus cases and deaths, Slovakia is testing its entire adult population. WSJ's Drew Hinshaw explains how ...
mag insects image superjumbo v

Disaster interrupted: Which farming system better preserves insect populations: Organic or conventional?

A three-year run of fragmentary Armageddon-like studies had primed the journalism pumps and settled the media framing about the future ...
dead bee desolate city

Are we facing an ‘Insect Apocalypse’ caused by ‘intensive, industrial’ farming and agricultural chemicals? The media say yes; Science says ‘no’

The media call it the “Insect Apocalypse”. In the past three years, the phrase has become an accepted truth of ...
globalmethanebudget globalcarbonproject cropped x

Infographic: Cows cause climate change? Agriculture scientist says ‘belching bovines’ get too much blame

A recent interview by Caroline Stocks, a UK journalist who writes about food, agriculture and the environment, of air quality ...
organic hillside sweet corn x

Organic v conventional using GMOs: Which is the more sustainable farming?

Many consumers spend more for organic food to avoid genetically modified products in part because they believe that “industrial agriculture” ...
benjamin franklin x

Are most GMO safety studies funded by industry?

The assertion that biotech companies do the research and the government just signs off on it is false ...
favicon

Environmental Working Group: EWG challenges safety of GMOs, food pesticide residues

Known by some as the "Environmental Worrying Group," EWG lobbies for tighter GMO legislation and famously puts out annual "dirty dozen" list of fruits and ...
m hansen

Michael Hansen: Architect of Consumers Union ongoing anti-GMO campaign

Michael K. Hansen (born 1956) is thought by critics to be the prime mover behind the ongoing campaign against agricultural biotechnology at Consumer Reports. He is an ...
News on human & agricultural genetics and biotechnology delivered to your inbox.
Optional. Mail on special occasions.
Send this to a friend