Social science ‘reproducibility crisis’: Only 13 of 21 prestigious studies replicable

| | September 5, 2018
replication
Image credit: Shout
This article or excerpt is included in the GLP’s daily curated selection of ideologically diverse news, opinion and analysis of biotechnology innovation.

The “reproducibility crisis” in [social] science is erupting again. A research project attempted to replicate 21 social science experiments published between 2010 and 2015 in the prestigious journals Science and Nature. Only 13 replication attempts succeeded. The other eight were duds, with no observed effects consistent with the original findings.

The researchers conclude that there is a systematic bias in published findings, “partly due to false positives and partly due to the overestimated effect sizes of true positives.”

One of the studies that didn’t replicate attempted to study whether self-reported religiosity would change among test subjects who had first been asked to look at an image of the famous Auguste Rodin sculpture “The Thinker.” The study found that people became less religious after exposure to that image.

Related article:  'Baby biome': Does a Caesarean section birth alter the gut bacteria of infants?

“Our study in hindsight was outright silly,” said Will Gervais, an associate professor of psychology at the University of Kentucky. Gervais said that his original study oversold a “random flip in the data,” although other parts of his paper did replicate.

A statement issued by the journal Science pointed out that all the experiments scrutinized in this latest effort were published before a decision several years ago by Science, Nature and other journals to adopt new guidelines designed to increase reproducibility, in part by greater sharing of data. “Our editorial standards have tightened,” said the statement from Science.

Read full, original post: Researchers replicate just 13 of 21 social science experiments published in top journals

Outbreak
Outbreak Daily Digest
Biotech Facts & Fallacies
Talking Biotech
Genetics Unzipped
a a b b a f ac a

Video: Death by COVID: The projected grim toll in historical context

The latest statistics, as of July 10, show COVID-19-related deaths in U.S. are just under 1,000 per day nationally, which is ...
mag insects image superjumbo v

Disaster interrupted: Which farming system better preserves insect populations: Organic or conventional?

A three-year run of fragmentary Armageddon-like studies had primed the journalism pumps and settled the media framing about the future ...
dead bee desolate city

Are we facing an ‘Insect Apocalypse’ caused by ‘intensive, industrial’ farming and agricultural chemicals? The media say yes; Science says ‘no’

The media call it the “Insect Apocalypse”. In the past three years, the phrase has become an accepted truth of ...
types of oak trees

Infographic: Power of evolution? How oak trees came to dominate North American forests

Over the course of some 56 million years, oaks, which all belong to the genus Quercus, evolved from a single undifferentiated ...
biotechnology worker x

Can GMOs rescue threatened plants and crops?

Some scientists and ecologists argue that humans are in the midst of an "extinction crisis" — the sixth wave of ...
food globe x

Are GMOs necessary to feed the world?

Experts estimate that agricultural production needs to roughly double in the coming decades. How can that be achieved? ...
eating gmo corn on the cob x

Are GMOs safe?

In 2015, 15 scientists and activists issued a statement, "No Scientific consensus on GMO safety," in the journal Environmental Sciences ...
Screen Shot at PM

Charles Benbrook: Agricultural economist and consultant for the organic industry and anti-biotechnology advocacy groups

Independent scientists rip Benbrook's co-authored commentary in New England Journal calling for reassessment of dangers of all GMO crops and herbicides ...
Screen Shot at PM

ETC Group: ‘Extreme’ biotechnology critic campaigns against synthetic biology and other forms of ‘extreme genetic engineering’

The ETC Group is an international environmental non-governmental organization (NGO) based in Canada whose stated purpose is to monitor "the impact of emerging technologies and ...
Share via
News on human & agricultural genetics and biotechnology delivered to your inbox.
Optional. Mail on special occasions.
Send this to a friend