Can Google’s medical AI improve our medical system? Laboratory results and real life offer different answers

image
A nurse operates the retinal scanner, taking images of the back of a patient’s eye. Credit: Google

[A] study from Google Health—the first to look at the impact of a deep-learning tool in real clinical settings—reveals that even the most accurate AIs can actually make things worse.

In the system Thailand had been using, nurses take photos of patients’ eyes during check-ups and send them off to be looked at by a specialist elsewhere­—a process that can take up to 10 weeks. AI developed by Google Health can identify signs of diabetic retinopathy from an eye scan with more than 90% accuracy—which the team calls “human specialist level”—and, in principle, give a result in less than 10 minutes.

When it worked well, the AI did speed things up. But it sometimes failed to give a result at all. Like most image recognition systems, the deep-learning model had been trained on high-quality scans; to ensure accuracy, it was designed to reject images that fell below a certain threshold of quality. With nurses scanning dozens of patients an hour and often taking the photos in poor lighting conditions, more than a fifth of the images were rejected.

Related article:  Which depression treatment is right for you? AI could provide answers

“This is a crucial study for anybody interested in getting their hands dirty and actually implementing AI solutions in real-world settings,” says [AI researcher] Hamid Tizhoosh.

Read the original post

Outbreak
Outbreak Daily Digest
Biotech Facts & Fallacies
Talking Biotech
Genetics Unzipped
can you boost your immune system to prevent coronavirus spread x

Video: How to boost your immune system to guard against COVID and other illnesses

Scientists have recently developed ways to measure your immune age. Fortunately, it turns out your immune age can go down ...
mag insects image superjumbo v

Disaster interrupted: Which farming system better preserves insect populations: Organic or conventional?

A three-year run of fragmentary Armageddon-like studies had primed the journalism pumps and settled the media framing about the future ...
dead bee desolate city

Are we facing an ‘Insect Apocalypse’ caused by ‘intensive, industrial’ farming and agricultural chemicals? The media say yes; Science says ‘no’

The media call it the “Insect Apocalypse”. In the past three years, the phrase has become an accepted truth of ...
globalmethanebudget globalcarbonproject cropped x

Infographic: Cows cause climate change? Agriculture scientist says ‘belching bovines’ get too much blame

A recent interview by Caroline Stocks, a UK journalist who writes about food, agriculture and the environment, of air quality ...
organic hillside sweet corn x

Organic v conventional using GMOs: Which is the more sustainable farming?

Many consumers spend more for organic food to avoid genetically modified products in part because they believe that “industrial agriculture” ...
benjamin franklin x

Are most GMO safety studies funded by industry?

The assertion that biotech companies do the research and the government just signs off on it is false ...
gmo corn field x

Do GMO Bt (insect-resistant) crops pose a threat to human health or the environment?

Bt is a bacterium found organically in the soil. It is extremely effective in repelling or killing target insects but ...
favicon

Environmental Working Group: EWG challenges safety of GMOs, food pesticide residues

Known by some as the "Environmental Worrying Group," EWG lobbies for tighter GMO legislation and famously puts out annual "dirty dozen" list of fruits and ...
m hansen

Michael Hansen: Architect of Consumers Union ongoing anti-GMO campaign

Michael K. Hansen (born 1956) is thought by critics to be the prime mover behind the ongoing campaign against agricultural biotechnology at Consumer Reports. He is an ...
News on human & agricultural genetics and biotechnology delivered to your inbox.
Optional. Mail on special occasions.
Send this to a friend