Race detector: AI’s ability to categorize us raises fears of bias

im

Today, more than a dozen companies offer some form of race or ethnicity detection, according to a review of websites, marketing literature and interviews.

In the last few years, companies have started using such race-detection software to understand how certain customers use their products, who looks at their ads, or what people of different racial groups like. Others use the tool to seek different racial features in stock photography collections, typically for ads, or in security, to help narrow down the search for someone in a database.

Some researchers and even vendors say race-based facial analysis should not exist. For decades, governments have barred doctors, banks and employers from using information about race to decide which patients to treat, which borrowers to grant mortgages and which job applicants to hire. Race-detection software poses the disconcerting possibility that institutions could—intentionally or not—make decisions based on a person’s ethnic background, in ways that are harder to detect because they occur as complex or opaque algorithms, according to researchers in the field.

Related article:  Population health vs personalized medicine? Coronavirus pandemic highlights the importance of multiple approaches
Follow the latest news and policy debates on agricultural biotech and biomedicine? Subscribe to our newsletter.

A person of mixed race might disagree with how an algorithm classifies them, says Carly Kind, director of the Ada Lovelace Institute in London, a research group that focuses on applications of AI. “Technological systems have the power to turn things into data, into facts, and seemingly objective conclusions,” she says.

im
Munich-based Betaface offers a facial-analysis tool that estimates a person’s ethnicity. In this case, it says with 91% certainty that the woman in the photo is Asian. Credit: Betaface

Read the original post

Outbreak
Outbreak Daily Digest
Biotech Facts & Fallacies
Talking Biotech
Genetics Unzipped
can you boost your immune system to prevent coronavirus spread x

Video: How to boost your immune system to guard against COVID and other illnesses

Scientists have recently developed ways to measure your immune age. Fortunately, it turns out your immune age can go down ...
mag insects image superjumbo v

Disaster interrupted: Which farming system better preserves insect populations: Organic or conventional?

A three-year run of fragmentary Armageddon-like studies had primed the journalism pumps and settled the media framing about the future ...
dead bee desolate city

Are we facing an ‘Insect Apocalypse’ caused by ‘intensive, industrial’ farming and agricultural chemicals? The media say yes; Science says ‘no’

The media call it the “Insect Apocalypse”. In the past three years, the phrase has become an accepted truth of ...
globalmethanebudget globalcarbonproject cropped x

Infographic: Cows cause climate change? Agriculture scientist says ‘belching bovines’ get too much blame

A recent interview by Caroline Stocks, a UK journalist who writes about food, agriculture and the environment, of air quality ...
organic hillside sweet corn x

Organic v conventional using GMOs: Which is the more sustainable farming?

Many consumers spend more for organic food to avoid genetically modified products in part because they believe that “industrial agriculture” ...
benjamin franklin x

Are most GMO safety studies funded by industry?

The assertion that biotech companies do the research and the government just signs off on it is false ...
gmo corn field x

Do GMO Bt (insect-resistant) crops pose a threat to human health or the environment?

Bt is a bacterium found organically in the soil. It is extremely effective in repelling or killing target insects but ...
favicon

Environmental Working Group: EWG challenges safety of GMOs, food pesticide residues

Known by some as the "Environmental Worrying Group," EWG lobbies for tighter GMO legislation and famously puts out annual "dirty dozen" list of fruits and ...
m hansen

Michael Hansen: Architect of Consumers Union ongoing anti-GMO campaign

Michael K. Hansen (born 1956) is thought by critics to be the prime mover behind the ongoing campaign against agricultural biotechnology at Consumer Reports. He is an ...
News on human & agricultural genetics and biotechnology delivered to your inbox.
Optional. Mail on special occasions.
Send this to a friend