Why people don’t trust artificial intelligence: It’s an ‘explainability’ problem

AI

Despite its promise, the growing field of Artificial Intelligence (AI) is experiencing a variety of growing pains. In addition to the problem of bias I discussed in a previous article, there is also the ‘black box’ problem: if people don’t know how AI comes up with its decisions, they won’t trust it.

In fact, this lack of trust was at the heart of many failures of one of the best-known AI efforts: IBM Watson – in particular, Watson for Oncology.

If oncologists had understood how Watson had come up with its [diagnoses] – what the industry refers to as ‘explainability’ – their trust level may have been higher.

“The more complex a system is, the less explainable it will be,” says John Zerilli, postdoctoral fellow at University of Otago and researcher into explainable AI. “If you want your system to be explainable, you’re going to have to make do with a simpler system that isn’t as powerful or accurate.”

Related article:  Can artificial intelligence give us a more efficient health care system?

The $2 billion that DARPA is investing in what it calls ‘third-wave AI systems,’ however, may very well be sufficient to resolve this tradeoff. “[Explainable AI] is one of a handful of current DARPA programs expected to enable ‘third-wave AI systems,’ where machines understand the context and environment in which they operate, and over time build underlying explanatory models that allow them to characterize real world phenomena,” DARPA’s [David] Gunning [says].

Read full, original post: Don’t Trust Artificial Intelligence? Time To Open The AI ‘Black Box’

Outbreak
Outbreak Daily Digest
Biotech Facts & Fallacies
Talking Biotech
Genetics Unzipped
Infographic: What are mRNA COVID-19 vaccines and how do they work?

Infographic: What are mRNA COVID-19 vaccines and how do they work?

As of 1 December 2020, thirteen vaccines have reached the final stage of testing: where they are being given to ...
favicon

Environmental Working Group: EWG challenges safety of GMOs, food pesticide residues

Known by some as the "Environmental Worrying Group," EWG lobbies ...
m hansen

Michael Hansen: Architect of Consumers Union ongoing anti-GMO campaign

Michael K. Hansen (born 1956) is thought by critics to be ...
News on human & agricultural genetics and biotechnology delivered to your inbox.
glp menu logo outlined

Newsletter Subscription

Optional. Mail on special occasions.
Send this to a friend