Why people don’t trust artificial intelligence: It’s an ‘explainability’ problem

| | September 26, 2018

Despite its promise, the growing field of Artificial Intelligence (AI) is experiencing a variety of growing pains. In addition to the problem of bias I discussed in a previous article, there is also the ‘black box’ problem: if people don’t know how AI comes up with its decisions, they won’t trust it.

In fact, this lack of trust was at the heart of many failures of one of the best-known AI efforts: IBM Watson – in particular, Watson for Oncology.

If oncologists had understood how Watson had come up with its [diagnoses] – what the industry refers to as ‘explainability’ – their trust level may have been higher.

“The more complex a system is, the less explainable it will be,” says John Zerilli, postdoctoral fellow at University of Otago and researcher into explainable AI. “If you want your system to be explainable, you’re going to have to make do with a simpler system that isn’t as powerful or accurate.”

Related article:  Fertility quest: How technology has fueled quantum leaps

The $2 billion that DARPA is investing in what it calls ‘third-wave AI systems,’ however, may very well be sufficient to resolve this tradeoff. “[Explainable AI] is one of a handful of current DARPA programs expected to enable ‘third-wave AI systems,’ where machines understand the context and environment in which they operate, and over time build underlying explanatory models that allow them to characterize real world phenomena,” DARPA’s [David] Gunning [says].

Read full, original post: Don’t Trust Artificial Intelligence? Time To Open The AI ‘Black Box’

The GLP aggregated and excerpted this article to reflect the diversity of news, opinion, and analysis. Click the link above to read the full, original article.

2 thoughts on “Why people don’t trust artificial intelligence: It’s an ‘explainability’ problem”

  1. This article deals with the reason the term “AI” artificial intelligence, creates problems.
    Why use the word “artificial”? It should be called “MI” machine intelligence. There is nothing artificial using digital technology to extend the capacity of our brains .Artificial at this time has the tendency to scare people.
    Just imagine we would have call using airplanes “AM” artificial movement. I am sure it would have slowed down traveling by air. Just like airplane wings are an extension of our legs, “computers” are an extension of our brains.
    I hope this awareness will spread, so we can benefit as fast and comprehensivily from the benefits MI has to offer, as possible. I see MI that is, algorithm, having the effect the wheel had on human evolution.

    • This to the them AI or better MI.
      Remember, when the first automobiles could be seen, they were called “horseless carriages”. I still remember raiding in a beautiful horse drown carriage. Most young people today have probably never seen or heard that expression.
      I thing it would be good, if the term “AI artificial intelligence” has the same fate. If not “MI machine intelligence”, how about “EI extended intelligence?

Leave a Comment

News on human & agricultural genetics and biotechnology delivered to your inbox.
Optional. Mail on special occasions.

Send this to a friend