Machines now read faster than we can. But do they understand the words?

ai computers can read now feature
Image: iStock

In an April 2018 paper coauthored with collaborators from the University of Washington and DeepMind, the Google-owned artificial intelligence company, [computational linguist Sam] Bowman introduced a battery of nine reading-comprehension tasks for computers called GLUE (General Language Understanding Evaluation). The test was designed as “a fairly representative sample of what the research community thought were interesting challenges,” said Bowman, but also “pretty straightforward for humans.”

The machines bombed.  Even state-of-the-art neural networks scored no higher than 69 out of 100 across all nine tasks: a D-plus, in letter grade terms.

Their appraisal would be short-lived. In October of 2018, Google introduced a new method nicknamed BERT (Bidirectional Encoder Representations from Transformers). It produced a GLUE score of 80.5. On this brand-new benchmark designed to measure machines’ real understanding of natural language — or to expose their lack thereof — the machines had jumped from a D-plus to a B-minus in just six months.

Related article:  Explaining hallucinations through math

But is AI actually starting to understand our language — or is it just getting better at gaming our systems?

“We know we’re somewhere in the gray area between solving language in a very boring, narrow sense, and solving AI,” Bowman said.

Read full, original post: Machines Beat Humans on a Reading Test. But Do They Understand?

Outbreak
Outbreak Daily Digest
Biotech Facts & Fallacies
Genetics Unzipped
Infographic: How dangerous COVID mutant strains develop

Infographic: How dangerous COVID mutant strains develop

Sometime in 2019, probably in China, SARS CoV-2 figured out a way to interact with a specific "spike" on the ...
Untitled

Philip Njemanze: Leading African anti-GMO activist claims Gates Foundation destroying Nigeria

Nigerian anti-GMO activist, physician, and inventor pushes anti-gay and anti-GMO ...
News on human & agricultural genetics and biotechnology delivered to your inbox.
glp menu logo outlined

Newsletter Subscription

Optional. Mail on special occasions.
Send this to a friend