Robots – Articles appear all the time touting how ‘intelligent’ a new system is. But are they really as smart as claimed? The article “How intelligent is artificial intelligence?” raises the point that we should look harder at how these systems have reached their conclusions.
This article is based on work done by researchers from TU Berlin, Fraunhofer Heinrich Hertz Institute HHI and Singapore University of Technology and Design (SUTD). Among the points raised in the article:
- Some seemingly successful AI systems employ flaky or even “cheating” problem solving strategies
- Some AI systems sometimes use so-called ‘Clever Hans Strategies’ 
- It is quite conceivable that about half of the AI systems currently in use implicitly or explicitly rely on such ‘Clever Hans’ strategies.
The researchers used a technology developed earlier by TU Berlin and Fraunhofer HHI, the so-called Layer-wise Relevance Propagation (LRP) algorithm. This algorithm allows visualizing which input variables an AI system uses to make their decisions
- Clever Hans was a horse that could supposedly count and was considered a scientific sensation during the 1900s. As it was discovered later, Hans did not master math but in about 90 percent of the cases, he was able to derive the correct answer from the questioner’s reaction.