A new analysis argues that AI may never truly think like humans because the most important parts of human intelligence cannot be programmed into machines.
A prominent computer scientist argues that a proposal made by Alan Turing, widely regarded as the father of theoretical computer science, sent artificial intelligence research in the wrong direction for the past 75 years.
In his new analysis, “Turing’s Mistake: Escaping the Yoke of Unintelligent Machines,” Peter J. Denning examines ideas Turing advanced in 1950. At the time, many scientists believed that human intelligence could exist independently of the body and might therefore be recreated as software running on a digital computer.
Denning also disputes the idea that machine intelligence can be demonstrated through an imitation game (now known as the Turing test).
“These two claims have shaped much of AI research and development,” Denning writes. “My premise is that our acquiescence to these claims has led to the AI mess in which we find ourselves today.”
According to Denning, the artificial intelligence (AI) systems now being developed are unlikely to produce human-level intelligence, known as artificial general intelligence (AGI). Instead, he warns, they may create serious dangers without ever thinking like humans.
Why Tacit Knowledge Matters
Central to Denning’s argument is the idea of tacit knowledge. This refers to the enormous amount of human understanding that people possess but cannot fully express in words or translate into symbols that a machine can process.
Denning describes five broad forms of tacit knowledge that he says ‘elude machine learning’. They include common sense, everyday interactions with people and the environment, feelings and perceptions, practical skills, and the cultural and historical background shared by societies.
Researchers have spent decades trying to record common sense in a form computers can use. Beginning in the 1980s, Douglas Lenat’s ambitious Cyc project set out to build a vast database of common-sense facts. After 40 years of work, the project contained 25 million entries.
“Yet even this treasury could not add up to a background of common sense sufficient to make expert systems smart enough to be experts,” Denning notes. “Cyc validated that much of the knowledge that makes people experts cannot be articulated as propositions.”
Knowing What Is Not the Same as Knowing How
Practical skill creates another major obstacle, Denning argues.
“Our performance skills in thousands of domains cannot be communicated to machines,” Denning explains. “Whereas descriptions of skillful outcomes (‘know what’) can often be represented as bits and stored in a machine, we do not know how to encode the embodied knowledge for skillful performance (‘know how’).”
Music offers a clear example of this difference. Denning says: “A virtuoso violinist can play beautiful music yet cannot describe to an acolyte how to produce it.
“Even if a robot could observe and imitate skilled humans, having no biological body, a robot cannot grasp how the musician feels when playing beautiful music or how an audience feels when hearing it.”
Intuition, gut feelings, spontaneous creativity, and imagination are other forms of tacit knowledge that resist being reduced to computer instructions.
The Representation Problem
Denning calls the central obstacle ‘the representation problem’.
Computers can only perform calculations when data and instructions are encoded in physical forms they can recognize and process. Tacit knowledge, however, cannot easily be converted into such a format.
“Behind every word is a deep well of tacit knowledge that gives it meaning,” Denning says. “Words are but symbolic representations of meanings, not the meanings themselves. Commonly used Large Language Models, such as ChatGPT, Claude and Gemini only manipulate words, they cannot know or understand the meaning of what they are saying.”
This creates what Denning sees as an unbridgeable gap. Because scientists do not fully understand how tacit knowledge operates within humans, they cannot determine how to transfer it to a machine.
“How we host tacit knowledge is largely a mystery,” Denning admits. “All we know is that it is embodied. We have no idea what we might observe and measure in our bodies to reveal it.”
Why Context Changes Meaning
Denning also stresses the importance of context, or the surrounding circumstances that give human words and actions their meaning and purpose.
A statement can mean very different things depending on whether the speaker is sincere, sarcastic, angry, playful, or teasing. Context also helps people decide when to use humor, when to show tact, and how to interpret what someone leaves unsaid.
Source: ScitechDaily