Moravec's paradox

Moravec's paradox is the observation in artificial intelligence and robotics that, contrary to traditional assumptions, reasoning requires very little computation, but sensorimotor and perception skills require enormous computational resources. The principle was articulated by Hans Moravec, Rodney Brooks, Marvin Minsky and others in the 1980s. Moravec wrote in 1988, "it is comparatively easy to make computers exhibit adult level performance on intelligence tests or playing checkers, and difficult or impossible to give them the skills of a one-year-old when it comes to perception and mobility". ^[1]

Similarly, Minsky emphasized that the most difficult human skills to reverse engineer are those that are below the level of conscious awareness. "In general, we're least aware of what our minds do best", he wrote, and added "we're more aware of simple processes that don't work well than of complex ones that work flawlessly". ^[2] Steven Pinker wrote in 1994 that "the main lesson of thirty-five years of AI research is that the hard problems are easy and the easy problems are hard." ^[3]

By the 2020s, in accordance to Moore's law, computers were hundreds of millions of times faster than in the 1970s, and the additional computer power was finally sufficient to begin to handle perception and sensory skills, as Moravec had predicted in 1976. ^[4] In 2017, leading machine learning researcher Andrew Ng presented a "highly imperfect rule of thumb", that "almost anything a typical human can do with less than one second of mental thought, we can probably now or in the near future automate using AI." ^[5] There is currently no consensus as to which tasks AI tends to excel at. ^[6]

The biological basis of human skills

One possible explanation of the paradox, offered by Moravec, is based on evolution. All human skills are implemented biologically, using machinery designed by the process of natural selection. In the course of their evolution, natural selection has tended to preserve design improvements and optimizations. The older a skill is, the more time natural selection has had to improve the design. Abstract thought developed only very recently, and consequently, we should not expect its implementation to be particularly efficient.

As Moravec writes:

Encoded in the large, highly evolved sensory and motor portions of the human brain is a billion years of experience about the nature of the world and how to survive in it. The deliberate process we call reasoning is, I believe, the thinnest veneer of human thought, effective only because it is supported by this much older and much more powerful, though usually unconscious, sensorimotor knowledge. We are all prodigious olympians in perceptual and motor areas, so good that we make the difficult look easy. Abstract thought, though, is a new trick, perhaps less than 100 thousand years old. We have not yet mastered it. It is not all that intrinsically difficult; it just seems so when we do it. ^[7]

A compact way to express this argument would be:

• We should expect the difficulty of reverse-engineering any human skill to be roughly proportional to the amount of time that skill has been evolving in animals.
• The oldest human skills are largely unconscious and so appear to us to be effortless.
• Therefore, we should expect skills that appear effortless to be difficult to reverse-engineer, but skills that require effort may not necessarily be difficult to engineer at all.

Some examples of skills that have been evolving for millions of years: recognizing a face, moving around in space, judging people's motivations, catching a ball, recognizing a voice, setting appropriate goals, paying attention to things that are interesting; anything to do with perception, attention, visualization, motor skills, social skills and so on.

Some examples of skills that have appeared more recently: mathematics, engineering, games, logic and scientific reasoning. These are hard for us because they are not what our bodies and brains were primarily evolved to do. These are skills and techniques that were acquired recently, in historical time, and have had at most a few thousand years to be refined, mostly by cultural evolution.

Historical influence on artificial intelligence

In the early days of artificial intelligence research, leading researchers often predicted that they would be able to create thinking machines in just a few decades (see history of artificial intelligence). Their optimism stemmed in part from the fact that they had been successful at writing programs that used logic, solved algebra and geometry problems and played games like checkers and chess. Logic and algebra are difficult for people and are considered a sign of intelligence. Many prominent researchers ^{[lower-alpha 1]} assumed that, having (almost) solved the "hard" problems, the "easy" problems of vision and commonsense reasoning would soon fall into place. They were wrong (see also AI winter), and one reason is that these problems are not easy at all, but incredibly difficult. The fact that they had solved problems like logic and algebra was irrelevant, because these problems are extremely easy for machines to solve. ^{[lower-alpha 2]}

Rodney Brooks explains that, according to early AI research, intelligence was "best characterized as the things that highly educated male scientists found challenging", such as chess, symbolic integration, proving mathematical theorems and solving complicated word algebra problems. "The things that children of four or five years could do effortlessly, such as visually distinguishing between a coffee cup and a chair, or walking around on two legs, or finding their way from their bedroom to the living room were not thought of as activities requiring intelligence." ^[9]

In the 1980s, this would lead Brooks to pursue a new direction in artificial intelligence and robotics research. He decided to build intelligent machines that had "No cognition. Just sensing and action. That is all I would build and completely leave out what traditionally was thought of as the intelligence of artificial intelligence." ^[9] He called this new direction "Nouvelle AI". ^[10]

Similarly, successful 21st century AI applications don't simulate step-by-step "intelligent" problem solving, they simulate the fast, "intuitive" judgements people use to instantly and automatically recognize patterns and anomalies.^{[ citation needed ]}

Reception

Linguist and cognitive scientist Steven Pinker considers this the main lesson uncovered by AI researchers. In his 1994 book The Language Instinct , he wrote:

The main lesson of thirty-five years of AI research is that the hard problems are easy and the easy problems are hard. The mental abilities of a four-year-old that we take for granted – recognizing a face, lifting a pencil, walking across a room, answering a question – in fact solve some of the hardest engineering problems ever conceived... As the new generation of intelligent devices appears, it will be the stock analysts and petrochemical engineers and parole board members who are in danger of being replaced by machines. The gardeners, receptionists, and cooks are secure in their jobs for decades to come. ^[11]

See also

• AI effect
• Embodied cognition
• History of artificial intelligence
• Subsumption architecture

Notes

1. Anthony Zador wrote in 2019: "Herbert Simon, a pioneer of artificial intelligence (AI), famously predicted in 1965 that “machines will be capable, within twenty years, of doing any work a man can do” — to achieve [human-level] general AI." ^[8]
2. These are not the only reasons that their predictions did not come true: see History of artificial intelligence § Problems.

References

1. Moravec 1988, p. 15.
2. Minsky 1986, p. 2.
3. Pinker 2007, p. 190.
4. Moravec 1976.
5. Lee 2017.
6. Brynjolfsson & Mitchell 2017.
7. Moravec 1988, pp. 15–16.
8. Zador 2019.
9. Brooks (2002), quoted in McCorduck (2004 , p. 456)
10. Brooks 1986.
11. Pinker 2007, pp. 190–91.

Bibliography

• Brooks, Rodney (1986), Intelligence Without Representation, MIT Artificial Intelligence Laboratory
• Brooks, Rodney (2002), Flesh and Machines, Pantheon Books
• Brynjolfsson, Erik; Mitchell, Tom (22 December 2017). "What can machine learning do? Workforce implications". Science. 358 (6370): 1530–1534. Bibcode:2017Sci...358.1530B. doi:10.1126/science.aap8062 . Retrieved 7 May 2018.
• Lee, Amanda (14 June 2017). "Will your job still exist in 10 years when the robots arrive?". South China Morning Post . Retrieved 7 May 2018.
• Minsky, Marvin (1986), The Society of Mind, Simon and Schuster, p. 29
• Moravec, Hans (1976), The Role of Raw Power in Intelligence, archived from the original on 3 March 2016, retrieved 16 October 2008
• Moravec, Hans (1988), Mind Children, Harvard University Press
• McCorduck, Pamela (2004), Machines Who Think (2nd ed.), Natick, MA: A. K. Peters, Ltd., ISBN   1-56881-205-1 , p. 456.
• Pinker, Steven (September 4, 2007) [1994], The Language Instinct, Perennial Modern Classics, Harper, ISBN   978-0-06-133646-1
• Zador, Anthony (2019-08-21). "A critique of pure learning and what artificial neural networks can learn from animal brains". Nature Communications. 10 (1): 3770. Bibcode:2019NatCo..10.3770Z. doi:10.1038/s41467-019-11786-6. PMC   6704116 . PMID   31434893.

External links

• Explanation of the XKCD comic about Moravec's paradox