How to Create a Mind

Last updated
How to Create a Mind: The Secret of Human Thought Revealed
Cover of How to Create a Mind by Ray Kurzweil.jpg
Author Ray Kurzweil
CountryUnited States
LanguageEnglish
PublisherViking Penguin
Publication date
2013
Media typePrint
Pages352
ISBN 978-0670025299
OCLC 779263503
612.82
LC Class QP385.K87
Preceded by The Singularity Is Near  
Followed byThe Singularity Is Nearer (upcoming) 

How to Create a Mind: The Secret of Human Thought Revealed is a non-fiction book about brains, both human and artificial, by the inventor and futurist Ray Kurzweil. First published in hardcover on November 13, 2012 by Viking Press [1] it became a New York Times Best Seller. [2] It has received attention from The Washington Post , The New York Times and The New Yorker .

Contents

Kurzweil describes a series of thought experiments which suggest to him that the brain contains a hierarchy of pattern recognizers. Based on this he introduces his Pattern Recognition Theory of Mind (PRTM). He says the neocortex contains 300 million very general pattern recognition circuits and argues that they are responsible for most aspects of human thought. He also suggests that the brain is a "recursive probabilistic fractal" whose line of code is represented within the 30-100 million bytes of compressed code in the genome.

Kurzweil then explains that a computer version of this design could be used to create an artificial intelligence more capable than the human brain. It would employ techniques such as hidden Markov models and genetic algorithms, strategies Kurzweil used successfully in his years as a commercial developer of speech recognition software. Artificial brains will require massive computational power, so Kurzweil reviews his law of accelerating returns, which explains how the compounding effects of exponential growth will deliver the necessary hardware in only a few decades.

Critics felt the subtitle of the book, The Secret of Human Thought Revealed, overpromises. Some protested that pattern recognition does not explain the "depth and nuance" [3] of mind including elements like emotion and imagination. Others felt Kurzweil's ideas might be right, but they are not original, pointing to existing work as far back as the 1980s. Yet critics admire Kurzweil's "impressive track record" [4] and say that his writing is "refreshingly clear", [5] containing "lucid discussions" [6] of computing history.

Background

Kurzweil has written several futurology books [7] including The Age of Intelligent Machines (1990), The Age of Spiritual Machines (1999) and The Singularity is Near (2005). In his books he develops the law of accelerating returns. The law is similar to Moore's Law, the persistent doubling in capacity of computer chips, but extended to all "human technological advancement, the billions of years of terrestrial evolution" and even "the entire history of the universe". [8]

Ray Kurzweil in 2008 Ray Kurzweil.jpg
Ray Kurzweil in 2008

Due to the exponential growth in computing technologies predicted by the law, Kurzweil says that by "the end of the 2020s" computers will have "intelligence indistinguishable to biological humans". [9] As computational power continues to grow, machine intelligence will represent an ever-larger percentage of total intelligence on the planet. Ultimately it will lead to the Singularity, a merger between biology and technology, which Kurzweil predicts will occur in 2045. [10] He says "There will be no distinction, post-Singularity, between human and machine...". [11]

Kurzweil himself plans to "stick around" [12] for the Singularity. He has written two health and nutrition books aimed at living longer, the subtitle of one is "Live Long Enough to Live Forever". [7] One month after How to Create a Mind was published, Google announced that it had hired Kurzweil to work as Director of Engineering "on new projects involving machine learning and language processing". [13] Kurzweil said his goal at Google is to "create a truly useful AI [artificial intelligence] that will make all of us smarter". [14]

Content

Thought experiments

Kurzweil opens the book by reminding us of the importance of thought experiments in the development of major theories, including evolution and relativity. [15] It's worth noting that Kurzweil sees Darwin as "a good contender" for the leading scientist of the 19th century. [16] He suggests his own thought experiments related to how the brain thinks and remembers things. For example, he asks the reader to recite the alphabet, but then to recite the alphabet backwards. The difficulty in going backwards suggests "our memories are sequential and in order". [17] Later he asks the reader to visualize someone he has met only once or twice, the difficulty here suggests "there are no images, videos, or sound recordings stored in the brain" only sequences of patterns. [18] Eventually he concludes the brain uses a hierarchy of pattern recognizers. [19]

Pattern Recognition Theory of Mind

Kurzweil states that the neocortex contains about 300 million very general pattern recognizers, arranged in a hierarchy. [20] For example, to recognize a written word there might be several pattern recognizers for each different letter stroke: diagonal, horizontal, vertical or curved. The output of these recognizers would feed into higher level pattern recognizers, which look for the pattern of strokes which form a letter. Finally a word-level recognizer uses the output of the letter recognizers. All the while signals feed both "forward" and "backward". For example, if a letter is obscured, but the remaining letters strongly indicate a certain word, the word-level recognizer might suggest to the letter-recognizer which letter to look for, and the letter-level would suggest which strokes to look for. Kurzweil also discusses how listening to speech requires similar hierarchical pattern recognizers. [21]

Kurzweil's main thesis is that these hierarchical pattern recognizers are used not just for sensing the world, but for nearly all aspects of thought. For example, Kurzweil says memory recall is based on the same patterns that were used when sensing the world in the first place. Kurzweil says that learning is critical to human intelligence. A computer version of the neocortex would initially be like a new born baby, unable to do much. Only through repeated exposure to patterns would it eventually self-organize and become functional. [22]

Kurzweil writes extensively about neuroanatomy, of both the neocortex and "the old brain". [23] He cites recent evidence that interconnections in the neocortex form a grid structure, which suggests to him a common algorithm across "all neocortical functions". [24]

Digital brain

Example of a hidden Markov model HiddenMarkovModel.svg
Example of a hidden Markov model

Kurzweil next writes about creating a digital brain inspired by the biological brain he has been describing. One existing effort he points to is Henry Markram's Blue Brain Project, which is attempting to create a full brain simulation by 2023. [25] Kurzweil says the full molecular modeling they are attempting will be too slow, and that they will have to swap in simplified models to speed up initial self-organization. [26]

Kurzweil believes these large scale simulations are valuable, but says a more explicit "functional algorithmic model" will be required to achieve human levels of intelligence. [26] Kurzweil is unimpressed with neural networks and their potential while he's very bullish on vector quantization, hidden Markov models and genetic algorithms since he used all three successfully in his speech recognition work. [27] Kurzweil equates pattern recognizers in the neocortex with statements in the LISP programming language, which is also hierarchical. [28] He also says his approach is similar to Jeff Hawkins' hierarchical temporal memory, although he feels the hierarchical hidden Markov models have an advantage in pattern detection. [29]

Kurzweil touches on some modern applications of advanced AI including Google's self-driving cars, IBM's Watson which beat the best human players at the game Jeopardy!, the Siri personal assistant in the Apple iPhone or its competitor Google Voice Search. He contrasts the hand-coded knowledge of the Douglas Lenat's Cyc project with the automated learning of systems like Google Translate and suggests the best approach is to use a combination of both, which is how IBM's Watson was so effective. [30] Kurzweil says that John Searle's has leveled his "Chinese Room" objection at Watson, arguing that Watson only manipulates symbols without meaning. Kurzweil thinks the human brain is "just" doing hierarchical statistical analysis as well. [31]

In a section entitled A Strategy for Creating a Mind Kurzweil summarizes how he would put together a digital mind. He would start with a pattern recognizer and arrange for a hierarchy to self-organize using a hierarchical hidden Markov model. All parameters of the system would be optimized using genetic algorithms. He would add in a "critical thinking module" to scan existing patterns in the background for incompatibilities, to avoid holding inconsistent ideas. Kurzweil says the brain should have access to "open questions in every discipline" and have the ability to "master vast databases", something traditional computers are good at. He feels the final digital brain would be "as capable as biological ones of effecting changes in the world". [32]

Philosophy

A digital brain with human-level intelligence raises many philosophical questions, the first of which is whether it is conscious. Kurzweil feels that consciousness is "an emergent property of a complex physical system", such that a computer emulating a brain would have the same emergent consciousness as the real brain. This is in contrast to people like John Searle, Stuart Hameroff and Roger Penrose who believe there is something special about the physical brain that a computer version could not duplicate. [33]

Another issue is that of free will, the degree to which people are responsible for their own choices. Free will relates to determinism, if everything is strictly determined by prior state, then some would say that no one can have free will. Kurzweil holds a pragmatic belief in free will because he feels society needs it to function. He also suggests that quantum mechanics may provide "a continual source of uncertainty at the most basic level of reality" such that determinism does not exist. [34]

Exponential growth of computing PPTExponentialGrowthof Computing.jpg
Exponential growth of computing

Finally Kurzweil addresses identity with futuristic scenarios involving cloning a nonbiological version of someone, or gradually turning that same person into a nonbiological entity one surgery at a time. In the first case it is tempting to say the clone is not the original person, because the original person still exists. Kurzweil instead concludes both versions are equally the same person. He explains that an advantage of nonbiological systems is "the ability to be copied, backed up, and re-created" and this is just something people will have to get used to. Kurzweil believes identity "is preserved through continuity of the pattern of information that makes us" and that humans are not bound to a specific "substrate" like biology. [35]

Law of accelerating returns

The law of accelerating returns is the basis for all of these speculations about creating a digital brain. It explains why computational capacity will continue to increase unabated even after Moore's Law expires, which Kurzweil predicts will happen around 2020. Integrated circuits, the current method of creating computer chips, will fade from the limelight, while some new more advanced technology will pick up the slack. It is this new technology that will get us to the massive levels of computation needed to create an artificial brain. [36]

As exponential progress continues into and beyond the Singularity, Kurzweil says "we will merge with the intelligent technology we are creating". [37] From there intelligence will expand outward rapidly. Kurzweil even wonders whether the speed of light is really a firm limit to civilization's ability to colonize the universe. [38]

Reception

Analysis

Simson Garfinkel thinks Kurzweil's "pattern recognition theory of mind" is not a theory. Simson Garfinkel with drives on shelves at Harvard University.jpg
Simson Garfinkel thinks Kurzweil's "pattern recognition theory of mind" is not a theory.

Simson Garfinkel, an entrepreneur and professor of computer science at the Naval Postgraduate School, says Kurzweil's pattern recognition theory of mind (PRTM) is misnamed because of the word "theory", he feels it is not a theory since it cannot be tested. Garfinkel rejects Kurzweil's one-algorithm approach instead saying "the brain is likely to have many more secrets and algorithms than the one Kurzweil describes". Garfinkel caricatures Kurzweil's plan for artificial intelligence as "build something that can learn, then give it stuff to learn", which he thinks is hardly the "secret of human thought" promised by the subtitle of the book. [39]

Gary Marcus, a research psychologist and professor at New York University, says only the name PRTM is new. He says the basic theory behind PRTM is "in the spirit of" a model of vision known as the neocognitron, introduced in 1980. He also says PRTM even more strongly resembles Hierarchical Temporal Memory promoted by Jeff Hawkins in recent years. Marcus feels any theory like this needs to be proven with an actual working computer model. And to that end he says that "a whole slew" of machines have been programmed with an approach similar to PRTM, and they have often performed poorly. [6]

Colin McGinn, a philosophy professor at the University of Miami, asserted in The New York Review of Books that "pattern recognition pertains to perception specifically, not to all mental activity". [40] While Kurzweil does say "memories are stored as sequences of patterns" [18] McGinn asks about "emotion, imagination, reasoning, willing, intending, calculating, silently talking to oneself, feeling pain and pleasure, itches, and mood" insisting these have nothing to do with pattern recognition. McGinn is also critical of the "homunculus language" Kurzweil uses, the anthropomorphization of anatomical parts like neurons. Kurzweil will write that a neuron "shouts" when it "sees" a pattern, where McGinn would prefer he say a neuron "fires" when it receives certain stimuli. In McGinn's mind only conscious entities can "recognize" anything, a bundle of neurons cannot. Finally he takes objection with Kurzweil's "law" of accelerating change, insisting it is not a law, but just a "fortunate historical fact about the twentieth century". [40]

In 2015, Kurzweil's theory was extended to a Pattern Activation/Recognition Theory of Mind with a stochastic model of self-describing neural circuits. [41]

Reviews

Garfinkel says Kurzweil is at his best with the thought experiments early in the book, but says the "warmth and humanitarianism" evident in Kurzweil's talks is missing. [39] Marcus applauds Kurzweil for "lucid discussion" of Alan Turing and John von Neumann and was impressed by his descriptions of computer algorithms and the detailed histories of Kurzweil's own companies. [6]

Matthew Feeney, assistant editor for Reason, was disappointed in how briefly Kurzweil dealt with the philosophical aspects of the mind-body problem, and the ethical implications of machines which appear to be conscious. He does say Kurzweil's "optimism about an AI-assisted future is contagious." [42] While Drew DeSilver, business reporter at the Seattle Times, says the first half of the book "has all the pizazz and drive of an engineering manual" but says Kurzweil's description of how the Jeopardy! computer champion Watson worked "is eye-opening and refreshingly clear". [5]

McGinn says the book is "interesting in places, fairly readable, moderately informative, but wildly overstated." He mocks the book's subtitle by writing "All is revealed!" after paraphrasing Kurzweil's pattern recognition theory of mind. Speaking as a philosopher, McGinn feels that Kurzweil is "way of out of his depth" when discussing Wittgenstein. [40]

Matt Ridley, journalist and author, wrote in The Wall Street Journal that Kurzweil "has a more impressive track record of predicting technological progress than most" and therefore he feels "it would be foolish, not wise, to bet against the emulation of the human brain in silicon within a couple of decades". [4]

Translations

Notes

  1. ↑ "Ray Kurzweil's How to Create a Mind published". Kurzweil Accelerating Intelligence. Retrieved 2013-02-17.
  2. ↑ Cowles, Gregory (2 December 2012). "Best Sellers". The New York Times. Retrieved 15 February 2013.
  3. ↑ Raulerson, Josh (23 December 2012). "'How to Create a Mind': The matter of Ray Kurzweil's mind". Pittsburgh Post-Gazette. Retrieved 3 February 2013.
  4. 1 2 Ridley, Matt (2012-11-23). "Why You Should Bet Big on Bionic Brains". The Wall Street Journal. Retrieved 2013-02-22.
  5. 1 2 DeSilver, Drew. "'How to Create a Mind': the astonishing organization of the human brain". The Seattle Times. Retrieved 4 February 2013.
  6. 1 2 3 Marcus, Gary (15 November 2012). "Ray Kurzweil's Dubious New Theory of Mind". The New Yorker. Retrieved 30 January 2013.
  7. 1 2 "Books by Ray Kurzweil". Kurzweil Accelerating Intelligence. Retrieved 10 February 2013.
  8. ↑ Bennett, Drake (25 September 2005). "The age of Ray Kurzweil". The Boston Globe. Retrieved 10 February 2013.
  9. ↑ Kurzweil 2005, p. 25.
  10. ↑ Kurzweil 2005, p. 136.
  11. ↑ Kurzweil 2005, p. 9.
  12. ↑ Goldman, Andrew (25 January 2013). "Ray Kurzweil Says We're Going to Live Forever". The New York Times. Retrieved 10 February 2013.
  13. ↑ Letzing, John (2012-12-14). "Google Hires Famed Futurist Ray Kurzweil". The Wall Street Journal. Retrieved 2013-02-13.
  14. ↑ Tapscott, Don (2013-02-08). "How To Create a Mind: Can a marriage between man and machine solve the world's problems?". The Globe and Mail. Toronto. Retrieved 2013-02-18.
  15. ↑ Kurzweil 2012, pp. 13–24.
  16. ↑ Kurzweil 2012, p. 23.
  17. ↑ Kurzweil 2012, p. 27.
  18. 1 2 Kurzweil 2012, p. 29.
  19. ↑ Kurzweil 2012, p. 33.
  20. ↑ Kurzweil 2012, p. 38.
  21. ↑ Kurzweil 2012, pp. 41–49.
  22. ↑ Kurzweil 2012, p. 63.
  23. ↑ Kurzweil 2012, pp. 75–108.
  24. ↑ Kurzweil 2012, p. 83.
  25. ↑ Kurzweil 2012, p. 125.
  26. 1 2 Kurzweil 2012, p. 128.
  27. ↑ Kurzweil 2012, pp. 131–153.
  28. ↑ Kurzweil 2012, p. 154.
  29. ↑ Kurzweil 2012, p. 156.
  30. ↑ Kurzweil 2012, pp. 159–166.
  31. ↑ Kurzweil 2012, p. 170.
  32. ↑ Kurzweil 2012, pp. 172–178.
  33. ↑ Kurzweil 2012, pp. 199–207.
  34. ↑ Kurzweil 2012, pp. 224–236.
  35. ↑ Kurzweil 2012, pp. 240–247.
  36. ↑ Kurzweil 2012, pp. 248–265.
  37. ↑ Kurzweil 2012, p. 279.
  38. ↑ Kurzweil 2012, p. 281.
  39. 1 2 Garfinkel, Simson (25 January 2013). "'How to Create a Mind: The Secret of Human Thought Revealed' by Ray Kurzweil". Washington Post. Archived from the original on 25 January 2013. Retrieved 4 February 2013.
  40. 1 2 3 McGinn, Colin (2013-03-21). "Homunculism". The New York Review of Books.
  41. ↑ du Castel, Bertrand (15 July 2015). "Pattern Activation/Recognition Theory of Mind". Frontiers in Computational Neuroscience. 9 (90). Lausanne: EPFL: 90. doi: 10.3389/fncom.2015.00090 . PMC   4502584 . PMID   26236228.
  42. ↑ Feeney, Matthew (13 November 2012). "Here Comes Artificial Intelligence". Reason. Retrieved 3 February 2013.

Related Research Articles

The Chinese room argument holds that a digital computer executing a program cannot have a "mind", "understanding", or "consciousness", regardless of how intelligently or human-like the program may make the computer behave. Philosopher John Searle presented the argument in his paper "Minds, Brains, and Programs", published in Behavioral and Brain Sciences in 1980. Gottfried Leibniz (1714), Anatoly Dneprov (1961), Lawrence Davis (1974) and Ned Block (1978) presented similar arguments. Searle's version has been widely discussed in the years since. The centerpiece of Searle's argument is a thought experiment known as the Chinese room.

<span class="mw-page-title-main">Ray Kurzweil</span> American author, inventor and futurist (born 1948)

Raymond Kurzweil is an American computer scientist, author, inventor, and futurist. He is involved in fields such as optical character recognition (OCR), text-to-speech synthesis, speech recognition technology and electronic keyboard instruments. He has written books on health technology, artificial intelligence (AI), transhumanism, the technological singularity, and futurism. Kurzweil is a public advocate for the futurist and transhumanist movements and gives public talks to share his optimistic outlook on life extension technologies and the future of nanotechnology, robotics, and biotechnology.

The technological singularity—or simply the singularity—is a hypothetical future point in time at which technological growth becomes uncontrollable and irreversible, resulting in unforeseeable consequences for human civilization. According to the most popular version of the singularity hypothesis, I. J. Good's intelligence explosion model, an upgradable intelligent agent will eventually enter a "runaway reaction" of self-improvement cycles, each new and more intelligent generation appearing more and more rapidly, causing an "explosion" in intelligence and resulting in a powerful superintelligence that qualitatively far surpasses all human intelligence.

<i>The Age of Spiritual Machines</i> 1999 non-fiction book by Ray Kurzweil

The Age of Spiritual Machines: When Computers Exceed Human Intelligence is a non-fiction book by inventor and futurist Ray Kurzweil about artificial intelligence and the future course of humanity. First published in hardcover on January 1, 1999, by Viking, it has received attention from The New York Times, The New York Review of Books and The Atlantic. In the book Kurzweil outlines his vision for how technology will progress during the 21st century.

<span class="mw-page-title-main">Mind uploading</span> Hypothetical process of digitally emulating a brain

Mind uploading is a speculative process of whole brain emulation in which a brain scan is used to completely emulate the mental state of the individual in a digital computer. The computer would then run a simulation of the brain's information processing, such that it would respond in essentially the same way as the original brain and experience having a sentient conscious mind.

<span class="mw-page-title-main">Sentience</span> Ability to be aware of feelings and sensations

Sentience is the simplest or most primitive form of cognition, consisting of a conscious awareness of stimuli without association or interpretation. The word was first coined by philosophers in the 1630s for the concept of an ability to feel, derived from Latin sentiens (feeling), to distinguish it from the ability to think (reason).

Artificial consciousness (AC), also known as machine consciousness (MC), synthetic consciousness or digital consciousness, is the consciousness hypothesized to be possible in artificial intelligence. It is also the corresponding field of study, which draws insights from philosophy of mind, philosophy of artificial intelligence, cognitive science and neuroscience. The same terminology can be used with the term "sentience" instead of "consciousness" when specifically designating phenomenal consciousness.

David Courtenay Marr was a British neuroscientist and physiologist. Marr integrated results from psychology, artificial intelligence, and neurophysiology into new models of visual processing. His work was very influential in computational neuroscience and led to a resurgence of interest in the discipline.

<span class="mw-page-title-main">Neocortex</span> Mammalian structure involved in higher-order brain functions

The neocortex, also called the neopallium, isocortex, or the six-layered cortex, is a set of layers of the mammalian cerebral cortex involved in higher-order brain functions such as sensory perception, cognition, generation of motor commands, spatial reasoning and language. The neocortex is further subdivided into the true isocortex and the proisocortex.

Artificial general intelligence (AGI) is a type of artificial intelligence (AI) that can perform as well or better than humans on a wide range of cognitive tasks, as opposed to narrow AI, which is designed for specific tasks. It is one of various definitions of strong AI.

<i>The Singularity Is Near</i> 2005 non-fiction book by Ray Kurzweil

The Singularity Is Near: When Humans Transcend Biology is a 2005 non-fiction book about artificial intelligence and the future of humanity by inventor and futurist Ray Kurzweil.

<i>The Age of Intelligent Machines</i> 1990 non-fiction book by Ray Kurzweil

The Age of Intelligent Machines is a non-fiction book about artificial intelligence by inventor and futurist Ray Kurzweil. This was his first book and the Association of American Publishers named it the Most Outstanding Computer Science Book of 1990. It was reviewed in The New York Times and The Christian Science Monitor. The format is a combination of monograph and anthology with contributed essays by artificial intelligence experts such as Daniel Dennett, Douglas Hofstadter, and Marvin Minsky.

The memory-prediction framework is a theory of brain function created by Jeff Hawkins and described in his 2004 book On Intelligence. This theory concerns the role of the mammalian neocortex and its associations with the hippocampi and the thalamus in matching sensory inputs to stored memory patterns and how this process leads to predictions of what will happen in the future.

An artificial brain is software and hardware with cognitive abilities similar to those of the animal or human brain.

The philosophy of artificial intelligence is a branch of the philosophy of mind and the philosophy of computer science that explores artificial intelligence and its implications for knowledge and understanding of intelligence, ethics, consciousness, epistemology, and free will. Furthermore, the technology is concerned with the creation of artificial animals or artificial people so the discipline is of considerable interest to philosophers. These factors contributed to the emergence of the philosophy of artificial intelligence.

The following outline is provided as an overview of and topical guide to artificial intelligence:

Hierarchical temporal memory (HTM) is a biologically constrained machine intelligence technology developed by Numenta. Originally described in the 2004 book On Intelligence by Jeff Hawkins with Sandra Blakeslee, HTM is primarily used today for anomaly detection in streaming data. The technology is based on neuroscience and the physiology and interaction of pyramidal neurons in the neocortex of the mammalian brain.

Kenneth Mark Colby was an American psychiatrist dedicated to the theory and application of computer science and artificial intelligence to psychiatry. Colby was a pioneer in the development of computer technology as a tool to try to understand cognitive functions and to assist both patients and doctors in the treatment process. He is perhaps best known for the development of a computer program called PARRY, which mimicked a person with paranoid schizophrenia and could "converse" with others. PARRY sparked serious debate about the possibility and nature of machine intelligence.

Turing's Wager is a philosophical argument that claims it is impossible to infer or deduce a detailed mathematical model of the human brain within a reasonable timescale, and thus impossible in any practical sense. The argument was first given in 1950 by the computational theorist Alan Turing in his paper Computing Machinery and Intelligence, published in Mind. The argument asserts that determining any mathematical model of a computer is not possible in a reasonable timeframe. As a consequence, determining a mathematical model of the human brain must also be impossible within that timeframe.

<span class="mw-page-title-main">Juyang Weng</span> Chinese-American computer engineer and neuroscientist

Juyang (John) Weng is a Chinese-American computer engineer, neuroscientist, author, and academic. He is a former professor at the Department of Computer Science and Engineering at Michigan State University and the President of Brain-Mind Institute and GENISAMA.

References

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.