Author | Ray Kurzweil |
---|---|
Language | English |
Publisher | Viking Penguin |
Publication date | 2013 |
Publication place | United States |
Media type | |
Pages | 352 |
ISBN | 978-0670025299 |
OCLC | 779263503 |
612.82 | |
LC Class | QP385.K87 |
Preceded by | The Singularity Is Near |
Followed by | The Singularity Is Nearer |
How to Create a Mind: The Secret of Human Thought Revealed is a non-fiction book about brains, both human and artificial, by the inventor and futurist Ray Kurzweil. First published in hardcover on November 13, 2012 by Viking Press [1] it became a New York Times Best Seller. [2] It has received attention from The Washington Post , The New York Times and The New Yorker .
Kurzweil describes a series of thought experiments which suggest to him that the brain contains a hierarchy of pattern recognizers. Based on this he introduces his Pattern Recognition Theory of Mind (PRTM). He says the neocortex contains 300 million very general pattern recognition circuits and argues that they are responsible for most aspects of human thought. He also suggests that the brain is a "recursive probabilistic fractal" whose line of code is represented within the 30-100 million bytes of compressed code in the genome.
Kurzweil then explains that a computer version of this design could be used to create an artificial intelligence more capable than the human brain. It would employ techniques such as hidden Markov models and genetic algorithms, strategies Kurzweil used successfully in his years as a commercial developer of speech recognition software. Artificial brains will require massive computational power, so Kurzweil reviews his law of accelerating returns, which explains how the compounding effects of exponential growth will deliver the necessary hardware in only a few decades.
Critics felt the subtitle of the book, The Secret of Human Thought Revealed, overpromises. Some protested that pattern recognition does not explain the "depth and nuance" [3] of mind including elements like emotion and imagination. Others felt Kurzweil's ideas might be right, but they are not original, pointing to existing work as far back as the 1980s. Yet critics admire Kurzweil's "impressive track record" [4] and say that his writing is "refreshingly clear", [5] containing "lucid discussions" [6] of computing history.
Kurzweil has written several futurology books [7] including The Age of Intelligent Machines (1990), The Age of Spiritual Machines (1999) and The Singularity is Near (2005). In his books he develops the law of accelerating returns. The law is similar to Moore's Law, the persistent doubling in capacity of computer chips, but extended to all "human technological advancement, the billions of years of terrestrial evolution" and even "the entire history of the universe". [8]
Due to the exponential growth in computing technologies predicted by the law, Kurzweil says that by "the end of the 2020s" computers will have "intelligence indistinguishable to biological humans". [9] As computational power continues to grow, machine intelligence will represent an ever-larger percentage of total intelligence on the planet. Ultimately it will lead to the Singularity, a merger between biology and technology, which Kurzweil predicts will occur in 2045. [10] He says "There will be no distinction, post-Singularity, between human and machine...". [11]
Kurzweil himself plans to "stick around" [12] for the Singularity. He has written two health and nutrition books aimed at living longer, the subtitle of one is "Live Long Enough to Live Forever". [7] One month after How to Create a Mind was published, Google announced that it had hired Kurzweil to work as Director of Engineering "on new projects involving machine learning and language processing". [13] Kurzweil said his goal at Google is to "create a truly useful AI [artificial intelligence] that will make all of us smarter". [14]
Kurzweil opens the book by reminding us of the importance of thought experiments in the development of major theories, including evolution and relativity. [15] It's worth noting that Kurzweil sees Darwin as "a good contender" for the leading scientist of the 19th century. [16] He suggests his own thought experiments related to how the brain thinks and remembers things. For example, he asks the reader to recite the alphabet, but then to recite the alphabet backwards. The difficulty in going backwards suggests "our memories are sequential and in order". [17] Later he asks the reader to visualize someone he has met only once or twice, the difficulty here suggests "there are no images, videos, or sound recordings stored in the brain" only sequences of patterns. [18] Eventually he concludes the brain uses a hierarchy of pattern recognizers. [19]
Kurzweil states that the neocortex contains about 300 million very general pattern recognizers, arranged in a hierarchy. [20] For example, to recognize a written word there might be several pattern recognizers for each different letter stroke: diagonal, horizontal, vertical or curved. The output of these recognizers would feed into higher level pattern recognizers, which look for the pattern of strokes which form a letter. Finally a word-level recognizer uses the output of the letter recognizers. All the while signals feed both "forward" and "backward". For example, if a letter is obscured, but the remaining letters strongly indicate a certain word, the word-level recognizer might suggest to the letter-recognizer which letter to look for, and the letter-level would suggest which strokes to look for. Kurzweil also discusses how listening to speech requires similar hierarchical pattern recognizers. [21]
Kurzweil's main thesis is that these hierarchical pattern recognizers are used not just for sensing the world, but for nearly all aspects of thought. For example, Kurzweil says memory recall is based on the same patterns that were used when sensing the world in the first place. Kurzweil says that learning is critical to human intelligence. A computer version of the neocortex would initially be like a new born baby, unable to do much. Only through repeated exposure to patterns would it eventually self-organize and become functional. [22]
Kurzweil writes extensively about neuroanatomy, of both the neocortex and "the old brain". [23] He cites recent evidence that interconnections in the neocortex form a grid structure, which suggests to him a common algorithm across "all neocortical functions". [24]
Kurzweil next writes about creating a digital brain inspired by the biological brain he has been describing. One existing effort he points to is Henry Markram's Blue Brain Project, which is attempting to create a full brain simulation by 2023. [25] Kurzweil says the full molecular modeling they are attempting will be too slow, and that they will have to swap in simplified models to speed up initial self-organization. [26]
Kurzweil believes these large scale simulations are valuable, but says a more explicit "functional algorithmic model" will be required to achieve human levels of intelligence. [26] Kurzweil is unimpressed with neural networks and their potential while he's very bullish on vector quantization, hidden Markov models and genetic algorithms since he used all three successfully in his speech recognition work. [27] Kurzweil equates pattern recognizers in the neocortex with statements in the LISP programming language, which is also hierarchical. [28] He also says his approach is similar to Jeff Hawkins' hierarchical temporal memory, although he feels the hierarchical hidden Markov models have an advantage in pattern detection. [29]
Kurzweil touches on some modern applications of advanced AI including Google's self-driving cars, IBM's Watson which beat the best human players at the game Jeopardy!, the Siri personal assistant in the Apple iPhone or its competitor Google Voice Search. He contrasts the hand-coded knowledge of the Douglas Lenat's Cyc project with the automated learning of systems like Google Translate and suggests the best approach is to use a combination of both, which is how IBM's Watson was so effective. [30] Kurzweil says that John Searle's has leveled his "Chinese Room" objection at Watson, arguing that Watson only manipulates symbols without meaning. Kurzweil thinks the human brain is "just" doing hierarchical statistical analysis as well. [31]
In a section entitled A Strategy for Creating a Mind Kurzweil summarizes how he would put together a digital mind. He would start with a pattern recognizer and arrange for a hierarchy to self-organize using a hierarchical hidden Markov model. All parameters of the system would be optimized using genetic algorithms. He would add in a "critical thinking module" to scan existing patterns in the background for incompatibilities, to avoid holding inconsistent ideas. Kurzweil says the brain should have access to "open questions in every discipline" and have the ability to "master vast databases", something traditional computers are good at. He feels the final digital brain would be "as capable as biological ones of effecting changes in the world". [32]
A digital brain with human-level intelligence raises many philosophical questions, the first of which is whether it is conscious. Kurzweil feels that consciousness is "an emergent property of a complex physical system", such that a computer emulating a brain would have the same emergent consciousness as the real brain. This is in contrast to people like John Searle, Stuart Hameroff and Roger Penrose who believe there is something special about the physical brain that a computer version could not duplicate. [33]
Another issue is that of free will, the degree to which people are responsible for their own choices. Free will relates to determinism, if everything is strictly determined by prior state, then some would say that no one can have free will. Kurzweil holds a pragmatic belief in free will because he feels society needs it to function. He also suggests that quantum mechanics may provide "a continual source of uncertainty at the most basic level of reality" such that determinism does not exist. [34]
Finally Kurzweil addresses identity with futuristic scenarios involving cloning a nonbiological version of someone, or gradually turning that same person into a nonbiological entity one surgery at a time. In the first case it is tempting to say the clone is not the original person, because the original person still exists. Kurzweil instead concludes both versions are equally the same person. He explains that an advantage of nonbiological systems is "the ability to be copied, backed up, and re-created" and this is just something people will have to get used to. Kurzweil believes identity "is preserved through continuity of the pattern of information that makes us" and that humans are not bound to a specific "substrate" like biology. [35]
The law of accelerating returns is the basis for all of these speculations about creating a digital brain. It explains why computational capacity will continue to increase unabated even after Moore's Law expires, which Kurzweil predicts will happen around 2020. Integrated circuits, the current method of creating computer chips, will fade from the limelight, while some new more advanced technology will pick up the slack. It is this new technology that will get us to the massive levels of computation needed to create an artificial brain. [36]
As exponential progress continues into and beyond the Singularity, Kurzweil says "we will merge with the intelligent technology we are creating". [37] From there intelligence will expand outward rapidly. Kurzweil even wonders whether the speed of light is really a firm limit to civilization's ability to colonize the universe. [38]
Simson Garfinkel, an entrepreneur and professor of computer science at the Naval Postgraduate School, says Kurzweil's pattern recognition theory of mind (PRTM) is misnamed because of the word "theory", he feels it is not a theory since it cannot be tested. Garfinkel rejects Kurzweil's one-algorithm approach instead saying "the brain is likely to have many more secrets and algorithms than the one Kurzweil describes". Garfinkel caricatures Kurzweil's plan for artificial intelligence as "build something that can learn, then give it stuff to learn", which he thinks is hardly the "secret of human thought" promised by the subtitle of the book. [39]
Gary Marcus, a research psychologist and professor at New York University, says only the name PRTM is new. He says the basic theory behind PRTM is "in the spirit of" a model of vision known as the neocognitron, introduced in 1980. He also says PRTM even more strongly resembles Hierarchical Temporal Memory promoted by Jeff Hawkins in recent years. Marcus feels any theory like this needs to be proven with an actual working computer model. And to that end he says that "a whole slew" of machines have been programmed with an approach similar to PRTM, and they have often performed poorly. [6]
Colin McGinn, a philosophy professor at the University of Miami, asserted in The New York Review of Books that "pattern recognition pertains to perception specifically, not to all mental activity". [40] While Kurzweil does say "memories are stored as sequences of patterns" [18] McGinn asks about "emotion, imagination, reasoning, willing, intending, calculating, silently talking to oneself, feeling pain and pleasure, itches, and mood" insisting these have nothing to do with pattern recognition. McGinn is also critical of the "homunculus language" Kurzweil uses, the anthropomorphization of anatomical parts like neurons. Kurzweil will write that a neuron "shouts" when it "sees" a pattern, where McGinn would prefer he say a neuron "fires" when it receives certain stimuli. In McGinn's mind only conscious entities can "recognize" anything, a bundle of neurons cannot. Finally he takes objection with Kurzweil's "law" of accelerating change, insisting it is not a law, but just a "fortunate historical fact about the twentieth century". [40]
In 2015, Kurzweil's theory was extended to a Pattern Activation/Recognition Theory of Mind with a stochastic model of self-describing neural circuits. [41]
Garfinkel says Kurzweil is at his best with the thought experiments early in the book, but says the "warmth and humanitarianism" evident in Kurzweil's talks is missing. [39] Marcus applauds Kurzweil for "lucid discussion" of Alan Turing and John von Neumann and was impressed by his descriptions of computer algorithms and the detailed histories of Kurzweil's own companies. [6]
Matthew Feeney, assistant editor for Reason, was disappointed in how briefly Kurzweil dealt with the philosophical aspects of the mind-body problem, and the ethical implications of machines which appear to be conscious. He does say Kurzweil's "optimism about an AI-assisted future is contagious." [42] While Drew DeSilver, business reporter at the Seattle Times, says the first half of the book "has all the pizazz and drive of an engineering manual" but says Kurzweil's description of how the Jeopardy! computer champion Watson worked "is eye-opening and refreshingly clear". [5]
McGinn says the book is "interesting in places, fairly readable, moderately informative, but wildly overstated." He mocks the book's subtitle by writing "All is revealed!" after paraphrasing Kurzweil's pattern recognition theory of mind. Speaking as a philosopher, McGinn feels that Kurzweil is "way of out of his depth" when discussing Wittgenstein. [40]
Matt Ridley, journalist and author, wrote in The Wall Street Journal that Kurzweil "has a more impressive track record of predicting technological progress than most" and therefore he feels "it would be foolish, not wise, to bet against the emulation of the human brain in silicon within a couple of decades". [4]
The Chinese room argument holds that a computer executing a program cannot have a mind, understanding, or consciousness, regardless of how intelligently or human-like the program may make the computer behave. The argument was presented in a 1980 paper by the philosopher John Searle entitled "Minds, Brains, and Programs" and published in the journal Behavioral and Brain Sciences. Before Searle, similar arguments had been presented by figures including Gottfried Wilhelm Leibniz (1714), Anatoly Dneprov (1961), Lawrence Davis (1974) and Ned Block (1978). Searle's version has been widely discussed in the years since. The centerpiece of Searle's argument is a thought experiment known as the Chinese room.
Raymond Kurzweil is an American computer scientist, author, entrepreneur, futurist, and inventor. He is involved in fields such as optical character recognition (OCR), text-to-speech synthesis, speech recognition technology and electronic keyboard instruments. He has written books on health technology, artificial intelligence (AI), transhumanism, the technological singularity, and futurism. Kurzweil is a public advocate for the futurist and transhumanist movements and gives public talks to share his optimistic outlook on life extension technologies and the future of nanotechnology, robotics, and biotechnology.
The technological singularity—or simply the singularity—is a hypothetical future point in time at which technological growth becomes uncontrollable and irreversible, resulting in unforeseeable consequences for Human civilization. According to the most popular version of the singularity hypothesis, I. J. Good's intelligence explosion model of 1965, an upgradable intelligent agent could eventually enter a positive feedback loop of self-improvement cycles, each successive; and more intelligent generation appearing more and more rapidly, causing a rapid increase ("explosion") in intelligence which would ultimately result in a powerful superintelligence, qualitatively far surpassing all human intelligence.
The Age of Spiritual Machines: When Computers Exceed Human Intelligence is a non-fiction book by inventor and futurist Ray Kurzweil about artificial intelligence and the future course of humanity. First published in hardcover on January 1, 1999, by Viking, it has received attention from The New York Times, The New York Review of Books and The Atlantic. In the book Kurzweil outlines his vision for how technology will progress during the 21st century.
Mind uploading is a speculative process of whole brain emulation in which a brain scan is used to completely emulate the mental state of the individual in a digital computer. The computer would then run a simulation of the brain's information processing, such that it would respond in essentially the same way as the original brain and experience having a sentient conscious mind.
Artificial consciousness, also known as machine consciousness, synthetic consciousness, or digital consciousness, is the consciousness hypothesized to be possible in artificial intelligence. It is also the corresponding field of study, which draws insights from philosophy of mind, philosophy of artificial intelligence, cognitive science and neuroscience. The same terminology can be used with the term "sentience" instead of "consciousness" when specifically designating phenomenal consciousness.
David Courtenay Marr was a British neuroscientist and physiologist. Marr integrated results from psychology, artificial intelligence, and neurophysiology into new models of visual processing. His work was influential in computational neuroscience and led to a resurgence of interest in the discipline.
The neocortex, also called the neopallium, isocortex, or the six-layered cortex, is a set of layers of the mammalian cerebral cortex involved in higher-order brain functions such as sensory perception, cognition, generation of motor commands, spatial reasoning and language. The neocortex is further subdivided into the true isocortex and the proisocortex.
Artificial general intelligence (AGI) is a type of artificial intelligence (AI) that matches or surpasses human capabilities across a wide range of cognitive tasks. This is in contrast to narrow AI, which is designed for specific tasks. AGI is considered one of various definitions of strong AI.
The Singularity Is Near: When Humans Transcend Biology is a 2005 non-fiction book about artificial intelligence and the future of humanity by inventor and futurist Ray Kurzweil. A sequel book, The Singularity Is Nearer, was released on June 25, 2024.
The Age of Intelligent Machines is a non-fiction book about artificial intelligence by inventor and futurist Ray Kurzweil. This was his first book and the Association of American Publishers named it the Most Outstanding Computer Science Book of 1990. It was reviewed in The New York Times and The Christian Science Monitor. The format is a combination of monograph and anthology with contributed essays by artificial intelligence experts such as Daniel Dennett, Douglas Hofstadter, and Marvin Minsky.
The memory-prediction framework is a theory of brain function created by Jeff Hawkins and described in his 2004 book On Intelligence. This theory concerns the role of the mammalian neocortex and its associations with the hippocampi and the thalamus in matching sensory inputs to stored memory patterns and how this process leads to predictions of what will happen in the future.
An artificial brain is software and hardware with cognitive abilities similar to those of the animal or human brain.
The philosophy of artificial intelligence is a branch of the philosophy of mind and the philosophy of computer science that explores artificial intelligence and its implications for knowledge and understanding of intelligence, ethics, consciousness, epistemology, and free will. Furthermore, the technology is concerned with the creation of artificial animals or artificial people so the discipline is of considerable interest to philosophers. These factors contributed to the emergence of the philosophy of artificial intelligence.
In philosophy of mind, the computational theory of mind (CTM), also known as computationalism, is a family of views that hold that the human mind is an information processing system and that cognition and consciousness together are a form of computation. Warren McCulloch and Walter Pitts (1943) were the first to suggest that neural activity is computational. They argued that neural computations explain cognition. The theory was proposed in its modern form by Hilary Putnam in 1967, and developed by his PhD student, philosopher, and cognitive scientist Jerry Fodor in the 1960s, 1970s, and 1980s. It was vigorously disputed in analytic philosophy in the 1990s due to work by Putnam himself, John Searle, and others.
The following outline is provided as an overview of and topical guide to artificial intelligence:
Hierarchical temporal memory (HTM) is a biologically constrained machine intelligence technology developed by Numenta. Originally described in the 2004 book On Intelligence by Jeff Hawkins with Sandra Blakeslee, HTM is primarily used today for anomaly detection in streaming data. The technology is based on neuroscience and the physiology and interaction of pyramidal neurons in the neocortex of the mammalian brain.
Transcendent Man is a 2009 documentary film by American filmmaker Barry Ptolemy about inventor, futurist and author Ray Kurzweil and his predictions about the future of technology in his 2005 book, The Singularity is Near. In the film, Ptolemy follows Kurzweil around his world as he discusses his thoughts on the technological singularity, a proposed advancement that will occur sometime in the 21st century when progress in artificial intelligence, genetics, nanotechnology, and robotics will result in the creation of a human-machine civilization.
Turing's Wager is a philosophical argument that claims it is impossible to infer or deduce a detailed mathematical model of the human brain within a reasonable timescale, and thus impossible in any practical sense. The argument was first given in 1950 by the computational theorist Alan Turing in his paper Computing Machinery and Intelligence, published in Mind. The argument asserts that determining any mathematical model of a computer is not possible in a reasonable timeframe. As a consequence, determining a mathematical model of the human brain must also be impossible within that timeframe.
Juyang (John) Weng is a Chinese-American computer engineer, neuroscientist, author, and academic. He is a former professor at the Department of Computer Science and Engineering at Michigan State University and the President of Brain-Mind Institute and GENISAMA.