Fluid Concepts and Creative Analogies

Last updated
Fluid Concepts and Creative Analogies
Hofstadter Fluid Concepts.jpg
Cover to the first edition
Author Douglas Hofstadter
Published1995 (Harvester Wheatsheaf)
Pages250
ISBN 978-0-7450-1065-6
OCLC 24742774

Fluid Concepts and Creative Analogies: Computer Models of the Fundamental Mechanisms of Thought is a 1995 book by Douglas Hofstadter and other members of the Fluid Analogies Research Group exploring the mechanisms of intelligence through computer modeling. It contends that the notions of analogy and fluidity are fundamental to explain how the human mind solves problems and to create computer programs that show intelligent behavior. It analyzes several computer programs that members of the group have created over the years to solve problems that require intelligence.

Contents

It was the first book ever sold by Amazon.com. [1]

Origin of the book

The book is a collection of revised articles that appeared in precedence, each preceded by an introduction by Hofstadter. They describe the scientific work by him and his collaborators in the 1980s and 1990s. The project started in the late 1970s at Indiana University. In 1983 he took a sabbatical year at MIT, working in Marvin Minsky's Artificial Intelligence Lab. There he met and collaborated with Melanie Mitchell, who then became his doctoral student. Subsequently, Hofstadter moved to the University of Michigan, where the FARG (Fluid Analogies Research Group) was founded. Eventually he returned to Indiana University in 1988, continuing the FARG research there. The book was written during a sabbatical year at the Istituto per la Ricerca Scientifica e Tecnologica in Trento, Italy.

Publication

Upon publication, Jon Udell, a BYTE senior technical editor-at-large said: [2]

Fifteen years ago, Gödel, Escher, Bach: An Eternal Golden Braid exploded on the literary scene, earning its author a Pulitzer prize and a monthly column in Scientific American . Douglas Hofstadter's exuberant synthesis of math, music, and art, and his inspired thought experiments with "tangled hierarchy," recursion, pattern recognition, figure/ground reversal, and self-reference, delighted armchair philosophers and AI theorists. But in the end, many people believed that these intellectual games yielded no useful model of cognition on which to base future AI research. Now Fluid Concepts and Creative Analogies presents that model, along with the computer programs Hofstadter and his associates have designed to test it. These programs work in stripped-down yet surprisingly rich microdomains.

On April 3, 1995, Fluid Concepts and Creative Analogies became the first book ordered online by an Amazon.com customer. [3]

Chapters and authors

Summary of chapters

Chapter 1: To Seek Whence Cometh a Sequence

The first AI project by Hofstadter stemmed from his teenage fascination with number sequences. When he was 17, he studied the way that triangular and square numbers interleave, and eventually found a recursive relation describing it. In his first course on AI, he set to the students and to himself the task of writing a program that could extrapolate the rule by which a numeric sequence is generated. He discusses breadth-first and depth-first techniques, but eventually concludes that the results represent expert systems that incarnate a lot of technical knowledge but don't shine much light on the mental processes that humans use to solve such puzzles.

Instead he devised a simplified version of the problem, called SeekWhence, where sequences are based on very simple basic rules not requiring advanced mathematical knowledge. He argues that pattern recognition, analogy, and fluid working hypotheses are fundamental to understand how humans tackle such problems.

Chapter 2: The Architecture of Jumbo

Jumbo is a program to solve jumbles, word puzzles consisting in five or six scrambled letters that need to be anagrammed to form an English word. The resulting word does not need to be a real one but just to a plausible, that is, to consists of a sequence of letters that is normal in English.

The constituent elements of Jumbo are the following:

A "temperature" is associated to the present state of the cytoplasm; it determines how probable it is that a destructive codelet is executed. There is a "freezing" temperature at which no destruction can occur anymore: a solution has been found.

Chapter 3: Numbo: A Study in Cognition and Recognition

Numbo is a program by Daniel Defays that tries to solve numerical problems similar to those used in the French game "Le compte est bon". The game consists in combining some numbers called "bricks", using the operations of multiplication, addition, and subtraction, to obtain a given result.

The program is modeled on Jumbo and Copycat and uses a permanent network of known mathematical facts, a working memory in the form of a cytoplasm, and a coderack containing codelets to produce free associations of bricks in order to arrive at the result.

Chapter 4: Highlevel Perception, Representation, and Analogy

The chapter subtitle A Critique of Artificial-intelligence Methodology indicates that this is a polemical article, in which David Chalmers, Robert French, and Hofstadter criticize most of the research going on at that time (the early '80s) as exaggerating results and missing the central features of human intelligence.

Some of these AI projects, like the structure mapping engine (SME), claimed to model high faculties of the human mind and to be able to understand literary analogies and to rediscover important scientific breakthroughs. In the introduction, Hofstadter warns about the Eliza effect that leads people to attribute understanding to a computer program that only uses a few stock phrases. The authors claim that the input data for such impressive results are already heavily structured in the direction of the intended discovery and only a simple matching task is left to the computer.

Their main claim is that it is impossible to model high-level cognition without at the same time modeling low-level perception. While cognition is necessarily based on perception, they argue that it in turn influences perception itself. Therefore, a sound AI project should try to model the two together. In a slogan repeated several times throughout the book: cognition is recognition.

Since human perception is too complex to be modelled by available technology, they favor the restriction of AI projects to limited domains like the one used for the Copycat project.

Chapter 5: The Copycat Project

This chapter presents, as stated in the full title, A Model of Mental Fluidity and Analogy-making. It is a description of the architecture of the Copycat program, developed by Hofstadter and Melanie Mitchell. The field of application of the program is a domain of short alphabetic sequences. A typical puzzle is: If abc were changed to abd, how would you change ijk in the same way?. The program tries to find an answer using a strategy supposedly similar to the way the human mind tackles the question.

Copycat has three major components:

The resulting software displays emergent properties. It works according to a parallel terraced scan that runs several possible processes at the same time. It shows mental fluidity in that concepts may slip into similar ones. It emulates human behavior in tending to find the most obvious solutions most of the time but being more satisfied (as witnessed by low temperature) by more clever and deep answers that it finds more rarely.

Chapter 6: Perspectives on Copycat

This chapter compares Copycat with other recent (at the time) work in artificial intelligence. Specifically, it matches it with the claimed results from the structure mapping engine SME and the Analogical Constraint Mapping Engine (ACME). The authors' judgment is that those programs suffer from two defects: Their input is pre-structured by the developers to highlight the analogies that the software is supposed to find; and the general architecture of the programs is serial and deterministic rather than parallel and stochastic like Copycat's, which they consider psychologically more plausible.

Severe criticism is put on the claim that these tools can solve "real-life" problems. In fact, only the terms used in the example suggest that the input to the programs comes from a concrete situation. The logical structures don't actually imply any meaning for the term.

Finally a more positive assessment is given to two other projects: Indurkhya' PAN model and Kokinov's AMBR system.

Chapter 7: Prolegomena to Any Future Metacat

This chapter looks at those aspects of human creativity that are not yet modeled by Copycat and lays down a research plan for a future extension of the software. The main missing element is the mind's ability to observe itself and reflect on its own thinking process. Also important is the ability to learn and to remember the results of the mental activity.

The creativity displayed in finding analogies should be applicable at ever higher levels: making analogies between analogies (expression inspired by the title of a book by Stanislaw Ulam), analogies between these second-order analogies, and so on.

Chapter 8: Tabletop, BattleOp, Ob-Platte, Potelbat, Belpatto, Platobet

Another of Hofstadter's students, Robert French, was assigned the task of applying the architecture of Copycat to a different domain, consisting in analogies between objects lying on a table in a coffeehouse. The resulting program was named Tabletop.

The authors present a different and vaster domain to justify the relevance of attacking such a trivial-seeming project. The alternative domain is called Ob-Platte and consists in discovering analogies between geographical locations in different regions or countries.

Once again arguments are offered against a brute-force approach, which would work on the small Tabletop domain but would become unfeasible on the larger Ob-Platte domain. Instead a parallel non-deterministic architecture is used, similar to the one adopted by the Copycat project.

Chapter 9: The Emergent Personality of Tabletop, a Perception-based Model of Analogy-making

In the premise to the chapter, title The Knotty Problem of Evaluating Research, Hofstadter considers the question of how research in AI should be assessed. He argues against a strict adherence to a match between the results of an AI program with the average answer of human test subjects. He gives two reasons for his rejection: the AI program is supposed to emulate creativity, while an average of human responses will delete any original insight by any of the single subjects; and the architecture of the program should be more important that its mere functional description.

In the main article, the architecture of Tabletop is described: it is strongly inspired by that of Copycat and consists of a Slipnet, a Workspace, and a Corerack.

Chapter 10: Letter Spirit

This last chapter is about a more ambitious project that Hofstadter started with student Gary McGraw. The microdomain used is that of grid fonts: typographic alphabets constructed using a rigid system of small rigid components. The goal is to construct a program that, given only a few or just one letter from the grid font, can generate the whole alphabet in the same style. The difficulty lies in the ambiguity and undefinability of style. The projected program would have a structure very similar to that of Jumble, Numble, Copycat, and Tabletop.

Epilogue

In the concluding part of the book, Hofstadter analyses some AI projects with a critical eye. He finds that today's AI is missing the gist of human creativity and is making exaggerated claims. The project under scrutiny are the following.

AARON, a computer artist that can draw images of people in outdoor settings in a distinctive style reminiscent of that of a human artist; criticism: the program doesn't have any understanding of the objects it draws, it just uses some graphical algorithms with some randomness thrown in to generate different scenes at every run and to give the style a more natural feel.

Racter, a computer author that wrote a book entitled The Policeman's Beard Is Half Constructed. Although some of the prose generated by the program is quite impressive, due in part to the Eliza effect, the computer does not have any notion of plot or of the meaning of the words it uses. Furthermore, the book is made up of selected texts from thousands produced by the computer over several years.

AM, a computer mathematician that generates new mathematical concepts. It managed to produce by itself the notion of prime number and the Goldbach conjecture. As with Racter, the question is how much the programmer filtered the output of the program, keeping only the occasional interesting output. Also, mathematics being a very specialized domain, it is doubtful whether the techniques used can be abstracted to general cognition.

Another mathematical program, called Geometry, was celebrated for making an insightful discovery of an original proof that an isosceles triangle has equal base angles. The proof is based on seeing the triangle in two different ways. However, the program generates all possible ways of seeing the triangle, not even knowing that it is the same triangle.

Hofstadter concludes with some methodological remarks on the Turing Test. In his opinion it is still a good definition and he argues that by interacting with a program, a human may be able to have insight not just on its behaviour but also on its structure. However, he criticises the use that is made of it at present: it encourages the development of fancy[ peacock prose ] natural-language interfaces instead of the investigation of deep cognitive faculties.

Editions

Related Research Articles

<span class="mw-page-title-main">Cognitive science</span> Interdisciplinary scientific study of the mind, the gut and its processes

Cognitive science is the interdisciplinary, scientific study of the mind and its processes with input from linguistics, psychology, neuroscience, philosophy, computer science/artificial intelligence, and anthropology. It examines the nature, the tasks, and the functions of cognition. Cognitive scientists study intelligence and behavior, with a focus on how nervous systems represent, process, and transform information. Mental faculties of concern to cognitive scientists include language, perception, memory, attention, reasoning, and emotion; to understand these faculties, cognitive scientists borrow from fields such as linguistics, psychology, artificial intelligence, philosophy, neuroscience, and anthropology. The typical analysis of cognitive science spans many levels of organization, from learning and decision to logic and planning; from neural circuitry to modular brain organization. One of the fundamental concepts of cognitive science is that "thinking can best be understood in terms of representational structures in the mind and computational procedures that operate on those structures."

<span class="mw-page-title-main">Douglas Hofstadter</span> American professor of cognitive science (born 1945)

Douglas Richard Hofstadter is an American scholar of cognitive science, physics, and comparative literature whose research includes concepts such as the sense of self in relation to the external world, consciousness, analogy-making, artistic creation, literary translation, and discovery in mathematics and physics. His 1979 book Gödel, Escher, Bach: An Eternal Golden Braid won both the Pulitzer Prize for general nonfiction and a National Book Award for Science. His 2007 book I Am a Strange Loop won the Los Angeles Times Book Prize for Science and Technology.

The ELIZA effect, in computer science, is the tendency to unconsciously assume computer behaviors are analogous to human behaviors; that is, anthropomorphisation.

<span class="mw-page-title-main">Analogy</span> Cognitive process of transferring information or meaning from a particular subject to another

Analogy is a cognitive process of transferring information or meaning from a particular subject to another, or a linguistic expression corresponding to such a process. In a narrower sense, analogy is an inference or an argument from one particular to another particular, as opposed to deduction, induction, and abduction, in which at least one of the premises, or the conclusion, is general rather than particular in nature. The term analogy can also refer to the relation between the source and the target themselves, which is often a similarity, as in the biological notion of analogy.

<span class="mw-page-title-main">Evolutionary computation</span> Trial and error problem solvers with a metaheuristic or stochastic optimization character

In computer science, evolutionary computation is a family of algorithms for global optimization inspired by biological evolution, and the subfield of artificial intelligence and soft computing studying these algorithms. In technical terms, they are a family of population-based trial and error problem solvers with a metaheuristic or stochastic optimization character.

<span class="mw-page-title-main">Logic in computer science</span> Academic discipline

Logic in computer science covers the overlap between the field of logic and that of computer science. The topic can essentially be divided into three main areas:

<span class="mw-page-title-main">Bongard problem</span>

A Bongard problem is a kind of puzzle invented by the Russian computer scientist Mikhail Moiseevich Bongard, probably in the mid-1960s. They were published in his 1967 book on pattern recognition. The objective is to spot the differences between the two sides. Bongard, in the introduction of the book credits the ideas in it to a group including M. N. Vaintsvaig, V. V. Maksimov, and M. S. Smirnov.

The memory-prediction framework is a theory of brain function created by Jeff Hawkins and described in his 2004 book On Intelligence. This theory concerns the role of the mammalian neocortex and its associations with the hippocampi and the thalamus in matching sensory inputs to stored memory patterns and how this process leads to predictions of what will happen in the future.

<span class="mw-page-title-main">Egbert B. Gebstadter</span>

Egbert B. Gebstadter is a fictional author who appears in the indexes of books by Douglas R. Hofstadter. For each Hofstadter book, there is a corresponding Gebstadter book. His name is derived from "GEB", the abbreviation for Hofstadter's first book Gödel, Escher, Bach: An Eternal Golden Braid; the letters appear in his last name, permuted in his first name, and permuted again in his initials.

<span class="mw-page-title-main">Copycat (software)</span>

Copycat is a model of analogy making and human cognition based on the concept of the parallel terraced scan, developed in 1988 by Douglas Hofstadter, Melanie Mitchell, and others at the Center for Research on Concepts and Cognition, Indiana University Bloomington. The original Copycat was written in Common Lisp and is bitrotten ; however, Java and Python ports exist. The latest version in 2018 is a Python3 port by Lucas Saldyt and J. Alan Brogan.

Computational cognition is the study of the computational basis of learning and inference by mathematical modeling, computer simulation, and behavioral experiments. In psychology, it is an approach which develops computational models based on experimental results. It seeks to understand the basis behind the human method of processing of information. Early on computational cognitive scientists sought to bring back and create a scientific form of Brentano's psychology.

Melanie Mitchell is an American scientist. She is the Davis Professor of Complexity at the Santa Fe Institute. Her major work has been in the areas of analogical reasoning, complex systems, genetic algorithms and cellular automata, and her publications in those fields are frequently cited.

The following outline is provided as an overview of and topical guide to artificial intelligence:

<span class="mw-page-title-main">Outline of thought</span> Overview of and topical guide to thought

The following outline is provided as an overview of and topical guide to thought (thinking):

<span class="mw-page-title-main">Computational creativity</span> Multidisciplinary endeavour

Computational creativity is a multidisciplinary endeavour that is located at the intersection of the fields of artificial intelligence, cognitive psychology, philosophy, and the arts.

The AI effect occurs when onlookers discount the behavior of an artificial intelligence program by arguing that it is not real intelligence.

The LIDA cognitive architecture is an integrated artificial cognitive system that attempts to model a broad spectrum of cognition in biological systems, from low-level perception/action to high-level reasoning. Developed primarily by Stan Franklin and colleagues at the University of Memphis, the LIDA architecture is empirically grounded in cognitive science and cognitive neuroscience. In addition to providing hypotheses to guide further research, the architecture can support control structures for software agents and robots. Providing plausible explanations for many cognitive processes, the LIDA conceptual model is also intended as a tool with which to think about how minds work.

Cognitive musicology is a branch of cognitive science concerned with computationally modeling musical knowledge with the goal of understanding both music and cognition.

Robert M. French is a research director at the French National Centre for Scientific Research. He is currently at the University of Burgundy in Dijon. He holds a Ph.D. from the University of Michigan, where he worked with Douglas Hofstadter on the Tabletop computational cognitive model. He specializes in cognitive science and has made an extensive study of the process of analogy-making.

Joshua Brett Tenenbaum is Professor of Computational Cognitive Science at the Massachusetts Institute of Technology. He is known for contributions to mathematical psychology and Bayesian cognitive science. According to the MacArthur Foundation, which named him a MacArthur Fellow in 2019, "Tenenbaum is one of the first to develop and apply probabilistic and statistical modeling to the study of human learning, reasoning, and perception, and to show how these models can explain a fundamental challenge of cognition: how our minds understand so much from so little, so quickly."

References