Attention schema theory

Last updated

The attention schema theory (AST) of consciousness (or subjective awareness) is a neuroscientific and evolutionary theory of consciousness which was developed by neuroscientist Michael Graziano at Princeton University. [1] [2] It proposes that brains construct subjective awareness as a schematic model of the process of attention. [1] [2] The theory is a materialist theory of consciousness. It shares similarities with the illusionist ideas of philosophers like Daniel Dennett, Patricia Churchland, and Keith Frankish. [3] [4]

Contents

Graziano proposed that an attention schema is like the body schema. Just like the brain constructs a simplified model of the body to help monitor and control movements of the body, so the brain constructs a simplified model of attention to help monitor and control attention. The information in that model, portraying an imperfect and simplified version of attention, leads the brain to conclude that it has a non-physical essence of awareness. The construct of subjective awareness is the brain's efficient but imperfect model of its own attention. This approach is intended to explain how awareness and attention are similar in many respects, yet are sometimes dissociated, how the brain can be aware of both internal and external events, and also provides testable predictions. [2]

Summary of the theory

The AST describes how an information-processing machine can make the claim that it has a conscious, subjective experience of something. [5] In the theory, the brain is an information processor that is captive to the information constructed within it. The machine has no means to discern the difference between its claim and reality. In this approach, the challenge of explaining consciousness is not, “How does the brain produce an ineffable internal experience,” but rather, “How does the brain construct a quirky self description, and what is the useful cognitive role of that self model?” A crucial aspect of the theory is model-based knowledge. The brain constructs rich internal models that lie beneath the level of higher cognition or of language. Cognition has partial access to those internal models, and we report the content of those models as though we are reporting literal reality.

The AST can be summarized in three broad points. [1] First, the brain is an information-processing device. Second, it has a capacity to focus its processing resources more on some signals than on others. That focus may be on select, incoming sensory signals, or it may be on internal information such as specific, recalled memories. That ability to process select information in a focused manner is sometimes called attention. Third, the brain not only uses the process of attention, but it also builds a set of information, or a representation, descriptive of attention. That representation, or internal model, is the attention schema.

In the theory, the attention schema provides the requisite information that allows the machine to make claims about consciousness. When the machine claims to be conscious of thing X – when it claims that it has a subjective awareness, or a mental possession, of thing X – the machine is using higher cognition to access an attention schema, and reporting the information therein.

For example, suppose a person looks at an apple. When the person reports, “I have a subjective experience of that shiny red apple,” three items are linked together in that claim: the self, the apple, and a subjective experience. The claim about the presence of a self depends on cognitive access to a self model. Without a self model, without the requisite information, the system would be unable to make claims referencing the self. The claim about the presence of, and properties of, an apple depends on cognitive access to a model of the apple, presumably constructed in the visual system. Again, without the requisite information, the system would obviously be unable to make any claims about the apple or its visual properties. In the theory, the claim about the presence of subjective experience depends on cognitive access to an internal model of attention. That internal model does not provide a scientifically precise description of attention, complete with the details of neurons, lateral inhibitory synapses, and competitive signals. The model is silent on the physical mechanisms of attention. Instead, like all internal models in the brain, it is simplified and schematic for the sake of efficiency.

Accessing the information within these three, linked internal models, cognitive machinery claims that there is a self, there is an apple, and the self has a mental possession of the apple; the mental possession, in and of itself, is invisible and has no physically describable properties, but has a general location somewhere inside the body and a specific anchor to the apple; and that mental essence empowers the self to understand, react to, and remember the apple. The machine, in relying on that incomplete and inaccurate model of attention, claims to have a metaphysical consciousness of the apple.

In the AST, subjective experience, or consciousness, or the ineffable mental possession of something, is a simplified construct that is a fairly good, if detail poor, description of the act of attending to something. The internal model of attention is not constructed at a higher cognitive level. It is not a cognitive self theory. It is not learned. Instead, it is constructed beneath the level of cognition and is automatic, much like the internal model of the apple and the internal model of the self. You cannot help constructing those models in those particular ways. In that sense, one could call the attention schema a perception-like model of attention, to distinguish it from a higher-order cognitive model such as a belief or an intellectually reasoned theory.

The AST explains how a machine with an attention schema contains the requisite information to claim to have a consciousness of something, whether consciousness of an apple, consciousness of a thought, or consciousness of the self; how the machine talks about consciousness in the same ways that we do; and how the machine, on accessing its internal information, does not find explanatory meta information, such as that it is a machine computing a conclusion, or that it is accessing an internal model, but instead learns only the narrow contents of the internal models. In AST, we are machines of that sort.

AST is consistent with the perspective called illusionism. [4] The term “illusion,” however, may have connotations that are not quite apt for this theory. Three issues with that label arise. First, many people equate an illusion with something dismissable or harmful. If we can see through the illusion, we are better off. Yet in the AST, the attention schema is a well-functioning internal model. It is not normally dysregulated or in error. Second, most people tend to equate an illusion with a mirage. A mirage falsely indicates the presence of something that actually does not exist. If consciousness is an illusion, then by implication nothing real is present behind the illusion. There is no “there” there. But in the AST, that is not so. Consciousness is a good, if detail-poor, account of something real: attention. We do have attention, a physical and mechanistic process that emerges from the interactions of neurons. When we claim to be subjectively conscious of something, we are providing a slightly schematized version of the literal truth. There is, indeed, a “there” there. Third, an illusion is experienced by something. Those who call consciousness an illusion are extremely careful to define what they mean by “experience” so as to avoid circularity. But the AST is not a theory of how the brain has experiences. It is a theory of how a machine makes claims – how it claims to have experiences – and being stuck in a logic loop, or captive to its own internal information, it cannot escape making those claims.

In the theory, an attention schema did not evolve so that we could walk around claiming to have consciousness. Instead it evolved because it has fundamental adaptive uses in perception, cognition, and social interaction.

Two main types of functions have been proposed for the attention schema. One is to help control attention. [2] A fundamental principle of control theory is that a good controller should incorporate an internal model. Thus the brain's controller of attention should incorporate an internal model of attention – a set of information that is continuously updated and that reflects the dynamics and the changing state of attention. Since attention is one of the most pervasive and important processes in the brain, the proposed attention schema, helping to control attention, would be of fundamental importance to the system. A growing set of behavioral evidence supports this hypothesis. When subjective awareness of a visual stimulus is absent, people can still direct attention to that stimulus, but that attention loses some aspects of control. It is less stable over time, and is less adaptable given training on perturbations. [2] [6] These findings support the proposal that awareness acts like the internal model for the control of attention.

A second proposed function of an attention schema is for social cognition – using the attention schema to model the attentional states of others as well as of ourselves. [1] A main advantage of this public, social use of an attention schema lies in behavioral prediction. As social animals, we survive in the world partly by predicting the behavior of other people. We also plan our futures partly by predicting our own actions. But attention is one of the dominant influences on behavior. What you are attending to, you are likely to behave toward. What you are not attending to, you are much less likely to behave toward. A good model of attention, of its dynamics and consequences, would be useful for predicting behavior.

Analogy to the body schema

AST was developed in analogy to the psychological and neuroscientific work on the body schema, an area of research to which Graziano contributed heavily in his previous publications. [1] In this section, the central ideas of AST are explained by use of the analogy to the body schema.

Suppose a person, Kevin, has reached out and grasped an apple. You ask Kevin what he is holding. He can tell you that the object is an apple, and he can describe the properties of the apple. The reason is that Kevin's brain has constructed a schematic description of the apple, also sometimes called an internal model. The internal model is a set of information, such as about size, color, shape, and location, that is constantly updated as new signals are processed. The model allows Kevin's brain to react to the apple and even predict how the apple may behave in different circumstances. Kevin's brain has constructed an apple schema. His cognitive and linguistic processors have some access to that internal model of an apple, and thus Kevin can verbally answer questions about the apple.

Now you ask Kevin, “How are you holding the apple? What is your physical relationship to the apple?” Once again Kevin can answer. The reason is that, in addition to an internal model of the apple, Kevin's brain also constructs an internal model of his body, including of his arm and hand. That internal model, also sometimes called the body schema, is a set of information, constantly updated as new signals are processed, that specifies the size and shape of Kevin's limbs, how they are hinged, how they tend to move, the state they are in at each moment, and what state they are likely to be in over the next few moments. The primary purpose of this body schema is to allow Kevin's brain to control movement. Because he knows the state that his arm is in, he can better guide its movement. A side-effect of his body schema is that he can explicitly talk about his body. His cognitive and linguistic processors have some access to the body schema, and therefore Kevin can answer, “I am grasping the apple with my hand, while my arm is outstretched.”

The body schema is limited. If you ask Kevin, “How many muscles are in your arm? Where do they attach to the bones?” he cannot answer based on his body schema. He may have intellectual knowledge gleaned from a book, but he has no immediate insight into the muscles of his particular arm. The body schema lacks that level of mechanistic detail.

AST takes this analysis one step further. Kevin is doing more than physically grasping the apple. He is also paying attention to the apple.

To understand AST, it is necessary to specify the correct definition of attention. The word is used colloquially in many ways, leading to some possible confusion. Here it is used to mean that Kevin's brain has focused some resources on the processing of the apple. The internal model of the apple has been boosted in signal strength, and as a result Kevin's brain processes the apple deeply, is more likely to store information about it in memory, and is more likely to trigger a behavioral response to the apple. In this definition of the word, attention is a mechanistic, data-handling process. It involves a relative deployment of processing resources to a specific signal.

Now you ask Kevin, “What is your mental relationship to the apple?” Kevin can answer this question too. The reason, according to AST, is that Kevin's brain constructs not only an internal model of the apple, and an internal model of his body, but also an internal model of his attention. That attention schema is a set of information that describes what attention is, what its most basic properties are, what its dynamics and consequences are, and what state it is in at any particular moment. Kevin's cognitive and linguistic machinery has some access to that internal model, and therefore Kevin can describe his mental relationship to the apple. However, just as in the case of the body schema, the attention schema lacks information about the mechanistic details. It does not contain information about the neurons, synapses, or electrochemical signals that make attention possible. As a result, Kevin reports having a property that lacks any clear physical attributes. He says, “I have a mental grasp of the apple. That mental possession, in and of itself, has no physical properties. It just is. It’s vaguely located inside me. It is what allows me to know about that apple. It allows me to remember the apple. It allows me to choose to react to the apple. It’s my mental self taking hold of the apple – my experience of the apple.” Here Kevin is describing a subjective, experiential consciousness of the apple. Consciousness, as he describes it, seems to transcend physical mechanism, only because it is an incomplete description of a physical mechanism. Kevin's account of his consciousness is a partial, schematic description of his state of attention.

The example given here relates to a consciousness of an apple. However, the same logic could apply to anything – consciousness of a sound, a memory, or oneself as a whole.

In AST, because we claim to be conscious, something in the brain must therefore have computed the requisite information about consciousness to enable the system to output that claim. AST proposes an adaptive function to that information: it serves as an internal model of one of the brain's most important features, attention.

Control of attention

The central hypothesis in AST is that the brain constructs an internal model of attention, the attention schema. The primary adaptive function of that attention schema is to enable a better, more flexible control of attention. In the theory of dynamical systems control, a control system works better and more flexibly if it constructs an internal model of the item it controls. An automatic airplane-piloting system will work better if it incorporates a model of the dynamics of the airplane. An air and temperature controller for a building works better if it incorporates a rich, predictive model of the building's airflow and temperature dynamics. The brain's controller of attention works better by constructing a rich, internal model of what attention is, how it changes over time, what its consequences are, and what state it is in at any moment.

Most of the experimental research on AST is therefore focused on the control of attention. In specific, when people are relatively less aware of a visual stimulus, and yet still directing attention to that stimulus, does attention behave as though its controller has a weakened or absent internal model? Initial experiments suggest that this may be true, though many more experiments would be needed to make the case. [2] [6]

Social cognition

According to one proposal in AST, not only does the brain construct an attention schema to model its own state of attention, but it also uses the same mechanism to model other people's states of attention. In effect, just as we attribute awareness to ourselves, we also attribute it to others. In this proposal, one of the main adaptive functions of an attention schema is for use in social cognition. Some of the research into AST therefore focuses on the overlap between one's own claims of awareness and one's attributions of awareness to others. Initial research using brain scanning in humans suggests that both processes recruit cortical networks that converge on the temporoparietal junction. [7] [8]

See Also

Related Research Articles

<span class="mw-page-title-main">Cognitive science</span> Interdisciplinary scientific study of cognitive processes

Cognitive science is the interdisciplinary, scientific study of the mind and its processes with input from linguistics, psychology, neuroscience, philosophy, computer science/artificial intelligence, and anthropology. It examines the nature, the tasks, and the functions of cognition. Cognitive scientists study intelligence and behavior, with a focus on how nervous systems represent, process, and transform information. Mental faculties of concern to cognitive scientists include language, perception, memory, attention, reasoning, and emotion; to understand these faculties, cognitive scientists borrow from fields such as linguistics, psychology, artificial intelligence, philosophy, neuroscience, and anthropology. The typical analysis of cognitive science spans many levels of organization, from learning and decision to logic and planning; from neural circuitry to modular brain organization. One of the fundamental concepts of cognitive science is that "thinking can best be understood in terms of representational structures in the mind and computational procedures that operate on those structures."

<span class="mw-page-title-main">Consciousness</span> Awareness of internal and external existence

Consciousness, at its simplest, is awareness of internal and external existence. However, its nature has led to millennia of analyses, explanations and debate by philosophers, theologians, and all of science. Opinions differ about what exactly needs to be studied or even considered consciousness. In some explanations, it is synonymous with the mind, and at other times, an aspect of mind. In the past, it was one's "inner life", the world of introspection, of private thought, imagination and volition. Today, it often includes any kind of cognition, experience, feeling or perception. It may be awareness, awareness of awareness, or self-awareness either continuously changing or not. The disparate range of research, notions and speculations raises a curiosity about whether the right questions are being asked.

Epiphenomenalism is a position on the mind–body problem which holds that subjective mental events are completely dependent for their existence on corresponding physical and biochemical events within the human body, yet themselves have no influence over physical events. The appearance that subjective mental states influence physical events is merely an illusion, consciousness being a by-product of physical states of the world. For instance, fear seems to make the heart beat faster, but according to epiphenomenalism the biochemical secretions of the brain and nervous system —not the experience of fear—is what raises the heartbeat. Because mental events are a kind of overflow that cannot cause anything physical, yet have non-physical properties, epiphenomenalism is viewed as a form of property dualism.

<span class="mw-page-title-main">Mind</span> Faculties responsible for mental phenomena

The mind is that which thinks, imagines, remembers, wills, and senses, or is the set of faculties responsible for such phenomena. The mind is also associated with experiencing perception, pleasure and pain, belief, desire, intention, and emotion. The mind can include conscious and non-conscious states as well as sensory and non-sensory experiences.

<span class="mw-page-title-main">Philosophy of perception</span> Branch of philosophy

The philosophy of perception is concerned with the nature of perceptual experience and the status of perceptual data, in particular how they relate to beliefs about, or knowledge of, the world. Any explicit account of perception requires a commitment to one of a variety of ontological or metaphysical views. Philosophers distinguish internalist accounts, which assume that perceptions of objects, and knowledge or beliefs about them, are aspects of an individual's mind, and externalist accounts, which state that they constitute real aspects of the world external to the individual. The position of naïve realism—the 'everyday' impression of physical objects constituting what is perceived—is to some extent contradicted by the occurrence of perceptual illusions and hallucinations and the relativity of perceptual experience as well as certain insights in science. Realist conceptions include phenomenalism and direct and indirect realism. Anti-realist conceptions include idealism and skepticism. Recent philosophical work have expanded on the philosophical features of perception by going beyond the single paradigm of vision.

<i>Consciousness Explained</i> 1991 book by Daniel Dennett

Consciousness Explained is a 1991 book by the American philosopher Daniel Dennett, in which the author offers an account of how consciousness arises from interaction of physical and cognitive processes in the brain. Dennett describes consciousness as an account of the various calculations occurring in the brain at close to the same time. He compares consciousness to an academic paper that is being developed or edited in the hands of multiple people at one time, the "multiple drafts" theory of consciousness. In this analogy, "the paper" exists even though there is no single, unified paper. When people report on their inner experiences, Dennett considers their reports to be more like theorizing than like describing. These reports may be informative, he says, but a psychologist is not to take them at face value. Dennett describes several phenomena that show that perception is more limited and less reliable than we perceive it to be.

<span class="mw-page-title-main">Sentience</span> Ability to be aware of feelings and sensations

Sentience is the simplest or most primitive form of cognition, consisting of a conscious awareness of stimuli without association or interpretation. The word was first coined by philosophers in the 1630s for the concept of an ability to feel, derived from Latin sentiens (feeling), to distinguish it from the ability to think (reason).

Artificial consciousness (AC), also known as machine consciousness (MC), synthetic consciousness or digital consciousness, is the consciousness hypothesized to be possible in artificial intelligence. It is also the corresponding field of study, which draws insights from philosophy of mind, philosophy of artificial intelligence, cognitive science and neuroscience. The same terminology can be used with the term "sentience" instead of "consciousness" when specifically designating phenomenal consciousness.

In psychology, cognitivism is a theoretical framework for understanding the mind that gained credence in the 1950s. The movement was a response to behaviorism, which cognitivists said neglected to explain cognition. Cognitive psychology derived its name from the Latin cognoscere, referring to knowing and information, thus cognitive psychology is an information-processing psychology derived in part from earlier traditions of the investigation of thought and problem solving.

Eliminative materialism is a materialist position in the philosophy of mind. It is the idea that the majority of mental states in folk psychology do not exist. Some supporters of eliminativism argue that no coherent neural basis will be found for many everyday psychological concepts such as belief or desire, since they are poorly defined. The argument is that psychological concepts of behavior and experience should be judged by how well they reduce to the biological level. Other versions entail the nonexistence of conscious mental states such as pain and visual perceptions.

Developed in his (1999) book, "The Feeling of What Happens", Antonio Damasio's theory of consciousness proposes that consciousness arises from the interactions between the brain, the body, and the environment. According to this theory, consciousness is not a unitary experience, but rather emerges from the dynamic interplay between different brain regions and their corresponding bodily states. Damasio argues that our conscious experiences are influenced by the emotional responses that are generated by our body's interactions with the environment, and that these emotional responses play a crucial role in shaping our conscious experience. This theory emphasizes the importance of the body and its physiological processes in the emergence of consciousness.

Awareness in philosophy and psychology is a concept about knowing, perceiving and being cognizant of events. Another definition describes it as a state wherein a subject is aware of some information when that information is directly available to bring to bear in the direction of a wide range of behavioral actions. The concept is often synonymous to consciousness and is also understood as being consciousness itself.

<span class="mw-page-title-main">Hard problem of consciousness</span> Philosophical concept, first stated by David Chalmers in 1995

In philosophy of mind, the hard problem of consciousness is to explain why and how humans and other organisms have qualia, phenomenal consciousness, or subjective experiences. It is contrasted with the "easy problems" of explaining why and how physical systems give a (healthy) human being the ability to discriminate, to integrate information, and to perform behavioral functions such as watching, listening, speaking, and so forth. The easy problems are amenable to functional explanation: that is, explanations that are mechanistic or behavioral, as each physical system can be explained purely by reference to the "structure and dynamics" that underpin the phenomenon.

Daniel Dennett's multiple drafts model of consciousness is a physicalist theory of consciousness based upon cognitivism, which views the mind in terms of information processing. The theory is described in depth in his book, Consciousness Explained, published in 1991. As the title states, the book proposes a high-level explanation of consciousness which is consistent with support for the possibility of strong AI.

Global workspace theory (GWT) is a framework for thinking about consciousness proposed by cognitive scientists Bernard Baars and Stan Franklin in the late 1980s. It was developed to qualitatively account for a large set of matched pairs of conscious and unconscious processes. GWT has been influential in modeling consciousness and higher-order cognition as emerging from competition and integrated flows of information across widespread, parallel neural processes.

<span class="mw-page-title-main">Animal consciousness</span> Quality or state of self-awareness within an animal

Animal consciousness, or animal awareness, is the quality or state of self-awareness within an animal, or of being aware of an external object or something within itself. In humans, consciousness has been defined as: sentience, awareness, subjectivity, qualia, the ability to experience or to feel, wakefulness, having a sense of selfhood, and the executive control system of the mind. Despite the difficulty in definition, many philosophers believe there is a broadly shared underlying intuition about what consciousness is.

Body schema is an organism's internal model of its own body, including the position of its limbs. The neurologist Sir Henry Head originally defined it as a postural model of the body that actively organizes and modifies 'the impressions produced by incoming sensory impulses in such a way that the final sensation of body position, or of locality, rises into consciousness charged with a relation to something that has happened before'. As a postural model that keeps track of limb position, it plays an important role in control of action.

<span class="mw-page-title-main">Neural correlates of consciousness</span> Neuronal events sufficient for a specific conscious percept

The neural correlates of consciousness (NCC) refer to the relationships between mental states and neural states and constitute the minimal set of neuronal events and mechanisms sufficient for a specific conscious percept. Neuroscientists use empirical approaches to discover neural correlates of subjective phenomena; that is, neural changes which necessarily and regularly correlate with a specific experience. The set should be minimal because, under the materialist assumption that the brain is sufficient to give rise to any given conscious experience, the question is which of its components are necessary to produce it.

Michael Steven Anthony Graziano is an American scientist and novelist who is currently a professor of Psychology and Neuroscience at Princeton University. His scientific research focuses on the brain basis of awareness. He has proposed the "attention schema" theory, an explanation of how, and for what adaptive advantage, brains attribute the property of awareness to themselves. His previous work focused on how the cerebral cortex monitors the space around the body and controls movement within that space. Notably he has suggested that the classical map of the body in motor cortex, the homunculus, is not correct and is better described as a map of complex actions that make up the behavioral repertoire. His publications on this topic have had a widespread impact among neuroscientists but have also generated controversy. His novels rely partly on his background in psychology and are known for surrealism or magic realism. Graziano also composes music including symphonies and string quartets.

<span class="mw-page-title-main">Neuroscience of free will</span> Neurophilosophical study of topics related to free will

Neuroscience of free will, a part of neurophilosophy, is the study of topics related to free will using neuroscience and the analysis of how findings from such studies may impact the free will debate.

References

  1. 1 2 3 4 5 Graziano MS (19 September 2013). Consciousness and the Social Brain. OUP USA. ISBN   978-0-19-992864-4.
  2. 1 2 3 4 5 6 Webb TW, Graziano MS (2015). "The attention schema theory: a mechanistic account of subjective awareness". Front Psychol. 6: 500. doi: 10.3389/fpsyg.2015.00500 . PMC   4407481 . PMID   25954242.
  3. Graziano MS (2016). "Consciousness Engineered" (PDF). Journal of Consciousness Studies. 23 (11–12): 98–115.
  4. 1 2 Frankish K (2016). "Not Disillusioned: Reply to Commentators". Journal of Consciousness Studies. 23 (11–12): 256–289.
  5. Graziano MS (2017-11-14). "The Attention Schema Theory: A Foundation for Engineering Artificial Consciousness". Frontiers in Robotics and AI. 4: 60. doi: 10.3389/frobt.2017.00060 .
  6. 1 2 Webb TW, Kean HH, Graziano MS (2016). "Effects of Awareness on the Control of Attention" (PDF). J Cogn Neurosci. 28 (6): 842–51. doi:10.1162/jocn_a_00931. PMID   26836517. S2CID   9378474.
  7. Kelly YT, Webb TW, Meier JD, Arcaro MJ, Graziano MS (2014). "Attributing awareness to oneself and to others" (PDF). Proc. Natl. Acad. Sci. U.S.A. 111 (13): 5012–7. Bibcode:2014PNAS..111.5012K. doi: 10.1073/pnas.1401201111 . PMC   3977229 . PMID   24639542.
  8. Webb TW, Igelström KM, Schurger A, Graziano MS (2016). "Cortical networks involved in visual awareness independent of visual attention". Proc. Natl. Acad. Sci. U.S.A. 113 (48): 13923–13928. doi: 10.1073/pnas.1611505113 . PMC   5137756 . PMID   27849616.

Further reading