A mental representation (or cognitive representation), in philosophy of mind, cognitive psychology, neuroscience, and cognitive science, is a hypothetical internal cognitive symbol that represents external reality or its abstractions. [1] [2]
Mental representation is the mental imagery of things that are not actually present to the senses. [3] In contemporary philosophy, specifically in fields of metaphysics such as philosophy of mind and ontology, a mental representation is one of the prevailing ways of explaining and describing the nature of ideas and concepts.
Mental representations (or mental imagery) enable representing things that have never been experienced as well as things that do not exist. [4] Our brains and mental imageries allow us to imagine things have either never happened or are impossible and do not exist. Although visual imagery is more likely to be recalled, mental imagery may involve representations in any of the sensory modalities, such as hearing, smell, or taste. Stephen Kosslyn proposes that images are used to help solve certain types of problems. We are able to visualize the objects in question and mentally represent the images to solve it. [4]
Mental representations also allow people to experience things right in front of them—however, the process of how the brain interprets and stores the representational content is debated. [5]
Representationalism (also known as indirect realism) is the view that representations are the main way we access external reality.
The representational theory of mind attempts to explain the nature of ideas, concepts and other mental content in contemporary philosophy of mind, cognitive science and experimental psychology. In contrast to theories of naïve or direct realism, the representational theory of mind postulates the actual existence of mental representations which act as intermediaries between the observing subject and the objects, processes or other entities observed in the external world. These intermediaries stand for or represent to the mind the objects of that world.
The original or "classical" representational theory probably can be traced back to Thomas Hobbes and was a dominant theme in classical empiricism in general. According to this version of the theory, the mental representations were images (often called "ideas") of the objects or states of affairs represented. For modern adherents, such as Jerry Fodor and Steven Pinker, the representational system consists rather of an internal language of thought (i.e., mentalese). The contents of thoughts are represented in symbolic structures (the formulas of mentalese) which, analogously to natural languages but on a much more abstract level, possess a syntax and semantics very much like those of natural languages. For the Portuguese logician and cognitive scientist Luis M. Augusto, at this abstract, formal level, the syntax of thought is the set of symbol rules (i.e., operations, processes, etc. on and with symbol structures) and the semantics of thought is the set of symbol structures (concepts and propositions). Content (i.e., thought) emerges from the meaningful co-occurrence of both sets of symbols. For instance, "8 x 9" is a meaningful co-occurrence, whereas "CAT x §" is not; "x" is a symbol rule called for by symbol structures such as "8" and "9", but not by "CAT" and "§". [6]
Canadian philosopher P. Thagard noted in his work "Introduction to Cognitive Science", that "most cognitive scientists agree that knowledge in the human mind consists of mental representations" and that "cognitive science asserts: that people have mental procedures that operate by means of mental representations for the implementation of thinking and action" [7]
There are two types of representationalism, strong and weak. Strong representationalism attempts to reduce phenomenal character to intentional content. On the other hand, weak representationalism claims only that phenomenal character supervenes on intentional content. Strong representationalism aims to provide a theory about the nature of phenomenal character, and offers a solution to the hard problem of consciousness. In contrast to this, weak representationalism does not aim to provide a theory of consciousness, nor does it offer a solution to the hard problem of consciousness.
Strong representationalism can be further broken down into restricted and unrestricted versions. The restricted version deals only with certain kinds of phenomenal states e.g. visual perception. Most representationalists endorse an unrestricted version of representationalism. According to the unrestricted version, for any state with phenomenal character that state's phenomenal character reduces to its intentional content. Only this unrestricted version of representationalism is able to provide a general theory about the nature of phenomenal character, as well as offer a potential solution to the hard problem of consciousness. The successful reduction of the phenomenal character of a state to its intentional content would provide a solution to the hard problem of consciousness once a physicalist account of intentionality is worked out.
When arguing against the unrestricted version of representationalism people will often bring up phenomenal mental states that appear to lack intentional content. The unrestricted version seeks to account for all phenomenal states. Thus, for it to be true, all states with phenomenal character must have intentional content to which that character is reduced. Phenomenal states without intentional content therefore serve as a counterexample to the unrestricted version. If the state has no intentional content its phenomenal character will not be reducible to that state's intentional content, for it has none to begin with.
A common example of this kind of state are moods. Moods are states with phenomenal character that are generally thought to not be directed at anything in particular. Moods are thought to lack directedness, unlike emotions, which are typically thought to be directed at particular things. People conclude that because moods are undirected they are also nonintentional i.e. they lack intentionality or aboutness. Because they are not directed at anything they are not about anything. Because they lack intentionality they will lack any intentional content. Lacking intentional content their phenomenal character will not be reducible to intentional content, refuting the representational doctrine.
Though emotions are typically considered as having directedness and intentionality this idea has also been called into question. One might point to emotions a person all of a sudden experiences that do not appear to be directed at or about anything in particular. Emotions elicited by listening to music are another potential example of undirected, nonintentional emotions. Emotions aroused in this way do not seem to necessarily be about anything, including the music that arouses them. [8]
In response to this objection, a proponent of representationalism might reject the undirected non-intentionality of moods, and attempt to identify some intentional content they might plausibly be thought to possess. The proponent of representationalism might also reject the narrow conception of intentionality as being directed at a particular thing, arguing instead for a broader kind of intentionality.
There are three alternative kinds of directedness/intentionality one might posit for moods. [8]
In the case of outward directedness, moods might be directed at either the world as a whole, a changing series of objects in the world, or unbound emotion properties projected by people onto things in the world. In the case of inward directedness, moods are directed at the overall state of a person's body. In the case of hybrid, directedness moods are directed at some combination of inward and outward things.
Even if one can identify some possible intentional content for moods we might still question whether that content is able to sufficiently capture the phenomenal character of the mood states they are a part of. Amy Kind contends that in the case of all the previously mentioned kinds of directedness (outward, inward, and hybrid) the intentional content supplied to the mood state is not capable of sufficiently capturing the phenomenal aspects of the mood states. [8] In the case of inward directedness, the phenomenology of the mood does not seem tied to the state of one's body, and even if one's mood is reflected by the overall state of one's body that person will not necessarily be aware of it, demonstrating the insufficiency of the intentional content to adequately capture the phenomenal aspects of the mood. In the case of outward directedness, the phenomenology of the mood and its intentional content does not seem to share the corresponding relation they should given that the phenomenal character is supposed to reduce to the intentional content. Hybrid directedness, if it can even get off the ground, faces the same objection.
There is a wide debate on what kinds of representations exist. There are several philosophers who bring about different aspects of the debate. Such philosophers include Alex Morgan, Gualtiero Piccinini, and Uriah Kriegel.
There are "job description" representations. [1] That is representations that represent something—have intentionality, have a special relation—the represented object does not need to exist, and content plays a causal role in what gets represented:.
Structural representations are also important. [1] These types of representations are basically mental maps that we have in our minds that correspond exactly to those objects in the world (the intentional content). According to Morgan, structural representations are not the same as mental representations—there is nothing mental about them: plants can have structural representations.
There are also internal representations. [1] These types of representations include those that involve future decisions, episodic memories, or any type of projection into the future.
In Gualtiero Piccinini's forthcoming work, he discusses topics on natural and nonnatural mental representations. He relies on the natural definition of mental representations given by Grice (1957) [9] where P entails that P. e.g. Those spots mean measles, entails that the patient has measles. Then there are nonnatural representations: P does not entail P. e.g. The 3 rings on the bell of a bus mean the bus is full—the rings on the bell are independent of the fullness of the bus—we could have assigned something else (just as arbitrary) to signify that the bus is full.
There are also objective and subjective mental representations. [10] Objective representations are closest to tracking theories—where the brain simply tracks what is in the environment. Subjective representations can vary person-to-person. The relationship between these two types of representation can vary.
Eliminativists think that subjective representations do not exist. Reductivists think subjective representations are reducible to objective. Non-reductivists think that subjective representations are real and distinct. [10]
In the field of cognitive psychology, mental representations refer to patterns of neural activity that encode abstract concepts or representational “copies” of sensory information from the outside world. [11] For example, our iconic memory can store a brief sensory copy of visual information, lasting a fraction of a second. This allows the brain to process visual details about a brief visual event, like another car driving past on the highway. Other mental representations are more abstract, like goals, conceptual representations, or verbal labels (“car”).
Functional Magnetic Resonance Imaging (fMRI) is a powerful tool in cognitive science for exploring the neural correlates of mental representations. “A powerful feature of event-related fMRI is that the experimenter can choose to combine the data from completed scans in many different ways.” [12]
Functional Magnetic Resonance Imaging (fMRI) is a powerful tool in cognitive science for exploring the neural correlates of mental representations. For instance, if participants are instructed to visualize a certain object or scene, fMRI can determine the engaged brain regions (primary visual cortex for visual imagery; hippocampus for episodic memory). By recording patterns of brain activity, functional magnetic resonance imaging (fMRI) can be used to quantify and decode different kinds of mental representations. Certain ideas, perceptions, or mental images may be associated with these patterns, which are a reflection of underlying neurological processes. For example, one study tested if fMRI could accurately measure the mental representations that are triggered when viewing a simple image. Participants' were shown 1,200 images of natural objects and printed letters while brain activity was recorded from multiple regions of visual cortex (V1-4), lateral occipital complex). Using deep neural networks (DNNs), the authors were then able to “recreate” the original images, based only on the brain data. These reconstructed images were remarkably similar to the original, preserving important elements like texture, shape, and color. A new group of participants was able to correctly identify the original image based on the reconstructed image 95 percent of the time.
For instance, if participants are instructed to visualize a certain object or scene, fMRI can determine the engaged brain regions (primary visual cortex for visual imagery; hippocampus for episodic memory). Such patterns provide a glimpse into neural encoding of mental states, and act as bridges between neural activity and subjective experience. Advocates for cognitive science consider fMRI research critical to exposing how mental representations are spread and overlapped. These methods have demonstrated that conceptual representations, such as "tools" versus "animals," are not limited to discrete brain regions but rather span networks encompassing associative, motor, and sensory regions. This illustrates how mental models combine semantic and perceptual aspects to provide a more complex and dynamic view of cognition. Furthermore, by showing how experiences gradually alter mental representations, fMRI research has advanced our understanding of brain plasticity. fMRI offers a glimpse into the brain underpinnings of thought and organization by mapping these processes. [13]
Multi-Voxel Pattern Analysis is a data processing method that is used to analyze multiple sets of patterns simultaneously. This analysis is also commonly used in cognitive psychology, to examine brain imaging data when paired with fMRI. This testing essentially allows researchers to analyze whether a particular mental representation is active within a particular brain region. With fMRI activation, the visual perception of the brain can be analyzed and decoded. In certain regions of the brain, such as the retinotopic region, researchers have the ability to predict features of the visual perception, such as lines or patterns, the awareness of the individual, features that weren’t originally analyzed, as well as the identifying perceived images of an individual. After thorough research, studies have shown that patterns of imagery and perception are more seen in the ventral temporal cortex, than they are in the retinotopic region of the brain. These results show that without new information entering the brain, it has the ability to reactivate certain patterns of neural activity that have been active before. [14] With this analysis, researchers are able to understand the process in which the brain decodes information and identify ways in which this information is represented.
When scientists study the brain, they want to understand how our thoughts, feelings, and perceptions are represented in brain activity. One way they do this is through something called neural decoding, where they try to figure out what’s going on in the brain by analyzing patterns of brain activity. There are two main ways to approach this: restricted decoding and unrestricted decoding. Here’s how they differ:
Restricted decoding is when scientists focus on brain activity tied to a specific task or stimulus. Basically, it’s when you do something like recognize an object, solve a problem, or look at a picture and scientists track the brain activity related to that task. For example, if you look at a picture of a face, certain areas of your brain will light up in a predictable way. Researchers can then study these patterns and "decode" the brain activity to figure out what you’re seeing or thinking. [15]
So, restricted decoding is pretty focused. The brain activity is tied to one thing, like a specific object or task. The goal is to figure out how the brain represents specific things (like seeing a face or recognizing a word) when you're actively engaging with something.
For example, with fMRI scans, researchers can track brain activity while people look at different objects or images. They can use this data to predict what the person is seeing based on the neural patterns, since those patterns are relatively consistent when someone is exposed to the same thing (like a particular image or object).
Unrestricted decoding is a bit more relaxed. Instead of focusing on a task, researchers look at brain activity when people aren’t doing anything in particular, for example when you’re resting or thinking freely. This approach is more about understanding general mental states or abstract thoughts that aren't linked to a specific task or stimulus. [16]
For example, someone might just be asked to relax and think about whatever comes to mind. Researchers would then try to decode the brain patterns to figure out what’s going on in their head, whether they're feeling happy, sad, or even daydreaming. Since the brain is in a more free-flowing state, the patterns are a lot less predictable, and scientists often use fancy tools like machine learning to help interpret the data.
In other words, unrestricted decoding is about trying to figure out what's happening in the brain when it's not responding to a clear task, this includes what kinds of emotions, memories, or random thoughts are popping up.
Cognitive science is the interdisciplinary, scientific study of the mind and its processes. It examines the nature, the tasks, and the functions of cognition. Mental faculties of concern to cognitive scientists include perception, memory, attention, reasoning, language, and emotion; to understand these faculties, cognitive scientists borrow from fields such as psychology, artificial intelligence, philosophy, neuroscience, linguistics and anthropology. The typical analysis of cognitive science spans many levels of organization, from learning and decision-making to logic and planning; from neural circuitry to modular brain organization. One of the fundamental concepts of cognitive science is that "thinking can best be understood in terms of representational structures in the mind and computational procedures that operate on those structures."
The philosophy of perception is concerned with the nature of perceptual experience and the status of perceptual data, in particular how they relate to beliefs about, or knowledge of, the world. Any explicit account of perception requires a commitment to one of a variety of ontological or metaphysical views. Philosophers distinguish internalist accounts, which assume that perceptions of objects, and knowledge or beliefs about them, are aspects of an individual's mind, and externalist accounts, which state that they constitute real aspects of the world external to the individual. The position of naïve realism—the 'everyday' impression of physical objects constituting what is perceived—is to some extent contradicted by the occurrence of perceptual illusions and hallucinations and the relativity of perceptual experience as well as certain insights in science. Realist conceptions include phenomenalism and direct and indirect realism. Anti-realist conceptions include idealism and skepticism. Recent philosophical work have expanded on the philosophical features of perception by going beyond the single paradigm of vision.
Intentionality is the mental ability to refer to or represent something. Sometimes regarded as the mark of the mental, it is found in mental states like perceptions, beliefs or desires. For example, the perception of a tree has intentionality because it represents a tree to the perceiver. A central issue for theories of intentionality has been the problem of intentional inexistence: to determine the ontological status of the entities which are the objects of intentional states.
Experience refers to conscious events in general, more specifically to perceptions, or to the practical knowledge and familiarity that is produced by these processes. Understood as a conscious event in the widest sense, experience involves a subject to which various items are presented. In this sense, seeing a yellow bird on a branch presents the subject with the objects "bird" and "branch", the relation between them and the property "yellow". Unreal items may be included as well, which happens when experiencing hallucinations or dreams. When understood in a more restricted sense, only sensory consciousness counts as experience. In this sense, experience is usually identified with perception and contrasted with other types of conscious events, like thinking or imagining. In a slightly different sense, experience refers not to the conscious events themselves but to the practical knowledge and familiarity they produce. Hence, it is important that direct perceptual contact with the external world is the source of knowledge. So an experienced hiker is someone who has actually lived through many hikes, not someone who merely read many books about hiking. This is associated both with recurrent past acquaintance and the abilities learned through them.
Eliminative materialism is a materialist position in the philosophy of mind. It is the idea that the majority of mental states in folk psychology do not exist. Some supporters of eliminativism argue that no coherent neural basis will be found for many everyday psychological concepts such as belief or desire, since they are poorly defined. The argument is that psychological concepts of behavior and experience should be judged by how well they reduce to the biological level. Other versions entail the nonexistence of conscious mental states such as pain and visual perceptions.
In the philosophy of mind, neuroscience, and cognitive science, a mental image is an experience that, on most occasions, significantly resembles the experience of "perceiving" some object, event, or scene but occurs when the relevant object, event, or scene is not actually present to the senses. There are sometimes episodes, particularly on falling asleep and waking up, when the mental imagery may be dynamic, phantasmagoric, and involuntary in character, repeatedly presenting identifiable objects or actions, spilling over from waking events, or defying perception, presenting a kaleidoscopic field, in which no distinct object can be discerned. Mental imagery can sometimes produce the same effects as would be produced by the behavior or experience imagined.
The language of thought hypothesis (LOTH), sometimes known as thought ordered mental expression (TOME), is a view in linguistics, philosophy of mind and cognitive science, forwarded by American philosopher Jerry Fodor. It describes the nature of thought as possessing "language-like" or compositional structure. On this view, simple concepts combine in systematic ways to build thoughts. In its most basic form, the theory states that thought, like language, has syntax.
The consciousness and binding problem is the problem of how objects, background, and abstract or emotional features are combined into a single experience. The binding problem refers to the overall encoding of our brain circuits for the combination of decisions, actions, and perception. It is considered a "problem" due to the fact that no complete model exists.
The intentional stance is a term coined by philosopher Daniel Dennett for the level of abstraction in which we view the behavior of an entity in terms of mental properties. It is part of a theory of mental content proposed by Dennett, which provides the underpinnings of his later works on free will, consciousness, folk psychology, and evolution.
Here is how it works: first you decide to treat the object whose behavior is to be predicted as a rational agent; then you figure out what beliefs that agent ought to have, given its place in the world and its purpose. Then you figure out what desires it ought to have, on the same considerations, and finally you predict that this rational agent will act to further its goals in the light of its beliefs. A little practical reasoning from the chosen set of beliefs and desires will in most instances yield a decision about what the agent ought to do; that is what you predict the agent will do.
A mental state, or a mental property, is a state of mind of a person. Mental states comprise a diverse class, including perception, pain/pleasure experience, belief, desire, intention, emotion, and memory. There is controversy concerning the exact definition of the term. According to epistemic approaches, the essential mark of mental states is that their subject has privileged epistemic access while others can only infer their existence from outward signs. Consciousness-based approaches hold that all mental states are either conscious themselves or stand in the right relation to conscious states. Intentionality-based approaches, on the other hand, see the power of minds to refer to objects and represent the world as the mark of the mental. According to functionalist approaches, mental states are defined in terms of their role in the causal network independent of their intrinsic properties. Some philosophers deny all the aforementioned approaches by holding that the term "mental" refers to a cluster of loosely related ideas without an underlying unifying feature shared by all. Various overlapping classifications of mental states have been proposed. Important distinctions group mental phenomena together according to whether they are sensory, propositional, intentional, conscious or occurrent. Sensory states involve sense impressions like visual perceptions or bodily pains. Propositional attitudes, like beliefs and desires, are relations a subject has to a proposition. The characteristic of intentional states is that they refer to or are about objects or states of affairs. Conscious states are part of the phenomenal experience while occurrent states are causally efficacious within the owner's mind, with or without consciousness. An influential classification of mental states is due to Franz Brentano, who argues that there are only three basic kinds: presentations, judgments, and phenomena of love and hate.
Neurophilosophy or the philosophy of neuroscience is the interdisciplinary study of neuroscience and philosophy that explores the relevance of neuroscientific studies to the arguments traditionally categorized as philosophy of mind. The philosophy of neuroscience attempts to clarify neuroscientific methods and results using the conceptual rigor and methods of philosophy of science.
In philosophy of mind, the computational theory of mind (CTM), also known as computationalism, is a family of views that hold that the human mind is an information processing system and that cognition and consciousness together are a form of computation. It is closely related to functionalism, a broader theory that defines mental states by what they do rather than what they're made of.
Creative visualization is the cognitive process of purposefully generating visual mental imagery, with eyes open or closed, simulating or recreating visual perception, in order to maintain, inspect, and transform those images, consequently modifying their associated emotions or feelings, with intent to experience a subsequent beneficial physiological, psychological, or social effect, such as expediting the healing of wounds to the body, minimizing physical pain, alleviating psychological pain including anxiety, sadness, and low mood, improving self-esteem or self-confidence, and enhancing the capacity to cope when interacting with others.
Representational systems is a postulated model from neuro-linguistic programming, a collection of models and methods regarding how the human mind processes and stores information. The central idea of this model is that experience is represented in the mind in sensorial terms, i.e. in terms of the putative five senses, qualia.
Brain-reading or thought identification uses the responses of multiple voxels in the brain evoked by stimulus then detected by fMRI in order to decode the original stimulus. Advances in research have made this possible by using human neuroimaging to decode a person's conscious experience based on non-invasive measurements of an individual's brain activity. Brain reading studies differ in the type of decoding employed, the target, and the decoding algorithms employed.
The self-model is the central concept in the theory of consciousness called the self-model theory of subjectivity (SMT). This concept comprises experiences of ownership, of first person perspective, and of a long-term unity of beliefs and attitudes. These features are instantiated in the prefrontal cortex. This theory is an interdisciplinary approach to understanding and explaining the phenomenology of consciousness and the self. This theory has two core contents, the phenomenal self-model (PSM) and the phenomenal model of the intentionality relation (PMIR). Thomas Metzinger advanced the theory in his 1993 book Subjekt und Selbstmodell.
Guided imagery is a mind-body intervention by which a trained practitioner or teacher helps a participant or patient to evoke and generate mental images that simulate or recreate the sensory perception of sights, sounds, tastes, smells, movements, and images associated with touch, such as texture, temperature, and pressure, as well as imaginative or mental content that the participant or patient experiences as defying conventional sensory categories, and that may precipitate strong emotions or feelings in the absence of the stimuli to which correlating sensory receptors are receptive.
Externalism is a group of positions in the philosophy of mind which argues that the conscious mind is not only the result of what is going on inside the nervous system, but also what occurs or exists outside the subject. It is contrasted with internalism which holds that the mind emerges from neural activity alone. Externalism is a belief that the mind is not just the brain or functions of the brain.
Higher-order theories of consciousness postulate that consciousness consists in perceptions or thoughts about first-order mental states. In particular, phenomenal consciousness is thought to be a higher-order representation of perceptual or quasi-perceptual contents, such as visual images.
James Van Loan Haxby is an American neuroscientist. He currently is a professor in the Department of Psychological and Brain Sciences at Dartmouth College and was the Director for the Dartmouth Center for Cognitive Neuroscience from 2008 to 2021. He is best known for his work on face perception and applications of machine learning in functional neuroimaging.