Amodal completion

Last updated

Amodal completion is the ability to see an entire object despite parts of it being covered by another object in front of it. It is one of the many functions of the visual system which aid in both seeing and understanding objects encountered on an everyday basis. [1] This mechanism allows the world to be perceived as though it is made of coherent wholes. For example, when the sun sets over the horizon it is still perceived as a full circle, despite occlusion causing it to appear as a semi-circle. Another example of this is a cat behind a picket fence. Amodal completion allows the cats to be seen as a full animal continuing behind each picket of the fence. [2] Essentially amodal completion allows for sensory stimulation from any parts of an occluded object we can not directly see. [3]

Contents

Neural systems of object recognition

The ability to carry out visual amodal completion relies on a serial order of visual processing steps which occur in a Feed forward control process. This process occurs in the ventral visual stream as information spreads throughout the brain and hits more specialised cells with each step. [4] There are two main stages in completion: initial detection and processing of physical features, and the final representation of the fully completed object. [5] Initial detection is likely to correspond with the mosaic stage and as the process continues, move on to the local or global stages of completion. [3]

The ventral stream (in purple) is involved in object recognition. Ventral-dorsal streams.svg
The ventral stream (in purple) is involved in object recognition.

Initial detection

Visual processing of the occluded stimulus begins in the primary visual cortex (V1), in the occipital lobe of the brain. [5] V1 receives and processes information on the stimulus, extracting specific features such as the orientation of edges and lines within the object. If a stimulus appears in front of this, the cells will respond more vigorously, signalling that further perceptual processing is required. [6]

As V1 primarily consists of simple cells with relatively small receptive fields, responses only occur to smaller, more specific visual cues. [4] Information is then processed by the complex cells of V2, integrating information extracted in V1 and providing a summation of several receptive fields. [7] This allows an increased response pattern to the stimulus, and a higher level of object complexity as information from several sources is combined. This process of integration is modulated by binocular disparity, [6] extracting further information from the simple cells and allowing for processing of depth, colours, spatial frequency, complex patterns and object orientation. [4]

As local contours are detected, they are assigned to the different objects (occluder and stimulus). The information from V2 then continues through the ventral stream to V4 where the contours of each object are completed. [5] Contour completion occurs in accordance with the Gestalt laws of grouping: similarity, closure, figure-ground, continuity and proximity. The automatic utilisation of Gestalt laws allows us to perceive these objects as separate, but does not provide a fully completed image of the occluded stimulus.

Final representations

The final step in the neuropsychological processing of amodal completion is demonstrated in a study by Weigelt et al. (2007). This study used fMRI scanning to show significantly lower levels of activity in the inferior temporal cortex (ITC) during object completion. The scans located three regions within the ITC that may be involved in processing, two in the left hemisphere and one in the right. One of these structures is the lateral occipital complex (LOC). LOC has been identified as the structure involved in representing and identifying the fully completed object exclusive to its occluder. [5] This evidence is consistent with other literature, including Plomp et al. (2006), who utilised MEG scanning to find that both temporal and occipital sensors are involved in object completion. [3]

Stages of Completion

Perception of an object that is partially covered by another depends on a combination of factors that allow us to differentiate between the two, and also decide what the covered object is. These factors may include variations in pattern coherence, colour, and angles. This is important in the visual system to aid in de-cluttering our visual environment, and interpreting information at a faster speed. [1] Amodal completion occurs under a variety of different circumstances, requiring a range of methods to differentiate between the objects. The differentiation of factors in both objects occurs in three stages. These stages may be individual, or build-up to the overall differentiation of singular objects. [1]

Mosaic

The first and fastest stage of amodal completion is mosaic. At this stage, information goes through less processing and is available for interpretation at a faster rate. [3] Contrary to the ideas behind amodal completion – that two objects are defined and separated from each other – mosaic interpretations result in two-dimensional shapes, with the first object ending where the next begins. [3] At the mosaic stage we are only paying attention to the visible components of the visual information. So, the covered object and its occluder are simply presented as cut-out segments that are joined together [1] This stage is the first step in interpreting visual information as two separate, three-dimensional objects.

Local

The mosaic stage becomes inaccessible as the visual stimuli are further defined. [3] Following on from this, completion occurs in one of two forms, depending on the complexity of the object. The next stage in amodal completion is local, which comprises a more linear interpretation of the occluded contours in the covered object. The main objective of local completion is to identify continuation of covered lines, contours, and boundaries in the occluded object without focussing on symmetry. [8] This process relies on the orientation of visible contours and continuation of T-junctions, forming the final interpretation of the covered object.

Global

The final stage in amodal completion is global which is characterised by maintenance of symmetry, regularity and simplicity. [8] This is the predominant mode of object completion, maximising symmetry of the covered object by matching the occluded edges to those you can see. [1] Global completions are more common and less variable than local, but more difficult to memorise as they require integration of more complex perceptual processes, resulting in longer processing speeds. [3]

Whether local or global mechanisms make-up the final stage in amodal completion is dependent on the context the visual stimuli are presented in. This may differ in the environment, object priming, and time allowed which activate certain expectations on how the object should be completed. [9] Longer presentation times facilitate the final stages in amodal completion as we have time to respond to the entire object, and not just the visible parts. [3] Recognition of certain features in the object or the environment surrounding it will also facilitate final completion. This allows for specific interpretation, based on previous experiences of the stimuli. [1] [8]

Theories of completion

Amodal completion is based on our ability to perceive a covered object as a coherent whole. The ability to do so is dependent on the structural characteristics of the object, and our knowledge or previous contact with it. Although both structure and knowledge are important in our perception of an object, the systems are said to function individually. It is suggested that knowledge of how an object should appear takes effect at a later stage in perception, and competes with the original structural information collected. [6] For example, in a picture of two horses with a block through the middle, this may originally be perceived as an elongated horse until our perceptual tendencies adapt and we take into account our knowledge on how a horse should actually appear. [10]

Structural theories

The structural characteristics used to define objects are very similar to the Gestalt laws of grouping. [9]

Knowledge theories

Knowledge is an important factor of amodal completion, allowing our prior contact with features of the object to impact our perception of it. There are several factors which affect our knowledge of objects:

Other senses

Amodal completion is typically described as a visual ability, but also occurs with our other senses. For example, auditory amodal completion may occur when we are listening to music, and briefly interrupted by an external sound. Although we are briefly distracted by this, the auditory system will allow the song to continue, as though the interruption never occurred. This also occurs with tactile amodal completion, allowing us the ability to sense that an object continues despite only receiving tactile stimulation from a portion of it [10]

Related Research Articles

Perception Organization, identification, and interpretation of sensory information in order to represent and understand the environment

Perception is the organization, identification, and interpretation of sensory information in order to represent and understand the presented information or environment.

Optical illusion Visually perceived images that differ from objective reality

Within visual perception, an optical illusion is an illusion caused by the visual system and characterized by a visual percept that arguably appears to differ from reality. Illusions come in a wide variety; their categorization is difficult because the underlying cause is often not clear but a classification proposed by Richard Gregory is useful as an orientation. According to that, there are three main classes: physical, physiological, and cognitive illusions, and in each class there are four kinds: Ambiguities, distortions, paradoxes, and fictions. A classical example for a physical distortion would be the apparent bending of a stick half immerged in water; an example for a physiological paradox is the motion aftereffect. An example for a physiological fiction is an afterimage. Three typical cognitive distortions are the Ponzo, Poggendorff, and Müller-Lyer illusion. Physical illusions are caused by the physical environment, e.g. by the optical properties of water. Physiological illusions arise in the eye or the visual pathway, e.g. from the effects of excessive stimulation of a specific receptor type. Cognitive visual illusions are the result of unconscious inferences and are perhaps those most widely known.

Gestalt psychology Theory of mind examining human perception, structures and organizing principles in sensory impressions

Gestalt psychology, gestaltism or configurationism is a school of psychology that emerged in the early twentieth century in Austria and Germany as a theory of perception that was a rejection of basic principles of Wilhelm Wundt's and Edward Titchener's elementalist and structuralist psychology.

Phi phenomenon Optical illusion of perceiving continuous motion between separate objects viewed rapidly in succession

The term phi phenomenon is used in a narrow sense for an apparent motion that is observed if two nearby optical stimuli are presented in alternation with a relatively high frequency. In contrast to beta movement, seen at lower frequencies, the stimuli themselves do not appear to move. Instead, a diffuse, amorphous shadowlike something seems to jump in front of the stimuli and occlude them temporarily. This shadow seems to have nearly the color of the background. Max Wertheimer first described this form of apparent movement in his habilitation thesis, published 1912, marking the birth of Gestalt psychology.

Structural information theory (SIT) is a theory about human perception and in particular about visual perceptual organization, which is the neuro-cognitive process that enables us to perceive scenes as structured wholes consisting of objects arranged in space. It has been applied to a wide range of research topics, mostly in visual form perception but also in, for instance, visual ergonomics, data visualization, and music perception.

Ambiguous image image that exploits graphical similarities between two or more distinct images

Ambiguous images or reversible figures are visual forms which create ambiguity by exploiting graphical similarities and other properties of visual system interpretation between two or more distinct image forms. These are famous for inducing the phenomenon of multistable perception. Multistable perception is the occurrence of an image being able to provide multiple, although stable, perceptions.

Inattentional blindness or perceptual blindness occurs when an individual fails to perceive an unexpected stimulus in plain sight, purely as a result of a lack of attention rather than any vision defects or deficits. When it becomes impossible to attend to all the stimuli in a given situation, a temporary “blindness” effect can occur, as individuals fail to see unexpected but often salient objects or stimuli.

Amodal perception is the perception of the whole of a physical structure when only parts of it affect the sensory receptors. For example, a table will be perceived as a complete volumetric structure even if only part of it—the facing surface—projects to the retina; it is perceived as possessing internal volume and hidden rear surfaces despite the fact that only the near surfaces are exposed to view. Similarly, the world around us is perceived as a surrounding plenum, even though only part of it is in view at any time. Another much quoted example is that of the "dog behind a picket fence" in which a long narrow object is partially occluded by fence-posts in front of it, but is nevertheless perceived as a single continuous object. Albert Bregman noted an auditory analogue of this phenomenon: when a melody is interrupted by bursts of white noise, it is nonetheless heard as a single melody continuing "behind" the bursts of noise.

Associative visual agnosia Medical condition

Associative visual agnosia is a form of visual agnosia. It is an impairment in recognition or assigning meaning to a stimulus that is accurately perceived and not associated with a generalized deficit in intelligence, memory, language or attention. The disorder appears to be very uncommon in a "pure" or uncomplicated form and is usually accompanied by other complex neuropsychological problems due to the nature of the etiology. Afflicted individuals can accurately distinguish the object, as demonstrated by the ability to draw a picture of it or categorize accurately, yet they are unable to identify the object, its features or its functions.

Visual search is a type of perceptual task requiring attention that typically involves an active scan of the visual environment for a particular object or feature among other objects or features. Visual search can take place with or without eye movements. The ability to consciously locate an object or target amongst a complex array of stimuli has been extensively studied over the past 40 years. Practical examples of using visual search can be seen in everyday life, such as when one is picking out a product on a supermarket shelf, when animals are searching for food among piles of leaves, when trying to find a friend in a large crowd of people, or simply when playing visual search games such as Where's Wally?

Illusory contours Visual illusions

Illusory contours or subjective contours are visual illusions that evoke the perception of an edge without a luminance or color change across that edge. Illusory brightness and depth ordering often accompany illusory contours. Friedrich Schumann is often credited with the discovery of illusory contours around the beginning of the 20th century, but they are present in art dating to the Middle Ages. Gaetano Kanizsa’s 1976 Scientific American paper marked the resurgence of interest in illusory contours for vision scientists.

Visual Neuroscience is a branch of neuroscience that focuses on the visual system of the human body, mainly located in the brain's visual cortex. The main goal of visual neuroscience is to understand how neural activity results in visual perception, as well as behaviors dependent on vision. In the past, visual neuroscience has focused primarily on how the brain responds to light rays projected from static images and onto the retina. While this provides a reasonable explanation for the visual perception of a static image, it does not provide an accurate explanation for how we perceive the world as it really is, an ever-changing, and ever-moving 3-D environment. The topics summarized below are representative of this area, but far from exhaustive. To be less topic specific, one can see this textbook for the computational link between neural activities and visual perception and behavior: "Understanding vision: theory, models, and data", published by Oxford University Press 2014.

Filling-in

In vision, filling-in phenomena are those responsible for the completion of missing information across the physiological blind spot, and across natural and artificial scotomata. There is also evidence for similar mechanisms of completion in normal visual analysis. Classical demonstrations of perceptual filling-in involve filling in at the blind spot in monocular vision, and images stabilized on the retina either by means of special lenses, or under certain conditions of steady fixation. For example, naturally in monocular vision at the physiological blind spot, the percept is not a hole in the visual field, but the content is “filled-in” based on information from the surrounding visual field. When a textured stimulus is presented centered on but extending beyond the region of the blind spot, a continuous texture is perceived. This partially inferred percept is paradoxically considered more reliable than a percept based on external input..

Visual perception Ability to interpret the surrounding environment using light in the visible spectrum

Visual perception is the ability to interpret the surrounding environment through photopic vision, color vision, scotopic vision, and mesopic vision, using light in the visible spectrum reflected by objects in the environment. This is different from visual acuity, which refers to how clearly a person sees. A person can have problems with visual perceptual processing even if they have 20/20 vision.

The principles of grouping are a set of principles in psychology, first proposed by Gestalt psychologists to account for the observation that humans naturally perceive objects as organized patterns and objects, a principle known as Prägnanz. Gestalt psychologists argued that these principles exist because the mind has an innate disposition to perceive patterns in the stimulus based on certain rules. These principles are organized into five categories: Proximity, Similarity, Continuity, Closure, and Connectedness.

Watercolor illusion

The watercolor illusion, also referred to as the water-color effect, is an optical illusion in which a white area takes on a pale tint of a thin, bright, intensely colored polygon surrounding it if the coloured polygon is itself surrounded by a thin, darker border. The inner and outer borders of watercolor illusion objects often are of complementary colours. The watercolor illusion is best when the inner and outer contours have chromaticities in opposite directions in color space. The most common complementary pair is orange and purple. The watercolor illusion is dependent on the combination of luminance and color contrast of the contour lines in order to have the color spreading effect occur.

Pre-attentive processing is the subconscious accumulation of information from the environment. All available information is pre-attentively processed. Then, the brain filters and processes what is important. Information that has the highest salience or relevance to what a person is thinking about is selected for further and more complete analysis by conscious (attentive) processing. Understanding how pre-attentive processing works is useful in advertising, in education, and for prediction of cognitive ability.

Form perception is the recognition of visual elements of objects, specifically those to do with shapes, patterns and previously identified important characteristics. An object is perceived by the retina as a two-dimensional image,[1] but the image can vary for the same object in terms of the context with which it is viewed, the apparent size of the object, the angle from which it is viewed, how illuminated it is, as well as where it resides in the field of vision.[2] Despite the fact that each instance of observing an object leads to a unique retinal response pattern, the visual processing in the brain is capable of recognizing these experiences as analogous, allowing invariant object recognition. recognition|object recognition]]. Visual processing occurs in a hierarchy with the lowest levels recognizing lines and contours, and slightly higher levels performing tasks such as completing boundaries and recognizing contour combinations. The highest levels integrate the perceived information to recognize an entire object. Essentially object recognition is the ability to assign labels to objects in order to categorize and identify them, thus distinguishing one object from another. During visual processing information is not created, but rather reformatted in a way that draws out the most detailed information of the stimulus.

Phantom contour

A phantom contour is a type of illusory contour. Most illusory contours are seen in still images, such as the Kanizsa triangle and the Ehrenstein illusion. A phantom contour, however, is perceived in the presence of moving or flickering images with contrast reversal. The rapid, continuous alternation between opposing, but correlated, adjacent images creates the perception of a contour that is not physically present in the still images. Quaid et al. have also authored a PhD thesis on the phantom contour illusion and its spatiotemporal limits which maps out limits and proposes mechanisms for its perception centering around magnocellularly driven visual area MT.

Biased competition theory advocates the idea that each object in the visual field competes for cortical representation and cognitive processing. This theory suggests that the process of visual processing can be biased by other mental processes such as bottom-up and top-down systems which prioritize certain features of an object or whole items for attention and further processing. Biased competition theory is, simply stated, the competition of objects for processing. This competition can be biased, often toward the object that is currently attended in the visual field, or alternatively toward the object most relevant to behavior.

References

  1. 1 2 3 4 5 6 Chen, S. Muller, H. J., & Conci, M. (2016). Amodal completion in visual working memory. Journal of Experimental Psychology, 42(9), 1344-1353.
  2. Emmanouil, T. A., & Ro, T. (2014). Amodal completion of unconsciously presented objects. Psychonomic Bulletin and Review, 21, 1188-1194.
  3. 1 2 3 4 5 6 7 8 Plomp, G., Liu, L., van Leeuwan, C., & Ioannides, A. A. (2006).The “mosaic stage” in amodal completion as characterised by magnetocephelography. Journal of Cognitive Neuroscience, 18(8), 1394-1905.
  4. 1 2 3 Huff, T., & Tadi, P. (2019). Neuroanatomy, Visual Cortex. Retrieved from https://www.ncbi.nlm.nih.gov/books/NBK482504/
  5. 1 2 3 4 Weigelt, S., Singer, W., & Muckli, L. (2007). Separate cortical stages in amodal completion revealed by functional magnetic resonance adaptation. BMC Neuroscience, 8(70).
  6. 1 2 3 Briscoe, R. E. (2011). Mental imagery and the varieties of amodal perception. Pacific Philosophical Quarterly, 92, 153-173.
  7. Lin, Z., & He, S. (2012). Emergent filling in induced by motion integration reveals a high-level mechanism in filling in. Psychological Science, 23(12), 1534-1541.
  8. 1 2 3 Dadam, J., Albertazzi, L., Canal. L., & Micciolo, R. (2012). Amodal completion of boundaries in coloured surfaces. Psychologia, 55, 227-254.
  9. 1 2 3 4 5 Yun, X., Hazenberg, S. J., & van Lier, R. (2018). Temporal properties of amodal completion: Influences of knowledge. Vision Research, 145, 21-30.
  10. 1 2 Nanay, B. (2018). The importance of amodal completion in everyday perception. I-Perception, 9(4), 1-16
  11. Lee, H., & Vecera, S. P. (2005). Visual cognition influences early vision: the role of visual short-term memory in amodal completion. Psychological Science, 16(10), 763–768.
  12. Plomp, G., & van Leeuwen, C. (2006). Asymmetric priming effects in visual processing of occlusion patterns. Perception & Psychophysics, 68(6), 946–958
  13. Hazenberg, S. J., Jongsma, M. L. A., Koning, A., & van Lier, R. (2014). Differential familiarity effects in amodal completion: support from behavioral and electrophysiological measurements. Journal of Experimental Psychology: Human Perception and Performance, 40(2), 669–684