A hypercomplex cell (currently called an end-stopped cell) is a type of visual processing neuron in the mammalian cerebral cortex. Initially discovered by David Hubel and Torsten Wiesel in 1965, hypercomplex cells are defined by the property of end-stopping, which is a decrease in firing strength with increasingly larger stimuli. The sensitivity to stimulus length is accompanied by selectivity for the specific orientation, motion, and direction of stimuli. For example, a hypercomplex cell may only respond to a line at 45˚ that travels upward. Elongating the line would result in a proportionately weaker response. Ultimately, hypercomplex cells can provide a means for the brain to visually perceive corners and curves in the environment by identifying the ends of a given stimulus . [1]
Visual processing is a term that is used to refer to the brain's ability to use and interpret visual information from the world around us. The process of converting light energy into a meaningful image is a complex process that is facilitated by numerous brain structures and higher level cognitive processes. On an anatomical level, light energy first enters the eye through the cornea, where the light is bent. After passing through the cornea, light passes through the pupil and then lens of the eye, where it is bent to a greater degree and focused upon the retina. The retina is where a group of light-sensing cells, called photoreceptors are located. There are two types of photoreceptors: rods and cones. Rods are sensitive to dim light and cones are better able to transduce bright light. Photoreceptors connect to bipolar cells, which induce action potentials in retinal ganglion cells. These retinal ganglion cells form a bundle at the optic disc, which is a part of the optic nerve. The two optic nerves from each eye meet at the optic chiasm, where nerve fibers from each nasal retina cross which results in the right half of each eye's visual field being represented in the left hemisphere and the left half of each eye's visual fields being represented in the right hemisphere. The optic tract then diverges into two visual pathways, the geniculostriate pathway and the tectopulvinar pathway, which send visual information to the visual cortex of the occipital lobe for higher level processing.
A neuron, also known as a neurone and nerve cell, is an electrically excitable cell that communicates with other cells via specialized connections called synapses. All multicellular organisms except sponges and Trichoplax have neurons. A neuron is the main component of nervous tissue.
The cerebral cortex, also known as the cerebral mantle, is the outer layer of neural tissue of the cerebrum of the brain, in humans and other mammals. It is separated into two cortices, by the longitudinal fissure that divides the cerebrum into the left and right cerebral hemispheres. The two hemispheres are joined beneath the cortex by the corpus callosum. The cerebral cortex is the largest site of neural integration in the central nervous system. It plays a key role in memory, attention, perception, awareness, thought, language, and consciousness.
Hypercomplex cells were originally characterized as the superordinate class of visual processing cells above complex and simple cells. Whereas complex cells were sensitive to moving stimuli of specific orientations that travel in a specific direction, simple cells only responded to properly oriented linear stimuli. Neither simple nor complex cells were believed to display end-stopping. Likewise, end-stopping was believed to be restricted to higher order visual areas (Brodmann area 18 and Brodmann area 19), but was later discovered to also exist in the primary visual cortex (Brodmann area 17). By 1968, Geoffrey Henry and Bogdan Dreher discovered simple and complex cells with end-stopping properties. Subsequently, hypercomplex cells were no longer recognized as a distinct class but rather a subtype of simple and complex cells. Currently, simple end-stopped and complex end-stopped cells are the terms of choice to describe neurons with end-stopping properties. [1]
Complex cells can be found in the primary visual cortex (V1), the secondary visual cortex (V2), and Brodmann area 19 (V3).
Brodmann area 19, or BA 19, is part of the occipital lobe cortex in the human brain. Along with area 18, it comprises the extrastriate cortex. In humans with normal sight, extrastriate cortex is a visual association area, with feature-extracting, shape recognition, attentional, and multimodal integrating functions.
Knowledge of cortical function was relatively limited by the 1950s. However, towards the end of the decade, the platform for understanding the cortex was being laid out. Investigations into the localization of function as well as the advent of single-cell recordings of neurons fostered greater insights into the processing of information from sensation to perception. With reference to vision, Stephen Kuffler discovered areas of the retina, termed receptive fields, that upon stimulation, would influence the firing of ganglion cells. [2] These fields comprised two concentric layers, one excitatory and the other inhibitory. One type of receptive field was described as on-centre, containing an excitatory centre and an inhibitory surround, while the other type was termed off-centre, containing an inhibitory centre and an excitatory surround. Similar receptive fields were discovered in the lateral geniculate nucleus (LGN). [2]
In neuroscience, single-unit recordings provide a method of measuring the electro-physiological responses of single neurons using a microelectrode system. When a neuron generates an action potential, the signal propagates down the neuron as a current which flows in and out of the cell through excitable membrane regions in the soma and axon. A microelectrode is inserted into the brain, where it can record the rate of change in voltage with respect to time. These microelectrodes must be fine-tipped, high-impedance conductors; they are primarily glass micro-pipettes or metal microelectrodes made of platinum or tungsten. Microelectrodes can be carefully placed close to the cell membrane, allowing the ability to record extracellularly.
Stephen William Kuffler was a pre-eminent Hungarian-American neurophysiologist. He is often referred to as the "Father of Modern Neuroscience". Kuffler, alongside noted Nobel Laureates Sir John Eccles and Sir Bernard Katz gave research lectures at the University of Sydney, strongly influencing its intellectual environment while working at Sydney Hospital. He founded the Harvard Neurobiology department in 1966, and made numerous seminal contributions to our understanding of vision, neural coding, and the neural implementation of behavior. He is known for his research on neuromuscular junctions in frogs, presynaptic inhibition, and the neurotransmitter GABA. In 1972, he was awarded the Louisa Gross Horwitz Prize from Columbia University.
The retina is the innermost, light-sensitive layer of tissue of the eye of most vertebrates and some molluscs. The optics of the eye create a focused two-dimensional image of the visual world on the retina, which translates that image into electrical neural impulses to the brain to create visual perception, the retina serving a function analogous to that of the film or image sensor in a camera.
Two doctoral students in Kuffler’s lab at Johns Hopkins University, David Hubel and Torsten Wiesel, were tasked with extending his work from retinal ganglion cells to the visual cortex. Hubel and Wiesel began recording cells in the cortex while presenting spots of light as stimuli. To start, the two had failed to produce any promising recordings, as the cells would not respond to the given stimuli. However, while inserting the glass slide into the projector, a strong signal was immediately elicited. Serendipitously, Hubel and Wiesel had discovered that the cell was not responding to spots but to edges, namely the slide’s shadow as it was placed into the projector. [2] [3]
Johns Hopkins University is a private research university in Baltimore, Maryland. Founded in 1876, the university was named for its first benefactor, the American entrepreneur, abolitionist, and philanthropist Johns Hopkins. His $7 million bequest —of which half financed the establishment of Johns Hopkins Hospital—was the largest philanthropic gift in the history of the United States up to that time. Daniel Coit Gilman, who was inaugurated as the institution's first president on February 22, 1876, led the university to revolutionize higher education in the U.S. by integrating teaching and research. Adopting the concept of a graduate school from Germany's ancient Heidelberg University, Johns Hopkins University is considered the first research university in the United States. Over the course of several decades, the university has led all U.S. universities in annual research and development expenditures. In fiscal year 2016, Johns Hopkins spent nearly $2.5 billion on research.
The visual cortex of the brain is that part of the cerebral cortex which processes visual information. It is located in the occipital lobe. Visual nerves run straight from the eye to the primary visual cortex to the Visual Association cortex.
Hubel and Wiesel would later call this cell a complex cell, incorporating it into a hierarchy of subsequently discovered visual processing cells, which included the centre-surround, simple, complex, and hypercomplex cells (distinguishable by receptive fields) [4]
Cell Type | Selectivity | Location |
---|---|---|
Simple | orientation, position | Brodmann area 17 |
Complex | orientation, motion, direction | Brodmann area 17 and 18 |
Hypercomplex | orientation, motion, direction, length | Brodmann areas 18 and 19 |
Following their initial finding, Hubel and Wiesel discovered the presence of a variety of visual processing cells, each with unique receptive field properties. At the lowest and simplest level of the hierarchy are the aforementioned centre-surround cells of the retinal ganglion and LGN. Next, within the visual cortex, are simple cells. [4] Simple cells exist within the primary visual cortex (Brodmann Area 17). These cells are found specifically in layer IV, at which most outgoing projections from the LGN terminate. [4] The receptive fields of simple cells are non-concentric and linear, in which excitatory and inhibitory regions exist adjacent to one another. Thus, a response is elicited by stationary linear stimuli. Furthermore, the regions exhibit mutual cancellation (antagonism) and produce stronger responses as the stimuli fill more space (spatial summation). A discerning feature of simple cells is that their responses display orientation and positional selectivity. This means that a simple cell fires at an optimal orientation. Elicited responses get progressively weaker as a stimulus's orientation shifts sub-optimally and ceases to fire when at 90˚ from the optimal orientation. Positional selectivity simply refers to the cell's receptiveness to the position of the stimulus within part or all of the excitatory/inhibitory regions. Accordingly, simple cell receptive fields exist in a variety of different geometries and sizes for all possible orientation and positions in the visual field. It is presumed that multiple concentric LGN receptive fields converge in a line to develop a single simple receptive field. [4] [5]
Beyond simple cells are complex cells, which are the most common type in the primary visual cortex (but are also found in Brodmann area 18). Akin to simple cells, complex cell receptive fields are orientation selective. However, unlike simple cells, complex cells do not respond to stationary stimuli. To produce a sustained response, the stimulus must be moving across the receptive field. The motion selectivity of complex cells means that a response is elicited over a vast range of stimulus positions. A substantial number of complex cells also display directional selectivity, such that movement in only one direction produces an optimal response. The cortical architecture of complex cells consists of converging adjacent simple cells with receptive fields that display the same orientation selectivity. To account for the motion selectivity of complex cells, Hubel and Wiesel postulated that the system of simple cells only elicits a brief response to stationary stimuli (i.e. the response adapts). Accordingly, successive stimulations that proceed across the complex receptive field are required to elicit a sustained response; thereby, producing motion selectivity. [4]
Although the above definitions, established by Hubel and Wiesel, are the most widely accepted, some of their contemporaries had initially distinguished the classes along different criteria. In sum, Hubel and Wiesel identified simple cells by discernibly separate excitatory and inhibitory regions that responded to stationary stimuli. Contrastingly, Peter Bishop used other criteria and included moving stimuli within the definition of simple cells. [1]
In addition to Hubel and Wiesel's wiring schemes, multiple alternative and complementary architectures have been put forth to explain the receptive fields of simple and complex cells:
By 1965, the next cell type in Hubel and Wiesel’s hierarchy of visual processing, the hypercomplex cell, was found within Brodmann areas 18 and 19. Upon discovery, hypercomplex cells were defined as, “all cells that exceed complex cells in intricacy of behavior.” [7] Hypercomplex cells displayed selectivity akin to complex cells, responding to moving a stimulus of a specific orientation in a specific direction.
Furthermore, much like the subordinate processing cells, increasing illumination in a particular region elicited stronger responses (i.e. spatial summation). However, this summation was confined to stimuli of a limited size. Extending beyond a specific length, the response would become progressively weaker. This phenomenon is termed end-stopping, and it is the defining property of hypercomplex cells. Hubel and Wiesel characterize these receptive fields as containing activating and antagonistic regions (similar to excitatory/inhibitory regions). For example, the left half of a receptive field can be the activating region, while the antagonistic region lies on the right. Accordingly, the hypercomplex cell will respond, with spatial summation, to stimuli on the left side (within the activating region) insofar as it does not extend further into the right side (antagonistic region). This receptive field would be described as stopped at one end (i.e. the right). Similarly, hypercomplex receptive fields can be stopped at both ends. In this case, a stimulus that extends too far in either direction (e.g. too far left or too far right) will begin to stimulate the antagonistic region and reduce the strength of the cell’s signal. [7] Note that hypercomplex cells are also selective to orientation, motion, and direction. In fact, the activating region will have the same orientation selectivity as the antagonistic region. Thus, only a line that extends into the antagonistic region will decrease response strength, rather than another differently oriented line. One possible scheme for the wiring of hypercomplex cells could comprise excitatory input from a complex cell within the activating region and inhibitory input by complex cells in the outlying antagonistic regions. [4] [8]
Shortly after Hubel and Wiesel included hypercomplexity into their version of the visual processing hierarchy, the notion of a class of hypercomplex cells was contended. In 1968, Geoffrey Henry and Bogdan Dreher discovered simple and complex cells in Brodmann area 17 that exhibited end-stopping properties. [9] Rather than characterizing end-stopping as exclusive to a superordinate class of neurons, it was more appropriate to ascribe it as a property of simple and complex cells. [2] Only a few years later, Charles Gilbert, a graduate student of Hubel and Wiesel, had confirmed end-stopping in the primary visual cortex. [10] Accordingly, the terms simple end-stopped and complex end-stopped were introduced in lieu of the hypercomplex cell. The hypercomplex cells described by Hubel and Wiesel earlier were likely a set of end-stopped complex cells. [11] In his Nobel Prize lecture, Hubel explained that the hierarchy of visual processing cells proved to be more complicated and amorphous than initially believed, noting that the topic began to resemble a “jungle”. [2]
Ultimately, these cells contribute to mechanisms underlying visual perception. A simple end-stopped cell will display length selectivity as well as orientation selectivity. In terms of cortical architecture, it may receive input from ordinary simple cells of identical orientation. [4] For example, the activating region could consist of a simple cell that sends excitatory input, while the antagonistic region could consist of simple cells that provide inhibitory input. A complex end-stopped cell would select for orientation, motion, and direction, but also for length. It could receive input from a set of complex cells, in a similar fashion to the scheme previously mentioned. The activating region could consist of a complex cell that sends excitatory input and the antagonistic region could consist of complex cells that send inhibitory input. [4]
The optimal stimulus for any end-stopped cell is one of a limited length. This translates into a capacity to identify corners (for cells stopped at one end) and curves (for cells stopped at both ends). [4] [12] Likewise, the cortex perceives visual scenes with an emphasis on the edges and borders of objects. [13] The visual processing cells in the cortex respond very poorly to diffuse light but optimally to lines. For instance, a simple cell will only weakly fire if it is entirely illuminated because both the excitatory and inhibitory regions will be stimulated.
If the object were a square, for example, then simple cells with receptive fields that corresponded to the inside of the square would not be stimulated. However, a simple cell with a receptive field that corresponded to the edge of the square would be stimulated as long as the edge lays within its excitatory region. Following suit, complex cells would respond weakly to the interior but strongly to an appropriate edge. Lastly, end-stopped cells would also be stimulated by the corners of the square. An end-stopped cell would not respond to an edge on the side of the square because the line would stimulate both the activating and antagonistic regions simultaneously. For instance, a cell stopped at the right end (i.e. antagonistic region on the right) would be stimulated by the right corner. Although perceiving a square involves much more than the contributions of simple and complex cells, this example illustrates that the edges and borders of a stimulus (without input from the interior) are sufficient to interpret its form. Thus, the mechanism of focusing on edges to translate activation into perception is an efficient use of neural resources.
Although end-stopped cells are a phenomenon of the mammalian visual cortex, there have been discoveries of cells exhibiting end-stopping properties within a variety of other species. For example, the small-target motion detectors (STMDs) of many insects select for small moving targets but are inhibited or unresponsive to larger stimuli. STMDs are used to discern moving insects from surrounding clutter, and are thus vital for pursuit behaviours. [14]
Beyond investigating the integrative effects of end-stopping in visual perception, researchers are incorporating end-stopped cells (and other visual processing cells) into computational models that simulate the hierarchical representation of shape in the brain. [15] [16]
The sensory nervous system is a part of the nervous system responsible for processing sensory information. A sensory system consists of sensory neurons, neural pathways, and parts of the brain involved in sensory perception. Commonly recognized sensory systems are those for vision, hearing, touch, taste, smell, and balance. In short, senses are transducers from the physical world to the realm of the mind where we interpret the information, creating our perception of the world around us.
In physiology, a stimulus is a detectable change in the internal or external environment. The ability of an organism or organ to respond to external stimuli is called sensitivity. When a stimulus is applied to a sensory receptor, it normally elicits or influences a reflex via stimulus transduction. These sensory receptors can receive information from outside the body, as in touch receptors found in the skin or light receptors in the eye, as well as from inside the body, as in chemoreceptors and mechanoreceptors. An internal stimulus is often the first component of a homeostatic control system. External stimuli are capable of producing systemic responses throughout the body, as in the fight-or-flight response. In order for a stimulus to be detected with high probability, its level must exceed the absolute threshold; if a signal does reach threshold, the information is transmitted to the central nervous system (CNS), where it is integrated and a decision on how to react is made. Although stimuli commonly cause the body to respond, it is the CNS that finally determines whether a signal causes a reaction or not.
David Hunter Hubel was a Canadian American neurophysiologist noted for his studies of the structure and function of the visual cortex. He was co-recipient with Torsten Wiesel of the 1981 Nobel Prize in Physiology or Medicine, for their discoveries concerning information processing in the visual system. For much of his career, Hubel was the John Franklin Enders University Professor of Neurobiology at Harvard Medical School. In 1978, Hubel and Wiesel were awarded the Louisa Gross Horwitz Prize from Columbia University.
The receptive field of an individual sensory neuron is the particular region of the sensory space in which a stimulus will modify the firing of that neuron. This region can be a hair in the cochlea or a piece of skin, retina, tongue or other part of an animal's body. Additionally, it can be the space surrounding an animal, such as an area of auditory space that is fixed in a reference system based on the ears but that moves with the animal as it moves, or in a fixed location in space that is largely independent of the animal's location. Receptive fields have been identified for neurons of the auditory system, the somatosensory system, and the visual system.
Motion perception is the process of inferring the speed and direction of elements in a scene based on visual, vestibular and proprioceptive inputs. Although this process appears straightforward to most observers, it has proven to be a difficult problem from a computational perspective, and extraordinarily difficult to explain in terms of neural processing.
Neuronal tuning refers to the hypothesized property of brain cells by which they selectively represent a particular type of sensory, association, motor, or cognitive information. Some neuronal responses have been hypothesized to be optimally tuned to specific patterns through experience. Neuronal tuning can be strong and sharp, as observed in primary visual cortex, or weak and broad, as observed in neural ensembles. Single neurons are hypothesized to be simultaneously tuned to several modalities, such as visual, auditory, and olfactory. Neurons hypothesized to be tuned to different signals are often hypothesized to integrate information from the different sources. In computational models called neural networks, such integration is the major principle of operation. The best examples of neuronal tuning can be seen in the visual, auditory, olfactory, somatosensory, and memory systems, although due to the small number of stimuli tested the generality of neuronal tuning claims is still an open question.
In mathematics, physics, and engineering, spatial frequency is a characteristic of any structure that is periodic across position in space. The spatial frequency is a measure of how often sinusoidal components of the structure repeat per unit of distance. The SI unit of spatial frequency is cycles per meter. In image-processing applications, spatial frequency is often expressed in units of cycles per millimeter or equivalently line pairs per millimeter.
In neurobiology, lateral inhibition is the capacity of an excited neuron to reduce the activity of its neighbors. Lateral inhibition disables the spreading of action potentials from excited neurons to neighboring neurons in the lateral direction. This creates a contrast in stimulation that allows increased sensory perception. It is also referred to as lateral antagonism and occurs primarily in visual processes, but also in tactile, auditory, and even olfactory processing. Cells that utilize lateral inhibition appear primarily in the cerebral cortex and thalamus and make up lateral inhibitory networks (LINs). Artificial lateral inhibition has been incorporated into artificial sensory systems, such as vision chips, hearing systems, and optical mice. An often under-appreciated point is that although lateral inhibition is visualised in a spatial sense, it is also thought to exist in what is known as "lateral inhibition across abstract dimensions." This refers to lateral inhibition between neurons that are not adjacent in a spatial sense, but in terms of modality of stimulus. This phenomenon is thought to aid in colour discrimination.
The neocognitron is a hierarchical, multilayered artificial neural network proposed by Kunihiko Fukushima in the 1980s. It has been used for handwritten character recognition and other pattern recognition tasks, and served as the inspiration for convolutional neural networks.
A simple cell in the primary visual cortex is a cell that responds primarily to oriented edges and gratings. These cells were discovered by Torsten Wiesel and David Hubel in the late 1950s.
The ventrobasal complex (VB) is a relay nucleus of the thalamus for nociceptive stimuli received from nociceptive nerves. The VB consists of the ventral posteromedial nucleus (VPM) and the ventral posterolateral nucleus (VPL). In some species the ventral posterolateral nucleus, pars caudalis is also a part of the VB. The VB gets inputs from the spinothalamic tract, medial lemniscus, and corticothalamic tract. The main output of the VB is the primary somatosensory cortex.
The neural basis of prey detection, recognition, and orientation was studied in depth by Jörg-Peter Ewert in a series of experiments that made the toad visual system a model system in neuroethology. He began by observing the natural prey catching behavior of the common European toad.
Feature detection is a process by which the nervous system sorts or filters complex natural stimuli in order to extract behaviorally relevant cues that have a high probability of being associated with important objects or organisms in their environment, as opposed to irrelevant background or noise.
Monocular deprivation is an experimental technique used by neuroscientists to study central nervous system plasticity. Generally, one of an animal's eyes is sutured shut during a period of high cortical plasticity. This manipulation serves as an animal model for amblyopia, a permanent deficit in visual sensation not due to abnormalities in the eye.
Orientation columns are organized regions of neurons that are excited by visual line stimuli of varying angles. These columns are located in the primary visual cortex (V1) and span multiple cortical layers. The geometry of the orientation columns are arranged in slabs that are perpendicular to the surface of the primary visual cortex.
Binocular neurons are neurons in the visual system that assist in the creation of stereopsis from binocular disparity. They have been found in the primary visual cortex where the initial stage of binocular convergence begins. Binocular neurons receive inputs from both the right and left eyes and integrate the signals together to create a perception of depth.
Surround suppression is where the relative firing rate of a neuron may under certain conditions decrease when a particular stimulus is enlarged. It is has been observed in electrophysiology studies of the brain and has been noted in many sensory neurons, most notably in the early visual system. Surround suppression is defined as a reduction in the activity of a neuron in response to a stimulus outside its classical receptive field. note, quoting Kuffler (1953), "not only the areas from which responses can actually be set up by retinal illumination may be included in a definition of the receptive field but also all areas which show a functional connection, by an inhibitory or excitatory effect on a ganglion cell." The necessary functional connections with other neurons influenced by stimulation outside a particular area and by dynamic processes in general, and the absence of a theoretical description of a system state to be treated as a baseline, deprive the term "classical receptive field" of functional meaning. The descriptor "surround suppression" suffers from a similar problem, as the activities of neurons in the "surround" of the "classical receptive field are similarly determined by connectivities and processes involving neurons beyond it.) This nonlinear effect is one of many that reveals the complexity of biological sensory systems, and the connections of properties of neurons that may cause this effect are still being studied. The characteristics, mechanisms, and perceptual consequences of this phenomenon are of interest to many communities, including neurobiology, computational neuroscience, psychology, and computer vision.
Orientation selectivity is expressed by cells within the visual cortex, when such cells increase impulse or signal activity for specific oriented degree of shape presented within the visual field. Orientation selectivity can also be expressed by simple cells if the orientation of a stimulus is orthogonal to the preferred degree of orientation, which results in the inhibition of impulse activity.