Parallax scanning

Last updated

Parallax scanning depth enhancing imaging methods rely on discrete parallax differences between depth planes in a scene. The differences are caused by a parallax scan. When properly balanced (tuned) and displayed, the discrete parallax differences are perceived by the brain as depth.

Contents

A continuously moving parallax scan records a pattern of sequential parallax views on a single strip of film or video tape. The lens's optical axis sweeps in the plane of the nominal X and Y axes around the nominal optical Z axis, pivoting on the optical convergence point (out along the Z axis), so that it passes through positions having parallax in relation to the optical convergence point. The circular scanning of the lens's optical axis traces out a coaxial cone pattern with the convergence point as its apex.

Early tests revealed that the brain will translate parallax scanned information into depth information at scanning frequencies of between 3–6 Hz, and that the ideal frequency is 4.31 Hz.

Human Visual Perception

In his 1995 book, Foundations of Vision, Brian Wandell states, "Perception is an interpretation of the retinal image, not a description. Information in the retinal image may be interpreted in many different ways. Because we begin with ambiguous information, we cannot make deductions from the retinal image, only inferences. ....we have learned that the visual system succeeds in interpreting images because of statistical regularities present in the visual environment and hence in the retinal image. These regularities permit the visual system to use fragmentary information present in the retinal image to draw accurate inferences about the physical cause of the image. For example, when we make inferences from the retinal image, the knowledge that we live in a three-dimensional world is essential to the correct interpretation of the image. Often, we are made aware of the existence of these powerful interpretations and their assumptions when they are in error, that is, when we discover a visual illusion." [1]

While it is not possible to create a stereo image on a standard display without special equipment, it is possible to create an image with enhanced texture and depth. The parallax scanning lens technology creates autostereoscopic moving images with enhanced texture and depth on standard displays (television, movie screens and computer monitors) without the necessity of special screens or the use of viewing glasses. Images can be recorded on normal film or videotape using industry standard camera systems. The image depth enhancement is accomplished entirely by the lens using parallax scanning technology. [2]

Psycho-physical Research

It is known that the act of visual perception is a cognitive exercise and not merely a stimulus response. [3] In other words, perception is a learned ability which we develop in infancy. Kenneth Ogle of the Mayo Clinic, reported 1967 that left and right-eye information can be presented alternatively to the left and right eyes, resulting in depth perception as long as the time interval does not exceed 100 ms. [4] Visual researcher David Marr has suggested that perceptual fusion of binocular information occurs in a short-term memory buffer by means of some sort of visual depth mapping. [5] In 1984, Edwin Jones of the University of South Carolina reported that the human brain can accept and process parallax information without regard to the direction of the parallax, i.e. horizontal, diagonal or vertical. [6] A. P. McLaurin of the University of South Carolina, has stated that if visual information is in fact compared in a temporary memory and does not have to be received simultaneously, there is no reason why stereoscopic information that is appropriately sequenced at the proper rate cannot be observed by the single eye. [7]

In August 1998, the University of Virginia—Cognitive Science Department received an Innovation Award from the Virginia Center for Innovative Technology (CIT) to fund a research project to study the perceptual aspects of parallax scanning on the human visual system. This project and its subsequent report were completed in March 1999.

The UVA report titled Perceived depth is enhanced with parallax scanning, was the first independent study of the parallax scanning technologies. Dr. Dennis Proffitt and Tom Banton's work confirm that parallax scanning enhances perceived depth in images, especially when the object depth is large (See UVA Report). The more depth in the scene, the more parallax scanning enhances its perception by a viewer on a standard television screen without the aid of special glasses. [8]

See also

Related Research Articles

<span class="mw-page-title-main">Perception</span> Interpretation of sensory information

Perception is the organization, identification, and interpretation of sensory information in order to represent and understand the presented information or environment. All perception involves signals that go through the nervous system, which in turn result from physical or chemical stimulation of the sensory system. Vision involves light striking the retina of the eye; smell is mediated by odor molecules; and hearing involves pressure waves.

An illusion is a distortion of the senses, which can reveal how the mind normally organizes and interprets sensory stimulation. Although illusions distort the human perception of reality, they are generally shared by most people.

<span class="mw-page-title-main">Optical illusion</span> Visually perceived images that differ from objective reality

In visual perception, an optical illusion is an illusion caused by the visual system and characterized by a visual percept that arguably appears to differ from reality. Illusions come in a wide variety; their categorization is difficult because the underlying cause is often not clear but a classification proposed by Richard Gregory is useful as an orientation. According to that, there are three main classes: physical, physiological, and cognitive illusions, and in each class there are four kinds: Ambiguities, distortions, paradoxes, and fictions. A classical example for a physical distortion would be the apparent bending of a stick half immerged in water; an example for a physiological paradox is the motion aftereffect. An example for a physiological fiction is an afterimage. Three typical cognitive distortions are the Ponzo, Poggendorff, and Müller-Lyer illusion. Physical illusions are caused by the physical environment, e.g. by the optical properties of water. Physiological illusions arise in the eye or the visual pathway, e.g. from the effects of excessive stimulation of a specific receptor type. Cognitive visual illusions are the result of unconscious inferences and are perhaps those most widely known.

<span class="mw-page-title-main">Binocular vision</span> Type of vision with two eyes facing the same direction

In biology, binocular vision is a type of vision in which an animal has two eyes capable of facing the same direction to perceive a single three-dimensional image of its surroundings. Binocular vision does not typically refer to vision where an animal has eyes on opposite sides of its head and shares no field of view between them, like in some animals.

<span class="mw-page-title-main">Stereoscopy</span> Technique for creating or enhancing the illusion of depth in an image

Stereoscopy is a technique for creating or enhancing the illusion of depth in an image by means of stereopsis for binocular vision. The word stereoscopy derives from Greek στερεός (stereos) 'firm, solid', and σκοπέω (skopeō) 'to look, to see'. Any stereoscopic image is called a stereogram. Originally, stereogram referred to a pair of stereo images which could be viewed using a stereoscope.

<span class="mw-page-title-main">Depth perception</span> Visual ability to perceive the world in 3D

Depth perception is the ability to perceive distance to objects in the world using the visual system and visual perception. It is a major factor in perceiving the world in three dimensions. Depth perception happens primarily due to stereopsis and accommodation of the eye.

<span class="mw-page-title-main">Autostereogram</span> Visual illusion of 3D scene achieved by unfocusing eyes when viewing specific 2D images

An autostereogram is a two-dimensional (2D) image that can create the optical illusion of a three-dimensional (3D) scene. Autostereograms use only one image to accomplish the effect while normal stereograms require two. The 3D scene in an autostereogram is often unrecognizable until it is viewed properly, unlike typical stereograms. Viewing any kind of stereogram properly may cause the viewer to experience vergence-accommodation conflict.

<span class="mw-page-title-main">3D display</span> Display device

A 3D display is a display device capable of conveying depth to the viewer. Many 3D displays are stereoscopic displays, which produce a basic 3D effect by means of stereopsis, but can cause eye strain and visual fatigue. Newer 3D displays such as holographic and light field displays produce a more realistic 3D effect by combining stereopsis and accurate focal length for the displayed content. Newer 3D displays in this manner cause less visual fatigue than classical stereoscopic displays.

<span class="mw-page-title-main">Ambiguous image</span> Image that exploits graphical similarities between two or more distinct images

Ambiguous images or reversible figures are visual forms that create ambiguity by exploiting graphical similarities and other properties of visual system interpretation between two or more distinct image forms. These are famous for inducing the phenomenon of multistable perception. Multistable perception is the occurrence of an image being able to provide multiple, although stable, perceptions.

<span class="mw-page-title-main">Anaglyph 3D</span> Method of representing images in 3D

Anaglyph 3D is the stereoscopic 3D effect achieved by means of encoding each eye's image using filters of different colors, typically red and cyan. Anaglyph 3D images contain two differently filtered colored images, one for each eye. When viewed through the "color-coded" "anaglyph glasses", each of the two images reaches the eye it's intended for, revealing an integrated stereoscopic image. The visual cortex of the brain fuses this into the perception of a three-dimensional scene or composition.

Stereopsis is the component of depth perception retrieved through binocular vision. Stereopsis is not the only contributor to depth perception, but it is a major one. Binocular vision happens because each eye receives a different image because they are in slightly different positions on one's head. These positional differences are referred to as "horizontal disparities" or, more generally, "binocular disparities". Disparities are processed in the visual cortex of the brain to yield depth perception. While binocular disparities are naturally present when viewing a real three-dimensional scene with two eyes, they can also be simulated by artificially presenting two different images separately to each eye using a method called stereoscopy. The perception of depth in such cases is also referred to as "stereoscopic depth".

<span class="mw-page-title-main">Troxler's fading</span> Optical illusion affecting visual perception

Troxler's fading, also called Troxler fading or the Troxler effect, is an optical illusion affecting visual perception. When one fixates on a particular point for even a short period of time, an unchanging stimulus away from the fixation point will fade away and disappear. Research suggests that at least some portion of the perceptual phenomena associated with Troxler's fading occurs in the brain.

<span class="mw-page-title-main">Kinetic depth effect</span> Phenomenon of visual perception

In visual perception, the kinetic depth effect refers to the phenomenon whereby the three-dimensional structural form of an object can be perceived when the object is moving. In the absence of other visual depth cues, this might be the only perception mechanism available to infer the object's shape. Being able to identify a structure from a motion stimulus through the human visual system was shown by Wallach and O'Connell in the 1950s through their experiments.

<span class="mw-page-title-main">Brian Wandell</span>

Brian A. Wandell is the Isaac and Madeline Stein Family Professor at Stanford University, where he is Director of the Stanford Center for Cognitive and Neurobiological Imaging, and Deputy Director of the Wu Tsai Neuroscience Institute. He was a founding co-editor of the Annual Review of Vision Science.

<span class="mw-page-title-main">Chromostereopsis</span> Visual illusion whereby the impression of depth is conveyed in two-dimensional color images

Chromostereopsis is a visual illusion whereby the impression of depth is conveyed in two-dimensional color images, usually of red–blue or red–green colors, but can also be perceived with red–grey or blue–grey images. Such illusions have been reported for over a century and have generally been attributed to some form of chromatic aberration.

Vision III Imaging is a company located in Reston, Virginia that specializes in depth enhancement parallax imaging technologies. It has developed the v3 parallax scanning technology for capturing and recording visual parallax information to high definition (HD), Digital Cinema, 3D graphics, and video games.

<span class="mw-page-title-main">Visual perception</span> Ability to interpret the surrounding environment using light in the visible spectrum

Visual perception is the ability to interpret the surrounding environment through photopic vision, color vision, scotopic vision, and mesopic vision, using light in the visible spectrum reflected by objects in the environment. This is different from visual acuity, which refers to how clearly a person sees. A person can have problems with visual perceptual processing even if they have 20/20 vision.

<span class="mw-page-title-main">Wiggle stereoscopy</span> 3-D image display method

Wiggle stereoscopy is an example of stereoscopy in which left and right images of a stereogram are animated. This technique is also called wiggle 3-D, wobble 3-D, or sometimes Piku-Piku.

Form perception is the recognition of visual elements of objects, specifically those to do with shapes, patterns and previously identified important characteristics. An object is perceived by the retina as a two-dimensional image, but the image can vary for the same object in terms of the context with which it is viewed, the apparent size of the object, the angle from which it is viewed, how illuminated it is, as well as where it resides in the field of vision. Despite the fact that each instance of observing an object leads to a unique retinal response pattern, the visual processing in the brain is capable of recognizing these experiences as analogous, allowing invariant object recognition. Visual processing occurs in a hierarchy with the lowest levels recognizing lines and contours, and slightly higher levels performing tasks such as completing boundaries and recognizing contour combinations. The highest levels integrate the perceived information to recognize an entire object. Essentially object recognition is the ability to assign labels to objects in order to categorize and identify them, thus distinguishing one object from another. During visual processing information is not created, but rather reformatted in a way that draws out the most detailed information of the stimulus.

References

  1. Wandell, B. (1995), Foundations of Vision, Sinauer Associates, Inc.
  2. Mayhew, C. A. (1990). "Texture and Depth Enhancement for Motion Pictures and Television". SMPTE Journal. 9 (10): 809–814. doi:10.5594/j00096.
  3. Churchland, P. (1992), The Computational Brain, Cambridge, MA: MIT Press
  4. Ogle, K. N. (1967). "Some Aspects of Stereoscopic Depth Perception". Journal of the Optical Society of America. 57 (9): 1073–1081. doi:10.1364/josa.57.001073. PMID   6051761.
  5. Marr, D. (1982), Vision, San Francisco: W. H. Freeman
  6. Jones, E.; et al. (1984). "Visual Image Depth Enhancement by Parallax Induction". Advances in Display Technology IV, SPIE Proceedings. Society of Photo-Optical Instrumentation Engineers: 16.
  7. McLaurin, A. P.; et al. (1986). "Visual Image Depth Enhancement Process: An Approach to Three-Dimensional Imaging". Displays. 7 (3): 112. doi:10.1016/0141-9382(86)90002-8.
  8. Proffitt, D.; et al. (March 1999), Perceived depth is enhanced with parallax scanning, University of Virginia - Cognitive Science Department