Oculometer

Last updated

Oculometer is a device that tracks eye movement. [1] [2] The oculometer computes eye movement by tracking corneal reflection relative to the center of the pupil. [3] An oculometer, which can provide continuous measurements in real time, can be a research tool to understand gaze as well as cognitive function. Further, it can be applied for hands-free control. [3] It has applications in flight training, [4] cognitive assessment, [4] disease diagnosis, [5] and treatment. [6] The oculometer relies on the principle that when a collimated light beam is incident on the eye, the direction in which the eye moves is proportional to the position of the reflection of that light beam from the cornea with respect to the center of the pupil. [3] Eye movements can be accurately measured over a linear range of more than 20  with a resolution of 0.1. [7]

Contents

History

Eye movement and tracking have been studied for centuries, with the very first eye tracking being simple observation of the eyes, by either oneself or another. [4] The first improvement on this occurred in 1738, when an observer would feel the outside of closed eyelids to track eye movement. [4] Next in 1879, an innovation to listen to muscle movements using a kymograph was implemented. [4] Though rudimentary, these early techniques show repeated need throughout history to track eye movements. [4]

The first true eye tracking device was invented by Huey in 1898. [4] To work, this device was required to contact the cornea, which limited its comfort, usability, and generalizability. [4]

It was not until the 20th century that a robust, non-contact, modern eye-tracker came to fruition. This device, called the photocornograph, worked by photographing eye movement based on reflection from the cornea. [4] This device only recorded horizontal movements, until the work of Judd and colleagues in 1905 added both temporal and vertical recording. [4]

Due to the many applications of an eye tracking device to aviators and pilots, NASA and the United States Air Force carried out extensive studies on this technology, propelling the field forward. [4] Much of this took place during the 1970s and 1980s. [4] However even with this extensive research, oculometers remained bulky and technically difficult. [3]

Research-grade oculometers finally received a user-friendly redesign, with commercial devices available as of recently. These low-profile devices can be worn non-intrusively on a pair of eyeglasses. [6]

Advantages

Since the principles governing the workings of the oculometer rely on a relatively simple concept (electro-optical sensing of the eye), it ensures that the oculometer will be functional whenever the user is seeing. [3] Additionally, the position of the reflection of the collimated beam from the cornea can be approximated to be on the plane of the pupil. This implies minimal parallax error between the corneal reflection and the center of the pupil, thus making the oculometer insensitive to changes in the head position during measurements. These properties of the oculometer ensures minimal interference with the routine activities of the user during measurements. It also negates the need for extensive equipment like bite plates or rigid skull clamping for measurements.

Optical components [3]

A schematic of the oculometer, depicting the arrangement of the light source, objective lens, beam splitter, two polarizing lenses, detector, and eyepiece. Oculometer Schematic.jpg
A schematic of the oculometer, depicting the arrangement of the light source, objective lens, beam splitter, two polarizing lenses, detector, and eyepiece.

General principles

Eye movement can be quantified by reflection off the cornea. However, in this case a movement of the head would also cause a movement to be recorded. [4] This can be overcome by either rigidly fixing the head to prevent any movements, however this is intrusive and uncomfortable for the user and not broadly applicable for human research studies. Or, the entire apparatus could be mounted on the head, which likewise is bulky and uncomfortable. A better solution is to measure two parameters, such as corneal reflection and pupil movement (based on pupil center). [8]

Optical design

The optical design of the oculometer allows normal vision, directs light from a fixed internal source onto the eye of the user, and forms the image of the pupil on a detector. [3] The basic lens design includes a fixed eye piece and an adjustable objective lens followed by 2 beam splitters. The device also consists of a polarization system to polarize the light from the source (typically a glow modulator tube) in the H direction. In order to attenuate the light from the source through reflections in the eyepiece, a linear polarizer in the V direction is placed in the optical path. A quarter wave plate is placed between the eye and the eye piece and rotates the plane of polarization by 90 degrees thus ensuring that the V-polarizer does not attenuate the true corneal reflections.

The light source and detector are aligned coaxially. When the eye moves, the reflection off the cornea is displaced from the pupil center. [8] This displacement is measured by

[8]

D is displacement, is the distance from the center of the cornea, is the angle of inclination of the eye's optical axis to the oculometer. [8]

Near infrared light (NIR) (approximately 750nm to 2,500nm wavelengths) is used for a few reasons. [8] First, NIR light is less detectable to the human eye than other wavelengths of visible light, so the NIR light beam is less intrusive or noticeable to the user. [8] Second, with this configuration the pupil is backlit, resulting in a bright disc, effectively differentiating the pupil from the rest of the eye and face. [8]

Typically, the oculometer consists of an eyepiece through which the user sees. An alternate design exists where the oculometer is head-mounted. This arrangement does not include the traditional eye-piece and user sees through a transparent, curved visor placed in front of his eyes.

Electronic design

The traditional oculometer operates in two modes: acquisition and tracking modes. [3] When the  user first sees through the eye piece, a rough raster scan captures the black pupil and bright reflections from the cornea. [3] Then, the device automatically switches to tracking mode where time-division-multiplex-scans acquires continuous measurements of eye direction. [3] Eye direction from the time-division-multiplex scans are computed by the superposition of the scan positions of corneal reflection and pupil positions. [3] In case of device malfunction or loss in continuity due to the user blinking their eyes, the device switches back to the acquisition mode until tracking is restored. [3] In recent designs, the acquisition mode has been automated to ensure that the pupil/iris boundary was instantly captures once the user sees through the eye piece. [3] The automation also led to automatic switch to tracking mode after initial acquisition was obtained or after the user blinks. [3]

Applications

Piloting aircraft

There are numerous uses for the oculometer in the field of aviation. [4] One is understanding whether cognitive abilities are sufficient for flight clearance. Further, flight programs can use the oculometer to inform cockpit design in terms of instrumentation panels, by studying the gaze of pilots as they fly. [4] Finally, aviator training has benefitted from the oculometer as well. [4] Understanding how a particular pilot scans through his field of view while flying allows for personalized feedback from flight coaches. [4] It can provide instructors with more information by which to evaluate and further instruct learning pilots. For this reason, NASA and the US Armed Forces have utilized oculometers in their training programs, creating the Oculometer Training Tape Technique in the late 1900s. [4]

NASA

A NASA research project regarding the oculometer was to realize the ability for a person to control a machine using their eyes, which firstly necessitates eye movement measurements. NASA engineered a telescopic oculometer in which a user looks through an eyepiece, and given that the user can see through the eyepiece, eye movements will be measured. [3]

One particular application of NASA's oculometer endeavor is eye control of an Astronaut Maneuvering Unit (AMU). [3] When an astronaut is in space and would like to move, the AMU facilitates this. However, controlling such a unit is no trivial task. [3] Manual/hand controls are difficult as there are many axes and therefore many muscle outputs needed to coordinate 3D movement. [3] However, eye control would be easier to implement with an oculometer. [3]  

Cognitive assessment

Aviation requires robust, sharp cognitive function, and the eye is part of the central nervous system as they are extensions of the brain, linking cognitive function with healthy eye function. [4] Therefore oculometers can function as cognitive assessment tools. [4]

Diagnosis of Parkinson's disease

Abnormal eye movements is an established biomarker for numerous motor diseases including Parkinson's disease. [9] Each motor disease is expected to produce different signature pattern of eye movement abnormalities. [9] Using those eye movement patterns both as a diagnostic tool and for monitoring disease progression has therefore been of scientific interest. [9] Oculometers are therefore used in this area for tracking eye movement. [9] The use of oculometers for diagnosis of motor diseases is promising, though it has not yet been validated in the clinic. [9]

For Parkinson's disease specifically, the signature pattern of eye movement abnormalities occur as horizontal saccades (rapid, conjugate, eye movement that shift the center of the vision field). [5] Patients with Parkinson's disease displayed high inabilities in performing antisaccadic tasks (eye movement in the opposite direction from the onset trigger). [5] Measurement of antisaccades therefore enables scientists to detect early stages of Parkinson's disease. [5] These studies are still in the research phase. [5]

Smart eyeglasses

For this application, the electronic design of the traditional oculometer has been modified to replace complex real-time video processing such that the oculometer could fit on light weight eyeglasses and have relatively long battery life. [6] Smart eyeglasses are used to correct for vision errors due to age-related conditions while restoring normal vision. [6] Smart eyeglasses utilize tunable eyepieces compared to fixed lenses used in conventional glasses. [6]

These glasses work by projecting light from a few different directions using infrared LEDs on the user's eyeball and receives the refracted light from discrete infrared proximity sensors also placed at a few different locations. [6] The use of multiple detectors not only enables oculometers to be used as lightweight wearables but also ensures that signals detected by the sensors are not dependent on external illumination. [6] This property allows the device to be functional in dark conditions. [6] The major disadvantage of the use of sensors compared to continuous video processing is the significant decline in accuracy since measurements are both reduced in frequency and number of measurements. [6]

Other applications

Other potential application of oculometers that are still currently under development include in air traffic control for operators to designate aircraft through eye movement; [10] in laser communication in dynamic situations where operators can transmit signals by looking at the signal; in television systems to monitor the eye direction as it views the television display such that sensory requirements of the eye can be met with lower bandwidths; and in psychological tests to analyze pattern of images that patients tend to avoid.

Related Research Articles

<span class="mw-page-title-main">Optics</span> Branch of physics that studies light

Optics is the branch of physics that studies the behaviour and properties of light, including its interactions with matter and the construction of instruments that use or detect it. Optics usually describes the behaviour of visible, ultraviolet, and infrared light. Light is a type of electromagnetic radiation, and other forms of electromagnetic radiation such as X-rays, microwaves, and radio waves exhibit similar properties.

<span class="mw-page-title-main">Binoculars</span> Pair of telescopes mounted side-by-side

Binoculars or field glasses are two refracting telescopes mounted side-by-side and aligned to point in the same direction, allowing the viewer to use both eyes when viewing distant objects. Most binoculars are sized to be held using both hands, although sizes vary widely from opera glasses to large pedestal-mounted military models.

<span class="mw-page-title-main">Optical microscope</span> Microscope that uses visible light

The optical microscope, also referred to as a light microscope, is a type of microscope that commonly uses visible light and a system of lenses to generate magnified images of small objects. Optical microscopes are the oldest design of microscope and were possibly invented in their present compound form in the 17th century. Basic optical microscopes can be very simple, although many complex designs aim to improve resolution and sample contrast.

<span class="mw-page-title-main">Keratoconus</span> Medical condition involving the eye

Keratoconus (KC) is a disorder of the eye that results in progressive thinning of the cornea. This may result in blurry vision, double vision, nearsightedness, irregular astigmatism, and light sensitivity leading to poor quality-of-life. Usually both eyes are affected. In more severe cases a scarring or a circle may be seen within the cornea.

<span class="mw-page-title-main">Cornea</span> Transparent front layer of the eye

The cornea is the transparent front part of the eye that covers the iris, pupil, and anterior chamber. Along with the anterior chamber and lens, the cornea refracts light, accounting for approximately two-thirds of the eye's total optical power. In humans, the refractive power of the cornea is approximately 43 dioptres. The cornea can be reshaped by surgical procedures such as LASIK.

<span class="mw-page-title-main">LASIK</span> Corrective ophthalmological surgery

LASIK or Lasik, commonly referred to as laser eye surgery or laser vision correction, is a type of refractive surgery for the correction of myopia, hyperopia, and an actual cure for astigmatism, since it is in the cornea. LASIK surgery is performed by an ophthalmologist who uses a laser or microkeratome to reshape the eye's cornea in order to improve visual acuity.

<span class="mw-page-title-main">Scanning laser ophthalmoscopy</span>

Scanning laser ophthalmoscopy (SLO) is a method of examination of the eye. It uses the technique of confocal laser scanning microscopy for diagnostic imaging of the retina or cornea of the human eye.

<span class="mw-page-title-main">Eye examination</span> Series of tests assessing vision and pertaining to the eyes

An eye examination is a series of tests performed to assess vision and ability to focus on and discern objects. It also includes other tests and examinations pertaining to the eyes. Eye examinations are primarily performed by an optometrist, ophthalmologist, or an orthoptist. Health care professionals often recommend that all people should have periodic and thorough eye examinations as part of routine primary care, especially since many eye diseases are asymptomatic.

<span class="mw-page-title-main">Slit lamp</span> Device for examining the eye

In ophthalmology and optometry, a slit lamp is an instrument consisting of a high-intensity light source that can be focused to shine a thin sheet of light into the eye. It is used in conjunction with a biomicroscope. The lamp facilitates an examination of the anterior segment and posterior segment of the human eye, which includes the eyelid, sclera, conjunctiva, iris, natural crystalline lens, and cornea. The binocular slit-lamp examination provides a stereoscopic magnified view of the eye structures in detail, enabling anatomical diagnoses to be made for a variety of eye conditions. A second, hand-held lens is used to examine the retina.

<span class="mw-page-title-main">Eye tracking</span> Measuring the point of gaze or motion of an eye relative to the head

Eye tracking is the process of measuring either the point of gaze or the motion of an eye relative to the head. An eye tracker is a device for measuring eye positions and eye movement. Eye trackers are used in research on the visual system, in psychology, in psycholinguistics, marketing, as an input device for human-computer interaction, and in product design. In addition, eye trackers are increasingly being used for assistive and rehabilitative applications such as controlling wheelchairs, robotic arms, and prostheses. Recently, eye tracking has been examined as a tool for the early detection of autism spectrum disorder. There are several methods for measuring eye movement, with the most popular variant using video images to extract eye position. Other methods use search coils or are based on the electrooculogram.

<span class="mw-page-title-main">Scleral lens</span> Large contact lens resting on the sclera, creating a tear-filled vault over the cornea

A scleral lens, also known as a scleral contact lens, is a large contact lens that rests on the sclera and creates a tear-filled vault over the cornea. Scleral lenses are designed to treat a variety of eye conditions, many of which do not respond to other forms of treatment.

<span class="mw-page-title-main">Pupillary distance</span> Distance in millimeters between the centers of each pupil

Pupillary distance (PD), more correctly known as interpupillary distance (IPD) is the distance in millimeters between the centers of each pupil.

<span class="mw-page-title-main">Corneal topography</span> Medical imaging technique

Corneal topography, also known as photokeratoscopy or videokeratography, is a non-invasive medical imaging technique for mapping the anterior curvature of the cornea, the outer structure of the eye. Since the cornea is normally responsible for some 70% of the eye's refractive power, its topography is of critical importance in determining the quality of vision and corneal health.

<span class="mw-page-title-main">Purkinje images</span>

Purkinje images are reflections of objects from the structure of the eye. They are also known as Purkinje reflexes and as Purkinje–Sanson images. At least four Purkinje images are usually visible in the normal eye. The first Purkinje image (P1) is the reflection from the outer surface of the cornea. The second Purkinje image (P2) is the reflection from the inner surface of the cornea. The third Purkinje image (P3) is the reflection from the outer (anterior) surface of the lens. The fourth Purkinje image (P4) is the reflection from the inner (posterior) surface of the lens. Unlike the others, P4 is an inverted image.

Eye movement in reading involves the visual processing of written text. This was described by the French ophthalmologist Louis Émile Javal in the late 19th century. He reported that eyes do not move continuously along a line of text, but make short, rapid movements (saccades) intermingled with short stops (fixations). Javal's observations were characterised by a reliance on naked-eye observation of eye movement in the absence of technology. From the late 19th to the mid-20th century, investigators used early tracking technologies to assist their observation, in a research climate that emphasised the measurement of human behaviour and skill for educational ends. Most basic knowledge about eye movement was obtained during this period. Since the mid-20th century, there have been three major changes: the development of non-invasive eye-movement tracking equipment; the introduction of computer technology to enhance the power of this equipment to pick up, record, and process the huge volume of data that eye movement generates; and the emergence of cognitive psychology as a theoretical and methodological framework within which reading processes are examined. Sereno & Rayner (2003) believed that the best current approach to discover immediate signs of word recognition is through recordings of eye movement and event-related potential.

Scanning laser polarimetry is the use of polarised light to measure the thickness of the retinal nerve fiber layer (RNFL) as part of a glaucoma workup. The GDx-VCC is one example.

<span class="mw-page-title-main">Corneal pachymetry</span>

Corneal pachymetry is the process of measuring the thickness of the cornea. A pachymeter is a medical device used to measure the thickness of the eye's cornea. It is used to perform corneal pachymetry prior to refractive surgery, for Keratoconus screening, LRI surgery and is useful in screening for patients suspected of developing glaucoma among other uses.

Vision of humans and other organisms depends on several organs such as the lens of the eye, and any vision correcting devices, which use optics to focus the image.

The aim of an accurate intraocular lens power calculation is to provide an intraocular lens (IOL) that fits the specific needs and desires of the individual patient. The development of better instrumentation for measuring the eye's axial length (AL) and the use of more precise mathematical formulas to perform the appropriate calculations have significantly improved the accuracy with which the surgeon determines the IOL power.

<span class="mw-page-title-main">Chameleon vision</span> Visual sense in the family of reptiles

The chameleon is among the most highly visually-oriented lizards, using this sense in prey capture, mating behavior, and predator avoidance. Unique features of chameleon vision include a negative lens, a positive cornea, and monocular focusing. The development of the chameleon visual system could have evolved to aid in prey capture and/or in predator avoidance.

References

  1. ↑ Crawford, Daniel; Burdette, Daniel; Capron, William (1994-01-01). "Techniques used for the analysis of oculometer eye-scanning data obtained from an air traffic control display".
  2. ↑ "LoCO: A Low-Cost Oculometer for Head-mounted Wearable Computer Displays". www.sbir.gov. U.S.: Small Business Innovation Research, United States Government.
  3. 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 Merchant, J (July 1, 1967). "The Oculometer". NASA.
  4. 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Vidulich, Michael A.; Tsang, Pamela S. (2019-02-11). Improving Aviation Performance through Applying Engineering Psychology: Advances in Aviation Psychology. CRC Press. ISBN   9780429960147.
  5. 1 2 3 4 5 Antoniades, C. A.; Hu, M.; Kennard, C. (2012-11-01). "Impaired Antisaccades in Parkinson's Disease". Journal of Neurology, Neurosurgery & Psychiatry. 83 (Suppl 2): A10. doi:10.1136/jnnp-2012-304200a.39. ISSN   0022-3050. S2CID   75265389.
  6. 1 2 3 4 5 6 7 8 9 Mastrangelo, A. S.; Karkhanis, M.; Likhite, R.; Bulbul, A.; Kim, H.; Mastrangelo, C. H.; Hasan, N.; Ghosh, T. (July 2018). "A Low-Profile Digital Eye-Tracking Oculometer for Smart Eyeglasses". 2018 11th International Conference on Human System Interaction (HSI). Vol. 2018. pp. 506–512. doi:10.1109/HSI.2018.8431368. ISBN   978-1-5386-5024-0. PMC   8528137 . PMID   34676133. S2CID   52004561.
  7. ↑ Bach, M.; Bouis, D.; Fischer, B. (1983-09-01). "An accurate and linear infrared oculometer". Journal of Neuroscience Methods. 9 (1): 9–14. doi:10.1016/0165-0270(83)90103-6. ISSN   0165-0270. PMID   6415349. S2CID   6569293.
  8. 1 2 3 4 5 6 7 Gale, A. G. (1981-05-01). "An inexpensive oculometer for human factors research". Behavior Research Methods & Instrumentation. 13 (3): 385–388. doi: 10.3758/BF03202041 . ISSN   1554-3528.
  9. 1 2 3 4 5 Fitzgerald, James J.; Lu, Zhongjiao; Jareonsettasin, Prem; Antoniades, Chrystalina A. (2018). "Quantifying Motor Impairment in Movement Disorders". Frontiers in Neuroscience. 12: 202. doi: 10.3389/fnins.2018.00202 . PMC   5904266 . PMID   29695949.
  10. ↑ Smyth, Christopher C.; Dominessy, Mary E. (2016-08-06). "Comparing Oculometer and Head-Fixed Reticle with Voice or Switch for Tactical Display Interaction". Proceedings of the Human Factors Society Annual Meeting. 32 (2): 116–120. doi:10.1177/154193128803200225. S2CID   67095431.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.