SensoMotoric Instruments

Last updated
SensoMotoric Instruments GmbH
TypePrivately owned
IndustryHardware and software development
Founded1991
Headquarters Teltow, Germany
Key people
Ali Sahin (Managing Director)
Products Eye tracking solutions[ buzzword ]
RED250mobile eye tracker, released in 2014; screen showing a scan path on a text. Photo by SMI. SMI RED250mobile.jpg
RED250mobile eye tracker, released in 2014; screen showing a scan path on a text. Photo by SMI.

SensoMotoric Instruments (SMI) [1] was a German provider of dedicated computer vision applications with a major focus on eye-tracking technology. SMI was founded in 1991 as a spin-off from academic and medical research at the Free University of Berlin. The company has its headquarters in Teltow near Berlin, Germany, offices in Boston, Massachusetts and San Francisco, California, in the United States, and a worldwide distributor and partner network.

Contents

SMI provided eye tracking systems for scientific research, professional solutions[ buzzword ] and OEM applications. The eye trackers can be combined with motion tracking systems, [2] EEG, [3] [4] and other biometric data. [5] They can be integrated into virtual reality CAVEs, [6] head-mounted displays  –such as Google Glass [7] [8] or Oculus Rift, [9] [10] [11] simulators, cars, or computers as a measurement or interaction modality.

History

The company was founded by Dr. Winfried Teiwes in 1991. [12] SMI's first system 3D VOG was employed by the ESA, the NASA and on board the Russian space station Mir to analyze the effect of space missions on gravity-responsive torsional eye movements of astronauts. [13] Gradually, the company shifted its focus from astronautics towards ophthalmology and scientific research. Dr. Teiwes remained the company's Managing Director until 2008, when Eberhard Schmidt took over this role. After the sale of the ENT productline to Interacoustics – the diagnostics arm of William Demant Group  – in 2001, [14] the spin-out of the retinal treatment activities into OD-OS in 2008, [15] and the sale of the Ophthalmic division to Alcon in 2012, [16] [17] the company focused on scientific and professional eye tracking research solutions[ buzzword ], virtual reality applications, and OEM integrations.

Technology and Products

The technology is based on the dark pupil and corneal reflection tracking: The cameras in the SMI eye trackers detect face, eyes, and pupils, as well as the corneal reflections from the infrared light sources, and calculate eye movements, gaze direction and points of regard. The sampling frequency of the eye trackers ranges from 30 Hz up to the kHz range.

On the hardware side, the company has three main product lines: mobile Eye Tracking Glasses (ETG), [18] [19] [20] remote eye tracking systems (RED), [21] [22] [23] and tower-mounted systems (Hi-Speed).

The software for experimental design and data analysis is called Experiment Suite and comes in different packages depending on the user's research interests.

Partnerships

At the 2014 Game Developers Conference, Sony unveiled the prototype InFamous: Second Son game for PlayStation 4, using SMI's RED-oem eye tracking system. [24]

At the CES 2016, SMI demoed a new 250 Hz eye tracking system and a working foveated rendering solution.[ buzzword ] It resulted from a partnership with camera sensor manufacturer Omnivision who provided the camera hardware for the new system. [25]

In 2015 DEWESoft together with SMI integrated the Eye Tracking Glasses into a driver machine monitoring and analysis platform for advanced driver-assistance systems (ADAS). [26]

In 2014 Red Bull started using the Eye Tracking Glasses as part of their Red Bull Surf Science project. [27] [28] At the Game Developers Conference 2014, Sony unveiled the prototype of PlayStation 4 game Infamous: Second Son with the RED-oem eye tracking system integrated into it. [29] [30] [31]

In 2013 TechViz integrated SMI's 3D Eye Tracking Glasses [32] [33] with TechViz 3D visualization software to enable eye tracking in a virtual reality CAVE. The 3D Eye Tracking Glasses were developed in partnership with Volfoni. [34] In the same year, WorldViz started cooperating with SMI to enable calculation of intersects of gaze vectors with 3D objects and saving the data in one common database for deeper analysis. [35] German Research Center for Artificial Intelligence (DFKI) used the Eye Tracking Glasses to create Talking Places – the prototype of an interactive city guide. [36] [37]

In 2012, in partnership with Emotiv SMI developed a software package that combined the EEG data from the Emotiv EEG Neuroheadset with the eye tracking data. [38] Neuromarketers can use this software to analyze consumer reactions to brands according to visual and emotional cues. Prentke Romich Company integrated SMI's NuEye eye-gaze accessory into its speech-generating platform for people with disabilities. [39] The system allows users to control a communication device using only their eyes. Visual Interaction offers myGaze eye tracking accessory based on SMI technology with selected software packages for assistive applications. [40] [41]

Acquisition

It was reported that Apple acquired SMI in June 2017. [42] [43]

Awards

In 1992, SMI won the Berlin and Brandenburg Innovation Prize. [44]

In 2009, SMI's iView X RED system received the iF Product Design Award. [45]

See also

Related Research Articles

<span class="mw-page-title-main">Virtual reality</span> Computer-simulated experience

Virtual reality (VR) is a simulated experience that employs pose tracking and 3D near-eye displays to give the user an immersive feel of a virtual world. Applications of virtual reality include entertainment, education and business. Other distinct types of VR-style technology include augmented reality and mixed reality, sometimes referred to as extended reality or XR, although definitions are currently changing due to the nascence of the industry.

<span class="mw-page-title-main">3D display</span> Display device

A 3D display is a display device capable of conveying depth to the viewer. Many 3D displays are stereoscopic displays, which produce a basic 3D effect by means of stereopsis, but can cause eye strain and visual fatigue. Newer 3D displays such as holographic and light field displays produce a more realistic 3D effect by combining stereopsis and accurate focal length for the displayed content. Newer 3D displays in this manner cause less visual fatigue than classical stereoscopic displays.

<span class="mw-page-title-main">Head-mounted display</span> Type of display device

A head-mounted display (HMD) is a display device, worn on the head or as part of a helmet, that has a small display optic in front of one or each eye. An HMD has many uses including gaming, aviation, engineering, and medicine. Virtual reality headsets are HMDs combined with IMUs. There is also an optical head-mounted display (OHMD), which is a wearable display that can reflect projected images and allows a user to see through it.

<span class="mw-page-title-main">Eye tracking</span> Measuring the point of gaze or motion of an eye relative to the head

Eye tracking is the process of measuring either the point of gaze or the motion of an eye relative to the head. An eye tracker is a device for measuring eye positions and eye movement. Eye trackers are used in research on the visual system, in psychology, in psycholinguistics, marketing, as an input device for human-computer interaction, and in product design. In addition, eye trackers are increasingly being used for assistive and rehabilitative applications such as controlling wheelchairs, robotic arms, and prostheses. Recently, eye tracking has been examined as a tool for the early detection of autism spectrum disorder. There are several methods for measuring eye movement, with the most popular variant using video images to extract eye position. Other methods use search coils or are based on the electrooculogram.

<span class="mw-page-title-main">Active shutter 3D system</span> Method of displaying stereoscopic 3D images

An active shutter 3D system is a technique of displaying stereoscopic 3D images. It works by only presenting the image intended for the left eye while blocking the right eye's view, then presenting the right-eye image while blocking the left eye, and repeating this so rapidly that the interruptions do not interfere with the perceived fusion of the two images into a single 3D image.

<span class="mw-page-title-main">Foveated imaging</span>

Foveated imaging is a digital image processing technique in which the image resolution, or amount of detail, varies across the image according to one or more "fixation points". A fixation point indicates the highest resolution region of the image and corresponds to the center of the eye's retina, the fovea.

<span class="mw-page-title-main">Leap Motion</span> Former American company

Leap Motion, Inc. was an American company that manufactured and marketed a computer hardware sensor device that supports hand and finger motions as input, analogous to a mouse, but requires no hand contact or touching. In 2016, the company released new software designed for hand tracking in virtual reality. The company was sold to the British company Ultrahaptics in 2019, which rebranded the two companies under the new name Ultraleap.

<span class="mw-page-title-main">Oculus Rift</span> Virtual reality headsets by Oculus VR

Oculus Rift is a discontinued line of virtual reality headsets developed and manufactured by Oculus VR, a virtual reality company founded by Palmer Luckey that is widely credited with reviving the virtual reality industry. It was the first virtual reality headset to provide a realistic experience at an accessible price, utilizing novel technology to increase quality and reduce cost by orders of magnitude compared to earlier systems. The first headset in the line was the Oculus Rift DK1, released on March 28, 2013. The last was the Oculus Rift S, discontinued in April of 2021.

<span class="mw-page-title-main">Optical head-mounted display</span> Type of wearable device

An optical head-mounted display (OHMD) is a wearable device that has the capability of reflecting projected images as well as allowing the user to see through it. In some cases, this may qualify as augmented reality (AR) technology. OHMD technology has existed since 1997 in various forms, but despite a number of attempts from industry, has yet to have had major commercial success.

<span class="mw-page-title-main">Smartglasses</span> Wearable computers glasses

Smartglasses or smart glasses are eye or head-worn wearable computers that offer useful capabilities to the user. Many smartglasses include displays that add information alongside or to what the wearer sees. Alternatively, smartglasses are sometimes defined as glasses that are able to change their optical properties, such as smart sunglasses that are programmed to change tint by electronic means. Alternatively, smartglasses are sometimes defined as glasses that include headphone functionality.

<span class="mw-page-title-main">Reality Labs</span> Virtual and augmented reality products company

Reality Labs is a business and research unit of Meta Platforms that produces virtual reality (VR) and augmented reality (AR) hardware and software, including virtual reality headsets such as Quest, and online platforms such as Horizon Worlds. In June 2022, several artificial intelligence (AI) initiatives that were previously a part of Meta AI were transitioned to Reality Labs. This also includes Meta's fundamental AI Research laboratory FAIR which is now part of the Reality Labs - Research (RLR) division.

<span class="mw-page-title-main">Stereoscopic video game</span>

A stereoscopic video game is a video game which uses stereoscopic technologies to create depth perception for the player by any form of stereo display. Such games should not be confused with video games that use 3D game graphics on a mono screen, which give the illusion of depth only by monocular cues but lack binocular depth information.

<span class="mw-page-title-main">HTC Vive</span> Virtual reality headset

HTC Vive is a line of virtual and mixed reality headsets produced by HTC Corporation. The brand currently encompasses headsets designed for use with personal computers as well as standalone headsets such as the Vive Focus line, Vive Flow glasses, and the Vive Elite XR mixed reality headset.

<span class="mw-page-title-main">Oculus Touch</span> Motion controller system

Oculus Touch is a line of motion controller systems used by Meta Platforms virtual reality headsets. The controller was first introduced in 2016 as a standalone accessory for the Oculus Rift CV1, and began to be bundled with the headset and all future Oculus products beginning in July 2017. Since their original release, Touch controllers have undergone revisions for later generations of Oculus/Meta hardware, including a switch to inside-out tracking, and other design changes.

<span class="mw-page-title-main">Kubity</span> Cloud-based 3D communication tool

Kubity is a cloud-based 3D communication tool that works on desktop computers, the web, smartphones, tablets, augmented reality gear, and virtual reality glasses. Kubity is powered by several proprietary 3D processing engines including "Paragone" and "Etna" that prepare the 3D file for transfer over mobile devices.

<span class="mw-page-title-main">Virtual reality headset</span> Head-mounted device that provides virtual reality for the wearer

A virtual reality headset is a head-mounted device that provides virtual reality for the wearer. VR headsets are widely used with VR video games but they are also used in other applications, including simulators and trainers. VR headsets typically include a stereoscopic display, stereo sound, and sensors like accelerometers and gyroscopes for tracking the pose of the user's head to match the orientation of the virtual camera with the user's eye positions in the real world.

Emotiv Inc. is a privately held bio-informatics and technology company developing and manufacturing wearable electroencephalography (EEG) products including neuroheadsets, software development kits (SDK), software, mobile apps, and data products. Founded in 2011 by Tan Le and Geoff Mackellar, the company is headquartered in San Francisco, U.S.A. with facilities in Sydney, Hanoi and Ho Chi Minh City.

Foveated rendering is a rendering technique which uses an eye tracker integrated with a virtual reality headset to reduce the rendering workload by greatly reducing the image quality in the peripheral vision.

<span class="mw-page-title-main">Virtual reality game</span> Video game played in virtual reality

A virtual reality game or VR games is a video game played on virtual reality (VR) hardware. Most VR games are based on player immersion, typically through head-mounted display unit or headset with stereoscopic displays and one or more controllers.

<span class="mw-page-title-main">Oculus Rift CV1</span> Virtual reality headset by Oculus VR

Oculus Rift CV1, also known simply as Oculus Rift, is a virtual reality headset developed by Oculus VR, a subsidiary of Meta Platforms, known at the time as Facebook Inc. It was announced in January 2016, and released in March the same year. The device constituted the first commercial release in the Oculus Rift lineup.

References

  1. ↑ SMI company Archived 2017-03-13 at the Wayback Machine . SMI. Retrieved March 13, 2017.
  2. ↑ Ben Coxworth (May 9, 2014) Two-part system tracks body movement and gaze. Gizmag. Retrieved April 17, 2015.
  3. ↑ Emotiv and SMI Combine Remote Eye Tracking and EEG: A Perfect Match! Archived 2015-09-24 at the Wayback Machine . Reuters. Retrieved April 3, 2014.
  4. ↑ Hisham Abboud (January 4, 2014) New: Cedrus Introduces StimTracker for SMI Eye Trackers. Cedrus. Retrieved April 3, 2014.
  5. ↑ SensoMotoric Instruments and Noldus Information Technology combine eye tracking and video analysis. Noldus. Retrieved April 2, 2014.
  6. ↑ Ben Lang (February 8, 2013) SMI Introduces 3D Glasses With Eye Tracking. Road to VR. Retrieved April 3, 2014.
  7. ↑ SMI Gaze Interaction Powers Google Glass Prototype Archived 2015-04-22 at the Wayback Machine . Reuters. Retrieved April 17, 2015.
  8. ↑ Stephen Hall (April 16, 2015). SMI’s Google Glass eye-tracking prototype is impressive. Google Glass Fans. Retrieved April 17, 2015.
  9. ↑ Jamie Feltham (November 17, 2014). SMI Launches Oculus Rift Eye Tracking Upgrade Package. VR Focus. Retrieved April 17, 2015.
  10. ↑ Dave LeClair (November 21, 2014). SMI announces eye-tracking upgrade for Oculus Rift. Gizmag. Retrieved April 17, 2015.
  11. ↑ Oliver Kreylos (June 2, 2014). An Eye-tracked Oculus Rift. Doc-ok. Retrieved April 17, 2015.
  12. ↑ Alio, J.L. Surgical Techniques in Ophthalmology: Strabismus Surgery. JP Medical Ltd, 2011. Retrieved April 2, 2014.
  13. ↑ ISS Symposium Berlin: The Effect of Gravity on Eye Movements. PRLOG. Retrieved March 13, 2017.
  14. ↑ Interacoustics acquires 2D VOG family from SMI. Hearing Review. Retrieved April 3, 2014.
  15. ↑ About OD-OS. OD-OS. Retrieved April 2, 2014.
  16. ↑ Alcon history Archived 2014-07-01 at the Wayback Machine . Alcon. Retrieved April 2, 2014.
  17. ↑ Alcon acquisition. Eyewire Today. Retrieved April 2, 2014.
  18. ↑ Jeff Mackey (Dec 22, 2014). A new, less cumbersome way to track consumer eye movement. WRLWND. Retrieved April 17, 2015.
  19. ↑ Edwin Kee (September 19, 2011). Eye Tracking glasses unveiled. Ubergizmo. Retrieved April 2, 2014.
  20. ↑ Steve Dent (August 28, 2013). SMI launches Eye Tracking Glasses 2.0 with smartphone-based recorder. Engadget. Retrieved April 2, 2014.
  21. ↑ Alan Brandon (November 16, 2010) 500 Hz remote eye tracker watches what you watch. Gizmag. Retrieved April 3, 2014.
  22. ↑ Edwin Kee (January 6, 2014) SensoMotoric Instruments Delivers SMI RED-n Consumer Eye Control Technology. Ubergizmo. Retrieved April 3, 2014.
  23. ↑ Ringier Medical (November 17, 2014). Contact-free eye tracking systems at SfN 2014. Industry Sourcing. Retrieved April 17, 2015.
  24. ↑ Kohler, Chris. "Magical Prototype Lets You Play PS4 With Your Eyeballs". Wired. ISSN   1059-1028 . Retrieved 2022-02-23.
  25. ↑ Mason, Will (2016-01-15). "SMI's 250Hz Eye Tracking and Foveated Rendering Are For Real, and the Cost May Surprise You". UploadVR . Retrieved 2017-02-02.
  26. ↑ SMI and DEWESoft Introduce Driver Machine Monitoring and Analysis Platform for ADAS Development. Yahoo Finance. Retrieved April 17, 2015.
  27. ↑ Freddy Lopez (April 3, 2015). Red Bull Explores Eye-Tracking Technology to Enhance Surfing Performance. SportTechie. Retrieved April 17, 2015.
  28. ↑ Nate Hoppes (November 4, 2014). This Is What Happens When Scientists Go Surfing. Red Bull. Retrieved April 17, 2015.
  29. ↑ Chris Kohler (March 25, 2014). Magical Prototype Lets You Play PS4 With Your Eyeballs. Wired. Retrieved April 2, 2014.
  30. ↑ Sean Hollister (March 20, 2014). Could throwing fireballs with your eyes be the future of PlayStation?. The Verge. Retrieved April 2, 2014.
  31. ↑ Luke Plunkett (March 20, 2014). Sony Tech Lets You Play Games Using Your Eyes. Kotaku. Retrieved April 2, 2014.
  32. ↑ Zach Honig (February 4, 2013). SMI Eye-Tracking 3D Glasses use rim-based cameras to adjust perspective. Engadget. Retrieved April 2, 2014.
  33. ↑ Thomas Anderson (February 4, 2013). Video: SMI debuts 3D eye-tracking device. TG Daily. Retrieved April 2, 2014.
  34. ↑ SMI reveals first 3D glasses with full eye tracking capability Archived 2014-04-03 at archive.today . Volfoni. Retrieved April 2, 2014.
  35. ↑ WorldViz Partners. WorldViz. Retrieved April 2, 2014.
  36. ↑ Daniel Cooper (March 5, 2013). 'Talking Places' is the Google Glass of tour guides, we go hands-on. Engadget. Retrieved April 2, 2014.
  37. ↑ Museum Guide 2.0 and TALKING PLACES. DFKI. Retrieved April 2, 2014.
  38. ↑ Emotiv and SMI Combine Remote Eye Tracking and EEG: A Perfect Match! Archived 2015-09-24 at the Wayback Machine . Reuters. Retrieved April 17, 2015.
  39. ↑ New eye-gaze technology may be your next mouse. Computer Dealer News. Retrieved April 2, 2014.
  40. ↑ Mike Stubbsy (November 18, 2013). MyGaze Eye Controller is a real next gen. GodIsAGeek. Retrieved April 2, 2014.
  41. ↑ Inclusive EyeGaze Foundations. Inclusive Technology. Retrieved April 14, 2015.
  42. ↑ Apple acquires SMI eye-tracking company TechCrunch. Retrieved October 30, 2017.
  43. ↑ SMI and Apple: What It Means for the Future of Eye Tracking iMotions. Retrieved October 30, 2017.
  44. ↑ "Preisträger des Innovationspreises Berlin-Brandenburg 1992". Innovationspreis Berlin-Brandenburg.
  45. ↑ "iF product design award 2009". iF International Forum Design.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.