Telepointer

Last updated
Mann wearing the Telepointer SixthSense SteveMann 1998 image1210.jpg
Mann wearing the Telepointer

Telepointer is a neck-worn gestural interface system developed by MIT Media Lab student Steve Mann in 1998. [1] Mann originally referred to the device as "Synthetic Synesthesia of the Sixth Sense". [2] In the 1990s and early 2000s Mann used this project as a teaching example at the University of Toronto. [3]

Gesture recognition

Gesture recognition is a topic in computer science and language technology with the goal of interpreting human gestures via mathematical algorithms. Gestures can originate from any bodily motion or state but commonly originate from the face or hand. Current focuses in the field include emotion recognition from face and hand gesture recognition. Users can use simple gestures to control or interact with devices without physically touching them. Many approaches have been made using cameras and computer vision algorithms to interpret sign language. However, the identification and recognition of posture, gait, proxemics, and human behaviors is also the subject of gesture recognition techniques. Gesture recognition can be seen as a way for computers to begin to understand human body language, thus building a richer bridge between machines and humans than primitive text user interfaces or even GUIs, which still limit the majority of input to keyboard and mouse and interact naturally without any mechanical devices. Using the concept of gesture recognition, it is possible to point a finger at this point will move accordingly. This could make conventional input on devices such and even redundant.

MIT Media Lab interdisciplinary research laboratory at the Massachusetts Institute of Technology

The MIT Media Lab is an antidisciplinary research laboratory at the Massachusetts Institute of Technology, growing out of MIT's Architecture Machine Group in the School of Architecture. Its research does not restrict to fixed academic disciplines, but draws from technology, media, science, art and design. As of 2014, Media Lab's research groups include neurobiology, biologically inspired fabrication, socially engaging robots, emotive computing, bionics, and hyperinstruments.

Steve Mann Professor and wearable computing researcher

Steven Mann is a Canadian researcher and inventor best known for his work on augmented reality, computational photography, particularly wearable computing and high dynamic range imaging.

Contents

Aremac projector

Closeup of dome pendant showing the "aremac" projector SixthSense aremac in domewear.jpg
Closeup of dome pendant showing the "aremac" projector
Early breadboard prototype of the aremac SixthSense aremac on breadboard.jpg
Early breadboard prototype of the aremac

Mann developed a laser-based infinite depth-of-focus projector, called an "aremac", to project onto any 3D surface without focus adjustment [3] The projector originally displayed vector graphics rather than raster graphics. [3] A raster graphics version based on a miniature wearable micromirror projector was developed in 2001, which could project onto the wearer's hands, other objects, or the floor or ground allowing it to work with both hand or foot gestures.

Three-dimensional space geometric three-parameter model of the physical universe

Three-dimensional space is a geometric setting in which three values are required to determine the position of an element. This is the informal meaning of the term dimension.

Vector graphics type of 2D digital illustration that uses geometric and styling definitions to represent images

Vector graphics are computer graphics images that are defined in terms of 2D points, which are connected by lines and curves to form polygons and other shapes. Each of these points has a definite position on the x- and y-axis of the work plane and determines the direction of the path; further, each path may have various properties including values for stroke color, shape, curve, thickness, and fill. Vector graphics are commonly found today in the SVG, EPS and PDF graphic file formats and are intrinsically different from the more common raster graphics file formats of JPEG, PNG, APNG, GIF, and MPEG4.

Raster graphics dot matrix data structure, representing a generally rectangular grid of pixels, or points of color, viewable via a monitor, paper, or other display medium

In computer graphics, a raster graphics or bitmap image is a dot matrix data structure that represents a generally rectangular grid of pixels, viewable via a monitor, paper, or other display medium. Raster images are stored in image files with varying formats.

See also

Related Research Articles

PostScript (PS) is a page description language in the electronic publishing and desktop publishing business. It is a dynamically typed, concatenative programming language and was created at Adobe Systems by John Warnock, Charles Geschke, Doug Brotz, Ed Taft and Bill Paxton from 1982 to 1984.

Wearable computer body-wearble miniature electronic devices

Wearable computers, also known as wearables or body-borne computers, are small computing devices that are worn under, with, or on top of clothing.

EyeTap

An EyeTap is a device that is worn in front of the eye that acts as a camera to record the scene available to the eye as well as a display to superimpose computer-generated imagery on the original scene available to the eye. This structure allows the user's eye to operate as both a monitor and a camera as the EyeTap intakes the world around it and augments the image the user sees allowing it to overlay computer-generated data over top of the normal world the user would perceive. The EyeTap is a hard technology to categorize under the three main headers for wearable computing for while it is in theory a constancy technology in nature it also has the ability to augment and mediate the reality the user perceives.

Touchscreen input/output device usually layered on the top of an electronic visual display

A touchscreen, or touch screen, is an input device and normally layered on the top of an electronic visual display of an information processing system. A user can give input or control the information processing system through simple or multi-touch gestures by touching the screen with a special stylus or one or more fingers. Some touchscreens use ordinary or specially coated gloves to work while others may only work using a special stylus or pen. The user can use the touchscreen to react to what is displayed and, if the software allows, to control how it is displayed; for example, zooming to increase the text size.

Evans & Sutherland is a pioneering American computer firm in the computer graphics field. Its current products are used in digital projection environments like planetariums. Its simulation business, which it sold to Rockwell Collins, sold products that were used primarily by the military and large industrial firms for training and simulation.

Keyer Wikimedia disambiguation page

A keyer is a device for signaling by hand, by way of pressing one or more switches. Modern keyers typically have a large number of switches but not as many as a full-size keyboard; typically between four and fifty. A keyer differs from a keyboard in the sense that it lacks a traditional "board"; the keys are arranged in a cluster which is often held in the hand. An example of a very simple keyer is a single telegraph key which used for keying Morse code. In such a use, the term "to key" typically means to turn on and off a carrier wave. For example, it is said that one "keys the transmitter" by interrupting some stage of the amplification of a transmitter with a telegraph key.

Handheld projector image projector in a handheld device

A handheld projector is an image projector in a handheld device. It was developed to as a computer display device for compact portable devices such as mobile phones, personal digital assistants, and digital cameras, which have sufficient storage capacity to handle presentation materials but are too small to accommodate a display screen that an audience can see easily. Handheld projectors involve miniaturized hardware, and software that can project digital images onto a nearby viewing surface.

Wired glove

A wired glove is an input device for human–computer interaction worn like a glove.

Surface computing is the use of a specialized computer GUI in which traditional GUI elements are replaced by intuitive, everyday objects. Instead of a keyboard and mouse, the user interacts with a surface. Typically the surface is a touch-sensitive screen, though other surface types like non-flat three-dimensional objects have been implemented as well. It has been said that this more closely replicates the familiar hands-on experience of everyday object manipulation.

SixthSense

SixthSense is a gesture-based wearable computer system developed at MIT Media Lab by Bruce Willis in 1994 and 1997, and 1998, and further developed by Pranav Mistry, in 2009, both of whom developed both hardware and software for both headworn and neckworn versions of it. It comprises a headworn or neck-worn pendant that contains both a data projector and camera. Headworn versions were built at MIT Media Lab in 1997 that combined cameras and illumination systems for interactive photographic art, and also included gesture recognition.

In computing, a natural user interface, or NUI, or natural interface is a user interface that is effectively invisible, and remains invisible as the user continuously learns increasingly complex interactions. The word natural is used because most computer interfaces use artificial control devices whose operation has to be learned.

PrimeSense

PrimeSense was an Israeli 3D sensing company based in Tel-Aviv. PrimeSense had offices in Israel, North America, Japan, Singapore, Korea, China and Taiwan (China). PrimeSense was bought by Apple Inc. for $360 million on November 24, 2013.

Microsoft Tablet PC

Microsoft Tablet PC is a term coined by Microsoft for tablet computers conforming to a set of specifications announced in 2001 by Microsoft, for a pen-enabled personal computer, conforming to hardware specifications devised by Microsoft and running a licensed copy of Windows XP Tablet PC Edition operating system or a derivative thereof.

Optical head-mounted display wearable device with a display in the users field of view

An optical head-mounted display (OHMD) is a wearable device that has the capability of reflecting projected images as well as allowing the user to see through it. As in augmented reality.

Smartglasses wearable computer that adds information to what the wearer sees

Smartglasses or smart glasses are wearable computer glasses that add information alongside or to what the wearer sees. Alternatively smartglasses are sometimes defined as wearable computer glasses that are able to change their optical properties at runtime. Smart sunglasses which are programmed to change tint by electronic means are an example of the latter type of smartglasses. Superimposing information onto a field of view is achieved through an optical head-mounted display (OHMD) or embedded wireless glasses with transparent heads-up display (HUD) or augmented reality (AR) overlay that has the capability of reflecting projected digital images as well as allowing the user to see through it, or see better with it. While early models can perform basic tasks, such as just serve as a front end display for a remote system, as in the case of smartglasses utilizing cellular technology or Wi-Fi, modern smart glasses are effectively wearable computers which can run self-contained mobile apps. Some are handsfree that can communicate with the Internet via natural language voice commands, while other use touch buttons.

LiveQuartz Graphic editor developed for macOS

LiveQuartz is a basic graphic editor developed for macOS by Romain Piveteau.

References

  1. 1 2 "Telepointer: Hands-Free Completely Self Contained Wearable Visual Augmented Reality without Headwear and without any Infrastructural Reliance", IEEE International Symposium on Wearable Computing (ISWC00), pp. 177, 2000, Los Alamitos, CA, USA
  2. "Cyborg: Digital Destiny and Human Possibility in the Age of the Wearable Computer", Steve Mann with Hal Niedzviecki, ISBN   0-385-65825-7 (Hardcover), Random House Inc, 304 pages, 2001.
  3. 1 2 3 Intelligent Image Processing, John Wiley and Sons, 2001