Project Digits

Last updated

Microsoft Digits
Also known asDigits
Developer Microsoft
Type Gesture recognition, Natural user interface
Release datePrototype displayed 9 October 2012 [1]
InputInfrared Camera Sensor, IR laser line generator, IR diffuse illuminator, inertial-measurement unit (IMU)
Website research.microsoft.com/en-us/projects/digits/

Project Digits is a Microsoft Research Project under Microsoft's computer science laboratory at the University of Cambridge; researchers from Newcastle University and University of Crete are also involved in this project. [1] Project is led by David Kim, a Microsoft Research PhD and also a PhD student in computer science at Newcastle University. [2] Digits is an input device which can be mounted on the wrist of human hand and it captures and displays a complete 3D graphical representation of the user's hand on screen without using any external sensing device or hand covering material like data gloves. [3] This project aims to make gesture-controlled interfaces completely hands free with greater mobility and accuracy. It allows user to interact with whatever hardware while moving from room to room or walking down the street without any line of sight connection with the hardware. [4]

Contents

Prototype

Prototype of the device was displayed at a conference on user interface technology in Massachusetts on 9 October 2012. [1] System is created using off the shelf hardware and consumes low power. [5] The Device uses Infrared-Camera sensor which detects infrared light and then the data is fed to the software which interprets it to create a 3D model of the human hand. Data changes according to the position of real hand and then so does the 3D representation also. The Infrared laser beam is used to determine the distance to fingers and thumbs to obtain the accurate orientation of the hands. Further, Infrared LED’s helps to determine the exact position of the fingertips, as the light bounced back from fingers is captured by the camera. One of the benefits of IR LED is that human eye cannot detect it, hence it does not disturbs the user while using the device. [6] "Ultimately we would like to reduce Digits to the size of a watch that can be worn all the time, We want users to be able to interact spontaneously with their electronic devices using simple gestures and not even have to reach for their devices." Quoted by David Kim Project Leader. [1]

Usability

Digits can be used to control various devices.

  1. User can control mobile phone interface without line of sight interaction. For example, user can twist an imaginary dial to control the frequency of radio and slide an imaginary slider to control the volume of music being played. User can also tap on an imaginary keypad to dial a number without taking out mobile from their pocket. [1]
  2. Using digits, user can play video games without using a controller. For example, user can use hand gestures to pick up objects in game, mimic a virtual gun from their hand and press the barrel etc. This type of gaming interaction has not been achieved yet. [1]
  3. Three Dimensional gesture controls can be used to control tablets and computers, 3D representation of hand can be used to navigate around in operating systems instead of a mouse, user can tap onto virtual keyboard to type, a pinching action can be used to zoom into image or documents etc. [1]
  4. Microsoft might also pair this device with Xbox Kinect, to achieve greater level of interaction with gaming consoles. [7]

Microsoft Demonstrated usability of digits in a video. [8]

Reception

Features of Digits look promising, but some gesture tech researchers believe that people would prefer sensing technology embedded into the device, instead of wearing it on the wrist. [1]

Dr Richard Picking, reader in human-computer interaction at Glyndwr University quoted to BBC that "This portable, mobile solution is an interesting development with potential for novel applications." [1] There have been attempts at gesture sensing technology like data gloves, which failed to make an impact and were only limited to video game industry, and there is a chance that Digits might end up like that. Also, there is not enough evidence that how accurate and reliable the technology in the device is, especially the camera, if the camera is displaced slightly then does the device still work effectively? Comfort-ability of the device is also not known. [1]

However, Microsoft team is aware of all the pros and cons of the device and believe that significant modification needs to be made before releasing the product in the market. [1]

See also

Related Research Articles

<span class="mw-page-title-main">Computer mouse</span> Pointing device used to control a computer

A computer mouse is a hand-held pointing device that detects two-dimensional motion relative to a surface. This motion is typically translated into the motion of the pointer on a display, which allows a smooth control of the graphical user interface of a computer.

<span class="mw-page-title-main">Graphical user interface</span> User interface allowing interaction through graphical icons and visual indicators

A graphical user interface, or GUI, is a form of user interface that allows users to interact with electronic devices through graphical icons and visual indicators such as secondary notation. In many applications, GUIs are used instead of text-based UIs, which are based on typed command labels or text navigation. GUIs were introduced in reaction to the perceived steep learning curve of command-line interfaces (CLIs), which require commands to be typed on a computer keyboard.

<span class="mw-page-title-main">Pointing device</span> Human interface device for computers

A pointing device is a human interface device that allows a user to input spatial data to a computer. Graphical user interfaces (GUI) and CAD systems allow the user to control and provide data to the computer using physical gestures by moving a hand-held mouse or similar device across the surface of the physical desktop and activating switches on the mouse. Movements of the pointing device are echoed on the screen by movements of the pointer and other visual changes. Common gestures are point and click and drag and drop.

<span class="mw-page-title-main">Augmented reality</span> View of the real world with computer-generated supplementary features

Augmented reality (AR) is an interactive experience that combines the real world and computer-generated 3D content. The content can span multiple sensory modalities, including visual, auditory, haptic, somatosensory and olfactory. AR can be defined as a system that incorporates three basic features: a combination of real and virtual worlds, real-time interaction, and accurate 3D registration of virtual and real objects. The overlaid sensory information can be constructive, or destructive. As such, it is one of the key technologies in the reality-virtuality continuum.

<span class="mw-page-title-main">Handheld projector</span> Image projector in a handheld device

A handheld projector is an image projector in a handheld device. It was developed as a computer display device for compact portable devices such as mobile phones, personal digital assistants, and digital cameras, which have sufficient storage capacity to handle presentation materials but are too small to accommodate a display screen that an audience can see easily. Handheld projectors involve miniaturized hardware, and software that can project digital images onto a nearby viewing surface.

<span class="mw-page-title-main">Gesture recognition</span> Topic in computer science and language technology

Gesture recognition is an area of research and development in computer science and language technology concerned with the recognition and interpretation of human gestures. A subdiscipline of computer vision, it employs mathematical algorithms to interpret gestures.

<span class="mw-page-title-main">User interface design</span> Planned operator–machine interaction

User interface (UI) design or user interface engineering is the design of user interfaces for machines and software, such as computers, home appliances, mobile devices, and other electronic devices, with the focus on maximizing usability and the user experience. In computer or software design, user interface (UI) design primarily focuses on information architecture. It is the process of building interfaces that clearly communicate to the user what's important. UI design refers to graphical user interfaces and other forms of interface design. The goal of user interface design is to make the user's interaction as simple and efficient as possible, in terms of accomplishing user goals.

<span class="mw-page-title-main">Wired glove</span> Input device for human–computer interaction

A wired glove is an input device for human–computer interaction worn like a glove.

<span class="mw-page-title-main">Multi-touch</span> Technology

In computing, multi-touch is technology that enables a surface to recognize the presence of more than one point of contact with the surface at the same time. The origins of multitouch began at CERN, MIT, University of Toronto, Carnegie Mellon University and Bell Labs in the 1970s. CERN started using multi-touch screens as early as 1976 for the controls of the Super Proton Synchrotron. Capacitive multi-touch displays were popularized by Apple's iPhone in 2007. Multi-touch may be used to implement additional functionality, such as pinch to zoom or to activate certain subroutines attached to predefined gestures using gesture recognition.

<span class="mw-page-title-main">Microsoft PixelSense</span> Interactive surface computing platform by Microsoft

Microsoft PixelSense was an interactive surface computing platform that allowed one or more people to use and touch real-world objects, and share digital content at the same time. The PixelSense platform consists of software and hardware products that combine vision based multitouch PC hardware, 360-degree multiuser application design, and Windows software to create a natural user interface (NUI).

Surface computing is the use of a specialized computer GUI in which traditional GUI elements are replaced by intuitive, everyday objects. Instead of a keyboard and mouse, the user interacts with a surface. Typically the surface is a touch-sensitive screen, though other surface types like non-flat three-dimensional objects have been implemented as well. It has been said that this more closely replicates the familiar hands-on experience of everyday object manipulation.

In computing, 3D interaction is a form of human-machine interaction where users are able to move and perform interaction in 3D space. Both human and machine process information where the physical position of elements in the 3D space is relevant.

In computing, a natural user interface (NUI) or natural interface is a user interface that is effectively invisible, and remains invisible as the user continuously learns increasingly complex interactions. The word "natural" is used because most computer interfaces use artificial control devices whose operation has to be learned. Examples include voice assistants, such as Alexa and Siri, touch and multitouch interactions on today's mobile phones and tablets, but also touch interfaces invisibly integrated into the textiles furnitures.

GestureTek is an American-based interactive technology company headquartered in Silicon Valley, California, with offices in Toronto and Ottawa, Ontario and Asia.

<span class="mw-page-title-main">Input device</span> Device that provides data and signals to a computer

In computing, an input device is a piece of equipment used to provide data and control signals to an information processing system, such as a computer or information appliance. Examples of input devices include keyboards, computer mice, scanners, cameras, joysticks, and microphones.

<span class="mw-page-title-main">PrimeSense</span> Former Israeli company

PrimeSense was an Israeli 3D sensing company based in Tel Aviv. PrimeSense had offices in Israel, North America, Japan, Singapore, Korea, China and Taiwan. PrimeSense was bought by Apple Inc. for $360 million on November 24, 2013.

<span class="mw-page-title-main">Optical head-mounted display</span> Type of wearable device

An optical head-mounted display (OHMD) is a wearable device that has the capability of reflecting projected images as well as allowing the user to see through it. In some cases, this may qualify as augmented reality (AR) technology. OHMD technology has existed since 1997 in various forms, but despite a number of attempts from industry, has yet to have had major commercial success.

<span class="mw-page-title-main">Microsoft HoloLens</span> Mixed reality smartglasses

Microsoft HoloLens is an augmented reality (AR)/mixed reality (MR) headset developed and manufactured by Microsoft. HoloLens runs the Windows Mixed Reality platform under the Windows 10 operating system. Some of the positional tracking technology used in HoloLens can trace its lineage to the Microsoft Kinect, an accessory for Microsoft's Xbox 360 and Xbox One game consoles that was introduced in 2010.

<span class="mw-page-title-main">Chris Harrison (computer scientist)</span> American computer scientist

Chris Harrison is a British-born, American computer scientist and entrepreneur, working in the fields of human–computer interaction, machine learning and sensor-driven interactive systems. He is a professor at Carnegie Mellon University and director of the Future Interfaces Group within the Human–Computer Interaction Institute. He has previously conducted research at AT&T Labs, Microsoft Research, IBM Research and Disney Research. He is also the CTO and co-founder of Qeexo, a machine learning and interaction technology startup.

Ken Hinckley is an American computer scientist and inventor. He is a senior principal research manager at Microsoft Research. He is known for his research in human-computer interaction, specifically on sensing techniques, pen computing, and cross-device interaction.

References

  1. 1 2 3 4 5 6 7 8 9 10 11 "Microsoft's Digits hand-gesture sensor bracelet detailed". BBC News. 9 October 2012. Retrieved 31 March 2018.
  2. ↑ "David Kim Details".
  3. ↑ "Microsoft Research: Digits description".
  4. ↑ "Project Digits details and opinions".
  5. ↑ "Microsoft Project Digits details".
  6. ↑ "How digits can take over keyboard and mice".
  7. ↑ "BBC Project Digits uses".
  8. ↑ "Video Demonstration of Digits".


This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.