This article has multiple issues. Please help improve it or discuss these issues on the talk page . (Learn how and when to remove these template messages)(Learn how and when to remove this template message)
|Also known as||Project Baraboo (in-development)|
|Product family||Windows 10|
|Type||Mixed reality augmented reality head-mounted display smartglasses|
(Development Edition 2) announced May 2, 2019
|Introductory price||$3,000 $5,000 (Commercial Suite)|
|Operating system||Windows Mixed Reality|
|CPU||Intel 32-bit (1GHz)|
|Storage||64 GB (flash memory)|
|Display||2.3 megapixel widescreen head-mounted display|
|Sound||Spatial sound technology|
|Controller input||Gestural commands via sensors and HPU|
|Mass||579 g (1.28 lb)|
Microsoft HoloLens, known under development as Project Baraboo,are a pair of mixed reality smartglasses developed and manufactured by Microsoft. HoloLens was the first head-mounted display running the Windows Mixed Reality platform under the Windows 10 computer operating system. The tracking technology used in HoloLens can trace its lineage to Kinect, an add-on for Microsoft's Xbox game console that was introduced in 2010.
The pre-production version of HoloLens, the Development Edition, shipped on March 30, 2016, and is targeted to developers in the United States and Canada for a list price of $3000.Samsung and Asus have extended an offer to Microsoft to help produce their own mixed-reality products, in collaboration with Microsoft, based around the concept and hardware on HoloLens. On October 12, 2016, Microsoft announced global expansion of HoloLens and publicized that HoloLens would be available for preorder in Australia, Ireland, France, Germany, New Zealand and the United Kingdom. There is also a Commercial Suite (similar to a pro edition of Windows), with enterprise features, such as BitLocker security. As of May 2017, The Suite sold for US$5,000. Microsoft has decided to rent the Hololens without clients making the full investment. Microsoft partner with a company called Abcomrents to give the service of Hololens rental.
HoloLens 2 was announced at the Mobile World Congress (MWC) in Barcelona, Spain, on February 24, 2019,and was available on preorder at US$3,500.
The HoloLens is a head-mounted display unit connected to an adjustable, cushioned inner headband, which can tilt HoloLens up and down, as well as forward and backward.To wear the unit, the user fits the HoloLens on their head, using an adjustment wheel at the back of the headband to secure it around the crown, supporting and distributing the weight of the unit equally for comfort, before tilting the visor towards the front of the eyes.
The front of the unit houses many of the sensors and related hardware, including the processors, cameras and projection lenses. The visor is tinted;enclosed in the visor piece is a pair of transparent combiner lenses, in which the projected images are displayed in the lower half. The HoloLens must be calibrated to the interpupillary distance (IPD), or accustomed vision of the user.
Along the bottom edges of the side, located near the user's ears, are a pair of small, red 3D audio speakers. The speakers, competing against typical sound systems, do not obstruct external sounds, allowing the user to hear virtual sounds, along with the environment.Using head-related transfer functions, the HoloLens generates binaural audio, which can simulate spatial effects; meaning the user, virtually, can perceive and locate a sound, as though it is coming from a virtual pinpoint or location.
On the top edge are two pairs of buttons: display brightness buttons above the left ear, and volume buttons above the right ear.Adjacent buttons are shaped differently—one concave, one convex—so that the user can distinguish them by touch.
At the end of the left arm is a power button and row of five, small individual LED nodes, used to indicate system status, as well as for power management, indicating battery level and setting power/standby mode.A USB 2.0 micro-B receptacle is located along the bottom edge. A 3.5 mm audio jack is located along the bottom edge of the right arm.
The HoloLens features an inertial measurement unit (IMU) (which includes an accelerometer, gyroscope, and a magnetometer)four "environment understanding" sensors (two on each side), an energy-efficient depth camera with a 120°×120° angle of view, a 2.4-megapixel photographic video camera, a four-microphone array, and an ambient light sensor.
In addition to an Intel Cherry Trail SoC containing the CPU and GPU,HoloLens features a custom-made Microsoft Holographic Processing Unit (HPU), a coprocessor manufactured specifically for the HoloLens by Microsoft. The SoC and the HPU each have 1GB LPDDR3 and share 8MB SRAM, with the SoC also controlling 64GB eMMC and running the Windows 10 operating system. The HPU uses 28 custom DSPs from Tensilica to process and integrate data from the sensors, as well as handling tasks such as spatial mapping, gesture recognition, and voice and speech recognition. According to Alex Kipman, the HPU processes "terabytes of information," one attendee estimated that the display field of view of the demonstration units was 30°×17.5°. In an interview at the 2015 Electronic Entertainment Expo in June, Microsoft Vice-President of Next-Gen Experiences, Kudo Tsunoda, indicated that the field of view is unlikely to be significantly different on release of the current version.
The HoloLens contains an internal rechargeable battery, with average life rated at 2–3 hours of active use, or 2 weeks of standby time. The HoloLens can be operated while charging.
HoloLens features IEEE 802.11ac Wi-Fi and Bluetooth 4.1 Low Energy (LE) wireless connectivity. The headset uses Bluetooth LE to pair with the included Clicker, a thumb-sized finger-operating input device that can be used for interface scrolling and selecting. The Clicker features a clickable surface for selecting, and an orientation sensor which provides for scrolling functions via tilting and panning of the unit. The Clicker features an elastic finger loop for holding the device, and a USB 2.0 micro-B receptacle for charging its internal battery.
As of 2016, a number of augmented-reality applications have been announced or showcased for Microsoft HoloLens. A collection of applications will be provided for free for developers purchasing the Microsoft HoloLens Developer Edition. Applications available at launch include:
Other applications announced or showcased for HoloLens include:
HoloLens, through the use of the HPU, uses sensual and natural interface commands—gaze, gesture, and voice—sometimes referred to as "GGV", inputs.Gaze commands, such as head-tracking, allows the user to bring application focus to whatever the user is perceiving. "Elements"—or any virtual application or button—are selected using an air tap method, similar to clicking an imaginary computer mouse. The tap can be held for a drag simulation to move an element, as well as voice commands for certain commands and actions.
The HoloLens shell carries over and adapts many elements from the Windows desktop environment. A "bloom" gesture for accessing the shell (performing a similar function to pressing a Windows key on a Windows keyboard or tablet, or the Xbox button on an Xbox One Controller) is performed by opening one's hand, fingers spread with the palm facing up.Windows can be dragged to a particular position, as well as resized. Virtual elements such as windows or menus can be "pinned" to locations, physical structures or objects within the environment; or can be "carried," or fixed in relation to the user, following the user as they move around. Title bars for application windows have a title on the left, and buttons for window management functions on the right.
In April 2016 Microsoft Created the Microsoft HoloLens App for Windows 10 PC's and Windows 10 Mobile devices, that allows developers to run apps, use his or her phone or PC's keyboard to type text, view a live stream from the HoloLens user's point of view, and remotely capture mixed reality photos and videos.
Microsoft Visual Studio is an IDE that can be used to develop applications (both 2D and 3D) for HoloLens. Applications can be tested using HoloLens emulator (included into Visual Studio 2015 IDE) or HoloLens Development Edition.
HoloLens can run almost all Universal Windows Platform apps.These apps appear as 2D projections. Not all Windows 10 APIs are currently supported by HoloLens, but in most cases the same app is able to run across all Windows 10 devices (including HoloLens), and the same tools that are used to develop applications for Windows PC or Windows Phone can be used to develop a HoloLens app.
3D applications, or "holographic" applications, use Windows Holographic APIs. Microsoft recommends Unity engine and Vuforia to create 3D apps for HoloLens, but it's also possible for a developer to build their own engine using DirectX and Windows APIs.
In November 2018 Microsoft got a contract for the supply of 100,000 HoloLens MR glasses, worth US$479 million, to the U.S. military.The MR goggles are intended to provide "increased lethality, mobility, and situational awareness necessary to achieve overmatch against [...] current and future adversaries.".
Just before the opening of one of the largest international technology conferences - the GSMA Mobile World Congress 2019 in Barcelona - fifty Microsoft employees wrote a letter to their CEO Satya Nadella and President Brad Smith stating that they "refuse to develop technologies for warfare and oppression". They demanded that corporate management terminate the contract.
Virtual reality (VR) is a simulated experience that can be similar to or completely different from the real world. Applications of virtual reality include entertainment, education and business. Other distinct types of VR-style technology include augmented reality and mixed reality, sometimes referred to as extended reality or XR.
Augmented reality (AR) is an interactive experience of a real-world environment where the objects that reside in the real world are enhanced by computer-generated perceptual information, sometimes across multiple sensory modalities, including visual, auditory, haptic, somatosensory and olfactory. AR can be defined as a system that incorporates three basic features: a combination of real and virtual worlds, real-time interaction, and accurate 3D registration of virtual and real objects. The overlaid sensory information can be constructive, or destructive. This experience is seamlessly interwoven with the physical world such that it is perceived as an immersive aspect of the real environment. In this way, augmented reality alters one's ongoing perception of a real-world environment, whereas virtual reality completely replaces the user's real-world environment with a simulated one. Augmented reality is related to two largely synonymous terms: mixed reality and computer-mediated reality.
Mixed reality (MR) is the merging of real and virtual worlds to produce new environments and visualizations, where physical and digital objects co-exist and interact in real time. Mixed reality does not exclusively take place in either the physical world or virtual world, but is a hybrid of reality and virtual reality. Augmented reality, a related term, takes place in the physical world, with information or objects added virtually.
Microsoft Software Updater is a Windows and OS X based application launched in 2006, that enables customers to update and recover their mobile device firmware of a S40 or S60 or Lumia device from any Internet enabled access point. To avoid data loss users are prompted with on-screen advice on how to safely update their device.
Microsoft engineering groups are the operating divisions of Microsoft. Starting in April 2002, Microsoft organised itself into seven groups, each an independent financial entity. In September 2005, Microsoft announced a reorganization of its then seven groups into three. In July 2013, Microsoft announced another reorganization into five engineering groups and six corporate affairs groups. A year later, in June 2015, Microsoft reformed into three engineering groups. In September 2016, a new group was created to focus on artificial intelligence and research. On March 29, 2018, a new structure merged all of these into three.
Wearable technology, wearables, fashion technology, smartwear, tech togs, skin electronics or fashion electronics are smart electronic devices that are worn close to and/or on the surface of the skin, where they detect, analyze, and transmit information concerning e.g. body signals such as vital signs, and/or ambient data and which allow in some cases immediate biofeedback to the wearer.
A virtual touch screen (VTS) is a user interface system that augments virtual objects into reality either through a projector or optical display using sensors to track a person's interaction with the object. For instance, using a display and a rear projector system a person could create images that look three-dimensional and appear to float in midair. Some systems utilize an optical head-mounted display to augment the virtual objects onto the transparent display utilizing sensors to determine visual and physical interactions with the virtual objects projected.
Oculus Rift is a line of virtual reality headsets developed and manufactured by Oculus VR, a division of Facebook Inc., released on March 28, 2016.
An optical head-mounted display (OHMD) is a wearable device that has the capability of reflecting projected images as well as allowing the user to see through it, similar to augmented reality technology. OHMD technology has existed since 1997 in various forms, but despite a number of attempts from industry, has yet to be commercialised.
Smartglasses or smart glasses are wearable computer glasses that add information alongside or to what the wearer sees. Alternatively, smartglasses are sometimes defined as wearable computer glasses that are able to change their optical properties at runtime. Smart sunglasses which are programmed to change tint by electronic means are an example of the latter type of smartglasses.
Magic Leap, Inc. is an American startup company that released a head-mounted virtual retinal display, called Magic Leap One, which superimposes 3D computer-generated imagery over real world objects, by "projecting a digital light field into the user's eye", involving technologies potentially suited to applications in augmented reality and computer vision. It is attempting to construct a light-field chip using silicon photonics.
Windows Mixed Reality is a mixed reality platform introduced as part of the Windows 10 operating system, which provides augmented reality and mixed reality experiences with compatible head-mounted displays.
Sidekick is a project developed by NASA and Microsoft to provide virtual aid for astronauts using the Microsoft HoloLens augmented-reality headset. As of December 2015, Sidekick is deployed at the International Space Station.
A virtual reality headset is a head-mounted device that provides virtual reality for the wearer. Virtual reality (VR) headsets are widely used with video games but they are also used in other applications, including simulators and trainers. They comprise a stereoscopic head-mounted display, stereo sound, and head motion tracking sensors. Some VR headsets also have eye tracking sensors and gaming controllers.
AltspaceVR is a social VR platform that was founded in 2013 and launched its initial product in May 2015. In 2017 it was acquired by Microsoft and is now part of the Mixed Reality division within the Cloud and AI group. Some elements of the platform appear in Microsoft Mesh.
A vision processing unit (VPU) is an emerging class of microprocessor; it is a specific type of AI accelerator, designed to accelerate machine vision tasks.
OpenXR is an open, royalty-free standard for access to virtual reality and augmented reality platforms and devices. It is developed by a working group managed by the Khronos Group consortium. OpenXR was announced by the Khronos Group on February 27, 2017 during GDC 2017. A provisional version of the standard was released on March 18, 2019 to enable developers and implementers to provide feedback on it. On July 29, 2019, OpenXR 1.0 was released to the public by Khronos Group at SIGGRAPH 2019.
Microsoft HoloLens 2 is a pair of mixed reality smartglasses developed and manufactured by Microsoft. It is the successor to the pioneering Microsoft HoloLens. On February 24, 2019 the HoloLens 2 enterprise edition debuted as the first variant of the device, followed by a developer edition that was announced on May 2, 2019. It was subsequently released in limited numbers on November 7, 2019.
The Azure Kinect DK is a developer kit and PC peripheral which employs the use of artificial intelligence sensors for computer vision and speech models, and is connected to the Microsoft Azure cloud. It is the successor to the Microsoft Kinect line of sensors.
Microsoft Holoportation is a project from Microsoft Research that demonstrates real-time holographic communications with the Microsoft Hololens. Holoportation is described as "a new type of 3D capture technology that allows high-quality 3D models of people to be reconstructed, compressed and transmitted anywhere in the world in real time. This allows users wearing virtual or augmented reality displays to see, hear and interact with remote participants in 3D, almost as if they were present in the same physical space. From an audio-visual perspective, communicating and interacting with remote users edges closer to face-to-face communication." In March 2016, Alex Kipman performed a live demonstration of the technology at the TED conference as part of his talk. The project was active as of 2019.
We will work to get devices out as quickly as possible. As soon as additional devices are available, more accepted applicants will be invited to purchase.
That means very little pressure on your nose, and even if you’re wearing glasses you can generally find a workable way to keep them on underneath.
HoloLens is the first—and so far—only holographic computer out there. [...] I hope that in the not-so-distant future there will be many such devices. [...] This is running Windows 10. All of the APIs for human and environment understanding are part of Windows, and this version of Windows that we put on this device—we call it Windows Holographic.
One Microsoft employee [...] typed my IPD (interpupillary distance) into a connected PC. Microsoft says the final version will automatically measure the distnace [ sic ] between your eyes, but the prototypes don’t have that feature yet.
This custom silicon efficiently processes data from the sensors, resulting in a relatively simple yet informative output that can be easily used by developers so they can focus on creating amazing experiences without having to work through complex physics calculations.
As I was stripped of all devices and gadgets before being allowed into the demo room, I had to guesstimeasure it by covering the visible screen with my hands (fingers splayed) at arm’s length, ending up with 1 3/4 hands horizontally, and 1 hand vertically (in other words, a 16:9 screen aspect ratio) (see Figure 1). In non-Doc-Ok units, that comes out to about 30° by 17.5° (for comparison, the Oculus Rift DK2′s field of view is about 100° by 100°).
the hardware we have now [...] the field of view isn't exactly final, but I wouldn't say it's going to be [...] hugely, noticeably different, either.
...but the rover moves everyday, and we wanted this tool to be useful operationally, so we actually needed to, not just do this once, but we needed a way to create these scenes easily and automatically as the rover moves, and new imagery is downlinked.Abercrombie, Parker (January 23, 2016). A Cloud-based Architecture for Processing 3D Mars Terrain (PDF). SCaLE 14x — The Fourteenth Annual Southern California Linux Expo . Retrieved February 17, 2016.
It's a new application under development in my lab, and we're talking about it publicly for the first time today. It's a tool for spacecraft designers, and it borrows a lot of technology from the work that we're doing for our applications on the International Space Station.
Each lens has three layers of glass—in blue, green, and red—full of microthin corrugated grooves that diffract light. [...] A "light engine" above the lenses projects light into the glasses, where it hits the grating and then volleys between the layers of glass millions of times.