Sensics

Last updated

Sensics is an American company making virtual reality products for professionals and consumers. [1] [2] Sensics is the co-founder of the OSVR ecosystem and technical lead of its software platform.[ citation needed ]

Contents

Sensics is headquartered in Columbia, Maryland.

Sensics headmount.jpg
XSight HMD.jpg

History

The company's products are based on patented technology developed at Johns Hopkins University at the request of a major car company, starting in 1999. The need presented by this car company was to develop a head-mounted display that had both wide field of view and high resolution, so that a high level of immersion in the virtual world can be achieved. The application was car design, with a focus towards designing the interior of the car, and the thought was that a high-performance head mounted display can shorten the time it takes to bring a new model into market.

Wide field of view and high resolution initially seemed to be contradictory requirements: if a single display element is used, it needs to be magnified to show a wide field of view, but this same magnification reduces the pixel density and makes it seem of lower resolution. The solution was to optically tile multiple displays. Conceptually similar to how multiple desktop PCs can be networked together to form a powerful computer, the team realized the multiple micro-displays can be blended together into a display that has much higher resolution. The project was successful: a prototype model was indeed delivered to that company and was used in the design process of a major family sedan.

After completing this project, Dr. Larry Brown and Marc Shapiro, part of the team that developed this technology at Johns Hopkins University decided to start Sensics to commercialize this product signed a technology licensing deal with the university. The team was able to secure a Phase I and then Phase II SBIR grant from NASA, which allowed it to incubate the company, [3] develop the technology and deliver a working product to NASA. [4]

Product evolution

2006–2013: Professional-grade tiled display systems

In 2006 Sensics hired Yuval Boger as CEO to take the company's products to market.

The company's first commercial product, the piSight [5] was launched in 2006. The initial piSight featured 24 micro-displays, 12 in each eye. Each micro-display was of SVGA resolution, and thus the initial product had nearly 6 million pixels per eye. This resulted in an overall field of view greater than 150 degrees. At the time, operating the piSight required an array of computers, which was required to generate the 24 SVGA signals. These computers had to be networked so that changes in the virtual scene could be synchronized.

While the 24-display piSight was sold towards several high-end uses, Sensics felt that it could offer tiled HMDs to customers that perhaps could not afford the high-end model. The company started offering many different models of its products, where the key difference was the number of micro-displays installed in each. For example, a model with 12 micro displays (6 per eye) could provide over 120 degree field of view, while requiring just 50% of the displays and computing power of the 24-display model. Because these models were quite similar, customers were able to upgrade from one model to a model with greater number of displays.

The early need to use multiple networked computer to drive the HMD was deemed to be a major issue for several customers that could not, or did not wish, to modify their application software to support such networked configuration. To overcome this limitation, Sensics introduced high-speed hardware [6] capable of taking a single video signal and performing real-time splitting of this signal to the lower-resolution signals required by the micro-displays.

The company also introduced the xSight, an HMD with a ski-goggle design, to complement the "over the head" mounting of the earlier piSight.

2010–present: Professional-grade Single-display HMDs

Sensics added a more traditional HMD, the zSight, to its product line. Like many other HMDs on the market, it uses a single display per eye. Though it does not provide a field of view that is as wide as the multi-display products, this design allows for a simpler, lower cost solution that as more portable and more power-efficient than its multi-display counterparts.

2012–present: Emulated optical devices

These are devices such as virtual binoculars and virtual rifle sights. They are typically made by modifying a commercial field binocular or similar device and inserting a micro display, adapting optics and sometimes a motion tracker inside them. The result is a device that looks similar to the original field device but shows an image that is generated by a computer. This is typically used for training applications.

2014–present: Consumer products and the OSVR open-source initiative

Sensics collaborated with Razer Inc. in creating OSVR, an open-source ecosystem that includes both an open-source software platform as well as open-source HMD for VR. Sensics created the software architecture and designed key parts of the OSVR HMD, also known as a Hacker Development Kit (HDK)

Sensics personnel frequently deliver presentation on the OSVR architecture [7] [8] [9]

Products

The company's head mounted display products fall into four categories:

1. Open-source consumer products, through the OSVR initiative that Sensics co-founded.

2. Emulated optical devices which look and feel like actual binoculars, spotter scopes and other optical equipment, but have an embedded micro display in them that presents in image generated from a computer instead of an image out in the real world. Sensics published a white paper [10] explaining the process by which these devices are built

3. Single-display professional products which employ a traditional approach of utilizing a single micro display (such as with 1280x1024 resolution) for each eye. An example of such a product is the zSight. [11]

4. Tiled-display professional products which use a multi-lens system to blend together multiple micro-displays. This approach allows to create head mounted displays that have more pixels than products that use a single micro-display. This is conceptually similar to how individual computers can be connected together in the field of grid computing. For instance, several micro displays with 800x600 pixel resolution can be blended into a 1920x1080 image. An example of such a product is the xSight.

Sensics' products, as do other head-mounted displays, are typically used with peripherals such as those that perform motion tracking and eye tracking.

Applications

The company's products are being used in various applications such as defense, [12] automotive, [13] and academic research. [14]

Related Research Articles

<span class="mw-page-title-main">Pixel</span> Physical point in a raster image

In digital imaging, a pixel, pel, or picture element is the smallest addressable element in a raster image, or the smallest addressable element in a dot matrix display device. In most digital display devices, pixels are the smallest element that can be manipulated through software.

<span class="mw-page-title-main">Virtual reality</span> Computer-simulated experience

Virtual reality (VR) is a simulated experience that employs pose tracking and 3D near-eye displays to give the user an immersive feel of a virtual world. Applications of virtual reality include entertainment, education and business. Other distinct types of VR-style technology include augmented reality and mixed reality, sometimes referred to as extended reality or XR, although definitions are currently changing due to the nascence of the industry.

<span class="mw-page-title-main">Webcam</span> Video camera connected to a computer or network

A webcam is a video camera which is designed to record or stream to a computer or computer network. They are primarily used in video telephony, live streaming and social media, and security. Webcams can be built-in computer hardware or peripheral devices, and are commonly connected to a device using USB or wireless protocols.

<span class="mw-page-title-main">Head-up display</span> Transparent display presenting data within normal sight lines of the user

A head-up display, or heads-up display, also known as a HUD or head-up guidance system (HGS), is any transparent display that presents data without requiring users to look away from their usual viewpoints. The origin of the name stems from a pilot being able to view information with the head positioned "up" and looking forward, instead of angled down looking at lower instruments. A HUD also has the advantage that the pilot's eyes do not need to refocus to view the outside after looking at the optically nearer instruments.

Pixels per inch (ppi) and pixels per centimetre are measurements of the pixel density of an electronic image device, such as a computer monitor or television display, or image digitizing device such as a camera or image scanner. Horizontal and vertical density are usually the same, as most devices have square pixels, but differ on devices that have non-square pixels. Pixel density is not the same as resolution — where the former describes the amount of detail on a physical surface or device, the latter describes the amount of pixel information regardless of its scale. Considered in another way, a pixel has no inherent size or unit, but when it is printed, displayed, or scanned, then the pixel has both a physical size (dimension) and a pixel density (ppi).

<span class="mw-page-title-main">3D display</span> Display device

A 3D display is a display device capable of conveying depth to the viewer. Many 3D displays are stereoscopic displays, which produce a basic 3D effect by means of stereopsis, but can cause eye strain and visual fatigue. Newer 3D displays such as holographic and light field displays produce a more realistic 3D effect by combining stereopsis and accurate focal length for the displayed content. Newer 3D displays in this manner cause less visual fatigue than classical stereoscopic displays.

<span class="mw-page-title-main">Head-mounted display</span> Type of display device

A head-mounted display (HMD) is a display device, worn on the head or as part of a helmet, that has a small display optic in front of one or each eye. An HMD has many uses including gaming, aviation, engineering, and medicine. Virtual reality headsets are HMDs combined with IMUs. There is also an optical head-mounted display (OHMD), which is a wearable display that can reflect projected images and allows a user to see through it.

The Sword of Damocles was the name for an early virtual reality (VR) head-mounted display and tracking system. It is widely considered to be the first augmented reality HMD system, although Morton Heilig had already created a stereoscopic head-mounted viewing apparatus without head tracking earlier, patented in 1960.

The following are common definitions related to the machine vision field.

TDVision Systems, Inc., was a company that designed products and system architectures for stereoscopic video coding, stereoscopic video games, and head mounted displays. The company was founded by Manuel Gutierrez Novelo and Isidoro Pessah in Mexico in 2001 and moved to the United States in 2004.

Document cameras, also known as visual presenters, visualizers, digital overheads, or docucams, are real-time image capture devices for displaying an object to a large audience. Like an opaque projector, a document camera is able to magnify and project the images of actual, three-dimensional objects, as well as transparencies. They are, in essence, high resolution web cams, mounted on arms so as to facilitate their placement over a page. This allows a teacher, lecturer or presenter to write on a sheet of paper or to display a two or three-dimensional object while the audience watches. Theoretically, all objects can be displayed by a document camera. Most objects are simply placed under the camera. The camera takes the picture which in turn produces a live picture using a projector or monitor. Different types of document camera/visualizer allow great flexibility in terms of placement of objects. Larger objects, for example, can simply be placed in front of the camera and the camera rotated as necessary, or a ceiling mounted document camera can also be used to allow a larger working area to be used.

<span class="mw-page-title-main">Helmet-mounted display</span> Headworn device projecting imagery to the eyes

A helmet-mounted display (HMD) is a headworn device that uses displays and optics to project imagery and/or symbology to the eyes. It provides visual information to the user where head protection is required – most notably in military aircraft. The display-optics assembly can be attached to a helmet or integrated into the design of the helmet. An HMD provides the pilot with situation awareness, an enhanced image of the scene, and in military applications cue weapons systems, to the direction their head is pointing. Applications which allow cuing of weapon systems are referred to as helmet-mounted sight and display (HMSD) or helmet-mounted sights (HMS).

<span class="mw-page-title-main">Computer graphics</span> Graphics created using computers

Computer graphics deals with by generating images and art with the aid of computers. Today, computer graphics is a core technology in digital photography, film, video games, digital art, cell phone and computer displays, and many specialized applications. A great deal of specialized hardware and software has been developed, with the displays of most devices being driven by computer graphics hardware. It is a vast and recently developed area of computer science. The phrase was coined in 1960 by computer graphics researchers Verne Hudson and William Fetter of Boeing. It is often abbreviated as CG, or typically in the context of film as computer generated imagery (CGI). The non-artistic aspects of computer graphics are the subject of computer science research.

Ferroelectric Liquid Crystal Display (FLCD) is a display technology based on the ferroelectric properties of chiral smectic liquid crystals as proposed in 1980 by Clark and Lagerwall. Reportedly discovered in 1975, several companies pursued the development of FLCD technologies, notably Canon and Central Research Laboratories (CRL), along with others including Seiko, Sharp, Mitsubishi and GEC. Canon and CRL pursued different technological approaches with regard to the switching of display cells, these providing the individual pixels or subpixels, and the production of intermediate pixel intensities between full transparency and full opacity, these differing approaches being adopted by other companies seeking to develop FLCD products.

Vuzix is an American multinational technology company headquartered in Rochester, New York and founded by Paul Travers in 1997. Vuzix is a supplier of wearable virtual reality and augmented reality display technology. Vuzix manufactures and sells computer display devices and software. Vuzix head-mounted displays are marketed towards mobile and immersive augmented reality applications, such as 3D gaming, manufacturing training, and military tactical equipment. On January 5, 2015, Intel acquired 30% of Vuzix's stock for $24.8 million.

<span class="mw-page-title-main">Optical head-mounted display</span> Type of wearable device

An optical head-mounted display (OHMD) is a wearable device that has the capability of reflecting projected images as well as allowing the user to see through it. In some cases, this may qualify as augmented reality (AR) technology. OHMD technology has existed since 1997 in various forms, but despite a number of attempts from industry, has yet to have had major commercial success.

Liquid Image Corporation was a Winnipeg-based company that manufactured head-mounted displays. The company formed in 1992 by Tony Havelka, David Collette and Shannon O'Brien. Liquid Image was started in Winnipeg, MB in response to the emergence of a market for virtual reality technology. Funding as provided by a group of local angels and the first office was in the attic of Tony Havelka.

<span class="mw-page-title-main">Smartglasses</span> Wearable computers glasses

Smartglasses or smart glasses are eye or head-worn wearable computers that offer useful capabilities to the user. Many smartglasses include displays that add information alongside or to what the wearer sees. Alternatively, smartglasses are sometimes defined as glasses that are able to change their optical properties, such as smart sunglasses that are programmed to change tint by electronic means. Alternatively, smartglasses are sometimes defined as glasses that include headphone functionality.

<span class="mw-page-title-main">Pimax</span> Chinese virtual reality company

Pimax is a technology company specializing in virtual reality hardware products.

References

  1. Newman, Lily Hay (February 3, 2016). "This company waited more than a decade for people to get serious about virtual reality". Slate. Retrieved July 6, 2023.
  2. Pierce, David (January 9, 2012). "Sensics Smart Goggles put your head in the game". The Verge. Retrieved July 6, 2023.
  3. "2011: First to provide real-time image processing for HMDs". Sensics. Archived from the original on 2016-01-23.
  4. http://sensics.com/download/25099/ Building Emulated Military Equipment