Smartglasses or smart glasses are eye or head-worn wearable computers. Many smartglasses include displays that add information alongside or to what the wearer sees. [1] [2] [3] Alternatively, smartglasses are sometimes defined as glasses that are able to change their optical properties, such as smart sunglasses that are programmed to change tint by electronic means. [4] Alternatively, smartglasses are sometimes defined as glasses that include headphone functionality.
A pair of smartglasses can be considered an augmented reality device if it performs pose tracking.
Superimposing information onto a field of view is achieved through an optical head-mounted display (OHMD) or embedded wireless glasses with transparent heads-up display (HUD) or augmented reality (AR) overlay. These systems have the capability to reflect projected digital images as well as allowing the user to see through it or see better with it. While early models can perform basic tasks, such as serving as a front end display for a remote system, as in the case of smartglasses utilizing cellular technology or Wi-Fi, modern smart glasses are effectively wearable computers which can run self-contained mobile apps. Some are handsfree and can communicate with the Internet via natural language voice commands, while others use touch buttons. [5] [6] [7] [8] [9]
Like other computers, smartglasses may collect information from internal or external sensors. It may control or retrieve data from other instruments or computers. In most cases, it supports wireless technologies like Bluetooth, Wi-Fi, and GPS. A small number of models run a mobile operating system and function as portable media players to send audio and video files to the user via a Bluetooth or WiFi headset. [10] [11] Some smartglasses models also feature full lifelogging and activity tracker capability. [12] [13] [14] [15]
Smartglasses devices may also have features found on a smartphone. [16] [17] Some have activity tracker functionality features (also known as "fitness tracker") as seen in some GPS watches. [18] [19]
As with other lifelogging and activity tracking devices, the GPS tracking unit and digital camera of some smartglasses can be used to record historical data. For example, after the completion of a workout, data can be uploaded into a computer or online to create a log of exercise activities for analysis. Some smart watches can serve as full GPS navigation devices, displaying maps and current coordinates. Users can "mark" their current location and then edit the entry's name and coordinates, which enables navigation to those new coordinates. [20] [21]
Although some smartglasses models manufactured in the 21st century are completely functional as standalone products, most manufacturers recommend or even require that consumers purchase mobile phone handsets that run the same operating system so that the two devices can be synchronized for additional and enhanced functionality. The smartglasses can work as an extension, for head-up display (HUD) or remote control of the phone and alert the user to communication data such as calls, SMS messages, emails, and calendar invites. [22]
Smart glasses could be used as a body camera. In 2018, Chinese police in Zhengzhou and Beijing were using smart glasses to take photos which are compared against a government database using facial recognition to identify suspects, retrieve an address, and track people moving beyond their home areas. [23] [24]
Several proofs of concept for Google Glasses have been proposed in healthcare. In July 2013, Lucien Engelen started research on the usability and impact of Google Glass in health care. Engelen, who is based at Singularity University and in Europe at Radboud University Medical Center, [25] is participating in the Glass Explorer program. [26]
Key findings of Engelen's research included:
Dr. Phil Haslam and Dr. Sebastian Mafeld demonstrated the first concept for Google Glass in the field of interventional radiology. They demonstrated the manner in which the concept of Google Glass could assist a liver biopsy and fistulaplasty, and the pair stated that Google Glass has the potential to improve patient safety, operator comfort, and procedure efficiency in the field of interventional radiology. [29] In June 2013, surgeon Dr. Rafael Grossmann was the first person to integrate Google Glass into the operating theater, when he wore the device during a PEG (percutaneous endoscopic gastrostomy) procedure. [30] In August 2013, Google Glass was also used at Wexner Medical Center at Ohio State University. Surgeon Dr. Christopher Kaeding used Google Glass to consult with a colleague in a distant part of Columbus, Ohio. A group of students at The Ohio State University College of Medicine also observed the operation on their laptop computers. Following the procedure, Kaeding stated, "To be honest, once we got into the surgery, I often forgot the device was there. It just seemed very intuitive and fit seamlessly." [31]
16 November 2013, in Santiago de Chile, the maxillofacial team led by Dr.gn Antonio Marino conducted the first orthognathic surgery assisted with Google Glass in Latin America, interacting with them and working with simultaneous three-dimensional navigation. The surgical team was interviewed by ADN radio. [32] In January 2014, Indian Orthopedic Surgeon Selene G. Parekh conducted the foot and ankle surgery using Google Glass in Jaipur, which was broadcast live on Google website via the internet. The surgery was held during a three-day annual Indo-US conference attended by a team of experts from the US and co-organized by Ashish Sharma. Sharma said Google Glass allows looking at an X-Ray or MRI without taking the eye off of the patient and allows a doctor to communicate with a patient's family or friends during a procedure.
In Australia, during January 2014, Melbourne tech startup Small World Social collaborated with the Australian Breastfeeding Association to create the first hands-free breastfeeding Google Glass application for new mothers. [33] The application, named Google Glass Breastfeeding app trial, allows mothers to nurse their baby while viewing instructions about common breastfeeding issues (latching on, posture etc.) or call a lactation consultant via a secure Google Hangout, who can view the issue through the mother's Google Glass camera. [34] The trial was successfully concluded in Melbourne in April 2014, and 100% of participants were breastfeeding confidently. [35] [36]
Various techniques have existed for see-through HMDs. Most of these techniques can be summarized into two main families: "Curved Mirror" (or Curved Combiner) based and "Waveguide" or "Light-guide" based. The mirror technique has been used in EyeTaps, by Meta in their Meta 1, by Vuzix in their Star 1200 product, by Olympus, and by Laster Technologies.
Various waveguide techniques have existed for some time. These techniques include diffraction optics, holographic optics, polarized optics, reflective optics, and projection:
The Technical Illusions castAR uses a different technique with clear glass. The glasses have a projector, and the image is returned to the eye by a reflective surface.
Lastly, there is a technique more popular with hobbyists due to its low cost which requires using a magnifying lens to focus the screen onto the eye. [39]
Smart sunglasses which are able to change their light filtering properties at runtime generally use liquid crystal technology. As lighting conditions change, for example when the user goes from indoors to outdoors, the brightness ratio also changes and can cause undesirable vision impairment. An attractive solution for overcoming this issue is to incorporate dimming filters into smart sunglasses which control the amount of ambient light reaching the eye. An innovative liquid crystal based component for use in the lenses of smart sunglasses is PolarView [40] by LC-Tec. [41] PolarView offers analog dimming control, with the level of dimming being adjusted by an applied drive voltage.
Another type of smart sunglasses uses adaptive polarization filtering (ADF). ADF-type smart sunglasses can change their polarization filtering characteristics at runtime. For example, ADF-type smart sunglasses can change from horizontal polarization filtering to vertical polarization filtering at the touch of a button.
The lenses of smart sunglasses can be manufactured out of multiple adaptive cells, therefore different parts of the lens can exhibit different optical properties. For example, the top of the lens can be electronically configured to have different polarization filter characteristics and different opacity than the lower part of the lens. [42]
Head-mounted displays are not designed to be workstations, and traditional input devices such as keyboard and mouse do not support the concept of smartglasses. Instead human–computer interface (HCI) control input needs to be methods lend themselves to mobility and/or hands-free use are good candidates, for example:
Analytics company IHS has estimated that the shipments of smart glasses may rise from just 50,000 units in 2012 to as high as 6.6 million units in 2016. [68] According to a survey of more than 4,600 U.S. adults conducted by Forrester Research, around 12 percent of respondents are willing to wear Google Glass or other similar devices if it offers a service that piques their interest. [69] Business Insider's BI Intelligence expects an annual sales of 21 million Google Glass units by 2018. [70] [71] [72] Samsung and Microsoft are expected to develop their own version of Google Glass within six months with a price range of $200 to $500. Samsung has reportedly bought lenses from Lumus, a company based in Israel. Another source says Microsoft is negotiating with Vuzix. [73] In 2006, Apple filed patent for its own HMD device. [74] In July 2013, APX Labs founder and CEO Brian Ballard stated that he knows of 25 to 30 hardware companies which are working on their own versions of smartglasses, some of which APX is working with. [75]
In November 2012, Google Glass received recognition by Time Magazine as one of the "Best Inventions of the Year 2012", alongside inventions such as the Curiosity Rover. [76]
John Naughton praised the Google Glass and compared it with the achievements of hardware and networking pioneer Douglas Engelbart. Naughton wrote that Engelbart believed that machines "should do what machines do best, thereby freeing up humans to do what they do best". [77] Lisa A. Goldstein, a freelance journalist, published a review on 6 August 2013, which stated that Google Glass does not accommodate hearing aids and is not suitable for people who cannot understand speech. Goldstein also explained the limited options for customer support, as telephone contact was her only means of communication. [78]
In December 2013, David Datuna became the first artist to incorporate Google Glass into a contemporary work of art. [79] [80] The artwork debuted at a private event at The New World Symphony in Miami Beach, Florida, US and was moved to the Miami Design District for the public debut. [81] Over 1500 people used Google Glass to experience Datuna's American flag from his "Viewpoint of Billions" series. [82]
After a negative public reaction, the retail availability of Google Glass ended in January 2015, and the company moved to focus on business customers in 2017.
The EyeTap's functionality and minimalist appearance have been compared to Steve Mann's EyeTap, [83] also known as "Glass" or "Digital Eye Glass", although Google Glass is a "Generation-1 Glass" compared to EyeTap, which is a "Generation-4 Glass". [84] According to Mann, both devices affect both privacy and secrecy by introducing a two-sided surveillance and sousveillance. [85] Concerns have been raised by various sources regarding the intrusion of privacy, and the etiquette and ethics of using the device in public and recording people without their permission. [86] [87] [88] There is controversy that Google Glass would violate privacy rights due to security problems and others. [89] [90] [91]
Privacy advocates are concerned that people wearing such eyewear may be able to identify strangers in public using facial recognition, or surreptitiously record and broadcast private conversations. [8] Some companies in the U.S. have posted anti-Google Glass signs in their establishments. [92] [93] In July 2013, prior to the official release of the product, Stephen Balaban, co-founder of software company Lambda Labs, circumvented Google's facial recognition app block by building his own, non-Google-approved operating system. Balaban then installed face-scanning Glassware that creates a summary of commonalities shared by the scanned person and the Glass wearer, such as mutual friends and interests. [94] Additionally, Michael DiGiovanni created Winky, a program that allows a Google Glass user to take a photo with a wink of an eye, while Marc Rogers, a principal security researcher at Lookout, discovered that Glass can be hijacked if a user could be tricked into taking a picture of a malicious QR code. [95] [96]
Other concerns have been raised regarding legality of Google Glass in a number of countries, particularly in Russia, Ukraine, and other post-USSR countries. In February 2013, a Google+ user noticed legal issues with Google Glass and posted in the Google Glass community about the issues, stating that the device may be illegal to use according to the current legislation in Russia and Ukraine, which prohibits use of spy gadgets that can record video, audio or take photographs in an inconspicuous manner. [97] Concerns were also raised in regard to the privacy and security of Google Glass users in the event that the device is stolen or lost, an issue that was raised by a US congressional committee. As part of its response to the governmental committee, Google stated in early July that is working on a locking system and raising awareness of the ability of users to remotely reset Google Glass from the web interface in the event of loss. Several facilities have banned the use of Google Glass before its release to the general public, citing concerns over potential privacy-violating capabilities. Other facilities, such as Las Vegas casinos, banned Google Glass, citing their desire to comply with Nevada state law and common gaming regulations which ban the use of recording devices near gambling areas. [98]
Concerns have also been raised on operating motor vehicles while wearing the device. On 31 July 2013 it was reported that driving while wearing Google Glass is likely to be banned in the UK, being deemed careless driving, therefore a fixed penalty offense, following a decision by the Department for Transport. [99] In the U.S., West Virginia state representative Gary G. Howell introduced an amendment in March 2013 to the state's law against texting while driving that would include bans against "using a wearable computer with head mounted display." In an interview, Howell stated, "The primary thing is a safety concern, it [the glass headset] could project text or video into your field of vision. I think there's a lot of potential for distraction." [100]
In October 2013, a driver in California was ticketed for "driving with monitor visible to driver (Google Glass)" after being pulled over for speeding by a San Diego Police Department officer. The driver was reportedly the first to be ticketed for driving while wearing a Google Glass. [101] While the judge noted that 'Google Glass fell under "the purview and intent" of the ban on driving with a monitor', the case was thrown out of court due to lack of proof the device was on at the time. [102]
A wearable computer, also known as a body-borne computer, is a computing device worn on the body. The definition of 'wearable computer' may be narrow or broad, extending to smartphones or even ordinary wristwatches.
Augmented reality (AR) is an interactive experience that combines the real world and computer-generated 3D content. The content can span multiple sensory modalities, including visual, auditory, haptic, somatosensory and olfactory. AR can be defined as a system that incorporates three basic features: a combination of real and virtual worlds, real-time interaction, and accurate 3D registration of virtual and real objects. The overlaid sensory information can be constructive, or destructive. As such, it is one of the key technologies in the reality-virtuality continuum.
Ray-Ban is a brand of luxury sunglasses and eyeglasses created in 1936 by Bausch & Lomb. The brand is best known for its Wayfarer and Aviator lines of sunglasses. In 1999, Bausch & Lomb sold the brand to Italian eyewear conglomerate Luxottica Group for a reported $640 million.
An EyeTap is a concept for a wearable computing device that is worn in front of the eye that acts as a camera to record the scene available to the eye as well as a display to superimpose computer-generated imagery on the original scene available to the eye. This structure allows the user's eye to operate as both a monitor and a camera as the EyeTap intakes the world around it and augments the image the user sees allowing it to overlay computer-generated data over top of the normal world the user would perceive.
Computer-mediated reality refers to the ability to add to, subtract information from, or otherwise manipulate one's perception of reality through the use of a wearable computer or hand-held device such as a smartphone.
A head-mounted display (HMD) is a display device, worn on the head or as part of a helmet, that has a small display optic in front of one or each eye. HMDs have many uses including gaming, aviation, engineering, and medicine.
A virtual retinal display (VRD), also known as a retinal scan display (RSD) or retinal projector (RP), is a display technology that draws a raster display directly onto the retina of the eye.
Wearable technology is any technology that is designed to be used while worn. Common types of wearable technology include smartwatches and smartglasses. Wearable electronic devices are often close to or on the surface of the skin, where they detect, analyze, and transmit information such as vital signs, and/or ambient data and which allow in some cases immediate biofeedback to the wearer.
Vuzix is an American multinational technology company headquartered in Rochester, New York and founded by Paul Travers in 1997. Vuzix is a supplier of wearable virtual reality and augmented reality display technology. Vuzix manufactures and sells computer display devices and software. Vuzix head-mounted displays are marketed towards mobile and immersive augmented reality applications, such as 3D gaming, manufacturing training, and military tactical equipment. On January 5, 2015, Intel acquired 30% of Vuzix's stock for $24.8 million.
Recon Instruments was a Canadian technology company that produced smartglasses and wearable displays marketed by the company as "heads-up displays" for sports. Recon's products delivered live activity metrics, GPS maps, and notifications directly to the user's eye. Recon's first heads-up display offering was released commercially in October 2010, roughly a year and a half before Google introduced Google Glass.
Google Glass, or simply Glass, is a discontinued brand of smart glasses developed by Google's X Development, with a mission of producing a ubiquitous computer. Google Glass displays information to the wearer using a head-up display. Wearers communicate with the Internet via natural language voice commands.
Epiphany Eyewear are smartglasses developed by Vergence Labs. The glasses record video stored within the glasses' hardware for live-stream upload to a computer or social media. The glasses use smartphone technology. The head mounted display is a mobile computer and a high-definition camera. The glasses take photographic images, record or stream video to a smartphone or computer tablet.
An optical head-mounted display (OHMD) is a wearable device that has the capability of reflecting projected images as well as allowing the user to see through it. In some cases, this may qualify as augmented reality (AR) technology. OHMD technology has existed since 1997 in various forms, but despite a number of attempts from industry, has yet to have had major commercial success.
castAR was a Palo Alto–based technology startup company founded in March 2013 by Jeri Ellsworth and Rick Johnson. Its first product was to be the castAR, a pair of augmented reality and virtual reality glasses. castAR was a founding member of the nonprofit Immersive Technology Alliance.
Augmate is a New York-based wearable technology company founded by Pete Wassell in July 2013. It has since become a device management platform focused on Internet of Things (IoT) devices and launched with Augmate Connect in 2017. Originally, the company developed applications for the workplace, connecting enterprise databases to wearable devices that include Glass, Vuzix M100, Epson Moverio, Kopin Golden-i, and Optinvent ORA-S.
Lumus is an Israeli-based augmented reality company headquartered in Ness Ziona, Israel. Founded in 2000, Lumus has developed technology for see-through wearable displays, via its patented Light-guide Optical Element (LOE) platform to market producers of smart glasses and augmented reality eyewear.
Spectacles are smartglasses dedicated to recording video for the Snapchat service. This term is often used to address sunglasses and eyeglasses. They feature a camera lens and are capable of recording short video segments and syncing with a smartphone to upload to the user's online account. They were developed and manufactured by Snap Inc., and announced on September 23, 2016. The smartglasses were released on November 10, 2016. They are made for Snap's image messaging and multimedia platform, Snapchat, and were initially distributed exclusively through Snap's pop-up vending machine, Snapbot. On February 20, 2017, Snap Spectacles became available for purchase online.
Everysight Ltd. is an Israeli technology company established in 2014 as a spinoff of Elbit Systems. Everysight develops smartglasses based on augmented reality technology for the civilian market. The company's main product is Raptor smartglasses.
Ray-Ban Meta is a range of smartglasses created by Meta Platforms and EssilorLuxottica. They include two cameras, open-ear speakers, a microphone, and touchpad built into the frame. They are latest in a line of smartglasses released by major companies including Snap Inc and Google and are designed as one component of Facebook’s plans for a metaverse.
Project Iris is the codename for an unreleased augmented reality (AR) headset designed and developed by Google. It was intended to resemble ordinary eyeglasses and expected to be released in 2024, until its cancellation in early 2023.
{{cite web}}
: CS1 maint: multiple names: authors list (link){{cite web}}
: CS1 maint: archived copy as title (link){{cite web}}
: |author=
has generic name (help)