Project Iris

Last updated

Project Iris is the codename for an unreleased augmented reality (AR) headset designed and developed by Google. It was intended to resemble ordinary eyeglasses and expected to be released in 2024, until its cancellation in early 2023.

Contents

Following the highly publicized failure of Google Glass smartglasses in 2013, Google executives were initially disinclined to re-enter the field of wearable AR technology. However, work had begun on a new AR headset by 2021 under the leadership of Mark Lucovsky, codenamed Project Iris. The project underwent a turbulent development stage, with Google executives constantly shifting their vision for Iris. To facilitate its efforts, the company also acquired North and Raxium.

After going through numerous iterations, a version of Iris was unveiled at the 2022 Google I/O keynote before undergoing public testing later that year. In June 2023, after Apple beat Google to the punch and unveiled the Vision Pro mixed reality headset, Google abandoned the project in the midst of company-wide layoffs and internal turmoil, with Project Moohan and Betty intended to serve as Iris' spiritual successors.

History

Background

Google first experimented with the prospect of smartglasses with the introduction of Google Glass in 2013. [1] The product was panned by critics due to privacy and ethical concerns, [2] leading Google to discontinue the consumer-facing model and focus on the enterprise model. [3] [4] In May 2019, Google VR/AR head Clay Bavor told CNET that the company was heavily invested in R&D regarding AR devices, [5] while a February 2020 report from The Information revealed that Google had no plans to develop a new pair of augmented reality (AR) smartglasses as of mid-2019, in part due to the highly publicized failure of Glass. [6] In June 2020, Google acquired North, a manufacturer of smartglasses, to assist in its hardware division's vision of ambient computing. [7] Shortly after the acquisition, the company began work on a new pair of AR smartglasses based on North designs, [8] which The New York Times confirmed in December 2021. [9]

In August 2021, following the announcement that the Pixel 6 and Pixel 6 Pro smartphones would feature the custom-developed Tensor system-on-chip (SoC), Google hardware chief Rick Osterloh told Business Insider that he believed that Tensor had long-term potential for AR-powered smartglasses, [10] and was echoed by CEO Sundar Pichai in October. [11] In November, a "Google Labs" division led by Bavor was created to oversee Google's AR and virtual reality (VR) ventures, unrelated to the defunct service of the same name, [12] while development on an AR operating system began the next month for an unknown "innovative AR device", an effort spearheaded by Mark Lucovsky. [13] Meanwhile, Google began work on two custom system-on-chips akin to Tensor, codenamed Alius and Alexandrite, which would power its smartglasses. [8]

Development

In January 2022, The Verge reported that Google was building an AR headset that used "outward-facing cameras to blend computer graphics with a video feed of the real world", internally codenamed Project Iris and being developed in a highly secretive and secure facility located in the San Francisco Bay Area. Overseen by Bavor, the headset was to be powered by the Android operating system as well as a custom system-on-chip, expected to launch in 2024 alongside the experimental Project Starline. Other key people named as part of the project include Shahram Izadi, Eddie Chung, Scott Huffman, Kurt Akeley, Paul Greco, and Lucovsky. [14] [8] Over the next two years, Google executives constantly changed strategies regarding Project Iris, frustrating employees. [15] [8]

During this time, longtime Google rival Apple was concurrently developing its own mixed reality (MR) headset, [16] eventually announced as the Vision Pro. [17] When reports began to surface in early 2022 that Apple was making significant progress on the Vision Pro and nearing an official launch, Google executives panicked and formed a partnership with Android collaborator Samsung, who also wished to build an MR headset. As part of "Project Moohan", Google agreed to provide Samsung with the software for a headset designed by Samsung. Moohan resembled ski goggles and had a targeted release date of 2024. However, tensions soon arose between the two companies, with Samsung consolidating its control over the project to prevent Google from building a rival product. [8] [15] [18]

In March 2022, The Information reported that Google would acquire Raxium, an AR hardware startup, for approximately $1 billion, and would continue to make further acquisitions to assist in their AR and MR work. [19] The acquisition was completed a month later. [20] During the 2022 Google I/O keynote in May, Google unveiled a version of Iris resembling eyeglasses with live translation capabilities. [15] [21] [22] The company began publicly testing these prototypes across the U.S. in August, [23] before expanding into Canada in October. [24] In December 2022, 9to5Google reported that the company was considering using rings or bracelets to control Iris. [25] Google discontinued Glass Enterprise in March 2023. [26]

Cancellation

In June 2023, Apple unveiled the Vision Pro, frustrating many Google employees. [8] Three weeks later, Business Insider reported that Google had shelved Project Iris as part of its company-wide cost-cutting measures earlier in the year, which saw mass layoffs and the departure of Bavor. The final product would have resembled ordinary eyeglasses. [15] [27] The Verge observed that Akeley was now listed as retired on LinkedIn, while Lucovsky, many North employees, and several other engineers remained involved in Google's AR ventures; [27] Chung had departed the company in February. Lucovsky left the following month, and Izadi assumed leadership of the AR division, now focused mainly on Project Moohan and reporting to Google senior vice president Hiroshi Lockheimer. [8] Employees did not rule out the possibility of Iris being resurrected in the future. [15] 9to5Google unearthed evidence in November that pointed to a possible revival of the project, locating a new string of code on the Google app on Android referencing Iris and the ability to activate the Google Assistant virtual assistant by touching one's right temple. [28] Google laid off much of its AR hardware team in January 2024. [29]

Meanwhile, Google shifted its attention from hardware to AR and MR software, which they hoped to license to third-party manufacturers à la Android. [15] [27] A new team under Izadi began incorporating Iris' code into a new project codenamed Betty, intended to be part of a "Micro XR" platform that would be pitched to manufacturers. The former Raxium team continued to explore potential AR hardware projects under Greco's supervision, but was reportedly "firewalled" from the Moohan and Betty crews. A Google employee described the situation as "a weird bureaucratic mess". [8] [18] The Information reported in December 2023 that Google was also looking to integrate a new virtual assistant codenamed "Pixie", powered by its recently announced Gemini large language model, into glasses. [30] [31]

Critical commentary

Writing for 9to5Google, Abner Li opined in February 2021 that Google should begin work on AR glasses technology as soon as possible to counter similar efforts from Apple if it wished not to be left behind in the future. [32] Following The Verge's report on Project Iris, Nicholas Sutrich of Android Central and analyst Anshel Sag of Moor Insights & Strategy agreed that it would be a daunting task for Google to reinstill the public's trust in its commitment to supporting its products in the long term, as well as demonstrate its investment in extended reality (XR), citing the failure of the Stadia cloud gaming service as a cautionary tale. [33] Tom Pritchard of Tom's Guide believed that Google's acquisition of Raxium technologies gave it an edge over other potential competitors. [34]

On the AR translation glasses Google demoed at I/O in 2022, The Verge's Antonio G. Di Benedetto and Mitchell Clark felt that Google's apparent goal to break down the language barrier was ambitious and difficult to accomplish, [35] while their colleague Sean Hollister wrote that Google would have to develop AR experiences "more compelling or convenient than what phones already offer". [36] After news broke that the project had been scrapped, Li expressed concern for Google's hardware division, deeming the cancellation a missed opportunity, [37] while Charlie Sorrel of Lifewire speculated that Google may have been intimidated by the Vision Pro. Lorne Fade, the co-founder of the VR Vision training company, reasoned that Google would likely "follow Apple and come out with an XR device in the coming years". [38]

See also

Related Research Articles

<span class="mw-page-title-main">Virtual retinal display</span> Display technology

A virtual retinal display (VRD), also known as a retinal scan display (RSD) or retinal projector (RP), is a display technology that draws a raster display directly onto the retina of the eye.

Google Store is a hardware retail store operated by Google that sells Google Pixel devices, Google Nest products, Chromecast dongles, Fitbit devices, and accessories such as earbuds, phone cases, chargers, and keyboards. It also sold Nexus, Daydream, Stadia and Cardboard devices until their discontinuations. Google Store sells products made by Google or made in collaboration with that company. It was introduced on March 11, 2015, and replaced the Devices section of Google Play as Google's hardware retailer. It is overseen by Ana Corrales, who is also the COO of Google's Devices & Services division.

<span class="mw-page-title-main">Optical head-mounted display</span> Type of wearable device

An optical head-mounted display (OHMD) is a wearable device that has the capability of reflecting projected images as well as allowing the user to see through it. In some cases, this may qualify as augmented reality (AR) technology. OHMD technology has existed since 1997 in various forms, but despite a number of attempts from industry, has yet to have had major commercial success.

<span class="mw-page-title-main">Smartglasses</span> Wearable computers glasses

Smartglasses or smart glasses are eye or head-worn wearable computers that offer useful capabilities to the user. Many smartglasses include displays that add information alongside or to what the wearer sees. Alternatively, smartglasses are sometimes defined as glasses that are able to change their optical properties, such as smart sunglasses that are programmed to change tint by electronic means. Alternatively, smartglasses are sometimes defined as glasses that include headphone functionality.

<span class="mw-page-title-main">Reality Labs</span> Virtual and augmented reality products company

Reality Labs, originally Oculus VR, is a business and research unit of Meta Platforms that produces virtual reality (VR) and augmented reality (AR) hardware and software, including virtual reality headsets such as Quest, and online platforms such as Horizon Worlds. In June 2022, several artificial intelligence (AI) initiatives that were previously a part of Meta AI were transitioned to Reality Labs. This also includes Meta's fundamental AI Research laboratory FAIR which is now part of the Reality Labs - Research (RLR) division.

castAR American technology company

castAR was a Palo Alto–based technology startup company founded in March 2013 by Jeri Ellsworth and Rick Johnson. Its first product was to be the castAR, a pair of augmented reality and virtual reality glasses. castAR was a founding member of the nonprofit Immersive Technology Alliance.

<span class="mw-page-title-main">Magic Leap</span> American augmented reality hardware manufacturer

Magic Leap, Inc. is an American technology company that released a head-mounted augmented reality display, called Magic Leap One, which superimposes 3D computer-generated imagery over real world objects. It is attempting to construct a light-field chip using silicon photonics.

<span class="mw-page-title-main">Windows Mixed Reality</span> Mixed reality platform

Windows Mixed Reality (WMR) is a discontinued platform by Microsoft which provides augmented reality and virtual reality experiences with compatible head-mounted displays.

<span class="mw-page-title-main">Microsoft HoloLens</span> Mixed reality smartglasses

Microsoft HoloLens is an augmented reality (AR)/mixed reality (MR) headset developed and manufactured by Microsoft. HoloLens runs the Windows Mixed Reality platform under the Windows 10 operating system. Some of the positional tracking technology used in HoloLens can trace its lineage to the Microsoft Kinect, an accessory for Microsoft's Xbox 360 and Xbox One game consoles that was introduced in 2010.

<span class="mw-page-title-main">HTC Vive</span> Virtual reality headset

HTC Vive is a line of virtual and mixed reality headsets produced by HTC Corporation. The brand currently encompasses headsets designed for use with personal computers as well as standalone headsets such as the Vive Focus line, Vive Flow glasses, and the Vive Elite XR mixed reality headset.

DAQRI was an American augmented reality company headquartered in Los Angeles, CA.

<span class="mw-page-title-main">Spectacles (product)</span> Smartglasses for recording Snapchat video

Spectacles are smartglasses dedicated to recording video for the Snapchat service. This term is often used to address sunglasses and eyeglasses. They feature a camera lens and are capable of recording short video segments and syncing with a smartphone to upload to the user's online account. They were developed and manufactured by Snap Inc., and announced on September 23, 2016. The smartglasses were released on November 10, 2016. They are made for Snap's image messaging and multimedia platform, Snapchat, and were initially distributed exclusively through Snap's pop-up vending machine, Snapbot. On February 20, 2017, Snap Spectacles became available for purchase online.

<span class="mw-page-title-main">Google Lens</span> Image recognition tool developed by Google

Google Lens is an image recognition technology developed by Google, designed to bring up relevant information related to objects it identifies using visual analysis based on a neural network. First announced during Google I/O 2017, it was first provided as a standalone app, later being integrated into Google Camera but was reportedly removed in October 2022. It has also been integrated with the Google Photos and Google Assistant app and with Bard as of 2023.

Everysight Ltd. is an Israeli technology company established in 2014 as a spinoff of Elbit Systems. Everysight develops smartglasses based on augmented reality technology for the civilian market. The company's main product is Raptor smartglasses.

The Pixel 6 and Pixel 6 Pro are a pair of Android smartphones designed, developed, and marketed by Google as part of the Google Pixel product line. They collectively serve as the successor to the Pixel 5. The phones were first previewed in August 2021, confirming reports that they would be powered by a custom system-on-chip named Google Tensor. The cameras are housed in a horizontal bar on the back, while the front features a hole-punch display notch in the center. They shipped with Android 12, with Google announcing numerous artificial intelligence and ambient computing features during the phones' launch event.

Ray-Ban Meta Smart Glasses, formerly known as Ray-Ban Stories, are smartglasses created as a collaboration between Meta Platforms and EssilorLuxottica. The product includes two cameras, open-ear speakers, a microphone, and touchpad, all built into the frame. The glasses, announced in August 2020 and released on September 9, 2021, had a controversial reception stemming from mistrust over Facebook’s privacy controls. The small size of the recording indicator light has also led to controversy post-release. Ray-Ban Stories are the latest in a line of smartglasses released by major companies including Snap Inc and Google and are designed as one component of Facebook’s plans for a metaverse. Unlike smart glasses previously created by other companies, the Ray-Ban Stories do not include any HUD or AR head-mounted display. On September 27, 2023, Meta removed the "Stories" name and announced the second generation of Meta Ray-Ban Smartglasses, which featured a Qualcomm Snapdragon AR1 Gen1 processor, upgrade of the cameras to 12 MP, improved audio, livestreaming to Facebook and Instagram, and Meta AI.

<span class="mw-page-title-main">Pixel Watch</span> 2022 smartwatch developed by Google

The Pixel Watch is a Wear OS smartwatch designed, developed, and marketed by Google as part of the Google Pixel product line. First previewed in May 2022 during the Google I/O keynote, it features a round dome-shaped display as well as deep integration with Fitbit, which Google acquired in 2021. Two Pixel-branded smartwatches had been in development at Google by July 2016, but were canceled ahead of their release due to hardware chief Rick Osterloh's concerns that they did not fit well with other Pixel devices. Development on a new Pixel-branded watch began shortly after Google's acquisition of Fitbit.

The Meta Quest Pro is a mixed reality (MR) headset developed by Reality Labs, a division of Meta Platforms.

<span class="mw-page-title-main">Apple Vision Pro</span> Mixed reality headset by Apple Inc.

Apple Vision Pro is a mixed reality headset developed by Apple Inc. Announced on June 5, 2023, at Apple's Worldwide Developers Conference, pre-orders began on January 19, 2024 and the product launched on February 2, 2024 in the United States. A worldwide launch has yet to be scheduled. It is Apple's first new major product category since the release of the Apple Watch in 2015.

References

  1. ↑ Goldman, David (April 4, 2012). "Google unveils 'Project Glass' virtual-reality glasses". CNN Money. Archived from the original on April 7, 2012. Retrieved December 31, 2021.
  2. ↑ Arthur, Charles (March 3, 2013). "Google Glass: is it a threat to our privacy?". The Guardian . Archived from the original on September 21, 2013. Retrieved December 31, 2021.
  3. ↑ Luckerson, Victor (January 15, 2015). "Google Will Stop Selling Glass Next Week" . Time . Archived from the original on January 15, 2015. Retrieved December 31, 2021.
  4. ↑ Savov, Vlad (July 18, 2017). "Google Glass gets a second chance in factories, where it's likely to remain". The Verge . Archived from the original on July 18, 2017. Retrieved December 31, 2021.
  5. ↑ Stein, Scott (May 7, 2019). "Google won't release an Oculus Quest VR competitor anytime soon". CNET . Archived from the original on August 28, 2021. Retrieved December 31, 2021.
  6. ↑ Bastone, Nick (February 14, 2020). "As Apple and Facebook Embrace AR Fully, Google Takes It Slow" . The Information . Archived from the original on February 15, 2020. Retrieved December 31, 2021.
  7. ↑ Bursztynsky, Jessica (June 30, 2021). "Google acquires North, which makes smart glasses similar to Google Glass". CNBC. Archived from the original on July 1, 2020. Retrieved December 31, 2021.
  8. 1 2 3 4 5 6 7 8 Langley, Hugh (August 22, 2023). "Google's augmented-reality dream turned into chaos. Insiders say constant pivots are delaying its master plan to chase Apple" . Business Insider . Archived from the original on August 22, 2023. Retrieved August 30, 2023.
  9. ↑ Metz, Cade (December 30, 2021). "Everybody Into the Metaverse! Virtual Reality Beckons Big Tech" . The New York Times . Archived from the original on December 30, 2021. Retrieved December 31, 2021.
  10. ↑ Eadicicco, Lisa (August 2, 2021). "Google wants its new chip to totally transform the smartphone. Its hardware chief tells us how" . Business Insider . Archived from the original on August 2, 2021. Retrieved December 31, 2021.
  11. ↑ Li, Abner (October 26, 2021). "Sundar Pichai says Google hardware & platform teams are 'thinking through' AR". 9to5Google . Archived from the original on October 27, 2021. Retrieved December 31, 2021.
  12. ↑ Perez, Sarah (November 11, 2021). "Google reorg moves AR, VR, Starline and Area 120 into new 'Labs' team". TechCrunch . Archived from the original on November 11, 2021. Retrieved December 31, 2021.
  13. ↑ Porter, Jon (December 14, 2021). "Google staffs up to build OS for unknown 'innovative AR device'". The Verge . Archived from the original on December 14, 2021. Retrieved December 31, 2021.
  14. ↑ Heath, Alex (January 20, 2022). "Google is building an AR headset". The Verge . Archived from the original on January 20, 2022. Retrieved March 19, 2022.
  15. 1 2 3 4 5 6 Langley, Hugh (June 26, 2023). "Google killed its Iris augmented-reality smart glasses as it shifts attention to building AR software" . Business Insider . Archived from the original on June 27, 2023. Retrieved July 5, 2023.
  16. ↑ Mickle, Tripp; Chen, Brian (June 4, 2022). "Apple Starts Connecting the Dots for Its Next Big Thing" . The New York Times . ISSN   0362-4331. Archived from the original on June 5, 2023. Retrieved June 5, 2023.
  17. ↑ Fowler, Geoffrey (June 5, 2023). "Apple unveils Vision Pro, its $3,499 augmented-reality headset" . The Washington Post . ISSN   0190-8286. Archived from the original on June 5, 2023. Retrieved June 5, 2023.
  18. 1 2 Amadeo, Ron (August 23, 2023). ""Project Moohan" is Google and Samsung's inevitable Apple Vision Pro clone". Ars Technica . Archived from the original on August 23, 2023. Retrieved August 30, 2023.
  19. ↑ Sisco, Josh; Nellis, Stephen; Olson, Mathew; Krouse, Sarah (March 16, 2022). "Google Buys Hardware Startup Raxium to Fuel AR Ambitions" . The Information . Archived from the original on March 16, 2022. Retrieved March 19, 2022.
  20. ↑ Trueman, Charlotte (May 5, 2022). "Google acquires Raxium in augmented reality push". Computerworld . Archived from the original on May 5, 2022. Retrieved May 10, 2022.
  21. ↑ Howley, David (May 11, 2022). "Google reveals AR glasses that can translate speech in real time". Yahoo! Finance. Archived from the original on May 11, 2022. Retrieved May 12, 2022.
  22. ↑ Stein, Scott (May 12, 2022). "Unlike Google Glass, These New AR Glasses Unveiled at I/O Might Actually Be Practical". CNET . Archived from the original on May 12, 2022. Retrieved May 15, 2022.
  23. ↑ Peters, Jay (July 19, 2022). "Google's prototype augmented reality glasses are going outside". The Verge . Archived from the original on July 19, 2022. Retrieved August 6, 2022.
  24. ↑ Li, Abner (October 23, 2022). "Google is expanding its AR prototype testing to Canada". 9to5Google . Archived from the original on October 24, 2022. Retrieved December 14, 2022.
  25. ↑ Li, Abner; Bradshaw, Kyle (December 12, 2022). "How Google's AR smart glasses could be controlled: rings and bracelets". 9to5Google . Archived from the original on December 12, 2022. Retrieved March 1, 2023.
  26. ↑ Leswing, Kif (March 15, 2023). "Google ends enterprise sales of Google Glass, its augmented reality smartglasses". CNBC. Archived from the original on March 15, 2023. Retrieved March 16, 2023.
  27. 1 2 3 Hollister, Sean (June 27, 2023). "Google has reportedly killed its Project Iris augmented reality glasses". The Verge . Archived from the original on June 27, 2023. Retrieved July 5, 2023.
  28. ↑ Bradshaw, Kyle (October 17, 2023). "Google app shows renewed work on 'Iris' smart glasses with Assistant support". 9to5Google . Archived from the original on October 17, 2023. Retrieved November 8, 2023.
  29. ↑ Li, Abner (January 10, 2024). "Google reorganizing Pixel hardware: Fitbit's James Park leaving, layoffs hit AR team". 9to5Google . Archived from the original on January 11, 2024. Retrieved February 4, 2024.
  30. ↑ Victor, Jon (December 14, 2023). "How Google Got Back on Its Feet in AI Race" . The Information . Archived from the original on December 14, 2023. Retrieved December 31, 2023.
  31. ↑ Amadeo, Ron (December 15, 2023). "The Pixel 9 might come with exclusive "Pixie" AI assistant". Ars Technica . Archived from the original on December 15, 2023. Retrieved December 31, 2023.
  32. ↑ Li, Abner (February 15, 2021). "What is Google's plan for AR glasses?". 9to5Google . Archived from the original on February 15, 2021. Retrieved July 5, 2023.
  33. ↑ Sutrich, Nicholas (January 31, 2022). "Project Iris could be amazing, but Google's rocky past could ruin it". Android Central . Archived from the original on January 31, 2022. Retrieved July 5, 2023.
  34. ↑ Pritchard, Tom (May 6, 2022). "Google AR glasses could have a clear advantage — here's why". Tom's Guide . Archived from the original on October 7, 2022. Retrieved July 5, 2023.
  35. ↑ Di Benedetto, Antonio G.; Clark, Mitchell (May 13, 2022). "Google's AR translation glasses: it's really not that simple". The Verge . Archived from the original on May 13, 2022. Retrieved August 6, 2022.
  36. ↑ Hollister, Sean (July 25, 2022). "Ready or not, the Glassholes are coming back". The Verge . Archived from the original on July 25, 2022. Retrieved August 6, 2022.
  37. ↑ Li, Abner (June 30, 2023). "Without hardware, is Google truly all-in on smart glasses". 9to5Google . Archived from the original on June 30, 2023. Retrieved July 5, 2023.
  38. ↑ Sorrel, Charlie (July 4, 2023). "Why Google's AR Glasses Just Can't Compete With Apple's Vision Pro". Lifewire . Archived from the original on July 4, 2023. Retrieved February 4, 2024.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.