Project Starline

Last updated

Project Starline is an experimental video communication method currently in development by Google that allows the user to see a 3D model of the person they are communicating with. Google announced the product at its 2021 I/O developer conference, saying that it will allow users to "talk naturally, gesture and make eye contact" [1] by utilizing machine learning, spatial audio, computer vision and real-time compression to create the 3D effect without the user wearing typical virtual reality goggles. [2] The goal is to make the user feel as if they are in the same room with the other user. [3] [4]

Contents

Development

Project Starline had been in development for more than five years prior to the official announcement on May 18, 2021. [5] [6] The technology is currently only available in a small number of Google's offices, but the company plans to begin collaborating with certain partners in the next year, [7] particularly partners in the healthcare and media industries. [8] [ better source needed ]

In November 2021, the project was reorganized under a new division called Google Labs (unrelated to the defunct service of the same name) along with Area 120 and Google's AR and VR efforts. [9] Google will begin testing the technology with corporations such as Salesforce and T-Mobile beginning in late 2022. [10]

Implementation

The current implementation of Project Starline is a booth that the user sits in, facing a 65 in (170 cm) "light field display," [7] surrounded by depth sensors, cameras, and lights. [5] [11] Light field technology is a photography technique that captures the direction of light as well as its intensity and color to enable more effective 3D imaging. [12] The user can then view another user on the display in 3D and vice versa. Google says it plans to "make this technology more affordable and accessible." [2]

Reception

Jay Peters of The Verge was impressed by a demo of Project Starline, comparing it to "real life science fiction". [13]

Related Research Articles

<span class="mw-page-title-main">Virtual reality</span> Computer-simulated experience

Virtual reality (VR) is a simulated experience that employs pose tracking and 3D near-eye displays to give the user an immersive feel of a virtual world. Applications of virtual reality include entertainment, education and business. Other distinct types of VR-style technology include augmented reality and mixed reality, sometimes referred to as extended reality or XR, although definitions are currently changing due to the nascence of the industry.

<span class="mw-page-title-main">Metaverse</span> Collective three-dimensional virtual shared space

In science fiction, the "metaverse" is a hypothetical iteration of the Internet as a single, universal, and immersive virtual world that is facilitated by the use of virtual reality (VR) and augmented reality (AR) headsets. In colloquial usage, a "metaverse" is a network of 3D virtual worlds focused on social and economic connection.

Google I/O is an annual developer conference held by Google in Mountain View, California. The name "I/O" is taken from the number googol, with the "I" representing the "1" in googol and the "O" representing the first "0" in the number. The format of the event is similar to Google Developer Day.

<span class="mw-page-title-main">Oculus Rift</span> Virtual reality headsets by Oculus VR

Oculus Rift is a discontinued line of virtual reality headsets developed and manufactured by Oculus VR, a virtual reality company founded by Palmer Luckey that is widely credited with reviving the virtual reality industry. It was the first virtual reality headset to provide a realistic experience at an accessible price, utilizing novel technology to increase quality and reduce cost by orders of magnitude compared to earlier systems. The first headset in the line was the Oculus Rift DK1, released on March 28, 2013. The last was the Oculus Rift S, discontinued in April of 2021.

<span class="mw-page-title-main">Google Hangouts</span> Communication software by Google

Google Hangouts was a cross-platform instant messaging service developed by Google. It originally was a feature of Google+, becoming a standalone product in 2013, when Google also began integrating features from Google+ Messenger and Google Talk into Hangouts. Google then began integrating features of Google Voice, its Internet telephony product, into Hangouts, stating that Hangouts was designed to be "the future" of Voice.

Slack is an instant messaging program designed by Slack Technologies and owned by Salesforce. Although Slack was developed for professional and organizational communications, it has also been adopted as a community platform. Users can communicate with voice calls, video calls, text messaging, media, and files in private chats or as part of communities called "workspaces." Slack also uses IRC-style features such as persistent chat rooms (channels) organized by topic, private groups, and direct messaging. In addition to these online communication features, Slack can integrate with other software. Slack runs on Web, Windows, Linux, MacOS, Android, Windows Phone and iOS.

<span class="mw-page-title-main">Reality Labs</span> Virtual and augmented reality products company

Reality Labs is a business and research unit of Meta Platforms that produces virtual reality (VR) and augmented reality (AR) hardware and software, including virtual reality headsets such as Quest, and online platforms such as Horizon Worlds. In June 2022, several artificial intelligence (AI) initiatives that were previously a part of Meta AI were transitioned to Reality Labs. This also includes Meta's fundamental AI Research laboratory FAIR which is now part of the Reality Labs - Research (RLR) division.

<span class="mw-page-title-main">Google Cardboard</span> Discontinued virtual reality platform

Google Cardboard is a discontinued virtual reality (VR) platform developed by Google. Named for its fold-out cardboard viewer into which a smartphone is inserted, the platform was intended as a low-cost system to encourage interest and development in VR applications. Users can either build their own viewer from simple, low-cost components using specifications published by Google, or purchase a pre-manufactured one. To use the platform, users run Cardboard-compatible mobile apps on their phone, place it into the back of the viewer, and view content through the lenses.

<span class="mw-page-title-main">Discord</span> Online communication software

Discord is an American VoIP and instant messaging social platform. Users have the ability to communicate with voice calls, video calls, text messaging, media and files in private chats or as part of communities called "servers". A server is a collection of persistent chat rooms and voice channels which can be accessed via invite links. Discord runs on Windows, macOS, Android, iOS, iPadOS, Linux, and in web browsers. As of 2021, the service has over 350 million registered users and over 150 million monthly active users. It is primarily used by gamers, although the share of other users is growing.

A virtual reality headset is a head-mounted device that provides virtual reality for the wearer. VR headsets are widely used with VR video games but they are also used in other applications, including simulators and trainers. VR headsets typically include a stereoscopic display, stereo sound, and sensors like accelerometers and gyroscopes for tracking the pose of the user's head to match the orientation of the virtual camera with the user's eye positions in the real world.

Tilt Brush is a room-scale 3D-painting virtual-reality application available from Google, originally developed by Skillman & Hackett.

Houseparty was a social networking service that enabled group video chatting through mobile and desktop apps. Users received a notification when friends are online and available to group video chat. On average, users spent more than 60 minutes per conversation on the app in group or one-on-one chats. It was launched by Life on Air, Inc. in 2016 and was available on iOS, Android mobile devices, macOS and Google Chrome. Sima Sistani is the company's chief executive officer and co-founder. Epic Games announced the decision to discontinue Houseparty on September 9th, 2021 and removed it from the app stores on the same day. It continued to function for users who had already downloaded it until October 2021.

Xbox Cloud Gaming is Microsoft's Xbox cloud gaming service. Initially released in beta testing in November 2019, the service later launched for subscribers of Xbox Game Pass Ultimate on September 15, 2020. Xbox Game Pass cloud gaming is provided to subscribers of Ultimate at no additional cost.

<span class="mw-page-title-main">Google Meet</span> Video-conferencing software developed by Google

Google Meet is a video communication service developed by Google. It is one of two apps that constitute the replacement for Google Hangouts, the other being Google Chat. It replaced the consumer-facing Google Duo in late 2022, with the Duo mobile app being renamed Meet and the original Meet app set to be phased out.

<span class="mw-page-title-main">Google Chat</span> Enterprise messaging software developed by Google

Google Chat is a communication service developed by Google. Initially designed for teams and business environments, it has since been made available for general consumers. It provides direct message, group conversations, and spaces, which allow users to create and assign tasks and share files in a central place in addition to chatting. It can be accessed through its own website and app or through the Gmail website and app.

Messages is an SMS, RCS, and instant messaging application developed by Google for its Android and WearOS mobile operating systems, while it's also available via the Web. Messages is Google's official universal messaging platform for the Android ecosystem, similar to the implementation of iMessage on Apple devices.

<i>Horizon Worlds</i> Virtual reality platform operated by Meta

Horizon Worlds is a free virtual reality, online video game with an integrated game creation system developed and published by Meta Platforms. On this multi-player virtual platform, players move and interact with each other in various worlds that host events, games, and social activities. The game works on Oculus Rift S and Meta Quest 2 headsets.

<span class="mw-page-title-main">Bluesky Social</span> Decentralized social network

Bluesky is an initiative to develop a decentralized social network protocol, and an associated social networking service.

Area 120 is Google's in-house incubator in which employees work on 20% Project product ideas. It has helped develop Gmail, AdSense, Google News, and Google Cardboard.

<span class="mw-page-title-main">Apple Vision Pro</span> Upcoming mixed reality headset by Apple Inc.

Apple Vision Pro is an upcoming mixed reality headset developed by Apple Inc. It was announced on June 5, 2023, at its 2023 Worldwide Developers Conference (WWDC) and is set to be available for purchase in early 2024 in the United States. It is Apple's first major product since the Apple Watch, released in 2015.

References

  1. ↑ "Project Starline: Feel like you're there, together". Google. May 18, 2021. Retrieved May 20, 2021.
  2. 1 2 "Project Starline: Google's video chat makes it look like users are physically in the same room". techxplore.com. Retrieved May 20, 2021.
  3. ↑ Molina, Brett. "Project Starline: Google's video chat makes it look like users are physically in the same room". USA TODAY. Retrieved May 20, 2021.
  4. ↑ Perry, Alex. "Google Starline could turn video calls into 3D holographic experiences". Mashable. Retrieved May 20, 2021.
  5. 1 2 "Google's Project Starline Wants to Turn You Into a Hologram". Wired. ISSN   1059-1028 . Retrieved May 20, 2021.
  6. ↑ May 2021, Mark Spoonauer 18. "Google I/O 2021 recap: Android 12, Wear OS, Project Starline and all the big news". Tom's Guide. Retrieved May 20, 2021.
  7. 1 2 Kastrenakes, Jacob (May 18, 2021). "Google previews Project Starline, a next-gen 3D video chat booth". The Verge. Retrieved May 20, 2021.
  8. ↑ "Google's Project Starline makes two-way communication immersive and realistic". GSMArena.com. Retrieved May 20, 2021.
  9. ↑ Perez, Sarah (November 11, 2021). "Google reorg moves AR, VR, Starline and Area 120 into new 'Labs' team". TechCrunch . Archived from the original on November 11, 2021. Retrieved November 14, 2021.
  10. ↑ Peters, Jay (October 11, 2022). "Google is going to test its 3D video chat booth with more companies". The Verge . Archived from the original on October 11, 2022. Retrieved October 13, 2022.
  11. ↑ "Google's Project Starline is a 'magic window' for 3D telepresence". Engadget. Retrieved May 20, 2021.
  12. ↑ David Pierce (February 29, 2012). "Lytro Review". Verge. Retrieved May 24, 2021.
  13. ↑ Peters, Jay (October 13, 2022). "A meeting in Google's 3D chat booth felt like real life science fiction". The Verge . Archived from the original on October 13, 2022. Retrieved October 15, 2022.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.