Google Lens

Last updated

Google Lens
Developer(s) Google
Initial releaseOctober 4, 2017;7 years ago (2017-10-04)
Operating system Android, iOS, Microsoft Windows, macOS, ChromeOS, Linux
Included with Google Pixel phones
Predecessor Google Goggles
Available inLens is able to translate text into most languages supported by Google Translate. Shopping results are available in Austria, Australia, Belgium, Brazil, Canada, Chile, Colombia, Czech Republic, Denmark, France, Germany, India, Indonesia, Ireland, Italy, Japan, Malaysia, Mexico, Netherlands, New Zealand, Norway, Philippines, Poland, Portugal, Russia, Singapore, South Africa, South Korea, Spain, Sweden, Switzerland, Turkey, UAE, United Kingdom, and the United States. [1]
Website lens.google

Google Lens is an image recognition technology developed by Google, designed to bring up relevant information related to objects it identifies using visual analysis based on a neural network. [2] First announced during Google I/O 2017, [3] it was first provided as a standalone app, later being integrated into Google Camera but was reportedly removed in October 2022. [4] It has also been integrated with the Google Photos and Google Assistant app and with Bard (now Gemini) as of 2023. [5] [6] [7]

Contents

Features

Lens

When directing the phone's camera at an object, Google Lens will attempt to identify the object by reading barcodes, QR codes, labels and text, and show relevant search results, web pages, and information. [8] For example, when pointing the device's camera at a Wi-Fi label containing the network name and password, it will automatically connect to the scanned Wi-Fi network. Lens can also use images to identify text and can find results from Google Search or translate the text with Google Translate in augmented reality. [9] Lens is also integrated with the Google Photos and Google Assistant apps. [5]

The service originally launched as Google Goggles, a previous app that functioned similarly but with less capability. [10] [11] Lens uses more advanced deep learning routines in order to empower detection capabilities, similar to other apps like Bixby Vision (for Samsung devices released after 2016) and Image Analysis Toolset, also known as IAT (available on Google Play). During Google I/O 2019, Google announced four new features. The software will be able to recognize and recommend items on a menu. It will also have the ability to calculate tips and split bills, show how to prepare dishes from a recipe, and use text-to-speech. [12]

On January 17, 2024, Samsung Electronics and Google announced Circle to Search, [13] a new feature that allows users to search the web by tapping on circling images that features Lens integration. The feature was originally just on the Samsung Galaxy S24 and the Pixel 8, but expanded to other phones from those manufacturers. [14] [15] [16]

Availability

Google officially launched Google Lens on October 4, 2017, with app previews pre-installed into the Google Pixel 2, [17] not yet widely available for other devices. In November 2017, the feature began rolling out into the Google Assistant for Pixel and Pixel 2 phones. [18] A preview of Lens has also been implemented into the Google Photos app for Pixel phones. [6] On March 5, 2018, Google officially released Google Lens to Google Photos on non-Pixel phones. [19] Support for Lens in the iOS version of Google Photos was made on March 15, 2018. [20] Beginning in May 2018, Google Lens was made available within Google Assistant on OnePlus devices [21] as well as being integrated into camera apps of various Android phones. [22] A standalone Google Lens app was made available on Google Play in June 2018. Device support is limited, although it is not clear which devices are not supported or why. It requires Android Marshmallow (6.0) or newer. [23] On December 10, 2018, Google rolled out the Lens visual search feature to the Google app for iOS. [24] In 2022, Google Lens gradually replaced the reverse image search functionality of Google Images, first by replacing it in Google Chrome and later by making it officially available as a web application. [25] A July 2023 update to Google's chatbot Bard integrated Google Lens, allowing users to contextualize their prompts by uploading images and adding image retrieval functionality. [26]

Related Research Articles

Google Pixel is a brand of portable consumer electronic devices developed by Google that run either ChromeOS or the Pixel version of the Android operating system. The main line of Pixel products consists of Android-powered smartphones, which have been produced since October 2016 as the replacement of the older Nexus, and of which the Pixel 9, Pixel 9 Pro and Pixel 9 Pro XL are the current models. The Pixel brand also includes laptop and tablet computers, as well as several accessories, and was originally introduced in February 2013 with the Chromebook Pixel.

<span class="mw-page-title-main">Google Fit</span> Health-tracking platform by Google

Google Fit is a health-tracking platform developed by Google for the Android operating system, Wear OS, and iOS. It is a single set of APIs that blends data from multiple apps and devices. Google Fit uses sensors in a user's activity tracker or mobile device to record physical fitness activities, which are measured against the user's fitness goals to provide a comprehensive view of their fitness.

<span class="mw-page-title-main">Pixel Camera</span> Camera application developed by Google for Pixel devices

Pixel Camera is a camera phone application developed by Google for the Android operating system on Google Pixel devices. Development with zoom lenses for the application began in 2011 at the Google X research incubator led by Marc Levoy, which was developing image fusion technology for Google Glass. It was publicly released for Android 4.4+ on the Google Play on April 16, 2014. The app was initially released as Google Camera and supported on all devices running Android 4.4 KitKat and higher. However, in October 2023, coinciding with the release of the Pixel 8 series, it was renamed to Pixel Camera and became officially supported only on Google Pixel devices.

<span class="mw-page-title-main">Google Photos</span> Photo storage service

Google Photos is a photo sharing and storage service developed by Google. It was announced in May 2015 and spun off from Google+, the company's former social network.

<span class="mw-page-title-main">Nexus 5X</span> Android smartphone manufactured by LG Electronics

The Nexus 5X is an Android smartphone manufactured by LG Electronics, co-developed with and marketed by Google as part of its Nexus line of flagship devices. Unveiled on September 29, 2015, it was a successor to the Nexus 5. The phone, along with the Nexus 6P, served as launch devices for Android 6.0 Marshmallow, which introduced a refreshed interface, performance improvements, increased Google Now integration, and other new features.

<span class="mw-page-title-main">Pixel C</span> 2015 Android tablet computer by Google

The Pixel C is a 10.2-inch (260 mm) Android tablet developed and marketed by Google. The device was unveiled during a media event on September 29, 2015. On October 9, 2018, it was succeeded by the Pixel Slate.

<span class="mw-page-title-main">Google Assistant</span> AI-powered digital assistant from Google

Google Assistant is a virtual assistant software application developed by Google that is primarily available on home automation and mobile devices. Based on artificial intelligence, Google Assistant can engage in two-way conversations, unlike the company's previous virtual assistant, Google Now.

The Pixel and Pixel XL are a pair of Android smartphones designed, developed, and marketed by Google and the first smartphones to be part of the Google Pixel product line, succeeding the Nexus line of smartphones. They were officially announced on October 4, 2016 at the Made by Google event and released in the United States on October 20. On October 4, 2017, they were succeeded by the Pixel 2 and Pixel 2 XL.

The Pixel 2 and Pixel 2 XL are a pair of Android smartphones designed, developed, and marketed by Google as part of the Google Pixel product line. They collectively serve as the successors to the Pixel and Pixel XL.

<span class="mw-page-title-main">Pixel 3</span> 2018 Android smartphone designed by Google

The Pixel 3 and Pixel 3 XL are a pair of Android smartphones designed, developed, and marketed by Google as part of the Google Pixel product line. They collectively serve as the successors to the Pixel 2 and Pixel 2 XL. They were officially announced on October 9, 2018 at the Made by Google event and released in the United States on October 18. On October 15, 2019, they were succeeded by the Pixel 4 and Pixel 4 XL.

Google One is a subscription service developed by Google that offers expanded cloud storage and is intended for the consumer market. Google One paid plans offer cloud storage starting at 30 gigabytes, up to a maximum of 30 terabytes, an expansion from the free basic Google Account storage space of 15 GB, which is shared across Google Drive, Gmail, and Google Photos.

<span class="mw-page-title-main">Google Podcasts</span> Podcast application

Google Podcasts was a podcast application developed by Google and released on June 18, 2018, for Android devices, and released on iOS devices on March 24, 2020.

<span class="mw-page-title-main">Google Messages</span> Messaging application developed by Google

Google Messages is a text messaging software application developed by Google for its Android and Wear OS mobile operating systems. It is also available as a web app.

<span class="mw-page-title-main">Pixel 4a</span> 2020 Android smartphone designed by Google

The Pixel 4a and Pixel 4a (5G) are a pair of Android smartphones designed, developed, and marketed by Google as part of the Google Pixel product line. They collectively serve as mid-range variants of the Pixel 4 and Pixel 4 XL. The Pixel 4a was announced on August 3, 2020 via a press release, while the Pixel 4a (5G) was announced on September 30, 2020 at the "Launch Night In" event. The Pixel 4a was considered to be one of the best budget smartphones of the 2020 year, being priced at around $400 USD.

The Pixel 6 and Pixel 6 Pro are a pair of Android smartphones designed, developed, and marketed by Google as part of the Google Pixel product line. They collectively serve as the successor to the Pixel 5. The phones were first previewed in August 2021, confirming reports that they would be powered by a custom system-on-chip named Google Tensor. The cameras are housed in a horizontal bar on the back, while the front features a hole-punch display notch in the center. They shipped with Android 12, with Google announcing numerous artificial intelligence and ambient computing features during the phones' launch event.

<span class="mw-page-title-main">Pixel Watch</span> 2022 smartwatch developed by Google

The Pixel Watch is a Wear OS smartwatch designed, developed, and marketed by Google as part of the Google Pixel product line. First previewed in May 2022 during the Google I/O keynote, it features a round dome-shaped display as well as deep integration with Fitbit, which Google acquired in 2021. Two Pixel-branded smartwatches had been in development at Google by July 2016, but were canceled ahead of their release due to hardware chief Rick Osterloh's concerns that they did not fit well with other Pixel devices. Development on a new Pixel-branded watch began shortly after Google's acquisition of Fitbit.

The Pixel 8 and Pixel 8 Pro are a pair of Android smartphones designed, developed, and marketed by Google as part of the Google Pixel product line. They serve as the successors to the Pixel 7 and Pixel 7 Pro, respectively. Visually, the phones resemble their respective predecessors, with incremental upgrades to their displays and performance. Powered by the third-generation Google Tensor system-on-chip, Google placed heavy emphasis on their artificial intelligence–powered features, especially in the realm of generative AI and photo editing.

The Pixel 9, Pixel 9 Pro, and Pixel 9 Pro XL are a group of Android smartphones designed, developed, and marketed by Google as part of the Google Pixel product line. They serve as the successor to the Pixel 8 and Pixel 8 Pro, respectively. Sporting a redesigned appearance and powered by the fourth-generation Google Tensor system-on-chip, the phones are heavily integrated with Gemini-branded artificial intelligence features.

References

  1. "Google Lens". lens.google. Retrieved June 24, 2019.
  2. "Google Lens app gets two new features". The Times of India.
  3. Nieva, Richard (May 18, 2017). "Forget rainbow vomit, Google Lens is AR you can actually use". CNET . Retrieved July 4, 2017.
  4. Schoon, Ben (December 13, 2022). "Pixel phones lost a handy Google Lens shortcut – here's how you can still access it quickly". 9to5Google .
  5. 1 2 Townsend, Tess (May 19, 2017). "Google Lens is Google's future". Recode . Retrieved July 4, 2017.
  6. 1 2 Ong, Thuy (October 24, 2017). "Google Lens starts rolling out to 2016 Pixel phones". The Verge. Retrieved October 25, 2017.
  7. "Gemini Apps' release updates & improvements". Gemini. Retrieved September 14, 2024.
  8. Villas-Boas, Antonio (May 16, 2017). "Google Lens can use your phone's CAMERA to do operations based on virtual analysis, like connecting your phone to a WiFi network". Business Insider . Retrieved July 4, 2017.
  9. Li, Abner (December 5, 2022). "Google Lens replaces Google Translate's camera mode on Android and iOS". 9to5Google .
  10. Conditt, Jessica (May 17, 2017). "Google Lens is a powerful, AI-driven visual search app". Engadget . Retrieved July 4, 2017.
  11. Dobie, Alex (October 6, 2017). "Google Lens: Everything you need to know". Android Central. Retrieved June 5, 2018.
  12. Villas-Boas, Antonio. "Google just showed off 4 major updates to its futuristic Lens technology that anyone who goes out to restaurants will love". Business Insider. Retrieved May 11, 2019.
  13. "Google reveals Circle to Search function for enhanced searching". Shacknews. January 17, 2024. Retrieved May 8, 2024.
  14. "Google's Circle to Search Is Coming to a Bunch of Other Pixel Devices". CNET. Retrieved May 8, 2024.
  15. Vonau, Manuel (March 22, 2024). "What's new in Chrome 124: Changes to local password storage". Android Police. Retrieved May 8, 2024.
  16. Li, Abner (May 8, 2024). "Google effectively brings Android's Circle to Search to any iPhone with new Lens shortcut". 9to5Google. Retrieved May 8, 2024.
  17. Grigonis, Hillary (October 4, 2017). "Pixel 2 Owners Get the First Glimpse of Google Lens Computer Vision Possibilities". Digital Trends. Retrieved October 13, 2017.
  18. Li, Abner (November 27, 2017). "Google Lens now more widely rolling out in Assistant on Pixel, Pixel 2 [Gallery]". 9to5Google. Retrieved November 29, 2017.
  19. "Google Lens is coming to all Android phones running Google Photos". The Verge. Retrieved March 6, 2018.
  20. Ong, Thuy (March 16, 2018). "Google Lens is now available on iOS". The Verge. Retrieved March 16, 2018.
  21. Patel, Nilen (March 28, 2020). "OnePlus Phones Now Getting Google Lens Feature in Google Assistant". Google Gadgets360.com. Retrieved March 28, 2020.
  22. Solsman, Joan (May 8, 2018). "Google integrates into new camera app". CNET. Retrieved May 8, 2018.
  23. Liao, Shannon (June 4, 2018). "Google Lens is now available as a standalone app". The Verge. Retrieved June 5, 2018.
  24. Li, Abner (December 10, 2018). "Google Lens visual search now rolling out to Google app for iOS". 9to5Google. Retrieved December 11, 2018.
  25. "Google Chrome drops right-click reverse image search in favor of Lens". Android Police. March 21, 2022.
  26. Li, Abner (August 10, 2022). "Google Images on the web now uses Google Lens". 9to5Google. Retrieved August 17, 2022.