Google Lens

Last updated

Google Lens
Developer(s) Google
Initial releaseOctober 4, 2017;7 years ago (2017-10-04)
Operating system Android, iOS, Microsoft Windows, macOS, ChromeOS, Linux
Included with Google Pixel phones
Predecessor Google Goggles
Available inLens is able to translate text into most languages supported by Google Translate. Shopping results are available in Austria, Australia, Belgium, Brazil, Canada, Chile, Colombia, Czech Republic, Denmark, France, Germany, India, Indonesia, Ireland, Italy, Japan, Malaysia, Mexico, Netherlands, New Zealand, Norway, Philippines, Poland, Portugal, Russia, Singapore, South Africa, South Korea, Spain, Sweden, Switzerland, Turkey, UAE, United Kingdom, and the United States. [1]
Website lens.google

Google Lens is an image recognition technology developed by Google, designed to bring up relevant information related to objects it identifies using visual analysis based on a neural network. [2] First announced during Google I/O 2017, [3] it was first provided as a standalone app, later being integrated into Google Camera but was reportedly removed in October 2022. [4] It has also been integrated with the Google Photos and Google Assistant app and with Bard (now Gemini) as of 2023. [5] [6] [7]

Contents

Features

Lens

When directing the phone's camera at an object, Google Lens will attempt to identify the object by reading barcodes, QR codes, labels and text, and show relevant search results, web pages, and information. [8] For example, when pointing the device's camera at a Wi-Fi label containing the network name and password, it will automatically connect to the scanned Wi-Fi network. Lens can also use images to identify text and can find results from Google Search or translate the text with Google Translate in augmented reality. [9] Lens is also integrated with the Google Photos and Google Assistant apps. [5]

The service originally launched as Google Goggles, a previous app that functioned similarly but with less capability. [10] [11] Lens uses more advanced deep learning routines in order to empower detection capabilities, similar to other apps like Bixby Vision (for Samsung devices released after 2016) and Image Analysis Toolset, also known as IAT (available on Google Play). During Google I/O 2019, Google announced four new features. The software will be able to recognize and recommend items on a menu. It will also have the ability to calculate tips and split bills, show how to prepare dishes from a recipe, and use text-to-speech. [12]

On January 17, 2024, Samsung Electronics and Google announced Circle to Search, [13] a new feature that allows users to search the web by tapping on circling images that features Lens integration. The feature was originally just on the Samsung Galaxy S24 and the Pixel 8, but expanded to other phones from those manufacturers,: Samsung Galaxy S – S21 Series, S22 Series, S23 Series, S24 Series; Samsung Galaxy Z Flip/Fold – 3, 4, 5; Samsung Galaxy Tab – S9 Series; Google Pixel – 8a, 8, 8 Pro, 7a, 7, 7 Pro, 6a, 6, 6 Pro, Pixel Fold, Pixel Tablet; Xiaomi 14 T series;

See anything you are interested in on your screen? Just Long press the Home button or navigation bar to enabe circle to search. Then circle, tab, scribble or highlite anything on your screen. This works in every app, and you get similar images, if ist for sale prices and if ist text results. Then when your curiosity is satisfyed just swipe down and you are back where you began. You can also translate anything you see on your screen. Find The song thats currently playing from your phone or in your surroindings simply. If you tapped, circled or scibbled an image you can add more context into the text box. This way you get more precise information. [14] [15] [16]

Availability

Google officially launched Google Lens on October 4, 2017, with app previews pre-installed into the Google Pixel 2, [17] not yet widely available for other devices. In November 2017, the feature began rolling out into the Google Assistant for Pixel and Pixel 2 phones. [18] A preview of Lens has also been implemented into the Google Photos app for Pixel phones. [6] On March 5, 2018, Google officially released Google Lens to Google Photos on non-Pixel phones. [19] Support for Lens in the iOS version of Google Photos was made on March 15, 2018. [20] Beginning in May 2018, Google Lens was made available within Google Assistant on OnePlus devices [21] as well as being integrated into camera apps of various Android phones. [22] A standalone Google Lens app was made available on Google Play in June 2018. Device support is limited, although it is not clear which devices are not supported or why. It requires Android Marshmallow (6.0) or newer. [23] On December 10, 2018, Google rolled out the Lens visual search feature to the Google app for iOS. [24] In 2022, Google Lens gradually replaced the reverse image search functionality of Google Images, first by replacing it in Google Chrome and later by making it officially available as a web application. [25] A July 2023 update to Google's chatbot Bard integrated Google Lens, allowing users to contextualize their prompts by uploading images and adding image retrieval functionality. [26]

Related Research Articles

Google Pixel is a brand of portable consumer electronic devices developed by Google that run either ChromeOS or the Pixel version of the Android operating system. The main line of Pixel products consist of Android-powered smartphones, which have been produced since October 2016 as the replacement of the older Nexus, and of which the Pixel 9, Pixel 9 Pro and Pixel 9 Pro XL are the current models. The Pixel brand also includes laptop and tablet computers, as well as several accessories, and was originally introduced in February 2013 with the Chromebook Pixel.

<span class="mw-page-title-main">Google Fit</span> Health-tracking platform by Google

Google Fit is a health-tracking platform developed by Google for the Android operating system, Wear OS, and iOS. It is a single set of APIs that blends data from multiple apps and devices. Google Fit uses sensors in a user's activity tracker or mobile device to record physical fitness activities, which are measured against the user's fitness goals to provide a comprehensive view of their fitness.

<span class="mw-page-title-main">Pixel Camera</span> Camera application developed by Google for Pixel devices

Pixel Camera is a camera phone application developed by Google for the Android operating system on Google Pixel devices. Development with zoom lenses for the application began in 2011 at the Google X research incubator led by Marc Levoy, which was developing image fusion technology for Google Glass. It was publicly released for Android 4.4+ on the Google Play on April 16, 2014. The app was initially released as Google Camera and supported on all devices running Android 4.4 KitKat and higher. However, in October 2023, coinciding with the release of the Pixel 8 series, it was renamed to Pixel Camera and became officially supported only on Google Pixel devices.

<span class="mw-page-title-main">Google Photos</span> Photo storage service

Google Photos is a photo sharing and storage service developed by Google. It was announced in May 2015 and spun off from Google+, the company's former social network.

<span class="mw-page-title-main">Nexus 5X</span> Android smartphone manufactured by LG Electronics

The Nexus 5X is an Android smartphone manufactured by LG Electronics, co-developed with and marketed by Google as part of its Nexus line of flagship devices. Unveiled on September 29, 2015, it was a successor to the Nexus 5. The phone, along with the Nexus 6P, served as launch devices for Android 6.0 Marshmallow, which introduced a refreshed interface, performance improvements, increased Google Now integration, and other new features.

<span class="mw-page-title-main">Pixel C</span> 2015 Android tablet computer by Google

The Pixel C is a 10.2-inch (260 mm) Android tablet developed and marketed by Google. The device was unveiled during a media event on September 29, 2015. On October 9, 2018, it was succeeded by the Pixel Slate.

<span class="mw-page-title-main">Google Assistant</span> AI-powered digital assistant from Google

Google Assistant is a virtual assistant software application developed by Google that is primarily available on home automation and mobile devices. Based on artificial intelligence, Google Assistant can engage in two-way conversations, unlike the company's previous virtual assistant, Google Now.

<span class="mw-page-title-main">Google Daydream</span> Discontinued virtual reality platform by Google

Daydream is a discontinued virtual reality (VR) platform which was developed by Google, primarily for use with a headset into which a smartphone is inserted. It is available for select phones running the Android mobile operating system that meet the platform's software and hardware requirements. Daydream was announced at the Google I/O developer conference in May 2016, and the first headset, the Daydream View, was released on November 10, 2016. To use the platform, users place their phone into the back of a headset, run Daydream-compatible mobile apps, and view content through the viewer's lenses.

The Pixel 2 and Pixel 2 XL are a pair of Android smartphones designed, developed, and marketed by Google as part of the Google Pixel product line. They collectively serve as the successors to the Pixel and Pixel XL. They were officially announced on October 4, 2017 at the Made by Google event and released in the United States on October 19. On October 9, 2018, they were succeeded by the Pixel 3 and Pixel 3 XL.

<span class="mw-page-title-main">Pixel 3</span> 2018 Android smartphone designed by Google

The Pixel 3 and Pixel 3 XL are a pair of Android smartphones designed, developed, and marketed by Google as part of the Google Pixel product line. They collectively serve as the successors to the Pixel 2 and Pixel 2 XL. They were officially announced on October 9, 2018 at the Made by Google event and released in the United States on October 18. On October 15, 2019, they were succeeded by the Pixel 4 and Pixel 4 XL.

<span class="mw-page-title-main">Phone Link</span> Software application developed by Microsoft

Phone Link, previously Your Phone, is a syncing software developed by Microsoft to connect Windows PCs to Android and iOS mobile devices to view notifications, make phone calls, use mobile apps amongst others, via the PC. It is a native component of Windows 10 and Windows 11, where it is a UWP app and consists of a driver that communicates with the Link to Windows app on the mobile device. Phone Link makes use of Wi-Fi, Bluetooth for voice calls, or mobile data.

<span class="mw-page-title-main">Google Messages</span> Messaging application developed by Google

Google Messages is a text messaging software application developed by Google for its Android and Wear OS mobile operating systems. It is also available as a web app.

<span class="mw-page-title-main">Pixel 4a</span> 2020 Android smartphone designed by Google

The Pixel 4a and Pixel 4a (5G) are a pair of Android smartphones designed, developed, and marketed by Google as part of the Google Pixel product line. They collectively serve as mid-range variants of the Pixel 4 and Pixel 4 XL. The Pixel 4a was announced on August 3, 2020 via a press release, while the Pixel 4a (5G) was announced on September 30, 2020 at the "Launch Night In" event.

<span class="mw-page-title-main">Nearby Share</span> Data transfer program by Google

Nearby Share was a functionality developed by Google that allows data to be transferred between devices via Bluetooth, Wi-FI Direct or Internet. In 2024, it was merged into Samsung's Quick Share. It was available for Android, ChromeOS and Microsoft's Windows. It was first released on August 4, 2020.

The Pixel 6 and Pixel 6 Pro are a pair of Android smartphones designed, developed, and marketed by Google as part of the Google Pixel product line. They collectively serve as the successor to the Pixel 5. The phones were first previewed in August 2021, confirming reports that they would be powered by a custom system-on-chip named Google Tensor. The cameras are housed in a horizontal bar on the back, while the front features a hole-punch display notch in the center. They shipped with Android 12, with Google announcing numerous artificial intelligence and ambient computing features during the phones' launch event.

<span class="mw-page-title-main">Pixel Watch</span> 2022 smartwatch developed by Google

The Pixel Watch is a Wear OS smartwatch designed, developed, and marketed by Google as part of the Google Pixel product line. First previewed in May 2022 during the Google I/O keynote, it features a round dome-shaped display as well as deep integration with Fitbit, which Google acquired in 2021. Two Pixel-branded smartwatches had been in development at Google by July 2016, but were canceled ahead of their release due to hardware chief Rick Osterloh's concerns that they did not fit well with other Pixel devices. Development on a new Pixel-branded watch began shortly after Google's acquisition of Fitbit.

<span class="mw-page-title-main">Pixel Fold</span> 2023 Android smartphone developed by Google

The Pixel Fold is an Android-powered foldable smartphone designed, developed, and marketed by Google as part of the Google Pixel product line. It was officially announced on May 10, 2023, at the annual Google I/O keynote, and was released in the United States on June 28. Reception was mixed, with many critics praising the phone's cameras and overall design but criticizing the price, durability, weight, and inner display.

Google Wallet is a digital wallet platform developed by Google. It is available for the Android, Wear OS, and Fitbit OS operating systems, and was announced on May 11, 2022, at the 2022 Google I/O keynote. It began rolling out on Android smartphones on July 18, 2022.

References

  1. "Google Lens". Google Lens Homepage. Retrieved June 24, 2019.
  2. "Google Lens app gets two new features". The Times of India.
  3. Nieva, Richard (May 18, 2017). "Forget rainbow vomit, Google Lens is AR you can actually use". CNET . Retrieved July 4, 2017.
  4. Schoon, Ben (December 13, 2022). "Pixel phones lost a handy Google Lens shortcut – here's how you can still access it quickly". 9to5Google .
  5. 1 2 Townsend, Tess (May 19, 2017). "Google Lens is Google's future". Recode . Retrieved July 4, 2017.
  6. 1 2 Ong, Thuy (October 24, 2017). "Google Lens starts rolling out to 2016 Pixel phones". The Verge. Retrieved October 25, 2017.
  7. "Gemini Apps' release updates & improvements". Gemini. Retrieved September 14, 2024.
  8. Villas-Boas, Antonio (May 16, 2017). "Google Lens can use your phone's CAMERA to do operations based on virtual analysis, like connecting your phone to a WiFi network". Business Insider . Retrieved July 4, 2017.
  9. Li, Abner (December 5, 2022). "Google Lens replaces Google Translate's camera mode on Android and iOS". 9to5Google .
  10. Conditt, Jessica (May 17, 2017). "Google Lens is a powerful, AI-driven visual search app". Engadget . Retrieved July 4, 2017.
  11. Dobie, Alex (October 6, 2017). "Google Lens: Everything you need to know". Android Central. Retrieved June 5, 2018.
  12. Villas-Boas, Antonio. "Google just showed off 4 major updates to its futuristic Lens technology that anyone who goes out to restaurants will love". Business Insider. Retrieved May 11, 2019.
  13. "Google reveals Circle to Search function for enhanced searching". Shacknews. January 17, 2024. Retrieved May 8, 2024.
  14. "Google's Circle to Search Is Coming to a Bunch of Other Pixel Devices". CNET. Retrieved May 8, 2024.
  15. Vonau, Manuel (March 22, 2024). "What's new in Chrome 124: Changes to local password storage". Android Police. Retrieved May 8, 2024.
  16. Li, Abner (May 8, 2024). "Google effectively brings Android's Circle to Search to any iPhone with new Lens shortcut". 9to5Google. Retrieved May 8, 2024.
  17. Grigonis, Hillary (October 4, 2017). "Pixel 2 Owners Get the First Glimpse of Google Lens Computer Vision Possibilities". Digital Trends. Retrieved October 13, 2017.
  18. Li, Abner (November 27, 2017). "Google Lens now more widely rolling out in Assistant on Pixel, Pixel 2 [Gallery]". 9to5Google. Retrieved November 29, 2017.
  19. "Google Lens is coming to all Android phones running Google Photos". The Verge. Retrieved March 6, 2018.
  20. Ong, Thuy (March 16, 2018). "Google Lens is now available on iOS". The Verge. Retrieved March 16, 2018.
  21. Patel, Nilen (March 28, 2020). "OnePlus Phones Now Getting Google Lens Feature in Google Assistant". Google Gadgets360.com. Retrieved March 28, 2020.
  22. Solsman, Joan (May 8, 2018). "Google integrates into new camera app". CNET. Retrieved May 8, 2018.
  23. Liao, Shannon (June 4, 2018). "Google Lens is now available as a standalone app". The Verge. Retrieved June 5, 2018.
  24. Li, Abner (December 10, 2018). "Google Lens visual search now rolling out to Google app for iOS". 9to5Google. Retrieved December 11, 2018.
  25. "Google Chrome drops right-click reverse image search in favor of Lens". Android Police. March 21, 2022.
  26. Li, Abner (August 10, 2022). "Google Images on the web now uses Google Lens". 9to5Google. Retrieved August 17, 2022.