Nokia Point & Find

Last updated

Nokia Point & Find is a mobile application, which lets you point your Nokia smartphone camera at objects and images you want to know more about, to find more information. [1] It is a visual search technology that uses the phone's camera to obtain information by using image recognition to identify objects, images and places in the physical world in real-time. [2] For example, one can use the application to find information on movies by pointing the camera at movie posters and then view reviews, or find tickets at nearby theaters. [3] Its uses include city landmark tagging, barcode scanning for comparison shopping and 2D barcode scanning and finding information related to products and services based on content provided by third party publishers. [2] [4]

Contents

Technology

Nokia Point & Find makes use of the mixed reality (MR) platform. Mixed reality is a combination of augmented reality (AR) and augmented virtuality as described in the virtuality continuum. Nokia Point & Find is based on real-time image processing and object recognition technology originally developed by Philipp Schloter, [5] founder of PIXTO, a start-up company acquired by Nokia. [6] [7]

Uses

Shopping

By pointing the camera at a barcode, Nokia Point & Find retrieves information about product pricing and availability.

City guide

When a Nokia Point & Find user points their device at a building they may see tags that were added by other Point & Find users, creating the possibility of real-time mobile discovery. This could be useful for travel and exploration of new cities. It enables the user to tag a building and for any Nokia Point & Find user to retrieve the information at a later date.

Advertising and branding

Publishers and advertisers are able to create and publish their own content, via a content management system provided by Nokia Point & Find. [4] The content published in these third-party "worlds" can be retrieved and accessed by Point & Find users when pointing their camera phone at specific products, images or buildings.

Restrictions

Point & Find was only available for limited Nokia smartphones including the N97, N97 Mini, 5800 XpressMusic, 5530 XpressMusic, 5230 and X6. An Internet connection is required to make use of the application. Nokia charges third-party publishers to create their own Point & Find content. [2] Later the app was made available on other platforms as well.

Hardware limitations

Nokia Point & Find depends on extensive use of the on-board camera and GPS. This can cause a substantial decrease in battery life.

See also

Related Research Articles

<span class="mw-page-title-main">Barcode</span> Optical machine-readable representation of data

A barcode or bar code is a method of representing data in a visual, machine-readable form. Initially, barcodes represented data by varying the widths, spacings and sizes of parallel lines. These barcodes, now commonly referred to as linear or one-dimensional (1D), can be scanned by special optical scanners, called barcode readers, of which there are several types. Later, two-dimensional (2D) variants were developed, using rectangles, dots, hexagons and other patterns, called matrix codes or 2D barcodes, although they do not use bars as such. 2D barcodes can be read using purpose-built 2D optical scanners, which exist in a few different forms. 2D barcodes can also be read by a digital camera connected to a microcomputer running software that takes a photographic image of the barcode and analyzes the image to deconstruct and decode the 2D barcode. A mobile device with an inbuilt camera, such as smartphone, can function as the latter type of 2D barcode reader using specialized application software.

<span class="mw-page-title-main">Augmented reality</span> View of the real world with computer-generated supplementary features

Augmented reality (AR) is an interactive experience that combines the real world and computer-generated content. The content can span multiple sensory modalities, including visual, auditory, haptic, somatosensory and olfactory. AR can be defined as a system that incorporates three basic features: a combination of real and virtual worlds, real-time interaction, and accurate 3D registration of virtual and real objects. The overlaid sensory information can be constructive, or destructive. This experience is seamlessly interwoven with the physical world such that it is perceived as an immersive aspect of the real environment. In this way, augmented reality alters one's ongoing perception of a real-world environment, whereas virtual reality completely replaces the user's real-world environment with a simulated one.

<span class="mw-page-title-main">Camera phone</span> Mobile phone which is able to capture still photographs and usually also videos

A camera phone is a mobile phone which is able to capture photographs and often record video using one or more built-in digital cameras. It can also send the resulting image wirelessly and conveniently. The first commercial phone with color camera was the Kyocera Visual Phone VP-210, released in Japan in May 1999.

<span class="mw-page-title-main">Nokia 6230</span> Cell phone model

The Nokia 6230 is a mobile phone based on the Nokia Series 40 platform. It was announced on 28 October 2003 and released in February 2004.

<span class="mw-page-title-main">QR code</span> Type of matrix barcode

A QR code is a type of matrix barcode invented in 1994 by Japanese company Denso Wave. A barcode is a machine-readable optical label that can contain information about the item to which it is attached. In practice, QR codes often contain data for a locator, identifier, or tracker that points to a website or application. QR codes use four standardized encoding modes to store data efficiently; extensions may also be used.

Object hyperlinking is a term that refers to extending the Internet to objects and locations in the real world. Object hyperlinking aims to extend the Internet to the physical world by attaching tags with URLs to tangible objects or locations. These object tags can then be read by a wireless mobile device and information about objects and locations retrieved and displayed.

<span class="mw-page-title-main">High Capacity Color Barcode</span>

High Capacity Color Barcode (HCCB) is a technology developed by Microsoft for encoding data in a 2D "barcode" using clusters of colored triangles instead of the square pixels conventionally associated with 2D barcodes or QR codes. Data density is increased by using a palette of 4 or 8 colors for the triangles, although HCCB also permits the use of black and white when necessary. It has been licensed by the ISAN International Agency for use in its International Standard Audiovisual Number standard, and serves as the basis for the Microsoft Tag mobile tagging application.

Mobile tagging is the process of providing data read from tags for display on mobile devices, commonly encoded in a two-dimensional barcode, using the camera of a camera phone as the reader device. The contents of the tag code is usually a URL for information addressed and accessible through Internet.

CyberCode is a visual tagging system based on a 2D barcode technology. Designed to be read by low-cost CMOS or CCD cameras common in mobile devices, it can also be used to determine the 3D position of the tagged object as well as its ID number.

<span class="mw-page-title-main">Word Lens</span> Augmented reality translation application

Word Lens was an augmented reality translation application from Quest Visual. Word Lens used the built-in cameras on smartphones and similar devices to quickly scan and identify foreign text, and then translated and displayed the words in another language on the device's display. The words were displayed in the original context on the original background, and the translation was performed in real-time without a connection to the internet. For example, using the viewfinder of a camera to show a shop sign on a smartphone's display would result in a real-time image of the shop sign being displayed, but the words shown on the sign would be the translated words instead of the original foreign words.

Springpad was a free online application and web service that allowed its registered users to save, organize and share collected ideas and information. As users added content to their Springpad accounts, the application automatically identified and categorized it, then generated additional snippets based on the types of objects added—for example, listing price comparisons for products and showtimes for movies.

Microsoft mobile services are a set of proprietary mobile services created specifically for mobile devices, they are typically offered through mobile applications and mobile browser for Windows Phone, | platforms, BREW, and Java. Microsoft's mobile services are typically connected with a Microsoft account and often come preinstalled on Microsoft's own mobile operating systems while they are offered via various means for other platforms. Microsoft started to develop for mobile computing platforms with the launch of Windows CE in 1996 and later added Microsoft's Pocket Office suite to their Handheld PC line of PDAs in April 2000. From December 2014 to June 2015, Microsoft made a number of corporate acquisitions, buying several of the top applications listed in Google Play and the App Store including Acompli, Sunrise Calendar, Datazen, Wunderlist, Echo Notification Lockscreen, and MileIQ.

<span class="mw-page-title-main">Screen–smart device interaction</span>

Screen-Smart Device Interaction (SSI) is fairly new technology developed as a sub-branch of Digital Signage.

<span class="mw-page-title-main">Lumia imaging apps</span> Imaging applications for Lumia devices

Lumia imaging apps are imaging applications by Microsoft Mobile and formerly by Nokia for Lumia devices built on the technology of Scalado. The Lumia imaging applications were notably all branded with "Nokia" in front of their names, but after Microsoft acquired Nokia's devices and services business the Nokia branding was superseded with "Lumia", and often updates included nothing but name changes, but for the Lumia Camera this included a new wide range of feature additions. Most of the imaging applications are developed by the Microsoft Lund division. As part of the release of Windows 10 Mobile and the integration of Lumia imaging features into the Windows Camera and Microsoft Photos applications some of these applications stopped working in October 2015.

<span class="mw-page-title-main">Bing Vision</span>

Bing Vision is an image recognition application created by Microsoft which is installed on Windows Phones running version 7.5 and above, including Windows Phone 8. It is a part of the Bing Mobile suite of services, and on most devices can be accessed using the search button. On Windows Phone 8.1 devices where Microsoft Cortana is available, it is only available through the lenses of the Camera app. Bing Vision can scan barcodes, QR codes, Microsoft Tags, books, CDs, and DVDs. Books, CDs, and DVDs are offered through Bing Shopping.

<span class="mw-page-title-main">Tango (platform)</span> Mobile computer vision platform for Android developed by Google

Tango was an augmented reality computing platform, developed and authored by the Advanced Technology and Projects (ATAP), a skunkworks division of Google. It used computer vision to enable mobile devices, such as smartphones and tablets, to detect their position relative to the world around them without using GPS or other external signals. This allowed application developers to create user experiences that include indoor navigation, 3D mapping, physical space measurement, environmental recognition, augmented reality, and windows into a virtual world.

Fyuse is a spatial photography app which lets users capture and share interactive 3D images. By tilting or swiping one's smartphone, one can view such "fyuses" from various angles — as if one were walking around an object or subject.

Commercial augmented reality (CAR) describes augmented reality (AR) applications that support various B2B (Business-to-Business) and B2C (Business-to-Consumer) commercial activities, particularly for the retail industry. The use of CAR started in 2010 with virtual dressing rooms for E-commerce.

Barcode library or Barcode SDK is a software library that can be used to add barcode features to desktop, web, mobile or embedded applications. Barcode library presents sets of subroutines or objects which allow to create barcode images and put them on surfaces or recognize machine-encoded text / data from scanned or captured by camera images with embedded barcodes. The library can support two modes: generation and recognition mode, some libraries support barcode reading and writing in the same way, but some libraries support only one mode.

Scandit AG, commonly referred to as Scandit, is a Swiss technology company that provides smart data capture software. Their technology allows any smart device equipped with a camera to scan barcodes, IDs and text and to perform additional functions using augmented reality and advanced analytics.

References

  1. 1 2 3 Sterling, Greg (13 December 2009). "Will 'Point & Find' Get Nokia Back in the Game?". Internet2go.net. Retrieved 1 June 2010.
  2. Arghire, Ionut (28 April 2010). "Nokia Updates Point & Find". Softpedia.com. Retrieved 1 June 2010.
  3. 1 2 "Nokia Point & Find For Publishers". Pointandfind.nokia.com. Retrieved 1 June 2010.
  4. "WIPO: Patent by Philipp Schloter". World Intellectual Property Organization.
  5. "Nokia Point & Find For Partners". Pointandfind.nokia.com. Retrieved 1 June 2010.
  6. "Nokia's Point and Find Phone Interface Moves Closer to Reality". WIRED.