Cashierless store

Last updated
Various cameras and sensors being used in the ceiling of an Amazon Go store. Amazon Go at Madison Centre (42589250540).jpg
Various cameras and sensors being used in the ceiling of an Amazon Go store.

A cashierless store (also called a till-less store, checkout-free store or Just walk out store) is a store which allows customers to shop their products and leave without having to wait in line and pay at a checkout. Cashierless stores can currently be found in the United States, Asia, Europe, the Middle East, and Africa.

Contents

Process

The process of shopping in a cashierless store can be broken down into four phases: the before-purchase phase, the check-in phase, the product selection phase, and the check-out phase. [1] In the before-purchase phase, an app may need to be downloaded. [1] In the check-in phase, a bar code from the store’s app may need to be scanned in order to enter the store. [1] In the product selection phase, products can usually be selected without taking any preceding actions, but some stores require customers to scan a bar-code on the product or tap a screen to select products. [1] In the check-out phase, stores utilize sensor fusion and deep learning for computer vision to allow customers to walk out with their products without waiting in line at a register. [1]

Technology

Sensor fusion

In cashierless stores, most systems mark each customer with defining features and use cameras and pressure sensors together to keep track of where each customer goes and takes from the shelves. [2] Sensor fusion gathers information from different sensors and compiles it to create an accurate representation of what is happening and the relative positions of objects in an area at a specific time. Sensor fusion is often more accurate than single sensors since the separate measurements can be used to double-check and narrow the margin of error.

Deep learning for computer vision

Deep learning for computer vision is used in cashierless stores to track customers and products. Computer vision is the computer’s ability to interpret real-life images and video feeds. [3] Computer vision uses deep learning to make interpretations of the real world. [4] Deep learning allows computers to learn from large amounts of data similarly to how the human brain would. [4] Deep learning for computer vision tracks customers and products using object detection, multitarget tracking, and pose estimation. [5] Object detection is the process of identifying objects within an image. [5] Object detection is useful in identifying instances when a customer picks up and puts down an object, or for identifying the products on each of the shelves. [5] Multitarget tracking approximately locates a moving person within consecutive frames of images. [5] Multitarget tracking allows stores to keep track of each customer and their actions, like what products they picked up and put back and when they entered and exited the store. [5] Pose estimation is the process of using an image to track a person using the positions of their body parts, like their head, hands, and wrists. [5] Similar to multitarget tracking, pose estimation allows stores to keep track of customers providing information for the computer to determine which customer interacted with the store, like when a product is grabbed. [5]

Human assistance

Inadequacies in Amazon's automatic tracking required over a thousand employees in India to label videos to allocate purchases to shoppers. [6] As a result, the company in 2024 announced it would remove its "Just Walk Out" technology from its Amazon Fresh stores. [6]

Regions

United States

In 2016, Amazon announced the opening of its first cashierless store, Amazon Go, which opened in 2018. To shop, customers were required to have the Amazon app (formerly a specific Amazon Go app) so that they could be billed for their purchases afterward through their accounts. [7] Amazon introduced its cashierless technology in two Whole Foods stores located in Washington, D.C., and Sherman Oaks, California in 2022. [8]

In January 2021, the Hudson Group, a travel retailer, announced that it would be implementing Amazon's Just Walk Out technology in select airport convenience stores, branded as Hudson Nonstop. [9]

In June 2021, San Diego’s first fully automated and cashierless store, Valet Market, was opened to the public. [10] Valet market is powered by the technology company Accel Robotics which utilizes an advanced machine learning AI platform that optimizes efficiency in local markets. [11] There are three ways of shopping at Valet Store: Hub Store, Satellite Store, and Last Step Delivery. [12]

Cashierless stores have also been established in sporting and event arenas. In March 2021, Delaware North opened two cashierless MRKT convenience stores at TD Garden in Boston (only open during arena events). [13] With the opening of Seattle's Climate Pledge Arena in October 2021, four stores were equipped with Amazon's cashierless technology. [14] In April 2022, Minute Maid Park in Houston, Texas became the first Major League Baseball stadium to incorporate cashierless stores, installing Amazon's technology at two of its concession stands. [15] Minor league Polar Park in Worcester, Massachusetts launched similar technology from startup Standard AI in April 2022. [16]

Asia

Japan introduced cashierless shopping to their country by implementing New Zealand start-up, Imagr’s, scalable autonomous checkout technology. However, Imagr’s technology in Japan is not fully cashierless. Customers have to go to a checkout operator to accommodate Japanese customers’ shopping behavior of paying with cash and having a cashier. [17] Cashierless stores can also be found at a subway station in Tokyo. In addition, other convenience store chains are implementing their cashierless stores. Stores like 7-Eleven and Lawson are working towards creating cashierless stores. [18]

In Singapore, the first cashierless convenience store named Cheers launched in 2017, where it saves 180 man hours per week through their autonomous format. [19] Cheers is the first convenience store that allows customers to pay with Nets by QR code. [20]

In China, the competition with the USA in the adoption and growth of cashierless stores led to rapid developments. Taobao launched the "Tao Cafe" pop-up cashierless store in Hangzhou in July 2017, and Alibaba opened a cashierless experience store in January 2018. Other Chinese retail giants such as Jingdong and WeChat also opened cashierless flash stores. However, by 2018, many of these stores faced closures and bankruptcies. The online retailer JD.com had announced 5,000 virtual shelves in July 2018 but retracted from this engagement 6 months later. One reason for the rapid downfall was the failure of the pioneering stores to create an authentic "just-walk-out" experience, which diminished the convenience of shopping there. The focus on technology over customer experience contributed to the decline. [21] [22] [23]

Europe

In 2019, Sainsbury's opened the first cashierless store in the United Kingdom. However, it closed a few months later due to customer dissatisfaction with the lack of additional payment options. [24] In September 2021, Aldi UK announced its first cashierless store in Greenwich. [25] In October 2021, Tesco introduced its cashierless store called the GetGo store in central London, following a small trial of a similar store at the Tesco head office in Welwyn Garden City. [26]

A Finnish company called Korttelikauppa opened a cashierless store in Helsinki in 2020, followed by six more stores in 2021 in Helsinki, Espoo, and Vantaa. Also in 2021, another Finnish convenience retailer, R-kioski, opened a cashierless store called R-kioski Go! in Helsinki. [27] [28]

In the Netherlands, Aldi Nord opened the first cashierless store in Utrecht as a 12-month trial in 2022. [29]

November 2023, in France, Carrefour launched a pilot store in Paris called Flash 10/10 ("10 seconds to shop and 10 seconds to pay") with AiFi’s technology [30] . It contains 900 SKU on 50 m2. Carrefour Flash was previously tested at head office in Massy over more than a year, during which the Innovation team was able to refine the technology and adapt the concept based on feedback from the employees using it on a daily basis [31] .

Middle East

In September 2021, French conglomerate Carrefour, thanks to its partner Majid Al Futtaim Group, opened the first cashierless store in the Middle East called Carrefour City+, located in the Mall of the Emirates in Dubai. [32] [33]

In 2019, Israel opened their first cashierless store Nowpet, a cashierless pet shop, which uses the technology developed by startup Cyb-Org. [33] Cyb-Org’s sensor technology differentiates from Amazon Go’s implementation of computer vision by detecting the weight of the shelf whenever customers grab products. [34] Cyb-Org has also collaborated with Rami Levy, a popular grocery chain store in Israel, to implement cashierless technology of scanning fingerprints as a method of purchase, which costs much less compared to Amazon Go’s checkout mechanism on its shopping carts. [35]

Africa

South Africa’s first cashierless food store, Checkers, is in the process of testing a store without checkout counters, from the technology of Shoprite Holdings. [33]

See also

Related Research Articles

<span class="mw-page-title-main">Convenience store</span> Small store that stocks a range of everyday items

A convenience store, convenience shop, bodega, corner store, corner shop, or superette is a small retail store that stocks a range of everyday items such as convenience food, groceries, beverages, tobacco products, lottery tickets, over-the-counter drugs, toiletries, newspapers and magazines.

<span class="mw-page-title-main">Point of sale</span> Time and place where a retail transaction is completed

The point of sale (POS) or point of purchase (POP) is the time and place at which a retail transaction is completed. At the point of sale, the merchant calculates the amount owed by the customer, indicates that amount, may prepare an invoice for the customer, and indicates the options for the customer to make payment. It is also the point at which a customer makes a payment to the merchant in exchange for goods or after provision of a service. After receiving payment, the merchant may issue a receipt, as proof of transaction, which is usually printed but can also be dispensed with or sent electronically.

Pak'nSave is a New Zealand discount food supermarket warehouse chain owned by the Foodstuffs cooperative. It is one of the three main supermarket chains in New Zealand, alongside Woolworths New Zealand and New World. There is a total of 58 Pak'nSave stores throughout the country.

<span class="mw-page-title-main">Grocery store</span> Retail store that primarily sells food and other household supplies

A grocery store (AE), grocery shop (BE) or simply grocery is a retail store that primarily retails a general range of food products, which may be fresh or packaged. In everyday U.S. usage, however, "grocery store" is a synonym for supermarket, and is not used to refer to other types of stores that sell groceries. In the UK, shops that sell food are distinguished as grocers or grocery shops

<span class="mw-page-title-main">Online shopping</span> Form of electronic commerce

Online shopping is a form of electronic commerce which allows consumers to directly buy goods or services from a seller over the Internet using a web browser or a mobile app. Consumers find a product of interest by visiting the website of the retailer directly or by searching among alternative vendors using a shopping search engine, which displays the same product's availability and pricing at different e-retailers. As of 2020, customers can shop online using a range of different computers and devices, including desktop computers, laptops, tablet computers and smartphones.

<span class="mw-page-title-main">Bloom (store)</span> American grocery store chain

Bloom was a chain of mid-grade American grocery stores operated by Food Lion established in 2004. The parent company of Food Lion, The Delhaize Group, announced in January 2012 that it was discontinuing the Bloom brand. Bloom's headquarters were in Salisbury, North Carolina.

<span class="mw-page-title-main">Bagger</span>

Bagger, packer, sacker or bag boy (US) is an unofficial title given to a courtesy clerk at a grocery store.

<span class="mw-page-title-main">Self-checkout</span> Machine for customers to complete a retail transaction

Self-checkouts (SCOs), also known as assisted checkouts (ACOs) or self-service checkouts, are machines that provide a mechanism for customers to complete their own transaction from a retailer without needing a traditional staffed checkout. When using SCOs, customers scan item barcodes before paying for their total shop without needing one-to-one staff assistance. Self-checkouts are used mainly in supermarkets, although they are not uncommon in department or convenience stores. Most self-checkout areas are supervised by at least one staff member, often assisting customers process transactions, correcting prices, or otherwise providing service.

<span class="mw-page-title-main">Amazon Fresh</span> Grocery store chain and delivery service operated by Amazon.com

Amazon Fresh is a subsidiary of the American e-commerce company Amazon in Seattle, Washington. It is a grocery retailer with physical stores and delivery services in some U.S. cities, as well as some international cities, such as Berlin, Hamburg, London, Milan, Munich, Rome, and some other locations in Singapore and India.

<span class="mw-page-title-main">Automated retail</span> Self-service standalone kiosks

Automated retail is the category of self-service, standalone kiosks that operate as fully automatic retail stores through the use of software integrations to replace the traditional retail services inside in a traditional retail store. These standalone kiosks are often located in heavily trafficked locations such as airports, malls, resorts and transit hubs.

A retail clerk, also known as a sales clerk, shop clerk, retail associate, or shop assistant, sales assistant or customer service assistant, is a service role in a retail business.

<span class="mw-page-title-main">Żabka (convenience store)</span> Chain of Polish convenience store shops

Żabka Polska, better known as Żabka, is a Polish chain of convenience stores with approximately 10,500 locations across Poland, operated by around 9,000 franchisees. The company serves over three million customers daily and generated approximately €4.6 billion in revenue in 2023.

<span class="mw-page-title-main">Carrefour City</span> French multinational convenience store chain owned by Carrefour Group

Carrefour City is a French chain of local convenience stores created in 2009 by the Carrefour Group with locations in five countries: France, Belgium, Spain, UAE and Israel.

<span class="mw-page-title-main">Amazon Go</span> Convenience store chain operated by Amazon.com

Amazon Go is a chain of convenience stores in the United States and the United Kingdom, operated by the online retailer Amazon. The stores are cashierless, thus partially automated, with customers having the ability to purchase products without being checked out by a cashier or using a self-checkout station. As of 2023, there are 43 open and announced store locations in Seattle, Chicago, Los Angeles, London and New York City.

<span class="mw-page-title-main">Automated convenience store</span>

An automated convenience store is a convenience store that operates without a cashier, and instead relies on computers and robotics.

<span class="mw-page-title-main">History of Amazon</span>

Amazon is an American multinational technology company which focuses on e-commerce, cloud computing, and digital streaming. It has been referred to as "one of the most influential economic and cultural forces in the world", and is one of the world's most valuable brands.

Robomart is an American technology company headquartered in Santa Monica, California that builds autonomous smart shops for cafes, ice cream parlors, and quick-service restaurants. The company’s white label platform gives retailers the option to expand their footprint at a significantly lower cost than traditional brick-and-mortar real-estate.

Steve Gu is an entrepreneur, computer vision scientist, author and the Co-founder and CEO of AiFi, an AI technology company providing autonomous store technology for retailers and brands, recognized as an Amazon Go rival by Fortune and CNBC. Gu has his PhD from Duke University in computer science, advised by Carlo Tomasi.

<span class="mw-page-title-main">Caper AI</span> US software technology company

Caper is a software technology company that develops and deploys AI-powered automated checkout devices as well as AI-based software applications for retailers, grocers, convenience stores and other general merchandising store formats. Caper AI was established in 2016 by Lindon Gao, York Yang, Yilin Huang and Ahmed Beshry. It is headquartered in Manhattan, New York.

Trigo is a computer vision technology company founded by Michael and Daniel Gabay in 2018. Trigo provides a cashierless shopping solution for grocery retailers to implement partially or fully automated stores.

References

  1. 1 2 3 4 5 Schögel, Marcus (2020). "Cashierless Stores – the New Way to the Customer?" (PDF).
  2. "What is sensor fusion?: AI terms explained - AI For Anyone". www.aiforanyone.org. Retrieved 2023-04-06.
  3. "What is Computer Vision? | IBM". www.ibm.com. Retrieved 2023-04-08.
  4. 1 2 "What is Deep Learning? - Deep Learning Explained - AWS". Amazon Web Services, Inc. Retrieved 2023-04-06.
  5. 1 2 3 4 5 6 7 Acuaviva Huertos, Arturo; Pérez Garbín, Inmaculada; Díaz-Agudo, Belén; Sánchez-Ruiz, Antonio (2021). "Explanations on Smart Stores" (PDF).
  6. 1 2 Maxwell Zeff (April 3, 2024). "Amazon Ditches 'Just Walk Out' Checkouts at Its Grocery Stores". Gizmodo.
  7. Machkovech, Sam (2016-12-05). "Trying, and failing, to sneak into Amazon's Skynet take on grocery shopping". Ars Technica. Retrieved 2023-04-06.
  8. Meyersohn, Nathaniel (2021-09-08). "Amazon will open two cashier-less Whole Foods stores next year | CNN Business". CNN. Retrieved 2023-04-06.
  9. "Hudson Advances Digital Growth Strategy with Plans to Open Stores Using Amazon's Just Walk Out Technology | Hudson". www.hudsongroup.com. Retrieved 2023-04-06.
  10. San Diego's first fully automated and cashier-less store opens to the public , retrieved 2023-04-06
  11. "Accel Robotics". www.accelrobotics.com. Retrieved 2023-04-06.
  12. "Valet Market | An Autonomous Grocery + Convenience Store". www.valetmarket.com. Retrieved 2023-04-06.
  13. Garden, T. D. "MRKT powered by Amazon's Just Walk Out Technology | TD Garden". www.tdgarden.com. Retrieved 2023-04-06.
  14. "Amazon to offer frictionless shopping, palm-based payment at new arena". Chain Store Age. Retrieved 2023-04-06.
  15. "Houston Astros' stadium will be the first in MLB to use Amazon's 'Just Walk Out' tech". Yahoo Finance. Retrieved 2023-04-06.
  16. Kohli, Diti (April 20, 2022). "No cash, no cashier: AI-powered checkout debuts at Fenway Park". BostonGlobe.com. Retrieved 2023-04-06.
  17. Lung, Tiffany. "Japan's Checkout-Free Grocery Store Is Giving Amazon A Run For Its Money". Forbes. Retrieved 2023-04-06.
  18. "The first cashierless store in Japan | Japan Experience". www.japan-experience.com. Retrieved 2023-04-06.
  19. "Convenience store Cheers opens first unmanned, cashless outlet | The Straits Times". www.straitstimes.com. 2017-07-28. Retrieved 2023-03-28.
  20. "Nets: digital payments and services | Nexi". www.nexigroup.com. Retrieved 2023-04-06.
  21. Meng JJing (26 July 2017). "China embraces Amazon's unmanned store concept as part of country's efforts to redefine retail experience". Scmp.com. Retrieved 24 February 2020.
  22. "中國無人商店錢坑超乎想像,阿里巴巴、騰訊也由熱轉冷". TechNews 科技新報 (in Chinese (Taiwan)). Retrieved 2019-12-14.
  23. Hiroshi Murayama (17 June 2019). "China's unmanned store boom ends as quickly as it began". Nikkei.com. Retrieved 28 February 2020.
  24. Stevens, Ben (2019-09-06). "Sainsbury's scraps UK's first cashierless grocery store admitting "not all our customers are ready" - Latest Retail Technology News From Across The Globe - Charged" . Retrieved 2023-03-28.
  25. Stevens, Ben (2021-09-27). "Aldi confirms Greenwich as the location for its first checkout-free store - Latest Retail Technology News From Across The Globe - Charged" . Retrieved 2023-03-28.
  26. Butler, Sarah (2021-10-19). "Tesco takes on Amazon Fresh with launch of 'just walk out' store". The Guardian. ISSN   0261-3077 . Retrieved 2023-03-28.
  27. "R-kioski avaa ensimmäisen miehittämättömän kioskin Helsingin Viikkiin / R-kioski". R-Kioski (in Finnish). Retrieved 2023-03-28.
  28. "Finland's R-kioski Opens Cashierless Store In Helsinki". ESM Magazine. Retrieved 2023-03-28.
  29. Stevens, Ben (2021-10-04). "Aldi to open first checkout-free store to the public in The Netherlands - Latest Retail Technology News From Across The Globe - Charged" . Retrieved 2023-04-06.
  30. "Carrefour Teams With AiFi to Launch Cashierless Convenience Store in Paris". The Spoon. 2021-11-24. Retrieved 2024-10-30.
  31. AiFi. "AiFi partners with Carrefour to launch Carrefour Flash 10/10, a next-generation concept store". www.prnewswire.com. Retrieved 2024-10-30.
  32. Rodrigues, Janice (2021-09-06). "Carrefour City+: Middle East's first cashier-less store launches in Dubai". The National. Retrieved 2023-04-06.
  33. 1 2 3 Santosdiaz, Richie (2021-10-02). "Piloting Cashier-less Stores in the Middle East and Africa: Dubai, Cape Town and Tel Aviv". The Fintech Times. Retrieved 2023-04-06.
  34. "Israel's First Cashier-less Store Debuting in Tel Aviv". Haaretz. Retrieved 2023-04-06.
  35. "Cashier-less grocery shopping coming to Israel". The Jerusalem Post | JPost.com. Retrieved 2023-04-06.