Hearables

Last updated
Hearable generic illustration Hearables.jpg
Hearable generic illustration

Hearables or smart headphones or earbuds are electronic in-ear devices designed for multiple purposes. The category is split between hearables for hearing health, and hearables for other applications.

Contents

Terminology

The neologism "hearable" is a hybrid of the terms wearable and headphone, as hearables combine major assets of wearable technology with the basic principle of audio-based information services, conventional rendition of music and wireless telecommunication. The term was introduced in April 2014 simultaneously by Apple in the context of the company's acquisition of Beats Electronics and product designer and wireless application specialist Nick Hunn in a blogpost for a wearable technologies internet platform. [1]

Hearables are often referenced as a subset of wearables. Sometimes the terms "smart headphones" or "smart advisors" are also used to denominate hearables. The news agency Reuters in its "Journalism media and technology predictions 2015" ranked voice-driven virtual assistants as an important field of innovation, including voice recognition software like Apple's Siri, Amazon's Echo, [2] or Me-OS on Vinci headphones. [3]

Concept and use

The first description of a wearable ear-worn multimedia platform for health monitoring, heart rate monitoring, entertainment, guidance, and cloud-based communications was described by Valencell in 2006. [4] Current advancements in the development of hearables aim at feature integration, size reduction, and covering a diverse range of applications. Controlled by touch, movement, thought or voice (or any combination of the mentioned control mechanisms) these miniaturized in-ear buds are designed primarily for the purposes of mobile communication, real time information services, activity tracking and various monitoring applications focusing on the wearers health conditions and body performance.

The hardware architecture typically comprises

  1. Speakers, to convert analog signals to sound
  2. Bluetooth IC, to communicate with other devices typically a smartphone
  3. Sensors, to track heart rate, cadence, or to detect proximity
  4. Microphones, to take or make phone calls, or take voice commands

Most of the "Hearables" seen to date are Bluetooth devices that use phones or PCs as the central computing unit. Vinci smart headphones, announced in 2016, [5] incorporated a dual-core CPU, local storage, Wi-Fi, and 3G connectivity that allow users to use without a phone. [6]

One important benefit of placing the entire interaction unit in-ear and addressing users purely through acoustic signals is the lower grade of overall distraction compared to vision based augmented reality tools or wearables with tactile signal, measuring and interaction mechanisms. At the same time acoustic warning signals – for example in case of an otherwise unnoticed medical crisis – are, as experiments have shown, more effective and immediate than visual indicators. [7] Furthermore, the measurement of biometric data such as temperature, heart rate or oxygen saturation can be monitored through via PPG with significantly higher reliability and better response times through in ear monitoring than contact devices placed on wrist or torso. [8] [9] [10] [11]

A substantial amount of research around hearables is dedicated to aiding the hearing impaired and the increasing number of elderly people struggling with conventional input/output devices such as keyboard, mouse or touchscreen, as it is reflected for instance by the recent cooperation between the EHIMA (European Hearing Industry Manufacturer's Association) [12] and the Bluetooth Special Interest Groupworks on the enhancement of conventional hearing aids by applying the newest Bluetooth generation for additional streaming of music, telecommunication and audio notifications. [13] The European Commission has initiated a similar research project in mid 2013, with a projected runtime until summer 2016. This so-called "AAL Joint Programme" [14] also involves the "Austrian Ministry of Traffic, Innovation and Technology", [15] the Austrian Society for Research Funding [16] and several privately owned technology companies. [17] A somewhat more ambitious project is the inclusion of EEG in hearables, making it an example of ear-EEG.

Current developments

Global Revenue from Smart Wearables and hearables Global Revenue from Smart Wearables and hearables.png
Global Revenue from Smart Wearables and hearables

Most systems in development are designed for binaural use and share a basic set of desired functionalities. Currently the deployment of hearables is on the agenda of many consumer technology manufacturers. The first hearable product to enter the marketplace was the iriverON Bluetooth headset, launched in late 2013, which integrated biometric sensor technology into a Bluetooth audio headset. Other biometric have since followed in the market, including the Jabra Sport Pulse, the Sony B-Trainer, the LG HR Earphone, and other biometric Bluetooth headsets. The core technology behind these products has been independently validated by Duke University. [18] In the summer of 2014 "Earin", a headphone firm based in Lund (Sweden), started a crowdfunding campaign for their "Minuscule" earbuds, claiming them to become the smallest in ear headphones ever. [19] [20] However, the design details known as of today hint at „Minuscule“ being deployed as Bluetooth headphones and as such the earbuds will not completely comply with the definition of hearables in a broader sense. If they are to be seen as but an interim stage in the development of a multi-purpose in ear-piece is yet uncertain. A similar approach was chosen by headphone company OwnPhones, [21] [22] which is currently working on wireless, Bluetooth triggered earbuds, which can be fitted individually to the user's ear by a smartphone based measuring application triggering a 3D-printing device. The earphones will be fully compatible with all major smartphone and tablet manufactures, as well as notebooks and desktop computers. However an independent use of the earbuds is not yet projected, OwnPhones-earbuds will, for now, be controlled by primary electronic devices.

Apart from "Earin" and "Ownphones," the Munich-based technology company Bragi [23] has advertised developments towards truly wireless smart earphones according to different publications such as Wired Magazine (10/2014), [24] the Dutch daily newspaper De Telegraaf, [25] and The Huffington Post. [26] [27] In early 2014 "Bragi" set up a crowdfunding campaign for "The Dash", claiming to realize the world’s first wireless performance tracking earbud which would eventually become the most successful crowd-sourcing campaign in Europe to date with a total revenue of roughly 3.3 million dollars. [28] "The Dash", which according to public company announcements will reach start of production in autumn 2015, is projected to enable wearers to listen to music while tracking physical activity (speed, time, distance, cadence, elevation gain, etc.) and at the same time measure key data on body performance (heart rate, energy turnover, oxygen saturation, etc.). In January 2015 "The Dash" was awarded the "Innovation Award" of the CES (Consumer Electronic Show). [29] held in Las Vegas. The preceding CES had already witnessed the release of LG's "Heart Rate Earphones", a device that connects wirelessly to the company's product "Lifeband Touch" and arbitrary smart devices via a "data processing medallion", which is attached to the earpieces applying a conventional wire connection. [30]

Already in autumn 2014 "FreeWavz" [31] was announced, a Bluetooth triggered headset developed by Florida-based ENT physician and fitness enthusiast Dr. Eric Hensen. [32] The earpieces can be controlled independently and give acoustic updates on heart rate, oxygen saturation, calories burned, distance, speed and duration. However, unlike the approach chosen by Bragi, the FreeWavz headphones as yet fully depend on the interlinking with a smartphone or tablet via a dedicated app.

Several other companies are currently also investing development capacities in hearables. Among them are "Elbee", [33] "Waverly Labs" [34] and "Motorola", [35] who with the "Moto Hint" already offer a hands-free, voice-controlled earbud for Bluetooth-enabled smartphones, and Alango Technologies, who has designed a hearable called "BeHear" that disrupts the hearing aid industry by putting a hearing enhancement solution that could previously only be provided by medical/healthcare professionals directly into the hands of users.

In May 2014 the British daily newspaper The Guardian reported on an information leak claiming that Apple Inc. had recently started to break into the wearables market by equipping their standard headphones with health monitoring features. However the article uncovered the unofficial source's information as totally fabricated. [36] In September 2016, Apple made several announcements that could further propel the hearables market. One was the removal of the 3.5mm audio jack from the iPhone, which was denigrated by many. However, it fundamentally changed the dynamics of the market for wireless headphones. Two additional announcements were a new wireless chip allowing them to enter the world of hearables by launching their own brand of earbuds, known as Airpods.

A company, "United Sciences", [37] founded in 2009, has developed a digital ear scanner which is used to make custom shaped hearables. Every individual has differently shaped ears and a custom shaped hearable provides comfort for long term wear. They are rumoured to have partnered with Google to develop custom shaped hearable for measuring pulse oxygenation, EEG, heart rate and for Brain computer interface. [38]

In November, 2016, Vinci smart headphones were first seen on Kickstarter [39] and successfully raised nearly $1M. The Vinci smart headphones integrate AI virtual assistant that manages users' music requests and other online services such as Spotify, Amazon Music, navigation on maps and search on Wiki. It also supports direct call for Amazon Alexa for voice services. It is the first of kind that combines a HiFi music player, a 32G local storage, voice recognition, activity tracking and biometric sensors (like heart rate). [40] The Vinci smart headphones use a combination of touch, gesture and voice to provide a streamlined music listening experience. [41] Vinci headphones carry an internal dual-core CPU thus no phones are needed when users go for a run or work out in a gym. [42] [43]

The NPD Group, which tracks retail sales in the US, has reported in June 2016 that the overall value of wireless headphone sales in the US overtook that of wired headphones, paving the way for a major hearable explosion. [44] Now more than 50 hearable devices exist or are in crowdfunding stages to be brought to market.

Related Research Articles

<span class="mw-page-title-main">Headphones</span> Device placed near the ears that plays sound

Headphones are a pair of small loudspeaker drivers worn on or around the head over a user's ears. They are electroacoustic transducers, which convert an electrical signal to a corresponding sound. Headphones let a single user listen to an audio source privately, in contrast to a loudspeaker, which emits sound into the open air for anyone nearby to hear. Headphones are also known as earspeakers, earphones or, colloquially, cans. Circumaural and supra-aural headphones use a band over the top of the head to hold the speakers in place. Another type, known as earbuds or earpieces consist of individual units that plug into the user's ear canal. A third type are bone conduction headphones, which typically wrap around the back of the head and rest in front of the ear canal, leaving the ear canal open. In the context of telecommunication, a headset is a combination of headphone and microphone.

<span class="mw-page-title-main">Headset (audio)</span> Telephone or computer accessory

Headsets connect over a telephone or to a computer, allowing the user to speak and listen while keeping both hands free. They are commonly used in customer service and technical support centers, where employees can converse with customers while typing information into a computer. Also common among computer gamers are headsets, which will let them talk with each other and hear others, as well as use their keyboards and mice to play the game.

<span class="mw-page-title-main">AirPods</span> Wireless earbuds by Apple

AirPods are wireless Bluetooth earbuds designed by Apple Inc. They were first announced on September 7, 2016, alongside the iPhone 7. Within two years, they became Apple's most popular accessory. The most recent model, AirPods, are a replacement to the 1st and 2nd Generation models, although the 2nd Generation is still sold on Apple's website. These models are Apple's entry-level wireless headphones, sold alongside the AirPods Pro and AirPods Max.

Bluetooth Low Energy is a wireless personal area network technology designed and marketed by the Bluetooth Special Interest Group aimed at novel applications in the healthcare, fitness, beacons, security, and home entertainment industries. It is independent of classic Bluetooth and has no compatibility, but Bluetooth Basic Rate/Enhanced Data Rate (BR/EDR) and LE can coexist. The original specification was developed by Nokia in 2006 under the name Wibree, which was integrated into Bluetooth 4.0 in December 2009 as Bluetooth Low Energy.

<span class="mw-page-title-main">Apple headphones</span> Lineup of products manufactured by Apple, Inc.

Apple Inc. has produced and sold headphones since 2001, available for standalone purchase and bundled with iPhone and iPod products. Apple's current product line consists of EarPods, AirPods and AirPods Pro, and AirPods Max.

<span class="mw-page-title-main">Wearable technology</span> Clothing and accessories incorporating computer and advanced electronic technologies

Wearable technology is any technology that is designed to be used while worn. Common types of wearable technology include smartwatches and smartglasses. Wearable electronic devices are often close to or on the surface of the skin, where they detect, analyze, and transmit information such as vital signs, and/or ambient data and which allow in some cases immediate biofeedback to the wearer.

<span class="mw-page-title-main">SMS Audio</span> American headphones manufacturer

SMS Audio is an American consumer electronics company that primarily manufactures and markets headphones. The company was founded by 50 Cent in 2011 and acquired Kono Audio that same year.

i.am+

i.am+ is an American technology company based in Los Angeles, California. The company was founded by musician Will.i.am, an American singer and rapper known for being a member of the Black Eyed Peas, in 2013 with the mission of "creating wearable products that combine fashion and technology." In 2016, i.am+ acquired Israeli machine learning software company Sensiya, now known as over.ai.

Soundhawk was an American corporation headquartered in Cupertino, California.

<span class="mw-page-title-main">Jaybird (company)</span> Consumer electronics company

Jaybird is a Utah-based consumer electronics company owned by Logitech. The company designs and manufactures headphones and wearable activity trackers. The company is mainly known for its line of wireless Bluetooth sports headsets. Jaybird was founded in 2006 by Australian entrepreneur Judd Armstrong.

<span class="mw-page-title-main">LifeBEAM</span>

LifeBEAM, founded in 2011, is an artificial-intelligence wearables technology company. The technology was originally developed for monitoring pilots, astronauts and special forces through sensors in their helmets. It was then expanded to consumer fitness products, including artificially intelligent wearables, such as Vi.

Valencell is a US-based biometric technology company that develops biometric sensor technology for wearables and hearables, and provides its patent-protected technology to consumer electronics manufacturers in various industries. Valencell's PerformTek technology enables wearables and hearables to continuously measure biometrics such as heart rate, blood oxygen levels, blood pressure, heart rate variability, respiration rate, VO2 and other parameters for health and fitness assessment. The technology can be integrated into products designed by consumer electronics manufacturers, mobile device and accessory makers, medical device, sports and fitness, and hearing aid companies. Valencell has more than 60 patents granted, plus more than 100 patents pending. More than 35 companies utilize Valencell's technology and intellectual property, which has been commercialized in wearable devices made by companies including Bose, Suunto, LG, Jabra, Samsung, and Sony.

<span class="mw-page-title-main">Bragi (company)</span> German technology company

Bragi is a German technology company headquartered in Munich, Germany, that designs, develops and sells wireless smart earphones; the Bragi OS, the operating system for next-generation computing platforms; and the Bragi App for smartphones.

<span class="mw-page-title-main">Doppler Labs</span>

Doppler Labs was a San Francisco-based audio technology company, founded in 2013. The company designed and manufactured in-ear computing technology, including earplugs and wireless smart earbuds.

<span class="mw-page-title-main">Here One</span>

Here One is a pair of wireless smart earbuds developed and manufactured by Doppler Labs. It allows users to filter sound, stream music, and amplify speech. It can also be used to take phone calls and filter certain sounds, such as background noise. Here One has been called the world's first in-ear computer and in June 2018 Here One was inducted into the Smithsonian Institution's Cooper Hewitt Museum of Design for innovation in audio technology.

<span class="mw-page-title-main">Nura (company)</span>

Nura is a consumer electronics company based in Melbourne, Australia, that designs and manufactures headphones with personalized sound technology. Nura's proprietary technology automatically measures the user's hearing sensitivities to different frequencies by monitoring sounds generated from the inner ear. This hearing measurement process takes 1–2 minutes. The headphones then adapt their frequency response to the user's hearing, allowing them to hear more detail when listening to music.

The Google Fast Pair Service, or simply Fast Pair, is Google's proprietary standard for quickly pairing Bluetooth devices when they come in close proximity for the first time using Bluetooth Low Energy (BLE). It was announced in October 2017 and initially designed for connecting audio devices such as speakers, headphones and car kits with the Android operating system. In 2018, Google added support for ChromeOS devices, and in 2019, Google announced that Fast Pair connections could now be synced with other Android devices with the same Google Account. Google has partnered with Bluetooth SoC designers including Qualcomm, Airoha Technology, and BES Technic to add Fast Pair support to their SDKs. In May 2019, Qualcomm announced their Smart Headset Reference Design, Qualcomm QCC5100, QCC3024 and QCC3034 SoC series with support for Fast Pair and Google Assistant. In July 2019, Google announced True Wireless Features, Find My Device and enhanced Connected Device Details.

<span class="mw-page-title-main">AirPods Pro</span> Wireless earbuds produced by Apple

AirPods Pro are wireless Bluetooth in-ear headphones designed by Apple, initially released on October 30, 2019. They are Apple's mid-range wireless headphones, sold alongside the base-level AirPods and highest-end AirPods Max.

<span class="mw-page-title-main">RHA Audio</span> British earphone manufacturer

Origin North Ltd., formerly RHA Technologies Ltd., is a British independently owned audio company specialising in the design and production of in-ear headphones.

References

  1. Nick Hunn: "Hearables – The new Wearables", Wearable Technologies online (April 4, 2014)
  2. Nic Newman: "Journalism media and technology predicitions 2015", Reuters Institute online (January 12, 2015)
  3. UberGizmo. "Vinci Smart Hearable Reinvents Headphones". ubergizmo.com.
  4. "United States Patent: 8157730 - Physiological and environmental monitoring systems and methods".
  5. Kickstarter. "Vinci - First Smart Headphones with Artificial Intelligence".
  6. Engadget. "Vinci's smart headphones play music, no phone required".
  7. Dieter Klebelsberg: Verkehrspsychologie, Berlin | Heidelberg | New York 1982, p. 83 [German] (with references to "Robert S. Woodworth" | Harold H. Schlosberg: Experimental Psychology (1954))
  8. Nick Hunn: "Hearables the new Wearables", Wearable Technology online (April 4, 2014)
  9. Scott Snyder (Senior Fellow MACK Institute for Innovation Management, University of Pennsylvania): "The ear happens to be a good place to pick up blood flow as it moves consistently in and out of the ear, and the membrane is relatively thin. We can pick up heart rate, blood flow and even oxygen levels at an accuracy rate comparable to the chest strap." Quoted from: "Are Hearables the next big thing in fitness?", U.S. News & World Report online (April 8, 2014)
  10. On the high accuracy of estimates on total energy expenditure and oxygen consumption during exercise through in ear devices also see: Steven Francis Leboeuf | Michael E. Aumer | William E. Kraus | Johanna L. Johnson | Brian Duscha: Earbud-based sensor for the adjustment of energy expenditure, HR and VO2 Max, in: Medicine & Science in Sport & Exercise, Vol. 46, Issue 5 (May 2014), pp. 1046–1052
  11. An overview on the advantages of in ear health monitoring is also given by: O. Brodersen | D. Römhild | D. Starke | A. Steinke & S. Vogel: In-Ear acquisition of vital signs discloses new chances for preventous continuous cardiovascular monitoring, in: IFMBE Proceedings, Vol. 13 (4th International Workshop on Wearable and Implantable Body Sensor Networks), Berlin | Heidelberg | New York 2007, pp. 189-194, particularly p. 189
  12. Homepage EHIMA
  13. "Bluetooth SIG and EHIMA Partner to Advance Hearing Instrument Technology to Improve the Lives of the Hearing Impaired", bluetooth.com (April 12, 2014)
  14. Homepage AAL Joint Programme
  15. Austrian Ministry of Traffic, Innovation and Technology
  16. Austrian Society for Research Funding
  17. Lutz Reum: "Wearables: Hype oder nützliches Gimmick?", "Deutsches Ärzteblatt Supplement" online [German] (2015)
  18. Leboeuf, SF; Aumer, ME; Kraus, WE; Johnson, JL; Duscha, B (2014). "Earbud-based sensor for the assessment of energy expenditure, HR, and VO2max". Med Sci Sports Exerc. 46 (5): 1046–52. doi:10.1249/MSS.0000000000000183. PMC   3996514 . PMID   24743110.
  19. Manufacturer's homepage
  20. "Wearable of the Month: Earin Truly Wireless Earbud". Humavox. Retrieved 2022-08-16.
  21. Manufacturer's homepage: "OwnPhones" Archived 2015-08-10 at the Wayback Machine
  22. Company Website of OwnPhones Archived 2015-08-10 at the Wayback Machine
  23. Manufacturer's homepage
  24. Stephen Brown: "Wearable fatigue? Stick it in your ear", "Wired Magazine" online (October 2014)
  25. "Kleinere sensoren laten wearables verdwijnen", "De Telegraaf" online (May 1, 2015)
  26. "The Dash: Die Kopfhörer der Zukunft sind das erfolgreichste Crowdfunding-Projekt Europas", "The Huffington Post" online [German] (February 2, 2014)
  27. Also see Nyshka Chandran: "Hearables – the next big thing in wearable tech", "CNBC" online (December 29, 2014)
  28. "Crowdfunding platform kickstarter.com"
  29. "Bragi’s The Dash wins CES Best of Innovation Award 2015 (PDF)" Archived 2015-04-19 at the Wayback Machine (November 1, 2014)
  30. Samuel Gibbs: "CES 2014: the best wearable smartwatches and fitness gadgets", "The Guardian" online (January 7, 2014)
  31. Manufacturer's homepage: FreeWavz
  32. For details see Randy Rieland: "These Ear Buds Will Play Music and Track Your Heart Rate", "The Smithsonian Institution Magazine" online (August 11, 2014)
  33. Manufacturers homepage: Elbee Archived 2015-08-21 at the Wayback Machine
  34. Manufacturer's homepage: Waverly Labs
  35. Manufacturer's homepage: Motorola
  36. Charles Arthur: "Apple's next headphones to track heart rate and blood pressure, leak claims", The Guardian online (May 1, 2014)
  37. Company homepage: / United Sciences Archived 2016-02-08 at the Wayback Machine
  38. Press article : / Project Aura updates
  39. "VINCI smart headphones". Kickstarter.
  40. Slash Gear. "Vinci smart headphones offer Alexa and standalone Spotify".
  41. UberGizmo. "Vinci Smart Hearable Reinvents Headphones".
  42. Wareable. "Vinci smart headphones: Would you wear these to play music without your phone?".
  43. Engadget. "Vinci's smart headphones play music, no phone required".
  44. Nick Hunn: "The Market For Hearables 2016-2020"