Hearing aid application

Last updated
Hearing aid application
Hearing aid application wearing.jpg
Hearing aid application (HAA).jpg
The way to use hearing aid application

Hearing aid application (HAA) is software which, when installed on a mobile computational platform, helps with hearing. [1] Mobile devices may include smartphones, tablets or smart watch.

Contents

Adjustment

As operational characteristics are adjusted directly through the graphic interface of the application, this feature allows classifying the hardware-software complex as a programmable hearing aid. [2]

HAA, as a rule, adjusts the level of the surrounding acoustic environment (sound) to the user's hearing characteristics, thereby allowing him to hear better. [3] [4] [5] [6] [7] Most of HAA works both with wired and bluetooth headsets/headphones. [5] [6] [7] [8] [9] [10]

Unlike traditional hearing aid, which is a part of system consisting of a hearing aid, wired or wireless interworking interface, computer device and installed software for changes, [2] adjustment of HAA is a procedure within the united hardware-software complex.

Comprative characteristics of traditional hearing aids and hearing aid applications
Hearing aid applicationsTraditional Hearing aids
ChannelsUp to 25615-111
Sample rateMaximum 44 kHz Maximum 14 kHz
Programmable hearing aidYes (done by user)Yes (done by specialist)
In-built hearing testYesYes (limited)
Hearing test timeA few minutes (by the user)30 minutes - 60 minutes (several times)
Effects of anti stigmatizationYesNo, except for intra channels (CIS)
Audio recorder + Speech recognition in textYesNo
Remote microphone option without additional devicesYesNo
Binaural correction of both earsYesNo
Gain formula, that takes into account the upper threshold of perceptionYesNo
Adjustable noise supppressionYesYes
Ecosystem of assistive applications (radio, music player, etc.)YesNo
Built into app course of adaptation to hearing aidYesNo
Online gain formula changeYesNo
Amplification of quiet sounds (dynamic compression - WDRC)YesNo
BatteriesBuilt-in, rechargeableRechargeable and replaceable

Thus, HAA is not inferior, and even surpasses traditional hearing aids in some characteristics (number of channels, sampling frequency etc.).

The basic hearing aid setting is amplification adjustment in accordance with the user's audiogram.

The process of selection of traditional hearing aid starts with audiometry, which is also the first characteristic of sound perception disorder considered during the adjustment of HAA. If the user has already had a special audiologic checkup, this type of adjustment can be done remotely by a specialist, and the results of this checkup can be entered by the user with the help of the application's graphic interface. A lot of HAA have a built-in procedure of in situ-audiometry which automates the whole process so that the user can take this type of examination on their own. Software-based generators of tone signals and interface elements for reaction to exceeding the hearing perception threshold are used for that.

Quick change of settings, such as recruitment compensation, noise suppression, amplification regulation allows HAA users to choose the settings which are more suitable to understanding the speech in silence or with a background noise.

An additional feature of HAA is ability to choose and apply the sets of parameters most suitable for the current acoustic situation, for example, for silence, for talking in a noisy environment, etc.

Some HAA provide for using different computing formulas for calculation of target amplification on the basis of audiometry data. These formulas are intended to amplify the speech up to the maximum comfortable level of perception by the user. [2]

In particular, Pertalex HAA offers its users 3 well-known formulas:

When using microphone equipment of phone headsets, maximum available amplification is limited by appearance of acoustic feedback between the microphone and the speaker. Increase of possible level of signal amplification is ensured by stronger suppression of acoustic feedback. [14]

Acoustic feedback is the most widespread option of feedback appearing at the return leakage of sound from the speaker to the microphone. This can be caused by small distance between the microphone and the speaker, loose fit of an earpiece to the surface of acoustic meatus and so on.

The processing under frequency-dependent amplification of input signal for compensation of hearing impairment includes assistive functions, such as acoustic feedback suppression. [2]

In a number of HAA a scheme with subband signal decomposition is used for acoustic feedback suppression. [15]

Advantages and disadvantages

Compared to traditional hearing aids, HAA has the following disadvantages:

  1. more noticeable and not so comfortable to wear;
  2. due to the fact that the microphone is not located in the ear, it does not use the functional advantages of the auricle and the natural acoustics of the outer ear.

At the same time, HAAs has a number of great advantages:

  1. the large distance between the microphone and the speaker prevents the occurrence of acoustic feedback, which allows the use of large acoustic amplification and a simpler audio signal processing algorithm;
  2. due to the rather large size of the device, it is possible to implement more convenient application control functions for people with poor motor skills;
  3. using of various types of headphones is possible;
  4. it is possible to achieve the highest sound pressure level and get high sound quality due to large speakers and a long battery life;
  5. resistant to ingress of earwax and moisture;
  6. thanks to the capacious battery, it is possible to use more complex audio signal processing algorithms and a higher sampling rate;
  7. software flexibility;
  8. developed software distribution system through appropriate services; the possibility of applying hearing correction algorithms to audio and video recordings, telephone calls, etc., and not only to acoustic signals;
  9. the set up HAA in simple cases does not require special equipment and qualifications, the user can perform it independently;
  10. HAA does not cause any psychological inconvenience, since the smartphone/tablet is not associated with the auditory pathologies in other people;
  11. the user does not need to purchase and carry a separate device.

Comparative characteristics

Of the 11 apps tested in the hearing assistant category, all 11 apps were still accessible at the end of the scoring period. The best app in the hearing assistant category was Petralex Hearing Aid (4.3/5). [16] Mobile App Rating Scale app quality rating.jpg

Distribution of HAA is limited by the infrastructure of specialized application stores, such as App Store, Google Play, etc. There is a fairly large number of applications that implements a hearing aid based on a smartphone/tablet. However, despite the general idea - hearing aid, they all differ in a number of criteria.

For benchmarking, the following applications were selected from the top 10 Google Play store applications (for Android devices) and the App Store (for iOS devices), selected on the "Hearing aid" request, and meet the following criteria:

Comparative characteristics of hearing aid applications presented on the market are presented in the following table: [17] [18]

Comparative characteristics of hearing aid applications, presented on the market

Petralex

uSound (Hearing Assistant)Hearing Aid Sound Amplifier

Fennex


Ear Spy

Jacoti ListenApp

BoiAid

AmplyPhone

Dectone

Listening device - Hearing aidGoogle

Sound Amplifier

Latest releaseJanuary 2019 (iOS),
January 2019

(Android)

November 2019 (iOS),
January 2019 (Android)
December 2018 (iOS)December 2018 (iOS)June 2018 (iOS),
October 2018

(Android)

October 2018 (iOS)February 2015 (iOS)April 2017 (iOS)October 2018 (Android)
July 2019 (iOS)July 2019 (Android)
Audio latency20 ms*** (iOS),
65 ms***

(Android)

30 ms***

(iOS),
30 ms***

(Android)

30 ms***

(iOS)

45 ms***

(iOS)

35 ms*** (iOS),
360 ms***

(Android)

20 ms***

(iOS)

30 ms*** (iOS)35 ms***

(iOS)

65 ms*** (Android)30 ms*** (iOS)
Programmable

hearing aid

YesYesYesYesNoYesNoNoYesYesNo
In-built hearing testYesYesNoYesNoYes*****NoNoYesYesNo
Automatic/manual

audiometry

Automatic and manualAutomatic and manualManualAutomatic and manualNoAutomatic and manualNoNoAutomatic and manualAutomatic and manualNo
Nonlinear hearing aidYesNoNoNoNoNoNoNoYesYesNo
Amplification of quiet

sounds (dynamic compression - WDRC)

YesNoNoYesNoNoNoNoYesYesYes
Adjustment of WDRCYesNoNoYesNoNoNoNoYesYesYes
Online gain formula changeYesNoNoNoNoNoNoNoYesYesNo
Ability to adapt to

the environment

YesYesYesYesNoYesYesNoYesYesNo
Adjustable noise

suppression

YesNoYesYesNoNoYesNoYesYesYes
Suppression of acoustic

feedback

YesNoNoNoNoNoNoNoYesYesNo
Bluetooth headset

support

Yes, on iOS and Android Yes, on iOS and Android Yes, only on iOS Yes, only on iOS Yes, on iOS

and Android****

NoYes, only on iOS NoYesYesNo
Audio recorderYesNoNoNoYes****NoNoYesYesYesNo
Speech recognition

in text

Yes, only

on iOS

NoNoNoNoNoNoNoNoYesNo
Volume balance reconstruction

of the left/right ear

NoNoYesYesNoNoNoNoYesYesYes
Gain formula, that takes

into account the upper thresholds of perception

YesNoNoNoNoNoNoNoYesYesNo
Ecosystem of assistive applicationsYesNoNoNoNoNoNoNoYesYesNo
Built into course of

adaptation to hearing

aid application

YesNoNoNoNoNoNoNoYesNoNo
Special gain formula

for tinnitus

YesNoNoNoNoNoNoNoYesYesNo
Ratings4.7 on AppStore, 4.0 on Google Play 3.7 on Google Play 4.4 on AppStore No3.1 on AppStore, 3.7 on Google Play NoNoNo3.7 on Google Play 4.6 on AppStore 3.7 on Google Play

Notes: *tested on iPhone 6+ (iOS 9.2), ** tested on Samsung Galaxy A3 (Android 7.0), *** on the date of testing (11 February 2019;22 months ago), **** in the paid version, ***** - with the help of an additional application.

HAA basic principles of work

The principles of working HAA are similar to those of traditional hearing aids.

Most HAA provides two modes: settings mode (passing through the in situ-audiometry procedure) and the hearing correction mode.

Setup mode is an in situ-audiometry procedure that allows the user to independently measure hearing thresholds using tone audio signals that are generated with a gradually increasing amplitude over a period of some seconds. Audio signals are generated according to the following sequence of frequencies: 125, 250, 500, 1000, 2000, 4000, 6000 and 8000 Hz.

Some HAA do not have an integrated audiometry system. In this case, the adjustment of the sound amplification level (similar to the equalizer) is made by the user based on their own subjective feelings. [9] [10] [19] [20]

Hearing correction mode represents an audio signal processing system. The audio signal processing system implements a broadband method for changing the correction of the spectral envelope of a signal using a filter with a finite impulse response whose frequency response is generated based on user-defined hearing thresholds during the in situ-audiometry procedure.

Figure 2 shows a general signal processing scheme in a hearing aid application.

Figure 2 - HAA general signal processing scheme HAA scheme.png
Figure 2 - HAA general signal processing scheme

Audio input signal, acoustic feedback (echo) and background noise are captured by the microphone, summed and then divided into sub-band components with a lower sampling rate using an analysis filter bank (AFB).

Estimation of noise is based on the minima controlled recursive averaging of past values of noise. [21]

Cleared of noise subband signal is cleared of acoustic echo by adaptive filtering. [21]

The subband audio components that are cleared of echo and noise are amplified by multiplying by the corresponding coefficients, which are calculated based on the level of input and output audio signals, ambient noise energy, as well as hearing thresholds (hearing loss frequency characteristics) of the user.

The gain unit also performs the function of dynamic range compression, thereby compensating for the function of non-linear amplification of the human cochlea.

The processed broadband signal is synthesized using a synthesis filter bank (SFB).

AFB and SFB can be realised as DFT-modulated filter banks, which is one of the most popular filter bank type used in modern hearing aids. [21]

The output signal can be multiplied by the total gain, which provides a comfortable sound level. This coefficient is adjusted by the user using an external controller directly in HAA interface. [9] [4] [5] [6]

HAA, as a rule, provides high speed (i.e. minimum sound delay) and high sound quality due to a simple signal processing algorithm as well as due to the effective implementation of application functional blocks. [21]

Some HAA may not have an acoustic cancellation block. [22]

Estimate of hearing aid efficiency

Based on the results of studies conducted on the effectiveness of using the different hearing aid applications, it can be concluded that for those respondents who have never used hearing aids before, there is a tendency of a positive effect on speech intelligibility. The positive impact on speech intelligibility when talking in a noisy environment was noted by those respondents who used hearing aids. [23]

HAA also can be useful not only as a hearing aid. For example, it can be useful in the process of studying, as students can place their smartphone/tablet closer to the teacher and hears him better. [8]

Related Research Articles

Mixing console Device used for audio mixing for recording or performance

In sound recording and reproduction, and sound reinforcement systems, a mixing console is an electronic device for combining sounds of many different audio signals. Inputs to the console include microphones being used by singers and for picking up acoustic instruments, signals from electric or electronic instruments, or recorded music. Depending on the type, a mixer is able to control analog or digital signals. The modified signals are summed to produce the combined output signals, which can then be broadcast, amplified through a sound reinforcement system or recorded.

Hearing aid Electroacoustic device

A hearing aid is a device designed to improve hearing by making sound audible to a person with hearing loss. Hearing aids are classified as medical devices in most countries, and regulated by the respective regulations. Small audio amplifiers such as PSAPs or other plain sound reinforcing systems cannot be sold as "hearing aids".

Hearing test

A hearing test provides an evaluation of the sensitivity of a person's sense of hearing and is most often performed by an audiologist using an audiometer. An audiometer is used to determine a person's hearing sensitivity at different frequencies. There are other hearing tests as well, e.g., Weber test and Rinne test.

Sound reinforcement system

A sound reinforcement system is the combination of microphones, signal processors, amplifiers, and loudspeakers in enclosures all controlled by a mixing console that makes live or pre-recorded sounds louder and may also distribute those sounds to a larger or more distant audience. In many situations, a sound reinforcement system is also used to enhance or alter the sound of the sources on the stage, typically by using electronic effects, such as reverb, as opposed to simply amplifying the sources unaltered.

Audiometry is a branch of audiology and the science of measuring hearing acuity for variations in sound intensity and pitch and for tonal purity, involving thresholds and differing frequencies. Typically, audiometric tests determine a subject's hearing levels with the help of an audiometer, but may also measure ability to discriminate between different sound intensities, recognize pitch, or distinguish speech from background noise. Acoustic reflex and otoacoustic emissions may also be measured. Results of audiometric tests are used to diagnose hearing loss or diseases of the ear, and often make use of an audiogram.

Portable media player Portable device capable of storing and playing digital media

A portable media player (PMP) or digital audio player (DAP) is a portable consumer electronics device capable of storing and playing digital media such as audio, images, and video files. The data is typically stored on a compact disc (CD), Digital Video Disc (DVD), Blu-ray Disc (BD), flash memory, microdrive, or hard drive. Most portable media players are equipped with a 3.5 mm headphone jack, which users can plug headphones into, or connect to a boombox or hifi system. In contrast, analogue portable audio players play music from non-digital media that use analogue signal storage, such as cassette tapes or vinyl records.

Sound level meter

A sound level meter is used for acoustic measurements. It is commonly a hand-held instrument with a microphone. The best type of microphone for sound level meters is the condenser microphone, which combines precision with stability and reliability. The diaphragm of the microphone responds to changes in air pressure caused by sound waves. That is why the instrument is sometimes referred to as a Sound Pressure Level (SPL) Meter. This movement of the diaphragm, i.e. the sound pressure deviation, is converted into an electrical signal. While describing sound in terms of sound pressure (Pascal) is possible, a logarithmic conversion is usually applied and the sound pressure level is stated instead, with 0 dB SPL equal to 20 micropascals.

Adaptive feedback cancellation is a common method of cancelling audio feedback in a variety of electro-acoustic systems such as digital hearing aids. The time varying acoustic feedback leakage paths can only be eliminated with adaptive feedback cancellation. When an electro-acoustic system with an adaptive feedback canceller is presented with a correlated input signal, a recurrent distortion artifact, entrainment is generated. There is a difference between the system identification and feedback cancellation.

Analysis of sound and acoustics plays a role in such engineering tasks as product design, production test, machine performance, and process control. For instance, product design can require modification of sound level or noise for compliance with standards from ANSI, IEC, and ISO. The work might also involve design fine-tuning to meet market expectations. Here, examples include tweaking an automobile door latching mechanism to impress a consumer with a satisfying click or modifying an exhaust manifold to change the tone of an engine's rumble. Aircraft designers are also using acoustic instrumentation to reduce the noise generated on takeoff and landing.

Audio signal flow is the path an audio signal takes from source to output. The concept of audio signal flow is closely related to the concept of audio gain staging; each component in the signal flow can be thought of as a gain stage.

Assistive listening device

An assistive listening device (ALD) is part of a system used to improve hearing ability for people in a variety of situations where they are unable to distinguish speech in noisy environments. Often, in a noisy or crowded room it is almost impossible for an individual who is hard of hearing to distinguish one voice among many. This is often exacerbated by the effect of room acoustics on the quality of perceived speech. Hearing aids are able to amplify and process these sounds, and improve the speech to noise ratio. However, if the sound is too distorted by the time it reaches the listener, even the best hearing aids will struggle to unscramble the signal. Assistive listening devices offer a more adaptive alternative to hearing aids, but can be more complex and cumbersome.

Equalization (audio)

Equalization is the process of adjusting the balance between frequency components within an electronic signal. The most well known use of equalization is in sound recording and reproduction but there are many other applications in electronics and telecommunications. The circuit or equipment used to achieve equalization is called an equalizer. These devices strengthen or weaken the energy of specific frequency bands or "frequency ranges".

In live sound mixing, gain before feedback (GBF) is a practical measure of how much a microphone can be amplified in a sound reinforcement system before causing audio feedback. In audiology, GBF is a measure of hearing aid performance. In both fields the amount of gain is measured in decibels at or just below the point at which the sound from the speaker driver re-enters the microphone and the system begins to ring or feed back. Potential acoustic gain (PAG) is a calculated figure representing gain that a system can support without feeding back.

History of hearing aids

The first hearing aid was created in the 17th century. The movement toward modern hearing aids began with the creation of the telephone, and the first electric hearing aid was created in 1898. By the late 20th century, the digital hearing aid was distributed to the public commercially. Some of the first hearing aids were external hearing aids. External hearing aids directed sounds in front of the ear and blocked all other noises. The apparatus would fit behind or in the ear.

Personal Sound Amplification Products, also known as "Personal Sound Amplification Devices," or by the acronym PSAP, are defined by the U.S. Food and Drug Administration as wearable electronic products that are intended to amplify sounds for people who are not d/Deaf or Hard of Hearing. They are not hearing aids, which the FDA describes as intended to compensate for hearing loss. According to Dr. Mann of the FDA, choosing a PSAP as a substitute for a hearing aid can lead to more damage to your hearing

Assistive Technology for the Deaf and Hard of Hearing is special technology made to assist them including Hearing aids, Video relay services, tactile devices, alerting devices and technology for supporting communication.

Here One

Here One is a pair of wireless smart earbuds developed and manufactured by Doppler Labs. It allows users to filter sound, stream music, and amplify speech. It can also be used to take phone calls and filter certain sounds, such as background noise. Here One has been called the world’s first in-ear computer and in June 2018 Here One was inducted into the Smithsonian Institution's Copper Hewitt Museum of Design for innovation in audio technology.

In sound technology, personalised sound refers to a range of technologies that customise an audio device's sound output to match the listener's hearing sensitivities or their environment.

AirPods Pro Apple Bluetooth earbuds

AirPods Pro are wireless Bluetooth earbuds created by Apple, initially released on October 30, 2019. They are Apple's mid-range wireless earbuds, sold alongside the base-level AirPods and highest-end AirPods Max.

Petralex Hearing aid application

"Petralex" is a hearing aid application for smartphones and tablets that implements a digital hearing aid with a built-in in situ-audiometry procedure. This application takes into account the ambient sound environment and independently adjusts to the user's ear. Petralex was developed by IT4YOU corporation for smartphones and tablets with Android and iOS operating systems and is distributed free of charge through the Donationware system.

References

  1. "Mobile Medical Applications. Guidance for Industry and Food and Drug Administration Staff" (PDF). Food and Drug Administration. 2015.
  2. 1 2 3 4 A. Vonlanthen, H. Arndt (2009). Hearing aids (in Russian). Translated by T. Gvelesiani. Rostov-on-Don: Feniks. ISBN   978-5-222-15490-8.
  3. Sergio Fernández Riquelme (2018). Nuevas tecnologías para la Intervención social: investigación, integración y difusión digital (PDF) (in Spanish). ISSN   2341-4529.
  4. 1 2 techwibe (2017-10-02). "Fennex – The First Free Augmented Hearing App For iPhone". TECHWIBE. Retrieved 2019-03-29.
  5. 1 2 3 "JacotiListen App. Datasheet" (PDF).
  6. 1 2 3 "About the technology". dectone.pro. Retrieved 2019-03-29.
  7. 1 2 "uSound Smart Hearing System | App | Earphone". www.usound.co. Retrieved 2019-03-29.
  8. 1 2 Ismaili, Jalal; Ibrahimi, El Houcine Ouazzani (2017-05-01). "Mobile learning as alternative to assistive technology devices for special needs students". Education and Information Technologies. 22 (3): 883–899. doi:10.1007/s10639-015-9462-9. ISSN   1573-7608.
  9. 1 2 3 "Hearing Aid - Sound Amplifier". App Store. Retrieved 2019-03-29.
  10. 1 2 "Ear Spy: Super Hearing". App Store. Retrieved 2019-03-29.
  11. D. Byrne, H. Dillon (1986). "The national acoustic laboratories (NAL) new procedure for selecting the gain and frequency response of a hearing aid". Ear and Hearing. Ear and Hearing, Vol. 7. 7 (4): 257–265. doi:10.1097/00003446-198608000-00007. PMID   3743918.
  12. K.W. Berger, E.N. Hagberg, R.L. Rane (1980). Determining hearing aid gain. Hearing Instruments, Vol. 30. pp. 26–44.CS1 maint: multiple names: authors list (link)
  13. G.A. McCandless, P.E. Lyregaard (1983). Prescription of gain/output (POGO) for hearing aids. Hearing Instruments, Vol. 34. pp. 16–21.
  14. A. Pandey, V.J. Mathews (2011). "Low-delay signal processing for digital hearing aids". IEEE Transactions on Audio, Speech, and Language Processing. IEEE Transactions on Audio, Speech, and Language Processing, Vol. 4 (19). 19 (4): 699–710. doi:10.1109/TASL.2010.2060193. ISSN   1558-7916.
  15. M.I. Vashkevich, E.S. Azarov, A.A. Petrovsky (2012). Low-delay hearing aid based on cochlear model with nonuniform subband acoustic feedback cancellation (PDF). Bucharest: Proceedings of the 20th European Signal Processing Conference (EUSIPCO). pp. 514–518.CS1 maint: multiple names: authors list (link)
  16. "Quality of Deaf and Hard-of-Hearing Mobile Apps: Evaluation Using the Mobile App Rating Scale (MARS) With Additional Criteria From a Content Expert". mhealth.jmir.org/2019/10/e14198/.
  17. "Google Play Market". Google Play.
  18. "App Store Market". App Store.
  19. "BioAid — The Biologically Inspired Hearing Aid". bioaid.org.uk. Retrieved 2019-03-29.
  20. "AmplyPhone - Personal hearing amplifier". App Store. Retrieved 2019-03-29.
  21. 1 2 3 4 Vashkevich, M.; Azarov, E.; Petrovsky, N.; Petrovsky, A. (2017). "Petralex: A smartphone-based real-time digital hearing aid with combined noise reduction and acoustic feedback suppression". 2017 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA): 249–254. doi:10.23919/SPA.2017.8166873. ISBN   978-83-62065-30-1.
  22. Review, Hearing. "Improving Patient Compliance to Hearing Healthcare Services and Treatment through Self-Efficacy and Smartphone Applications". Hearing Review. Retrieved 2019-03-29.
  23. "Utility of Smartphone-based Hearing Aid Applications as a Substitute to Traditional Hearing Aids". Hearing Review. Retrieved 2019-03-29.