Spoken (app)

Last updated
Spoken - Tap to Talk AAC
Other namesSpoken, Spoken AAC
Original author(s) Michael Bond
Developer(s) Spoken, Inc.
Initial release2019;5 years ago (2019)
Stable release
1.8.8 / March 2024;2 months ago (2024-03) [1] [2]
Operating system iOS, Android, MacOS
Available inEnglish
Type Augmentative and alternative communication application software
License Proprietary
Website spokenaac.com

Spoken (also known as Spoken - Tap to Talk AAC and Spoken AAC) is a mobile application and augmentative and alternative communication (AAC) tool launched in 2019. [3] The app was designed to aid individuals with speech and language impairments like aphasia or nonverbal autism, using a combination of symbols, text, and voice output.

Contents

History

Michael Bond began development of Spoken in 2015, prompted by a need for modern and accessible tools in speech therapy, as traditional methods had not significantly changed in the last 50 years. [4] The project saw considerable advancement due to participation in the Start-Up Chile accelerator program, where it took first place against eighteen competing startups on the 13th generation's Demo Day in November 2015. [5] [6] The app officially launched in 2019.

Many of Spoken's original symbols were borrowed from The Noun Project, selected using crowdsourced human-based computation to determine the best icons for individual words.[ citation needed ] Although many Noun Project icons are still used in Spoken, an effort has been made to switch to proprietary icons for improved style consistency and faster word recognition. [7]

The real-world application of Spoken's technology was unexpectedly extended during the COVID-19 pandemic, assisting patients recovering from ventilator use. By March 2021, the application had garnered over 10,000 downloads and reported a sustained 20% monthly growth. [8] By May 2022, it was averaging an additional 1,000 downloads per week. [9]

In February 2022, Spoken joined AlphaLab Health, a startup accelerator by Allegheny Health Network and Innovation Works. This provided the company with access to clinical resources, funding, and mentorship, further enabling its growth. [9] It has also participated in other programs like the Multiple Autism Accelerator and Slalom Ventures' AI for Good Accelerator. [10] [11]

Spoken has set out to expand its technological offerings to more languages, seeking to address the needs of underserved populations and preparing for growing global demand. [6] [8]

Operation

Spoken distinguishes itself from other AAC applications through the use of an artificial neural network that provides predictive text capabilities, similar to a smartphone's autocomplete function. [12] This feature learns from the user's speech patterns, offering increasingly personalized suggestions over time. Additionally, Spoken can tailor its predictions based on the user's location, providing contextually relevant suggestions in specific settings such as restaurants or hospitals.

The application includes a selection of natural-sounding, synthesized voices with customization options for pitch, speed, and volume, enabling users to choose a voice that best represents their identity or preferences.

Spoken supports a variety of input methods to accommodate different user needs and preferences. Beyond conventional typing and predictive text, it recognizes handwriting and even simple drawings, translating these inputs into spoken words. [13] The data used to train Spoken's drawing canvas was sourced from the game Quick, Draw!, allowing it to recognize very crude drawings with great accuracy.[ citation needed ]

Another feature of Spoken is its "attention button." This feature was designed as a substitution for verbal cues like clearing one's throat. [14] A single tap of this button repeatedly blinks the device's flashlight and plays a customizable, attention-grabbing sound. AAC users can use this feature to notify others that they are about to speak, or to quickly get someone's attention in an emergency.

For additional accessibility, Spoken incorporates features like large print, dark mode, and word dividers to ensure that the app is usable and comfortable for individuals with varying needs. [13]

Users can also display their sentences in fullscreen scale for communicating in high volume environments or in situations where they don't want to make noise.

Other features include the ability to quickly share written content from the app via text or email and an option to block certain words from appearing in predictions, providing an extra layer of personalization.

See also

Related Research Articles

Speech synthesis is the artificial production of human speech. A computer system used for this purpose is called a speech synthesizer, and can be implemented in software or hardware products. A text-to-speech (TTS) system converts normal language text into speech; other systems render symbolic linguistic representations like phonetic transcriptions into speech. The reverse process is speech recognition.

<span class="mw-page-title-main">Screen reader</span> Assistive technology that converts text or images to speech or Braille

A screen reader is a form of assistive technology (AT) that renders text and image content as speech or braille output. Screen readers are essential to people who are blind, and are useful to people who are visually impaired, illiterate, or have a learning disability. Screen readers are software applications that attempt to convey what people with normal eyesight see on a display to their users via non-visual means, like text-to-speech, sound icons, or a braille device. They do this by applying a wide variety of techniques that include, for example, interacting with dedicated accessibility APIs, using various operating system features, and employing hooking techniques.

<span class="mw-page-title-main">Telecommunications relay service</span>

A telecommunications relay service, also known as TRS, relay service, or IP-relay, or Web-based relay service, is an operator service that allows people who are deaf, hard of hearing, deafblind, or have a speech disorder to place calls to standard telephone users via a keyboard or assistive device. Originally, relay services were designed to be connected through a TDD, teletypewriter (TTY) or other assistive telephone device. Services gradually have expanded to include almost any real-time text capable technology such as a personal computer, laptop, mobile phone, PDA, and many other devices. The first TTY was invented by deaf scientist Robert Weitbrecht in 1964. The first relay service was established in 1974 by Converse Communications of Connecticut.

<span class="mw-page-title-main">Google Talk</span> Instant messaging service

Google Talk was an instant messaging service that provided both text and voice communication. The instant messaging service was variously referred to colloquially as Gchat, Gtalk, or Gmessage among its users.

<span class="mw-page-title-main">Augmentative and alternative communication</span> Techniques used for those with communication impairments

Augmentative and alternative communication (AAC) encompasses the communication methods used to supplement or replace speech or writing for those with impairments in the production or comprehension of spoken or written language. AAC is used by those with a wide range of speech and language impairments, including congenital impairments such as cerebral palsy, intellectual impairment and autism, and acquired conditions such as amyotrophic lateral sclerosis and Parkinson's disease. AAC can be a permanent addition to a person's communication or a temporary aid. Stephen Hawking, probably the best-known user of AAC, had amyotrophic lateral sclerosis, and communicated through a speech-generating device.

A voice-user interface (VUI) enables spoken human interaction with computers, using speech recognition to understand spoken commands and answer questions, and typically text to speech to play a reply. A voice command device is a device controlled with a voice user interface.

<span class="mw-page-title-main">Windows Speech Recognition</span> Speech recognition software

Windows Speech Recognition (WSR) is speech recognition developed by Microsoft for Windows Vista that enables voice commands to control the desktop user interface, dictate text in electronic documents and email, navigate websites, perform keyboard shortcuts, and operate the mouse cursor. It supports custom macros to perform additional or supplementary tasks.

<span class="mw-page-title-main">Speech-generating device</span> Augmenting speech device

Speech-generating devices (SGDs), also known as voice output communication aids, are electronic augmentative and alternative communication (AAC) systems used to supplement or replace speech or writing for individuals with severe speech impairments, enabling them to verbally communicate. SGDs are important for people who have limited means of interacting verbally, as they allow individuals to become active participants in communication interactions. They are particularly helpful for patients with amyotrophic lateral sclerosis (ALS) but recently have been used for children with predicted speech deficiencies.

Semantic compaction, (Minspeak), conceptually described as polysemic (multi-meaning) iconic encoding, is one of the three ways to represent language in Augmentative and alternative communication (AAC). It is a system utilized in AAC devices in which sequences of icons are combined in order to form a word or a phrase. The goal is to increase independent communication in individuals who cannot use speech. Minspeak is the only patented system for Semantic Compaction and is based on multi-meaning icons that code vocabulary in short sequences determined by rule-driven patterns. Minspeak has been used with both children and adults with various disabilities, including cerebral palsy, motor speech disorders, developmental disabilities, autism spectrum disorder, and adult onset disabilities such as Amyotrophic Lateral Sclerosis (ALS).

Tank Top TV was a website providing personalized programme listings and recommendations for online TV and movies in the United Kingdom.

iConji Pictographic writing system

iConji is a free pictographic communication system based on an open, visual vocabulary of characters with built-in translations for most major languages.

HTML audio is a subject of the HTML specification, incorporating audio input, playback, and synthesis, all in the browser.

<span class="mw-page-title-main">Start-Up Chile</span>

Start-Up Chile is a seed accelerator created by the Chilean government, based in Santiago de Chile. It was founded in 2010 with the goal of increasing the number of national and international ventures that are generated in the country.

Libon is a voice over IP application developed for iOS and Android by Orange S.A.’s subsidiary, Orange Vallée. The application is available for free on the App Store and Google Play in 90 countries, including in countries where Orange does not have a presence in the telecommunications industry, such as the United States.

<span class="mw-page-title-main">Guide (software company)</span>

Guide was a US technology startup company developing a newsreader app that translates text from online news sources, blogs and social media streams into streaming audio and video. The company's apps include animal character readers. The company was founded in 2012 by chief executive officer Freddie A. Laker, and privately launched its mobile app in alpha in February 2013.

TextSecure was an encrypted messaging application for Android that was developed from 2010 to 2015. It was a predecessor to Signal and the first application to use the Signal Protocol, which has since been implemented into WhatsApp and other applications. TextSecure used end-to-end encryption to secure the transmission of text messages, group messages, attachments and media messages to other TextSecure users.

<span class="mw-page-title-main">Speech Recognition & Synthesis</span> Screen reader application by Google

Speech Recognition & Synthesis, formerly known as Speech Services, is a screen reader application developed by Google for its Android operating system. It powers applications to read aloud (speak) the text on the screen, with support for many languages. Text-to-Speech may be used by apps such as Google Play Books for reading books aloud, Google Translate for reading aloud translations for the pronunciation of words, Google TalkBack, and other spoken feedback accessibility-based applications, as well as by third-party apps. Users must install voice data for each language.

Michael Phillips is the CEO and co-founder of Sense Labs and a pioneer in machine learning, including mobile speech recognition and text-to-speech technology.

<span class="mw-page-title-main">StatMuse</span>

StatMuse Inc. is an American artificial intelligence company founded in 2014. The company maintains its own eponymous website where it hosts a database of sports statistics.

References

  1. "Spoken - Tap to Talk AAC". App Store. 3 January 2024. Retrieved 7 February 2024.
  2. "Spoken – Tap to Talk AAC". Google Play Store. Retrieved 7 February 2024.
  3. "About Spoken : Tap to Talk AAC" . Retrieved 2 February 2024.
  4. "Spoken Gives a Voice to Those Who Can't Speak". Archived from the original on 2024-02-01.
  5. Sebastian Diaz, Language App wins Start-Up Chile Demo Day, archived from the original on 2016-01-12
  6. 1 2 "How Start-Up Chile Put Their Ecosystem on the Global Map and Became a Benchmark for Other Countries". HuffPost. 2 February 2016. Retrieved 2 February 2024.
  7. "AAC App Update Aims to Boost Communication Access". AT Today. 12 April 2024. Retrieved 9 May 2024.
  8. 1 2 "Patch Gets To Know Spoken". Patch. 29 March 2021. Retrieved 2 February 2024.
  9. 1 2 "Igniting Innovation at AlphaLab Health". Highmark Health. Retrieved 2 February 2024.
  10. "Alumni". Multiple. Retrieved 17 May 2024.
  11. "Slalom Ventures Presents AI for Good Accelerator Demo Day". Slalom. Retrieved 17 May 2024.
  12. "How a Zombie Hospital in Pennsylvania was Reborn as a Startup Accelerator". MD Next. AngelMD. 8 August 2022. Retrieved 1 February 2024.
  13. 1 2 "Spoken AAC". Neil Squire Society. 10 November 2023. Retrieved 2 February 2024.
  14. "Michael Bond". Ohio Southeast. 8 February 2024. Retrieved 8 February 2024.