Spoken (app)

Last updated
Spoken - Tap to Talk AAC
Other namesSpoken, Spoken AAC
Original author(s) Michael Bond
Developer(s) Spoken, Inc.
Initial release2019;5 years ago (2019)
Stable release
1.8.9 / October 2024;0 months ago (2024-10) [1] [2]
Operating system iOS, Android, MacOS
Available inEnglish
Type Augmentative and alternative communication application software
License Proprietary
Website spokenaac.com

Spoken (also known as Spoken - Tap to Talk AAC and Spoken AAC) is a mobile application and augmentative and alternative communication (AAC) tool launched in 2019. [3] The app was designed to aid individuals with speech and language impairments like aphasia or nonverbal autism, using a combination of symbols, text, and voice output.

Contents

History

Michael Bond began development of Spoken in 2015, prompted by a need for modern and accessible tools in speech therapy, as traditional methods had not significantly changed in the last 50 years. [4] The project saw considerable advancement due to participation in the Start-Up Chile accelerator program, where it took first place against eighteen competing startups on the 13th generation's Demo Day in November 2015. [5] [6] [7] The app officially launched in 2019.

Many of Spoken's original symbols were borrowed from The Noun Project, selected using crowdsourced human-based computation to determine the best icons for individual words.[ citation needed ] Although many Noun Project icons are still used in Spoken, an effort has been made to switch to proprietary icons for improved style consistency and faster word recognition. [8]

The real-world application of Spoken's technology was unexpectedly extended during the COVID-19 pandemic, assisting patients recovering from ventilator use. By March 2021, the application had garnered over 10,000 downloads and reported a sustained 20% monthly growth. [9] By May 2022, it was averaging an additional 1,000 downloads per week. [10]

In February 2022, Spoken joined AlphaLab Health, a startup accelerator by Allegheny Health Network and Innovation Works. This provided the company with access to clinical resources, funding, and mentorship, further enabling its growth. [10] It has also participated in other programs like the Multiple Autism Accelerator and Slalom Ventures' AI for Good Accelerator. [11] [12]

Spoken has set out to expand its technological offerings to more languages, seeking to address the needs of underserved populations and preparing for growing global demand. [6] [9]

Operation

Spoken distinguishes itself from other AAC applications through the use of an artificial neural network that provides predictive text capabilities, similar to a smartphone's autocomplete function. [13] This feature learns from the user's speech patterns, offering increasingly personalized suggestions over time. Users can expand the app’s vocabulary in three ways: by repeatedly using new words in sentences so Spoken learns their context, by adding terms in bulk through the "Add Vocabulary" option for basic prediction, or by using the "Personalized Predictions" feature, which asks targeted questions to ensure new words are immediately predicted in the correct contexts. Additionally, Spoken can tailor its predictions based on the user's location, providing contextually relevant suggestions in specific settings such as restaurants or hospitals.

The application includes a selection of natural-sounding, synthesized voices with customization options for pitch, speed, and volume, enabling users to choose a voice that best represents their identity or preferences. All voices included in Spoken are named after plants rather than people to make them appear more gender-neutral or unisex.[ citation needed ] Examples include Elderberry, Bottlebrush, and Dandelion.

Spoken supports a variety of input methods to accommodate different user needs and preferences. Beyond conventional typing and predictive text, it recognizes handwriting and even simple drawings, translating these inputs into spoken words. [14] The data used to train Spoken's drawing canvas was sourced from the game Quick, Draw!, allowing it to recognize very crude drawings with great accuracy.[ citation needed ]

Spoken also offers a saved phrases feature, designed for users who regularly use specific sentences or expressions. These phrases can be retrieved in just two taps, streamlining communication in fast-paced or emergency situations.

Another feature of Spoken is its "attention button." This feature was designed as a substitution for verbal cues like clearing one's throat. [15] A single tap of this button repeatedly blinks the device's flashlight and plays a customizable, attention-grabbing sound. AAC users can use this feature to notify others that they are about to speak, or to quickly get someone's attention in an emergency.

For additional accessibility, Spoken incorporates features like large print, dark mode, and word dividers to ensure that the app is usable and comfortable for individuals with varying needs. [14]

Users can also display their sentences in fullscreen scale for communicating in high volume environments or in situations where they don't want to make noise.

Other features include the ability to quickly share written content or audio clips from the app via text or email and an option to block certain words from appearing in predictions, providing an extra layer of personalization.

See also

Related Research Articles

Speech synthesis is the artificial production of human speech. A computer system used for this purpose is called a speech synthesizer, and can be implemented in software or hardware products. A text-to-speech (TTS) system converts normal language text into speech; other systems render symbolic linguistic representations like phonetic transcriptions into speech. The reverse process is speech recognition.

<span class="mw-page-title-main">Autocomplete</span> Computing feature predicting ending to a word a user is typing

Autocomplete, or word completion, is a feature in which an application predicts the rest of a word a user is typing. In Android and iOS smartphones, this is called predictive text. In graphical user interfaces, users can typically press the tab key to accept a suggestion or the down arrow key to accept one of several.

<span class="mw-page-title-main">Augmentative and alternative communication</span> Techniques used for those with communication impairments

Augmentative and alternative communication (AAC) encompasses the communication methods used to supplement or replace speech or writing for those with impairments in the production or comprehension of spoken or written language. AAC is used by those with a wide range of speech and language impairments, including congenital impairments such as cerebral palsy, intellectual impairment and autism, and acquired conditions such as amyotrophic lateral sclerosis and Parkinson's disease. AAC can be a permanent addition to a person's communication or a temporary aid. Stephen Hawking, probably the best-known user of AAC, had amyotrophic lateral sclerosis, and communicated through a speech-generating device.

A voice-user interface (VUI) enables spoken human interaction with computers, using speech recognition to understand spoken commands and answer questions, and typically text to speech to play a reply. A voice command device is a device controlled with a voice user interface.

<span class="mw-page-title-main">Windows Speech Recognition</span> Speech recognition software

Windows Speech Recognition (WSR) is speech recognition developed by Microsoft for Windows Vista that enables voice commands to control the desktop user interface, dictate text in electronic documents and email, navigate websites, perform keyboard shortcuts, and operate the mouse cursor. It supports custom macros to perform additional or supplementary tasks.

<span class="mw-page-title-main">Speech-generating device</span> Augmenting speech device

Speech-generating devices (SGDs), also known as voice output communication aids, are electronic augmentative and alternative communication (AAC) systems used to supplement or replace speech or writing for individuals with severe speech impairments, enabling them to verbally communicate. SGDs are important for people who have limited means of interacting verbally, as they allow individuals to become active participants in communication interactions. They are particularly helpful for patients with amyotrophic lateral sclerosis (ALS) but recently have been used for children with predicted speech deficiencies.

Gestures in language acquisition are a form of non-verbal communication involving movements of the hands, arms, and/or other parts of the body. Children can use gesture to communicate before they have the ability to use spoken words and phrases. In this way gestures can prepare children to learn a spoken language, creating a bridge from pre-verbal communication to speech. The onset of gesture has also been shown to predict and facilitate children's spoken language acquisition. Once children begin to use spoken words their gestures can be used in conjunction with these words to form phrases and eventually to express thoughts and complement vocalized ideas.

<span class="mw-page-title-main">Virtual assistant</span> Software agent

A virtual assistant (VA) is a software agent that can perform a range of tasks or services for a user based on user input such as commands or questions, including verbal ones. Such technologies often incorporate chatbot capabilities to simulate human conversation, such as via online chat, to facilitate interaction with their users. The interaction may be via text, graphical interface, or voice - as some virtual assistants are able to interpret human speech and respond via synthesized voices.

<span class="mw-page-title-main">Siri</span> Software-based personal assistant from Apple

Siri is a digital assistant purchased, developed, and popularized by Apple Inc., which included it in the iOS, iPadOS, watchOS, macOS, tvOS, audioOS, and visionOS operating systems. It uses voice queries, gesture based control, focus-tracking and a natural-language user interface to answer questions, make recommendations, and perform actions by delegating requests to a set of Internet services. With continued use, it adapts to users' individual language usages, searches, and preferences, returning individualized results.

Semantic compaction, (Minspeak), conceptually described as polysemic (multi-meaning) iconic encoding, is one of the three ways to represent language in Augmentative and alternative communication (AAC). It is a system utilized in AAC devices in which sequences of icons are combined in order to form a word or a phrase. The goal is to increase independent communication in individuals who cannot use speech. Minspeak is the only patented system for Semantic Compaction and is based on multi-meaning icons that code vocabulary in short sequences determined by rule-driven patterns. Minspeak has been used with both children and adults with various disabilities, including cerebral palsy, motor speech disorders, developmental disabilities, autism spectrum disorder, and adult onset disabilities such as Amyotrophic Lateral Sclerosis (ALS).

Tank Top TV was a website providing personalized programme listings and recommendations for online TV and movies in the United Kingdom.

<span class="mw-page-title-main">Microsoft SwiftKey</span> Virtual keyboard app

Microsoft SwiftKey is a virtual keyboard app originally developed by TouchType for Android and iOS devices. It was first released for Android in July 2010, followed by an iOS release in September 2014 after Apple's implementation of third-party keyboard support.

<span class="mw-page-title-main">Start-Up Chile</span>

Start-Up Chile is a seed accelerator created by the Chilean government, based in Santiago de Chile. It was founded in 2010 with the goal of increasing the number of national and international ventures that are generated in the country.

<span class="mw-page-title-main">Guide (software company)</span>

Guide was a US technology startup company developing a newsreader app that translates text from online news sources, blogs and social media streams into streaming audio and video. The company's apps include animal character readers. The company was founded in 2012 by chief executive officer Freddie A. Laker, and privately launched its mobile app in alpha in February 2013.

<span class="mw-page-title-main">Cortana (virtual assistant)</span> Discontinued personal assistant by Microsoft

Cortana was a virtual assistant developed by Microsoft that used the Bing search engine to perform tasks such as setting reminders and answering questions for users.

<span class="mw-page-title-main">Kinsa</span> Internet-connected thermometer company (founded 2012)

Kinsa Inc. is a health technology company with a powerful and robust AI platform that provides predictive insights for pharmaceutical companies, retailers, illness product companies, public health agencies, hospital systems, and communities. Kinsa aims to stop the spread of infectious illness through a network of smart thermometers that power their Insights platform.

<span class="mw-page-title-main">Speech Recognition & Synthesis</span> Screen reader application by Google

Speech Recognition & Synthesis, formerly known as Speech Services, is a screen reader application developed by Google for its Android operating system. It powers applications to read aloud (speak) the text on the screen, with support for many languages. Text-to-Speech may be used by apps such as Google Play Books for reading books aloud, Google Translate for reading aloud translations for the pronunciation of words, Google TalkBack, and other spoken feedback accessibility-based applications, as well as by third-party apps. Users must install voice data for each language.

Endel is a paid generative music app that creates personalized sound environments to match user activities. The app provides preset modes for relaxation, focus, sleep, and moving, and reacts to time of the day, weather, heart rate, and location to create unique compositions.

<span class="mw-page-title-main">StatMuse</span>

StatMuse Inc. is an American artificial intelligence company founded in 2014. The company maintains its own eponymous website where it hosts a database of sports statistics.

References

  1. "Spoken - Tap to Talk AAC". App Store. 27 September 2024. Retrieved 3 October 2024.
  2. "Spoken – Tap to Talk AAC". Google Play Store. Retrieved 3 October 2024.
  3. "About Spoken : Tap to Talk AAC" . Retrieved 2 February 2024.
  4. "Spoken Gives a Voice to Those Who Can't Speak". Archived from the original on 2024-02-01.
  5. Sebastian Diaz, Language App wins Start-Up Chile Demo Day, archived from the original on 2016-01-12
  6. 1 2 Anne Ravanona (2 February 2016), "How Start-Up Chile Put Their Ecosystem on the Global Map and Became a Benchmark for Other Countries", HuffPost, retrieved 2 February 2024
  7. Anna Heim, "Tech in Latin America: All the News You Shouldn't Miss From the Past Month", The Next Web
  8. "AAC App Update Aims to Boost Communication Access". AT Today. 12 April 2024. Retrieved 9 May 2024.
  9. 1 2 "Patch Gets To Know Spoken". Patch. 29 March 2021. Retrieved 2 February 2024.
  10. 1 2 "Igniting Innovation at AlphaLab Health". Highmark Health. Retrieved 2 February 2024.
  11. "Alumni". Multiple. Retrieved 17 May 2024.
  12. "Slalom Ventures Presents AI for Good Accelerator Demo Day". Slalom. Retrieved 17 May 2024.
  13. "How a Zombie Hospital in Pennsylvania was Reborn as a Startup Accelerator". MD Next. AngelMD. 8 August 2022. Retrieved 1 February 2024.
  14. 1 2 "Spoken AAC". Neil Squire Society. 10 November 2023. Retrieved 2 February 2024.
  15. "Michael Bond". Ohio Southeast. 8 February 2024. Retrieved 8 February 2024.