Mycroft (software)

Last updated
Mycroft
Developer(s) Mycroft AI team
Repository
Written in Python
License Apache License [1]
Website mycroft.ai

Mycroft is a free and open-source software virtual assistant that uses a natural language user interface. [2] [3] [4] Its code was formerly copyleft, but is now under a permissive license. [1] It is named after a fictional computer from the 1966 science fiction novel The Moon Is a Harsh Mistress . [5]

Contents

History

Inspiration for Mycroft came when Ryan Sipes and Joshua Montgomery were visiting a makerspace in Kansas City, MO, where they came across a simple and basic intelligent virtual assistant project. They were interested in the technology, but did not like its inflexibility. [6] [7] Montgomery believes that the burgeoning industry of intelligent personal assistance poses privacy concerns for users, and has promised that Mycroft will protect privacy through its open source machine learning platform. [8]

Mycroft AI, Inc., has won several awards, including the prestigious Techweek's KC Launch competition in 2016. [9] They were part of the Sprint Accelerator 2016 class in Kansas City and joined 500 Startups Batch 20 in February 2017. [10] [11] The company accepted a strategic investment from Jaguar Land Rover during this same time period. [12] The company had raised more than $2.5 million from institutional investors before they opted to offer shares of the company to the public through StartEngine, an equity crowdfunding platform. [13]

In early 2023, Mycroft AI ceased development. [14]

Software

Mycroft voice stack

Mycroft provides free software for most[ clarification needed ] parts of the voice stack.

Wake Word

Mycroft does Wake Word spotting, also called keyword spotting, through its Precise Wake Word engine. [15] Prior to Precise becoming the default Wake Word engine, Mycroft employed PocketSphinx. Instead of being based on phoneme recognition, Precise uses a trained recurrent neural network to distinguish between sounds which are, and which aren't Wake Words.

Speech to text

Mycroft is partnering with Mozilla's Common Voice Project to leverage their DeepSpeech speech to text software. [16]

Intent parsing

Mycroft uses an intent parser called Adapt to convert natural language into machine-readable data structures. Adapt undertakes intent parsing by matching specific keywords in an order within an utterance. They also have a parser, Padatious. Padatious, in contrast, uses example-based inference to determine intent.

Text to speech

For speech synthesis Mycroft uses Mimic, which is based on the Festival Lite speech synthesis system. [17]

Modular design and interoperability

Mycroft is designed to be modular, so users are able to change its components. For example, espeak can be used instead of Mimic. [18] [19] [20] [21]

Hardware

Prototype of the Mycroft Mark II voice assistant Mycroft Mark II voice assistant.png
Prototype of the Mycroft Mark II voice assistant

The Mycroft project is also working on and selling smart speakers that run its software. All of its hardware is open-source, released under the CERN Open Hardware Licence. [22]

Its first hardware project was the Mark I, targeted primarily at developers. Its production was partially funded through a Kickstarter campaign, which finished successfully. Units started shipping out in April 2016. [23]

Its most recent hardware project is the Mark II, intended for general usage, not just for developers. Unlike the Mark I, the Mark II is equipped with a screen, being able to relay information both visually and acoustically. As with the Mark I, the Mark II's production was partially funded through a Kickstarter campaign, which wrapped up in February 2018, hitting almost 8 times its original goal. Mark II shipping started to crowdfunders in the end of 2022. In February 2023, a post on the Kickstarter page announced that they "will not be able to fulfill any remaining Mark II rewards", however they "will still be shipping all orders that are made through the Mycroft website". [24]

Partnerships

Mycroft has undertaken several commercial collaborations. In May 2018, the company partnered with WorkAround, an impact sourcing provider who broker work opportunities for refugees, to undertake bulk machine learning training. [25] In October 2018, Mycroft collaborated with disease surveillance and forecasting company, SickWeather, to identify the frequency of coughing on public transport, funded by the City of Kansas City, Missouri. [26]

See also

Related Research Articles

<span class="mw-page-title-main">Device driver</span> Software interface to attached devices

In computing, a device driver is a computer program that operates or controls a particular type of device that is attached to a computer or automaton. A driver provides a software interface to hardware devices, enabling operating systems and other computer programs to access hardware functions without needing to know precise details about the hardware being used.

<span class="mw-page-title-main">Red Hat</span> Computing services company

Red Hat, Inc. is an American software company that provides open source software products to enterprises and is a subsidiary of IBM. Founded in 1993, Red Hat has its corporate headquarters in Raleigh-Durham, North Carolina, with other offices worldwide.

<span class="mw-page-title-main">Nvidia</span> American multinational technology company

Nvidia Corporation is an American multinational corporation and technology company headquartered in Santa Clara, California, and incorporated in Delaware. It is a software and fabless company which designs and supplies graphics processing units (GPUs), application programming interfaces (APIs) for data science and high-performance computing as well as system on a chip units (SoCs) for the mobile computing and automotive market. Nvidia is also a dominant supplier of artificial intelligence (AI) hardware and software.

A computing platform, digital platform, or software platform is an environment in which software is executed. It may be the hardware or the operating system (OS), a web browser and associated application programming interfaces, or other underlying software, as long as the program code is executed using the services provided by the platform. Computing platforms have different abstraction levels, including a computer architecture, an OS, or runtime libraries. A computing platform is the stage on which computer programs can run.

<span class="mw-page-title-main">Xen</span> Type-1 hypervisor

Xen is a free and open-source type-1 hypervisor, providing services that allow multiple computer operating systems to execute on the same computer hardware concurrently. It was originally developed by the University of Cambridge Computer Laboratory and is now being developed by the Linux Foundation with support from Intel, Citrix, Arm Ltd, Huawei, AWS, Alibaba Cloud, AMD, Bitdefender and epam.

<span class="mw-page-title-main">FOSDEM</span> Annual event in Brussels centered on free and open source software development

Free and Open source Software Developers' European Meeting (FOSDEM) is a non-commercial, volunteer-organized European event centered on free and open-source software development. It is aimed at developers and anyone interested in the free and open-source software movement. It aims to enable developers to meet and to promote the awareness and use of free and open-source software.

<span class="mw-page-title-main">Trusted Platform Module</span> Standard for secure cryptoprocessors

Trusted Platform Module (TPM) is an international standard for a secure cryptoprocessor, a dedicated microcontroller designed to secure hardware through integrated cryptographic keys. The term can also refer to a chip conforming to the standard ISO/IEC 11889. Common uses are to verify platform integrity, and to store disk encryption keys.

UNIGINE is a proprietary cross-platform game engine developed by UNIGINE Company used in simulators, virtual reality systems, serious games and visualization. It supports OpenGL 4, Vulkan and DirectX 12.

<span class="mw-page-title-main">Kernel-based Virtual Machine</span> Virtualization module in the Linux kernel

Kernel-based Virtual Machine (KVM) is a free and open-source virtualization module in the Linux kernel that allows the kernel to function as a hypervisor. It was merged into the mainline Linux kernel in version 2.6.20, which was released on February 5, 2007. KVM requires a processor with hardware virtualization extensions, such as Intel VT or AMD-V. KVM has also been ported to other operating systems such as FreeBSD and illumos in the form of loadable kernel modules.

<span class="mw-page-title-main">Collabora</span> Global private company

Collabora Ltd is a global private company headquartered in Cambridge, United Kingdom, with offices in Cambridge and Montreal. It provides open-source consultancy, training and products to companies.

<span class="mw-page-title-main">Ubuntu version history</span> History of the Ubuntu operating system

Ubuntu releases are made semiannually by Canonical Ltd, its developers, using the year and month of the release as a version number. The first Ubuntu release, for example, was Ubuntu 4.10 and was released on 20 October 2004. Consequently, version numbers for future versions are provisional; if the release is delayed until a different month than planned, the version number will change accordingly.

Docker is a set of platform as a service (PaaS) products that use OS-level virtualization to deliver software in packages called containers. The service has both free and premium tiers. The software that hosts the containers is called Docker Engine. It was first released in 2013 and is developed by Docker, Inc.

uSens, Inc. is a Silicon Valley startup founded in 2014 in San Jose, California. The company builds interactive computer-vision tracking solutions. The uSens team has extensive experience in artificial intelligence (AI), computer vision, 3D Human–computer interaction (HCI) technology and augmented reality and virtual reality. uSens has been applying computer vision and AI technologies in AR/VR, Automotive and smartphones. 

CHIP was a single-board computer crowdfunded by now-defunct Next Thing Co. (NTC), released as open-source hardware running open-source software. It was advertised as "the world's first $9 computer". CHIP and related products are discontinued. NTC has since gone insolvent.

<span class="mw-page-title-main">Google Assistant</span> AI-powered digital assistant from Google

The Google Assistant is a virtual assistant software application developed by Google that is primarily available on mobile and home automation devices. Based on artificial intelligence, The Google Assistant can engage in two-way conversations, unlike the company's previous virtual assistant, Google Now.

Crowd Supply is a crowdfunding platform based in Portland, Oregon. The platform has claimed "over twice the success rate of Kickstarter and Indiegogo", and partners with creators who use it, providing mentorship resembling a business incubator.

The Libre Computer Project is an effort initiated by Shenzhen Libre Technology Co., Ltd., with the goal of producing standards-compliant single-board computers (SBC) and upstream software stack to power them.

<span class="mw-page-title-main">Home Assistant</span> Home automation software

Home Assistant is free and open-source software for home automation, designed to be an Internet of things (IoT) ecosystem-independent integration platform and smart home hub for controlling smart home devices, with a focus on local control and privacy. Its interface can be accessed through a web-based user interface, by using companion apps for Android and iOS, or by voice commands via a supported virtual assistant, such as Google Assistant, Amazon Alexa, Apple Siri, and Home Assistant's own "Assist" uisng natural language.

Plasma Bigscreen is a software project from KDE which contains an interface optimized for Smart TVs and other computers such as the Raspberry Pi which can be connected to large displays.

References

  1. 1 2 "Having the Right license is just as important as having a License". 28 June 2017.
  2. Bhartiya, Swapnil (25 December 2015). "2015's most exciting Linux devices". CIO magazine. Archived from the original on 26 June 2018. Retrieved 17 March 2017.
  3. Hunckler, Matt (25 July 2017). "5 Growing Artificial Intelligence Startups You Need to Know About". Inc.com. Retrieved 6 October 2017.
  4. Hunckler, Matt (15 May 2017). "This Open-Source AI Voice Assistant Is Challenging Siri and Alexa for Market Superiority". Forbes . Archived from the original on 13 October 2017. Retrieved 6 October 2017.
  5. "Why Name it Mycroft?". 14 August 2015.
  6. Harrington, Rebecca (1 January 2016). "Customize An Open-Source HAL For Your Home". Popular Science . Archived from the original on 27 June 2018. Retrieved 17 March 2017.
  7. Bhartiya, Swapnil (17 January 2016). "Mycroft: Linux's Own AI". Linux.com. Retrieved 19 April 2016.
  8. Mycroft AI (2018-05-24), Mycroft StartEngine Equity Offering , retrieved 2018-07-08
  9. "Alexa can you find me a better assistant? | Techweek". Techweek. 2017-09-11. Archived from the original on 2018-07-09. Retrieved 2018-07-08.
  10. Fein, John (22 February 2016). "Announcing the 2016 Class of the Sprint Accelerator Powered by Techstars!". Techstars . Archived from the original on 30 September 2017. Retrieved 29 September 2017.
  11. Lynley, Matthew (8 February 2017). "Here's the 20th batch of 500 Startups companies". TechCrunch . Archived from the original on 30 September 2017. Retrieved 29 September 2017.
  12. Burch, Bobby (27 February 2017). "Jaguar Land Rover invests in artificial intelligence startup Mycroft". Startland News. Archived from the original on 12 January 2018. Retrieved 29 September 2017.
  13. "Mycroft AI". StartEngine. Retrieved 2018-07-08.
  14. Lewis, Michael (2023-02-01). "Update from the CEO: Part 1". Open Source Conversational AI Community. Retrieved 2024-05-14.
  15. "Precise Wake Word Engine". GitHub. 30 March 2020.
  16. Smith, Katie. "Developing an Open Source Voice Assistant: Interview with Mycroft AI's Steve Penrod". All About Circuits. Retrieved 24 October 2018.
  17. Gold, Jon (7 January 2016). "Raspberry Pi-based home AI project open-sources key components". Network World. Archived from the original on 19 May 2018. Retrieved 17 March 2017.
  18. Stahie, Silviu (7 January 2016). "Mycroft Releases Key AI Component as Open Source". Softpedia News. Archived from the original on 12 June 2018. Retrieved 24 April 2016.
  19. MSV, Janakiram (20 August 2015). "Meet Mycroft, The Open Source Alternative To Amazon Echo". Forbes . Archived from the original on 14 February 2018. Retrieved 17 March 2017.
  20. Stahie, Silviu (14 August 2015). "Mycroft Is an AI for Your Home Powered by Raspberry Pi 2 and Ubuntu Snappy". Softpedia News. Archived from the original on 6 June 2017. Retrieved 17 March 2017.
  21. Crist, Ry (17 August 2015). "Meet Mycroft, an open-source smart-home AI platform". CNET . CBS Interactive. Archived from the original on 21 June 2017. Retrieved 17 March 2017.
  22. "Github: Mycroft Mark I hardware". GitHub . Retrieved 18 March 2018.
  23. Adair, Kris (4 April 2016). "Making a Mycroft & First Shipment". Mycroft blog. Archived from the original on 27 June 2018. Retrieved 18 March 2018.
  24. Dobberstein, Laura (13 February 2023). "Creator of Linux virtual assistant blames 'patent troll' for project's death". The Register .
  25. "Using Precise to Help Refugees - Mycroft Partners with WorkAround". 14 May 2018. Retrieved 24 October 2018.
  26. Bezner, Elyssa (18 October 2018). "Collaboration in the air: Cough detection sensors combine Sickweather, Mycroft tech". StartlandNews. Retrieved 24 October 2018.