Asao (codec)

Last updated

Asao (also known as Nellymoser audio codec) is a proprietary single-channel (mono) codec and compression format optimized for low-bitrate transmission of audio, developed by Nellymoser Inc.

Contents

Technical Details

Sound data is grouped into frames of 256 samples. Each frame is converted into the frequency domain and the most significant (highest-amplitude) frequencies are identified. A number of frequency bands are selected for encoding; the rest are discarded. The bitstream for each frame then encodes which frequency bands are in use and what their amplitudes are. This codec does not take into consideration actual sample rate, and has fixed ratio between input samples amount and output packet size (2 bits per input sample).

Use in Flash technology

On March 4, 2002 Nellymoser Inc. announced that Macromedia licensed Nellymoser's Asao speech and audio compression software to be part of FlashMX and Macromedia Flash Player 6. [1] [2] (Macromedia is now Adobe Systems.) The Nellymoser Asao codec is an integral part of the Flash-plugin since Flash version 6, released in 2003. The codec is optimized for real-time and low-latency encoding of audio. Flash Player clients, when recording audio from a user's microphone, can use the Nellymoser Asao codec. (Flash Player 10 released in 2008 also supports the open source Speex codec. [3] ) The sampling rate of the audio capture can be controlled by the Flash programmer to increase and decrease encoding bitrate and quality. Encoding is done on the client host, and compressed data is then sent using Adobe's RTMP protocol to an RTMP server (Flash Media Server, Wowza Media Server). [4] [5] [6]

Use in other technology

At the time of the release of Flash Player 6 in 2003, there was no free or open source software for encoding and decoding Nellymoser audio. [7] [8] [9] [10] Nellymoser Inc. sold a decoder for thousands of US dollars. [11] [12] [13] [14]

In March 2006, Adobe Systems' people posted to Flash Server development newsgroup information about an on-coming new tool for FLV audio (including Nellymoser audio) conversion to MP3/WAV. [15] In July 2006, they announced that they have not been able to release the FLV/MP3 converter due to restrictions in Nellymoser license agreement. They found that they can only distribute this tool to be used with licensed copies of Flash Media Server. [16] [17]

In 2007, a project called "nelly2pcm" was created. In 2008, this project was removed from Google Code in response to a complaint under the U.S. Digital Millennium Copyright Act. [5] [18] [19] There were also some other attempts for creating free Nellymoser decoder. [20] Some apparently use a "wrapper" to force the flash ocx to play audio faster (e.g. 1:4 ratio), which redirects and grabs the audio output (wave) and then encodes it to MP3. This method does not use a licensed Nellymoser codec. [21]

In September 2007, a patch based on "nelly2pcm" was sent to FFmpeg multimedia framework development mailinglist. [22] In October 2007, a patch for decoding Nellymoser audio was added to FFmpeg SVN. [23] [24] [25] As of December 3, 2008, the open source FFmpeg project has encoding and decoding support for the Nellymoser Asao codec. [26] [27] Stable release with Nellymoser audio support is 0.5, released on March 10, 2009.

Related Research Articles

<span class="mw-page-title-main">Adobe Flash</span> Deprecated multimedia platform used to add animation and interactivity to websites

Adobe Flash is a multimedia software platform used for production of animations, rich internet applications, desktop applications, mobile apps, mobile games, and embedded web browser video players.

Windows Media Audio (WMA) is a series of audio codecs and their corresponding audio coding formats developed by Microsoft. It is a proprietary technology that forms part of the Windows Media framework. WMA consists of four distinct codecs. The original WMA codec, known simply as WMA, was conceived as a competitor to the popular MP3 and RealAudio codecs. WMA Pro, a newer and more advanced codec, supports multichannel and high resolution audio. A lossless codec, WMA Lossless, compresses audio data without loss of audio fidelity. WMA Voice, targeted at voice content, applies compression using a range of low bit rates. Microsoft has also developed a digital container format called Advanced Systems Format to store audio encoded by WMA.

A video file format is a type of file format for storing digital video data on a computer system. Video is almost always stored using lossy compression to reduce the file size.

Speex is an audio compression codec specifically tuned for the reproduction of human speech and also a free software speech codec that may be used on voice over IP applications and podcasts. It is based on the code excited linear prediction speech coding algorithm. Its creators claim Speex to be free of any patent restrictions and it is licensed under the revised (3-clause) BSD license. It may be used with the Ogg container format or directly transmitted over UDP/RTP. It may also be used with the FLV container format.

Theora is a free lossy video compression format. It was developed by the Xiph.Org Foundation and distributed without licensing fees alongside their other free and open media projects, including the Vorbis audio format and the Ogg container.

<span class="mw-page-title-main">FFmpeg</span> Multimedia framework

FFmpeg is a free and open-source software project consisting of a suite of libraries and programs for handling video, audio, and other multimedia files and streams. At its core is the command-line ffmpeg tool itself, designed for processing of video and audio files. It is widely used for format transcoding, basic editing, video scaling, video post-production effects and standards compliance.

Advanced Audio Coding (AAC) is an audio coding standard for lossy digital audio compression. Designed to be the successor of the MP3 format, AAC generally achieves higher sound quality than MP3 encoders at the same bit rate.

On2 TrueMotion VP3 is a (royalty-free) lossy video compression format and video codec. It is an incarnation of the TrueMotion video codec, a series of video codecs developed by On2 Technologies.

On2 TrueMotion VP6 is a proprietary lossy video compression format and video codec. It is an incarnation of the TrueMotion video codec, a series of video codecs developed by On2 Technologies. This codec is commonly used by Adobe Flash, Flash Video, and JavaFX media files.

<span class="mw-page-title-main">On2 Technologies</span> American video technology company

On2 Technologies, formerly known as The Duck Corporation, was a small publicly traded company, founded in New York City in 1992 and headquartered in Clifton Park, New York, that designed video codec technology. It created a series of video codecs called TrueMotion.

<span class="mw-page-title-main">High-Efficiency Advanced Audio Coding</span> Audio codec

High-Efficiency Advanced Audio Coding (HE-AAC) is an audio coding format for lossy data compression of digital audio defined as an MPEG-4 Audio profile in ISO/IEC 14496–3. It is an extension of Low Complexity AAC (AAC-LC) optimized for low-bitrate applications such as streaming audio. The usage profile HE-AAC v1 uses spectral band replication (SBR) to enhance the modified discrete cosine transform (MDCT) compression efficiency in the frequency domain. The usage profile HE-AAC v2 couples SBR with Parametric Stereo (PS) to further enhance the compression efficiency of stereo signals.

Adobe Flash Player is computer software for viewing multimedia content, executing rich Internet applications, and streaming audio and video content created on the Adobe Flash platform. It can run from a web browser as a browser plug-in or independently on supported devices. Originally created by FutureWave under the name FutureSplash Player, it was renamed to Macromedia Flash Player after Macromedia acquired FutureWave in 1996. It was then developed and distributed by Adobe Systems as Flash Player after Adobe acquired Macromedia in 2005. It is currently developed and distributed by Zhongcheng for users in China, and by Harman International for enterprise users outside of China, in collaboration with Adobe.

<span class="mw-page-title-main">Adobe Flash Lite</span> Lightweight version of Adobe Flash Player

Adobe Flash Lite was a lightweight version of Adobe Flash Player, a software application published by Adobe Systems for viewing Flash content. Flash Lite operates on devices that Flash Player cannot, such as mobile phones and other portable electronic devices like Wii, Chumby and Iriver.

<span class="mw-page-title-main">Combined Community Codec Pack</span>

The Combined Community Codec Pack, more commonly referred to by its acronym CCCP, is a collection of codecs packed for Microsoft Windows, designed originally for the playback of anime fansubs. The CCCP was developed and maintained by members of various fansubbing groups.

Flash Video is a container file format used to deliver digital video content over the Internet using Adobe Flash Player version 6 and newer. Flash Video content may also be embedded within SWF files. There are two different Flash Video file formats: FLV and F4V. The audio and video data within FLV files are encoded in the same way as SWF files. The F4V file format is based on the ISO base media file format, starting with Flash Player 9 update 3. Both formats are supported in Adobe Flash Player and developed by Adobe Systems. FLV was originally developed by Macromedia. In the early 2000s, Flash Video was the de facto standard for web-based streaming video. Users include Hulu, VEVO, Yahoo! Video, metacafe, Reuters.com, and many other news providers.

<span class="mw-page-title-main">Gnash (software)</span> Media player for playing SWF files

Gnash is a media player for playing SWF files. Gnash is available both as a standalone player for desktop computers and embedded devices, as well as a plugin for the browsers still supporting NPAPI. It is part of the GNU Project and is a free and open-source alternative to Adobe Flash Player. It was developed from the gameswf project.

Adobe Media Server (AMS) is a proprietary data and media server from Adobe Systems. This server works with the Flash Player and HTML5 runtime to create media driven, multiuser RIAs. The server uses ActionScript 1, an ECMAScript based scripting language, for server-side logic. Prior to version 2, it was known as Flash Communication Server. Prior to version 5, it was known as Flash Media Server. In February 2019, Adobe Systems Incorporated granted Veriskope Inc rights to further develop, resell, and extend distribution of the software product.

<span class="mw-page-title-main">VP8</span> Open and royalty-free video coding format released by Google in 2010

VP8 is an open and royalty-free video compression format released by On2 Technologies in 2008.

Sorenson Media was an American software company specializing in video encoding technology. Established in December 1995 as Sorenson Vision, the company developed technology which was licensed and ultimately acquired from Utah State University. The company first announced its codec at a developer’s preview at MacWorld Expo in January 1997.

References

  1. Nellymoser, Inc. (2002-03-04) "Macromedia Selects Nellymoser's Asao Compression Technology for FlashMX". Archived from the original on July 24, 2003. Retrieved 2017-04-18.{{cite web}}: CS1 maint: bot: original URL status unknown (link), Retrieved on 2009-08-12
  2. Adobe Inc. (2008) Flash CS3 - Legal Notices, Retrieved on 2009-08-11
  3. AskMeFlash.com (2009-05-10) Speex vs Nellymoser, Retrieved on 2009-08-12
  4. MultimediaWiki Nelly Moser, Retrieved on 2009-08-11
  5. 1 2 Mark Lynch (2008-07-23) Extracting from sound from Flash (aka NellyMoser), Retrieved on 2009-08-12
  6. (2002-12-27) NellyMoser Voice Codec, Retrieved on 2009-08-12
  7. Marco Casario (2005-04-14) FLV created with FCS and nellymoser audio codec, Retrieved on 2009-08-13
  8. FlashComGuru Forum (2006) Convert on2 to mp3 / flv to mp3? Archived August 23, 2009, at the Wayback Machine , Retrieved on 2009-08-12
  9. LiSoG (2006-10-06) Open Source Tender: Implementation of an Audio Codec Compatible with Nellymoser Asao Codec (PDF) Archived 2006-10-13 at the Wayback Machine , Retrieved on 2009-08-12
  10. Nellymoser Codec - How many people have run into the same problem? Archived 2009-09-04 at the Wayback Machine , Retrieved on 2009-08-13
  11. Gnash Project Wiki Nellymoser Archived August 18, 2009, at the Wayback Machine , Retrieved on 2009-08-12
  12. FlashComGuru (2006-07-31) Nellymoser Link List, Retrieved on 2009-08-12
  13. Andrew Paul Simmons (2007-05-22) Recording Audio with Flash Player to MP3, WAV, AVI, etc. Archived August 13, 2009, at the Wayback Machine , Retrieved on 2009-08-12
  14. FlashComGuru (2007) Convert on2 to mp3 / flv to mp3? Archived October 24, 2007, at the Wayback Machine , Retrieved on 2009-08-12
  15. Steve Wolkoff (2006-03-16) How to export FLV audio Archived 2009-08-18 at the Wayback Machine , Retrieved on 2009-08-13
  16. Burak KALAYCI (2006-03-08) Extracting FLV Audio (2) Archived 2009-10-01 at the Wayback Machine , ASVGuy SWFBlog, Retrieved on 2009-08-13
  17. FlashComGuru (2006-10-03) Adobe comments on FLV to MP3 conversion tool, Retrieved on 2009-08-12
  18. Google Code nelly2pcm - Project Taken Down Archived June 9, 2010, at the Wayback Machine , Retrieved on 2009-08-12
  19. Audio/video stream recording forums (2008) Splitting Nellymoser FLV (extracting raw Nellymoser stream from FLV file), Retrieved on 2009-08-13
  20. Moxie Marlinspike (2007-07-03) nellynomore [ permanent dead link ], Retrieved on 2009-08-13
  21. FlashComGuru Forum (2006) Convert on2 to mp3 / flv to mp3? Archived July 11, 2011, at the Wayback Machine , Page 10, Retrieved on 2009-08-13
  22. (2007-08-11) FFmpeg-devel - PATCH - NellyMoser audio decoder
  23. NellyMoser decoding support in ffmpeg! Archived August 4, 2009, at the Wayback Machine , Retrieved on 2009-08-12
  24. (2007-10-31) Lair Of The Multimedia Guru - FFmpeg weekly news #2 - October 2007, Retrieved on 2009-08-12
  25. (2007-10-15) FFmpeg-devel - PATCH - NellyMoser audio decoder v2
  26. FFmpeg (2008-12-03). "FFmpeg News". Archived from the original on March 18, 2009. Retrieved 2009-08-12.
  27. FFmpeg. "FFmpeg Supported Audio Codecs" . Retrieved 2009-08-12.