List of codecs

Last updated

The following is a list of compression formats and related codecs.

Contents

Audio compression formats

Non-compression

Lossless compression

Lossy compression

General/Speech hybrid

Neural audio codecs

General

AES3
  • SMPTE 302M
    • FFmpeg (decoder only)
  • Dolby E
    • FFmpeg (decoder only)
Bluetooth
Digital radio

Voice

(low bit rate, optimized for speech)

Microsoft DirectPlay

Those codecs are used by many PC games which use voice chats via Microsoft DirectPlay API.

  • Voxware MetaVoice
    • Windows Media Player (voxmvdec.ax)
  • Truespeech
    • Windows Media Player (tssoft32.acm)
    • FFmpeg (decoder only)
  • MS GSM
    • Windows Media Player (msgsm32.acm)
    • libgsm
    • FFmpeg (decoder only)
  • MS-ADPCM
    • Windows Media Player (msadp32.acm)
    • FFmpeg
Digital Voice Recorder
  • International Voice Association (IVA) standards:
    • Digital Speech Standard / Standard Play (DSS-SP)
      • FFmpeg (decoding only)
    • Digital Speech Standard / Quality Play (DSS-QP)
  • Sony LPEC
  • Truespeech Triple Rate CODER (TRC) [21]   used in some pocket recorders
  • Micronas  [ de ] Intermetall MI-SC4 - used by voice recorders such as RadioShack Digital Recorder [22] and I-O DATA  [ ja ] HyperHyde [23]
    • FFmpeg (decoder only)
Mobile phone
Generation 2
Generation 3/4
  • 3rd Generation Partnership Project (3GPP)
    • Adaptive Multi-Rate (AMR)
      • AMR-NB
        • 3GPP TS 26.073  AMR speech Codec (C-source code)  reference implementation [24]
        • opencore-amr (one may compile ffmpeg with—enable-libopencore-amrnb to incorporate the OpenCORE lib)
        • FFmpeg (by default decoder only, but see above the compiling options to incorporate the OpenCORE lib)
      • AMR-WB
        • 3GPP TS 26.173  AMR-WB speech Codec (C-source code)  reference implementation [9]
        • opencore-amr (decoder), from OpenCORE (one may compile ffmpeg with—enable-libopencore-amrwb to incorporate the OpenCORE lib)
        • vo-amrwbenc (encoder), from VisualOn, included in Android (one may compile ffmpeg with—enable-libvo-amrwbenc to incorporate the VisualOn lib)
        • FFmpeg (by default decoder only, but see above the compiling options).
      • AMR-WB+
        • 3GPP TS 26.273  AMR-WB+ speech Codec (C-source code)  reference implementation [25]
      • Enhanced Voice Services (EVS)
        • 3GPP TS.26.443 – Codec for Enhanced Voice Services (EVS) – ANSI C code (floating-point) [26]
  • 3rd Generation Partnership Project 2 (3GPP2)
Professional mobile radio
  • APCO
    • Project 25 Phase 2 Enhanced Full-Rate (AMBE+2 4400bit/s with 2800bit/s FEC)
    • Project 25 Phase 2 Half-Rate (AMBE+2 2450bit/s with 1150bit/s FEC)  also used in NXDN and DMR
      • mbelib (decoder only)
    • Project 25 Phase 1 Full Rate (IMBE 7200bit/s)
      • mbelib (decoder only)
  • European Telecommunications Standards Institute (ETSI)
    • ETS 300 395-2 (TETRA ACELP 4.6kbit/s)
  • TETRAPOL
    • RPCELP 6 kbit/s
  • D-STAR Digital Voice (AMBE 2400bit/s with 1200bit/s FEC)
    • mbelib (decoder only)
  • Professional Digital Trunking System Industry Association (PDT Alliance) standards:
    • NVOC  used in China
  • Spirit DSP RALCWI
  • DSPINI
    • SPR Robust
    • TWELP Robust
  • Codec2
    • libcodec2
  • RL-CELP (used in Japanese railways [27] [28] )
Military

Video games

  • Bink Audio, Smacker Audio
    • FFmpeg (decoder only)
  • Actimagine (Nintendo European Research & Development) FastAudio [30]
    • MobiclipDecoder (decoder only)
    • FFmpeg (decoder only)
  • Nintendo GCADPCM [31] (a.k.a. DSP ADPCM or THP ADPCM) - used in GameCube, Wii and Nintendo 3DS.
    • vgmstream (decoder only)
    • VGAudio
    • FFmpeg (decoder only)
  • Sony VAG [31] (a.k.a. Sony PSX ADPCM)
    • vgmstream (decoder only)
    • FFmpeg (decoder only)
  • Sony HEVAG [31] - used in PS Vita. [32]
    • vgmstream (decoder only)
  • Sony ATRAC9 [31] - used in PS4 and PS Vita.
    • VGAudio (decoder only)
    • FFmpeg (decoder only)
  • Microsoft XMA [31] - WMA variants for Xbox 360 hardware decoding. [33]
    • FFmpeg (decoder only)
  • Xbox ADPCM
    • vgmstream (decoder only)
  • CRI ADX ADPCM
    • vgmstream (decoder only)
    • VGAudio
    • FFmpeg
  • CRI HCA/HCA-MX - used in CRI ADX2 middleware. [34]
    • vgmstream (decoder only)
    • VGAudio
    • FFmpeg (decoder only)
    • libcgss
    • HCADecoder (decoder only)
  • FMOD FADPCM [35]
    • vgmstream (decoder only)

Text compression formats

Video compression formats

Non-compression

Analog signals

Lossless video compression

Lossless game codecs

  • DXA
    • ScummVM Tools (encoder only)
    • FFmpeg (decoder only)

Lossy compression

General

Scalable

VP8, [61] VP9, [61] AV1, [61] and H.266/VVC support scalable modes by default.

Intra-frame-only

  • Motion JPEG
    • FFmpeg
    • Morgan Multimedia M-JPEG [62]
    • Pegasus PICVideo M-JPEG
    • MainConcept M-JPEG
  • ISO/IEC standard
    • Motion JPEG 2000 (ISO/IEC 15444-3, ITU-T T.802)
      • libopenjpeg
      • FFmpeg
      • Morgan Multimedia M-JPEG2000 [63]
      • Morgan Multimedia dcpPlayer (decoder only) [64]
    • JPEG XS (ISO/IEC 21122) Lightweight Low latency video codec
      • intoPIX fastTICO-XS [65]
    • DV (IEC 61834)
      • FFmpeg
    • MPEG-4 SStP (ISO/IEC 14496-2)
    • Motion JPEG XR (ISO/IEC 29199-3, ITU-T T.833)
    • Animated JPEG XL (ISO/IEC 18181)
  • Apple ProRes 422/4444
    • FFmpeg
  • Apple Intermediate Codec
    • FFmpeg (decoder only)
  • Apple Pixlet
    • FFmpeg (decoder only)
  • AVC-Intra
    • x264 (encoder only)
    • FFmpeg (decoder only)
  • AVC-Ultra   a subset of MPEG-4 AVC Hi444PP profile
  • XAVC-I
  • CineForm HD
    • CineForm-SDK   developed by GoPro (open source)
    • FFmpeg
  • SMPTE standard
    • VC-2 SMPTE standard (a.k.a. Dirac Pro. SMPTE ST 2042)
      • Schrödinger
      • dirac-research
      • VC-2 Reference Encoder and Decoder   developed by BBC (open source)
      • FFmpeg (the encoder only supports VC-2 HQ profile)
    • VC-3 SMPTE standard (SMPTE ST 2019)
    • VC-5 SMPTE standard (SMPTE ST 2073; a superset of CineForm HD)
  • Grass Valley HQ/HQA/HQX
    • Grass Valley Codec Option
    • FFmpeg (decoder only)
  • NewTek NT25
  • NewTek SpeedHQ - used in Network Device Interface (NDI) protocol
    • NewTek Codec [68]
    • FFmpeg

Stereoscopic 3D

Security and surveillance cameras

  • Guobiao standards (GB/T)
    • AVS-S-P2 (suspended [69] )
    • SVAC (GB/T 25724-2010)
  • Infinity CCTV Codec (IMM4/IMM5/IMM6)
    • FFmpeg [70] [71] (IMM4 and IMM5 decoder only)
  • CDXL codec
    • FFmpeg (decoder only)
  • Cinepak [72] (a.k.a. Apple Compact Video)
    • FFmpeg
  • Photo CD codec
    • FFmpeg (decoder only)
  • MotionPixels - used in MovieCD
    • FFmpeg (decoder only)
  • CD+G (CD+Graphics) codec
    • FFmpeg (decoder only)
    • VLC (decoder only)
  • CD+EG (CD+Extended Graphics) codec

Network video codecs

Bayer video codecs

  • CinemaDNG (created by Adobe; used in Blackmagic cameras)
  • Redcode RAW (used in RED cameras)  a modified version of JPEG 2000 [75]
    • libredcode
  • ArriRaw (used in Arri cameras)
  • Cineform RAW (used in Silicon Imaging cameras)
    • CineForm-SDK
  • Blackmagic RAW (used in Blackmagic cameras)
    • Blackmagic RAW SDK
  • Cintel RAW (used in Cintel Scanner [76] )
    • FFmpeg (decoder only)
  • Apple ProRes RAW
  • intoPIX TICO RAW [77]
    • intoPIX fastTICO-RAW SDK & TICO-RAW FPGA/ASIC libraries [78]
  • Canon CRX - used in Canon Cinema Raw Light movie
    • Canon RAW Plugin for Avid Media Access
    • LibRaw (decoder only; open source)

Video games

Real-time

  • RivaTuner video codec (RTV1/RTV2)
    • FFmpeg (RTV1 decoder only)
  • Hap/Hap Alpha/Hap Q
    • VIDVOX hap codec
    • FFmpeg
  • DXV Codec
    • Resolume DXV Codec
    • FFmpeg
  • NotchLC
    • FFmpeg (decoder only)
  • VESA Display Stream Compression (DSC)
  • VESA Display Compression-M (VDC-M)

See also

Related Research Articles

<span class="mw-page-title-main">JPEG 2000</span> Image compression standard and coding system

JPEG 2000 (JP2) is an image compression standard and coding system. It was developed from 1997 to 2000 by a Joint Photographic Experts Group committee chaired by Touradj Ebrahimi, with the intention of superseding their original JPEG standard, which is based on a discrete cosine transform (DCT), with a newly designed, wavelet-based method. The standardized filename extension is .jp2 for ISO/IEC 15444-1 conforming files and .jpx for the extended part-2 specifications, published as ISO/IEC 15444-2. The registered MIME types are defined in RFC 3745. For ISO/IEC 15444-1 it is image/jp2.

<span class="mw-page-title-main">FFmpeg</span> Multimedia framework

FFmpeg is a free and open-source software project consisting of a suite of libraries and programs for handling video, audio, and other multimedia files and streams. At its core is the command-line ffmpeg tool itself, designed for processing of video and audio files. It is widely used for format transcoding, basic editing, video scaling, video post-production effects and standards compliance.

Advanced Audio Coding (AAC) is an audio coding standard for lossy digital audio compression. It was designed to be the successor of the MP3 format and generally achieves higher sound quality than MP3 at the same bit rate.

MPEG-4 Part 3 or MPEG-4 Audio is the third part of the ISO/IEC MPEG-4 international standard developed by Moving Picture Experts Group. It specifies audio coding methods. The first version of ISO/IEC 14496-3 was published in 1999.

3GP is a multimedia container format defined by the Third Generation Partnership Project (3GPP) for 3G UMTS multimedia services. It is used on 3G mobile phones but can also be played on some 2G and 4G phones.

<span class="mw-page-title-main">High-Efficiency Advanced Audio Coding</span> Audio codec

High-Efficiency Advanced Audio Coding (HE-AAC) is an audio coding format for lossy data compression of digital audio defined as an MPEG-4 Audio profile in ISO/IEC 14496–3. It is an extension of Low Complexity AAC (AAC-LC) optimized for low-bitrate applications such as streaming audio. The usage profile HE-AAC v1 uses spectral band replication (SBR) to enhance the modified discrete cosine transform (MDCT) compression efficiency in the frequency domain. The usage profile HE-AAC v2 couples SBR with Parametric Stereo (PS) to further enhance the compression efficiency of stereo signals.

MPEG-4 Part 2, MPEG-4 Visual is a video compression format developed by the Moving Picture Experts Group (MPEG). It belongs to the MPEG-4 ISO/IEC standards. It uses block-wise motion compensation and a discrete cosine transform (DCT), similar to previous standards such as MPEG-1 Part 2 and H.262/MPEG-2 Part 2.

These tables compare features of multimedia container formats, most often used for storing or streaming digital video or digital audio content. To see which multimedia players support which container format, look at comparison of media players.

FAAC is a software project which includes the AAC encoder FAAC and decoder FAAD2. It supports MPEG-2 AAC as well as MPEG-4 AAC. It supports several MPEG-4 Audio object types, file formats, multichannel and gapless encoding/decoding and MP4 metadata tags. The encoder and decoder is compatible with standard-compliant audio applications using one or more of these object types and facilities. It also supports Digital Radio Mondiale.

libavcodec is a free and open-source library of codecs for encoding and decoding video and audio data.

The following tables compare general and technical information for a variety of audio coding formats.

MPEG-4 Audio Lossless Coding, also known as MPEG-4 ALS, is an extension to the MPEG-4 Part 3 audio standard to allow lossless audio compression. The extension was finalized in December 2005 and published as ISO/IEC 14496-3:2005/Amd 2:2006 in 2006. The latest description of MPEG-4 ALS was published as subpart 11 of the MPEG-4 Audio standard in December 2019.

<span class="mw-page-title-main">MPEG-4 SLS</span> Extension to the MPEG-4 Audio standard

MPEG-4 SLS, or MPEG-4 Scalable to Lossless as per ISO/IEC 14496-3:2005/Amd 3:2006 (Scalable Lossless Coding), is an extension to the MPEG-4 Part 3 (MPEG-4 Audio) standard to allow lossless audio compression scalable to lossy MPEG-4 General Audio coding methods (e.g., variations of AAC). It was developed jointly by the Institute for Infocomm Research (I2R) and Fraunhofer, which commercializes its implementation of a limited subset of the standard under the name of HD-AAC. Standardization of the HD-AAC profile for MPEG-4 Audio is under development (as of September 2009).

<span class="mw-page-title-main">MP4 file format</span> Digital format for storing video and audio

MPEG-4 Part 14, or MP4, is a digital multimedia container format most commonly used to store video and audio, but it can also be used to store other data such as subtitles and still images. Like most modern container formats, it allows streaming over the Internet. The only filename extension for MPEG-4 Part 14 files as defined by the specification is .mp4. MPEG-4 Part 14 is a standard specified as a part of MPEG-4.

MPEG Surround, also known as Spatial Audio Coding (SAC) is a lossy compression format for surround sound that provides a method for extending mono or stereo audio services to multi-channel audio in a backwards compatible fashion. The total bit rates used for the core and the MPEG Surround data are typically only slightly higher than the bit rates used for coding of the core. MPEG Surround adds a side-information stream to the core bit stream, containing spatial image data. Legacy stereo playback systems will ignore this side-information while players supporting MPEG Surround decoding will output the reconstructed multi-channel audio.

G.719 is an ITU-T standard audio coding format providing high quality, moderate bit rate wideband audio coding at low computational load. It was produced through a collaboration between Polycom and Ericsson.

The ISO base media file format (ISOBMFF) is a container file format that defines a general structure for files that contain time-based multimedia data such as video and audio. It is standardized in ISO/IEC 14496-12, a.k.a. MPEG-4 Part 12, and was formerly also published as ISO/IEC 15444-12, a.k.a. JPEG 2000 Part 12.

Unified Speech and Audio Coding (USAC) is an audio compression format and codec for both music and speech or any mix of speech and audio using very low bit rates between 12 and 64 kbit/s. It was developed by Moving Picture Experts Group (MPEG) and was published as an international standard ISO/IEC 23003-3 and also as an MPEG-4 Audio Object Type in ISO/IEC 14496-3:2009/Amd 3 in 2012.

JPEG XS is an interoperable, visually lossless, low-latency and lightweight image and video coding system used in professional applications. Applications of the standard include streaming high quality content for virtual reality, drones, autonomous vehicles using cameras, gaming, and broadcasting. It was the first ISO codec ever designed for this specific purpose. JPEG XS, built on core technology from both intoPIX and Fraunhofer IIS, is formally standardized as ISO/IEC 21122 by the Joint Photographic Experts Group with the first edition published in 2019. Although not official, the XS acronym was chosen to highlight the eXtra Small and eXtra Speed characteristics of the codec. Today, the JPEG committee is still actively working on further improvements to XS, with the second edition scheduled for publication and initial efforts being launched towards a third edition.

References

  1. FLAC (Free Lossless Audio Codec), Version 1.1.2 Library of Congress
  2. "About lossless audio in Apple Music". 25 October 2021.
  3. "BFDLAC: A Fast lossless Audio Compression Algorithm For Drum Sounds" (PDF).
  4. "Lossless Audio Homepage". www.lossless-audio.com.
  5. Shorten Lossless Audio Compression Format (SHN), Version 3.5.1 Library of Congress
  6. "RK Audio - Hydrogenaudio Knowledgebase". wiki.hydrogenaud.io.
  7. IPMR Speech Codec - draft-spiritdsp-ipmr-01.txt IETF
  8. TeamSpirit Voice&Video Engine PC. Spirit DSP
  9. 1 2 3 3GPP (2008-12-11) 3GPP TS 26.173 - AMR-WB speech Codec; version 8.0.0 Release 8, retrieved 2009-09-09
  10. Release of sbc-1.1, BlueZ Project, April 30, 2013
  11. PulseAudio 15 Released With Bluetooth Improvements, Better Hardware Support. Phoronix. July 28, 2021
  12. PipeWire: Bluetooth support status update. Collabora. April 29, 2022
  13. 1 2 Integration of the aptX and aptX-HD codecs for A2DP source, Android Open Source Project, January 4, 2017
  14. The contribution of LDAC encoder, Android Open Source Project, January 10, 2017
  15. "What is LHDC". hwa-audio. Retrieved 2019-04-30.
  16. "What is LLAC™?". LHDC org.[ dead link ]
  17. Speex Audio Codec, Version 1.2 Library of Congress
  18. 1 2 3 4 5 6 Finding voice codecs for free software. Linux.com. October 14, 2005
  19. SILK Speech Codec - draft-vos-silk-02 IETF
  20. Constrained-Energy Lapped Transform (CELT) Codec - draft-valin-celt-codec-02 IETF
  21. "DSP Group Unveils Total Telephony Solutions(TM) For Digital Cordless Telephony Applications". Archived from the original on August 23, 2016. Retrieved June 24, 2015.
  22. RadioShack Digital Recorder OWNER'S MANUAL p.38. RadioShack. 2002.
  23. HyperHyde Operation Manual. p.40. I-O DATA. 2000.
  24. 3GPP (2008-12-11) 3GPP TS 26.073 - AMR speech Codec; version 8.0.0 Release 8, retrieved 2009-09-08.
  25. 3GPP (2008-12-18) 3GPP TS 26.273 - AMR-WB+ speech Codec; version 8.0.0 Release 8, retrieved 2009-09-09
  26. 3GPP TS 26.443. Codec for Enhanced Voice Services (EVS); ANSI C code (floating-point).
  27. INFORMATION COLLECTION SURVEY FOR THE MEGA MANILA SUBWAY PROJECT IN THE REPUBLIC OF THE PHILIPPINES Japan International Cooperation Agency September, 2015
  28. 東北上越新幹線デジタル列車 無線システムの開発 (in Japanese) East Japan Railway Company 2003
  29. Obranovich, Charles R.; Golusky, John M.; Preuss, Robert D.; Fabbri, Darren R.; Cruthirds, Daniel R.; Aylward, Erin M.; Freebersyser, James A.; Kolek, Stephen R. (2010). "300 BPS noise robust vocoder". 2010 - Milcom 2010 Military Communications Conference. pp. 298–303. doi:10.1109/MILCOM.2010.5680311. ISBN   978-1-4244-8178-1. S2CID   8991597.
  30. Actimagine allège le multimédia sur les terminaux portables (in French), IT Industrie & Technologies, June 25, 2004
  31. 1 2 3 4 5 AudioCompressionFormat, Unity Technologies
  32. Audio Clip, Unity Technologies
  33. Differences Between Windows and Xbox 360, Microsoft
  34. 【ひらブラ vol.37】音数を諦めず/音質を妥協せず/負荷を極小にする方法(iOS&Android) (in Japanese), Kadokawa Dwango, September 26, 2014
  35. FMOD Studio 1.06 and FMOD at GDC expo program announced, Gamasutra, February 17, 2015
  36. "Lossless". x265.readthedocs.io.
  37. "HEVC Decoding". x265.
  38. "FFmpeg Now Supports HEVC/H.265 Decoding". phoronix.
  39. "Encode/H.265". FFmpeg.
  40. Niedermayer, Michael; Rice, Dave; Martinez, Jérôme (August 2021). "rfc9043 - FFV1 Video Coding Format Version 0, 1, and 3". datatracker.ietf.org.
  41. "Lossless Codec Libraries". multimedia.cx.
  42. "FFmpeg: libavcodec/flashsv.c File Reference". ffmpeg.org.
  43. "FRAPS show fps, record video game movies, screen capture software". www.fraps.com.
  44. "Lagarith Lossless Video Codec". lags.leetcode.net.
  45. "LOCO - MultimediaWiki". wiki.multimedia.cx.
  46. "MagicYUV – Lossless video codec".
  47. "ScreenPressor by Infognition - lossless video codec for screen capture". infognition.com.
  48. "Downloads". TechSmith.
  49. "#534 (Ut Video Support) – FFmpeg". ffmpeg.org.
  50. "Ut Video Codec Suite - a new lossless video codec for Windows! [Archive] - Doom9's Forum". doom9.org.
  51. "VBLE - MultimediaWiki". wiki.multimedia.cx.
  52. "VMware Video". multimedia.cx.
  53. "The WebM Project - VP8 Encode Parameter Guide". webmproject.org.
  54. Medoff, Norman; Fink, Edward J. (September 10, 2012). Portable Video: ENG & EFP. CRC Press. p. 221. ISBN   9781136047701.
  55. Samuelsson, J. and P. Hermansson (July 2, 2018). "The xvc video codec". datatracker.ietf.org.
  56. Fuldseth, Arild; Bjontegaard, Gisle; Midtskogen, Steinar; Davies, Thomas; Zanaty, Mo (October 31, 2016). "Thor Video Codec". tools.ietf.org.
  57. "Live demonstration". Forbidden.
  58. Indeo Video Codec, Version 3 Library of Congress
  59. Indeo Video Codec, Version 5 Library of Congress
  60. Sorenson Video Codec, Version 3 Library of Congress
  61. 1 2 3 Scalable Video Coding (SVC) Extension for WebRTC - 4. Operational model, World Wide Web Consortium, September 26, 2020
  62. "M-JPEG Codec". Montpellier, France: Morgan Multimedia. Retrieved April 28, 2018.
  63. "M-JPEG2000 Codec". Montpellier, France: Morgan Multimedia. Retrieved April 28, 2018.
  64. "dcpPlayer". Montpellier, France: Morgan Multimedia. Retrieved April 28, 2018.
  65. "FastTICO-XS Codec". Mont-Saint-Guibert, Belgium: intoPIX.
  66. FFmpeg-cvslog - mpeg4video: Add support for MPEG-4 Simple Studio Profile., FFmpeg Project, April 2, 2018
  67. FFmpeg Adds Support For Animated JPEG-XL, Phoronix, June 8, 2023
  68. NewTek Codec Notes NewTek
  69. Achievement, Audio Video Coding Standard Workgroup of China
  70. FFmpeg-cvslog - avcodec: add IMM4 decoder, FFmpeg Project, August 21, 2018
  71. FFmpeg-cvslog - avcodec: add IMM5 decoder, FFmpeg Project, August 29, 2019
  72. Cinepak Library of Congress
  73. SunVideo Plus for PCI User's Guide - Audio Video Conferencing. Oracle
  74. vic: Change History. Lawrence Berkeley National Laboratory
  75. libredcode
  76. Cintel Scanner p.35. Blackmagic Design. May, 2020.
  77. intoPIX Tico Raw is a format with a huge potential
  78. intoPIX Tico Raw
  79. 独自コーデックを搭載したニンテンドーDS版Sofdec (in Japanese) CRI Middleware, May 11, 2006
  80. CRI・ミドルウェア、ゲーム開発者向けブログ「CRIチャンネル」を開設 (in Japanese) Impress Watch Corporation, April 19, 2007