FFmpeg

Last updated
FFmpeg
Original author(s) Fabrice Bellard
Bobby Bingham (libavfilter) [1]
Developer(s) FFmpeg team
Initial releaseDecember 20, 2000;23 years ago (2000-12-20) [2]
Stable release
6.1.1 [3]   OOjs UI icon edit-ltr-progressive.svg / 31 December 2023
Repository git.ffmpeg.org/ffmpeg.git
Written in C and Assembly [4]
Operating system Various, including Windows, macOS, and Linux (executable programs are only available from third parties, as the project only distributes source code) [5] [6]
Platform x86, ARM, PowerPC, MIPS, RISC-V, DEC Alpha, Blackfin, AVR32, SH-4, and SPARC; may be compiled for other desktop computers
Type Multimedia framework
License LGPL-2.1-or-later, GPL-2.0-or-later
Unredistributable if compiled with any software with a license incompatible with the GPL [7]
Website ffmpeg.org

FFmpeg is a free and open-source software project consisting of a suite of libraries and programs for handling video, audio, and other multimedia files and streams. At its core is the command-line ffmpeg tool itself, designed for processing of video and audio files. It is widely used for format transcoding, basic editing (trimming and concatenation), video scaling, video post-production effects and standards compliance (SMPTE, ITU).

Contents

FFmpeg also includes other tools: ffplay, a simple media player and ffprobe, a command-line tool to display media information. Among included libraries are libavcodec, an audio/video codec library used by many commercial and free software products, libavformat (Lavf), [8] an audio/video container mux and demux library, and libavfilter, a library for enhancing and editing filters through a Gstreamer-like filtergraph. [9]

FFmpeg is part of the workflow of many other software projects, and its libraries are a core part of software media players such as VLC, and has been included in core processing for YouTube and Bilibili. [10] Encoders and decoders for many audio and video file formats are included, making it highly useful for the transcoding of common and uncommon media files.

FFmpeg is published under the LGPL-2.1-or-later or GPL-2.0-or-later, depending on which options are enabled. [11]

History

The project was started by Fabrice Bellard [11] (using the pseudonym "Gérard Lantau") in 2000, and was led by Michael Niedermayer from 2004 until 2015. [12] Some FFmpeg developers were also part of the MPlayer project.

The name of the project is inspired by the MPEG video standards group, together with "FF" for "fast forward", so FFmpeg stands for "Fast Forward Moving Picture Experts Group". [13] The logo represents a zigzag scan pattern that shows how MPEG video codecs handle entropy encoding. [14]

On March 13, 2011, a group of FFmpeg developers decided to fork the project under the name Libav. [15] [16] [17] The event was related to an issue in project management, in which developers disagreed with the leadership of FFmpeg. [18] [19] [20]

On January 10, 2014, two Google employees announced that over 1000 bugs had been fixed in FFmpeg during the previous two years by means of fuzz testing. [21]

In January 2018, the ffserver command-line program – a long-time component of FFmpeg – was removed. [22] The developers had previously deprecated the program citing high maintenance efforts due to its use of internal application programming interfaces. [23]

The project publishes a new release every three months on average. While release versions are available from the website for download, FFmpeg developers recommend that users compile the software from source using the latest build from their source code Git version control system. [24]

Codec history

Two video coding formats with corresponding codecs and one container format have been created within the FFmpeg project so far. The two video codecs are the lossless FFV1, and the lossless and lossy Snow codec. Development of Snow has stalled, while its bit-stream format has not been finalized yet, making it experimental since 2011. The multimedia container format called NUT is no longer being actively developed, but still maintained. [25]

In summer 2010, FFmpeg developers Fiona Glaser, Ronald Bultje, and David Conrad, announced the ffvp8 decoder. Through testing, they determined that ffvp8 was faster than Google's own libvpx decoder. [26] [27] Starting with version 0.6, FFmpeg also supported WebM and VP8. [28]

In October 2013, a native VP9 [29] decoder and OpenHEVC, an open source High Efficiency Video Coding (HEVC) decoder, were added to FFmpeg. [30] In 2016 the native AAC encoder was considered stable, removing support for the two external AAC encoders from VisualOn and FAAC. FFmpeg 3.0 (nicknamed "Einstein") retained build support for the Fraunhofer FDK AAC encoder. [31] Since version 3.4 "Cantor" FFmpeg supported the FITS image format. [32] Since November 2018 in version 4.1 "al-Khwarizmi" AV1 can be muxed in MP4 and Matroska incl. WebM. [33] [34]

Components

Command line tools

Libraries

Supported hardware

CPUs

FFmpeg encompasses software implementations of video and audio compressing and decompressing algorithms. These can be compiled and run on diverse instruction sets.

Many widespread instruction sets are supported by FFmpeg, including x86 (IA-32 and x86-64), PPC (PowerPC), ARM, DEC Alpha, SPARC, and MIPS. [36]

Special purpose hardware

There are a variety of application-specific integrated circuits (ASICs) for audio/video compression and decompression. These ASICs can partially or completely offload the computation from the host CPU. Instead of a complete implementation of an algorithm, only the API is required to use such an ASIC. [37]

FirmASICpurposesupported by FFmpegDetails
AMD UVD decodingYes check.svgvia VDPAU API and VAAPI
VCE encodingYes check.svgvia VAAPI, considered experimental [38]
Amlogic Amlogic Video Engine decoding ?
BlackMagicDeckLinkencoding/decodingYes check.svgreal-time ingest and playout
Broadcom Crystal HD decodingYes check.svg
Qualcomm Hexagon encoding/decodingYes check.svghwaccel [39]
Intel Intel Clear Video decodingYes check.svg(libmfx, VAAPI)
Intel Quick Sync Video encoding/decodingYes check.svg(libmfx, VAAPI)
Nvidia PureVideo / NVDEC decodingYes check.svgvia the VDPAU API as of FFmpeg v1.2 (deprecated)
via CUVID API as of FFmpeg v3.1 [40]
NVENC encodingYes check.svgas of FFmpeg v2.6

The following APIs are also supported: DirectX Video Acceleration (DXVA2, Windows), Direct3D 11 (D3D11VA, Windows), Media Foundation (Windows), VideoToolbox (macOS), RockChip MPP, OpenCL, OpenMAX, MMAL (Raspberry Pi), MediaCodec (Android OS), V4L2 (Linux). Depending on the environment, these APIs may lead to specific ASICs, to GPGPU routines, or to SIMD CPU code. [41]

Supported codecs and formats

Image formats

FFmpeg supports many common and some uncommon image formats.

The PGMYUV image format is a homebrew variant of the binary (P5) PGM Netpbm format. FFmpeg also supports 16-bit depths of the PGM and PPM formats, and the binary (P7) PAM format with or without alpha channel, depth 8 bit or 16 bit for pix_fmtsmonob, gray, gray16be, rgb24, rgb48be, ya8, rgba, rgb64be.

Supported formats

In addition to FFV1 and Snow formats, which were created and developed from within FFmpeg, the project also supports the following formats:

GroupFormat typeFormat name
ISO/IEC/ITU-T Video MPEG-1 Part 2, H.261 (Px64), [42] H.262/MPEG-2 Part 2, H.263, [42] MPEG-4 Part 2, H.264/MPEG-4 AVC, HEVC/H.265 [30] (MPEG-H Part 2), MPEG-4 VCB (a.k.a. VP8), Motion JPEG, IEC DV video and CD+G
Audio MP1, MP2, MP3, AAC, HE-AAC, MPEG-4 ALS, G.711 μ-law, G.711 A-law, G.721 (a.k.a. G.726 32k), G.722, G.722.2 (a.k.a. AMR-WB), G.723 (a.k.a. G.726 24k and 40k), G.723.1, G.726, G.729, G.729D, IEC DV audio and Direct Stream Transfer
Subtitle MPEG-4 Timed Text (a.k.a. 3GPP Timed Text)
Image JPEG, Lossless JPEG, JPEG-LS, JPEG 2000, JPEG XL, [43] PNG, CCITT G3 and CCITT G4
Alliance for Open Media Video AV1 [44]
Image AVIF [45]
EIA Subtitle EIA-608
CEA Subtitle CEA-708
SMPTE VideoSMPTE 314M (a.k.a. DVCAM and DVCPRO), SMPTE 370M (a.k.a. DVCPRO HD), VC-1 (a.k.a. WMV3), VC-2 (a.k.a. Dirac Pro), VC-3 (a.k.a. AVID DNxHD)
Audio SMPTE 302M
Image DPX
ATSC/ETSI/DVB Audio Full Rate (GSM 06.10), AC-3 (Dolby Digital), Enhanced AC-3 (Dolby Digital Plus) and DTS Coherent Acoustics (a.k.a. DTS or DCA)
SubtitleDVB Subtitling (ETSI 300 743)
DVD Forum/Dolby Audio MLP / Dolby TrueHD
Subtitle DVD-Video subtitles
Xperi/DTS, Inc/QDesign Audio DTS Coherent Acoustics (a.k.a. DTS or DCA), DTS Extended Surround (a.k.a. DTS-ES), DTS 96/24, DTS-HD High Resolution Audio, DTS Express (a.k.a. DTS-HD LBR), DTS-HD Master Audio, QDesign Music Codec 1 and 2
Blu-ray Disc Association SubtitlePGS (Presentation Graphics Stream)
3GPP Audio AMR-NB, AMR-WB (a.k.a. G.722.2)
3GPP2 Audio QCELP-8 (a.k.a. SmartRate or IS-96C), QCELP-13 (a.k.a. PureVoice or IS-733) and Enhanced Variable Rate Codec (EVRC. a.k.a. IS-127)
World Wide Web Consortium Video Animated GIF [46]
Subtitle WebVTT
Image GIF, and SVG (via librsvg)
IETF Video FFV1
Audio iLBC (via libilbc), Opus and Comfort noise
International Voice AssociationAudio DSS-SP
SAC Video AVS video, AVS2 video [47] (via libdavs2), and AVS3 video (via libuavs3d)
Microsoft VideoMicrosoft RLE, Microsoft Video 1, Cinepak, Microsoft MPEG-4 v1, v2 and v3, Windows Media Video (WMV1, WMV2, WMV3/VC-1), WMV Screen and Mimic codec
Audio Windows Media Audio (WMA1, WMA2, WMA Pro and WMA Lossless), XMA (XMA1 and XMA2), [48] MSN Siren, MS-GSM and MS-ADPCM
Subtitle SAMI
Image Windows Bitmap, WMV Image (WMV9 Image and WMV9 Image v2), DirectDraw Surface, and MSP [49]
Interactive Multimedia Association AudioIMA ADPCM
Intel / Digital Video Interactive VideoRTV 2.1 (Indeo 2), Indeo 3, 4 and 5, [42] and Intel H.263
AudioDVI4 (a.k.a. IMA DVI ADPCM), Intel Music Coder, and Indeo Audio Coder
RealNetworks Video RealVideo Fractal Codec (a.k.a. Iterated Systems ClearVideo), 1, 2, 3 and 4
Audio RealAudio v1 – v10, and RealAudio Lossless [50]
Subtitle RealText
Apple / Spruce TechnologiesVideo Cinepak (Apple Compact Video), ProRes, Sorenson 3 Codec, QuickTime Animation (Apple Animation), QuickTime Graphics (Apple Graphics), Apple Video, Apple Intermediate Codec and Pixlet [51]
Audio ALAC
Image QuickDraw PICT
SubtitleSpruce subtitle (STL)
Adobe Flash Player (SWF)VideoScreen video, Screen video 2, Sorenson Spark and VP6
AudioAdobe SWF ADPCM and Nellymoser Asao
Adobe / Aldus Image TIFF, PSD, [51] and DNG
Xiph.Org Video Theora
Audio Speex, [52] Vorbis, Opus and FLAC
Subtitle Ogg Writ
Sony Audio Adaptive Transform Acoustic Coding (ATRAC1, ATRAC3, ATRAC3Plus, [53] and ATRAC9 [47] ) [42] and PSX ADPCM
NTT Audio TwinVQ
Google / On2 / GIPS VideoDuck TrueMotion 1, Duck TrueMotion 2, Duck TrueMotion 2.0 Real Time, VP3, VP4, [54] VP5, [42] VP6, [42] VP7, VP8, [55] VP9 [29] and animated WebP
Audio DK ADPCM Audio 3/4, On2 AVC and iLBC (via libilbc)
Image WebP [56]
Epic Games / RAD Game ToolsVideo Smacker video and Bink video
AudioBink audio
CRI Middleware Audio ADX ADPCM, and HCA
Nintendo / NERD Video Mobiclip video
AudioGCADPCM (a.k.a. ADPCM THP), FastAudio, and ADPCM IMA MOFLEX
Synaptics / DSP Group Audio Truespeech
Electronic Arts / Criterion Games / Black Box Games / Westwood Studios Video RenderWare TXD, [57] Madcow, CMV, TGV, TGQ, TQI, Midivid VQ (MVDV), MidiVid 3.0 (MV30), Midivid Archival (MVHA), and Vector Quantized Animation (VQA)
AudioElectronic Arts ADPCM variants
Netpbm Image PBM, PGM, PPM, PNM, PAM, PFM and PHM
MIT/X Consortium/The Open Group Image XBM, [50] XPM and xwd
HPE / SGI / Silicon Graphics VideoSilicon Graphics RLE 8-bit video, [46] Silicon Graphics MVC1/2 [46]
Image Silicon Graphics Image
Oracle/Sun Microsystems Image Sun Raster
IBM Video IBM UltiMotion
Avid Technology / Truevision VideoAvid 1:1x, Avid Meridien, [50] Avid DNxHD, Avid DNx444, [53] and DNxHR
Image Targa [46]
Autodesk / Alias Video Autodesk Animator Studio Codec and FLIC
ImageAlias PIX
Activision Blizzard / Activision / Infocom AudioADPCM Zork
Konami / Hudson Soft VideoHVQM4 Video
AudioKonami MTAF, and ADPCM IMA HVQM4
Grass Valley / Canopus VideoHQ, HQA, HQX and Lossless
Vizrt / NewTek VideoSpeedHQ
ImageVizrt Binary Image [45]
Academy Software Foundation / ILM Image OpenEXR [50]
Mozilla Corporation Video APNG [56]
Matrox VideoMatrox Uncompressed SD (M101) / HD (M102)
AMD/ATI VideoATI VCR1/VCR2
Asus VideoASUS V1/V2 codec
Commodore Video CDXL codec
Kodak Image Photo CD
Blackmagic Design / Cintel ImageCintel RAW
Houghton Mifflin Harcourt / The Learning Company / ZSoft CorporationImage PCX
Australian National University Image X-Face [46]
Bluetooth Special Interest Group Audio SBC, and mSBC
Qualcomm / CSR Audio QCELP, aptX, and aptX HD
Open Mobile Alliance / WAP ForumImage Wireless Bitmap

Muxers

Output formats (container formats and other ways of creating output streams) in FFmpeg are called "muxers". FFmpeg supports, among others, the following:

Pixel formats

TypeColor Packed Planar Palette
Without alphaWith alpha Without alphaWith alphaChroma-interleavedWith alpha
Monochrome Binary (1-bit monochrome)monoblack, monowhite—————
Grayscale 8/9/10/12/14/16bpp——16/32bpp——
RGB RGB 1:2:1 (4-bit color)4bpp—————
RGB 3:3:2 (8-bit color)8bpp—————
RGB 5:5:5 (High color)16bpp—————
RGB 5:6:5 (High color)16bpp—————
RGB/BGR24/30 [p 1] /48bpp32 [p 2] /64bpp———8bit->32bpp
GBR [p 3] ——8/9/10/12/14/16bpc8/10/12/16bpc——
RGB Float RGB32bpc16/32bpc————
GBR——32bpc32bpc——
YUV YVU 4:1:0——(9bpp (YVU9)) [p 4] ———
YUV 4:1:0——9bpp———
YUV 4:1:18bpc (UYYVYY)—8bpc—(8bpc (NV11))—
YVU 4:2:0——(8bpc (YV12)) [p 4] —8 (NV21)—
YUV 4:2:0——8 [p 5] /9/10/12/14/16bpc8/9/10/16bpc8 (NV12)/10 (P010)/12 (P012)/16bpc (P016)—
YVU 4:2:2——(8bpc (YV16)) [p 4] —(8bpc (NV61))—
YUV 4:2:28 (YUYV [p 6] and UYVY)/10 (Y210)/12bpc (Y212) [p 7] —8 [p 8] /9/10/12/14/16bpc8/9/10/12/16bpc8 (NV16)/10 (NV20 and P210)/16bpc (P216)—
YUV 4:4:0——8/10/12bpc———
YVU 4:4:4——(8bpc (YV24)) [p 4] —8bpc (NV42)—
YUV 4:4:48 (VUYX)/10 [p 9] /12bpc [p 10] 8 [p 11] / 16bpc (AYUV64) [p 12] 8 [p 13] /9/10/12/14/16bpc8/9/10/12/16bpc8 (NV24)/10 (P410)/ 16bpc (P416)—
XYZ XYZ 4:4:4 [p 14] 12bpc—————
Bayer BGGR/RGGB/GBRG/GRBG8/16bpp—————
  1. ↑ 10-bit color components with 2-bit padding (X2RGB10)
  2. ↑ RGBx (rgb0) and xBGR (0bgr) are also supported
  3. ↑ used in YUV-centric codecs such like H.264
  4. 1 2 3 4 YVU9, YV12, YV16, and YV24 are supported as rawvideo codec in FFmpeg.
  5. ↑ I420 a.k.a. YUV420P
  6. ↑ aka YUY2 in Windows
  7. ↑ UYVY 10bpc without a padding is supported as bitpacked codec in FFmpeg. UYVY 10bpc with 2-bits padding is supported as v210 codec in FFmpeg. 16bpc (Y216) is supported as targa_y216 codec in FFmpeg.
  8. ↑ I422 a.k.a. YUV422P
  9. ↑ XV30 a.k.a. XVYU2101010
  10. ↑ XV36
  11. ↑ VUYA a.k.a. AYUV
  12. ↑ 10bpc (Y410), 12bpc (Y412), and Y416 (16bpc) are not supported.
  13. ↑ I444 a.k.a. YUV444P
  14. ↑ used in JPEG2000

FFmpeg does not support IMC1-IMC4, AI44, CYMK, RGBE, Log RGB and other formats. It also does not yet support ARGB 1:5:5:5, 2:10:10:10, or other BMP bitfield formats that are not commonly used.

Supported protocols

Open standards

De facto standards

Supported filters

FFmpeg supports, among others, the following filters. [68]

Audio

Video

  • Transformations
    • Cropping (crop, cropdetect)
    • Fading (fade)
    • Scaling (scale)
    • Padding (pad)
    • Rotation (rotate)
    • Transposition (transpose)
    • Others:
      • Lens correction (lenscorrection)
      • OpenCV filtering (ocv)
      • Perspective correction (perspective)
  • Temporal editing
    • Framerate (fps, framerate)
    • Looping (loop)
    • Trimming (trim)
  • Deinterlacing (bwdif, idet, kerndeint, nnedi, yadif, w3fdif)
  • Inverse Telecine
  • Filtering
  • Denoising (atadenoise, bitplanenoise, dctdnoiz, owdenoise, removegrain)
  • Logo removal (delogo, removelogo)
  • Subtitles (ASS, subtitles)
  • Alpha channel editing (alphaextract, alphamerge)
  • Keying (chromakey, colorkey, lumakey)
  • Frame detection
    • Black frame detection (blackdetect, blackframe)
    • Thumbnail selection (thumbnail)
  • Frame Blending (blend, tblend, overlay)
  • Video stabilization (vidstabdetect, vidstabtransform)
  • Color and Level adjustments
    • Balance and levels (colorbalance, colorlevels)
    • Channel mixing (colorchannelmixer)
    • Color space (colorspace)
    • Parametric adjustments (curves, eq)
  • Histograms and visualization
  • Drawing
  • OCR
  • Quality measures
  • Lookup Tables
    • lut, lutrgb, lutyuv, lut2, lut3d, haldclut

Supported test patterns

  • SMPTE color bars (smptebars and smptehdbars)
  • EBU color bars (pal75bars and pal100bars)

Supported LUT formats

Supported media and interfaces

FFmpeg supports the following devices via external libraries. [70]

Media

Physical interfaces

Audio IO

Video IO

Screen capture and output

Others

Applications

FFmpeg contains more than 100 codecs, [71] most of which use compression techniques of one kind or another. Many such compression techniques may be subject to legal claims relating to software patents. [72] Such claims may be enforceable in countries like the United States which have implemented software patents, but are considered unenforceable or void in member countries of the European Union, for example. [73] [ original research ] Patents for many older codecs, including AC3 and all MPEG-1 and MPEG-2 codecs, have expired.[ citation needed ]

FFmpeg is licensed under the LGPL license, but if a particular build of FFmpeg is linked against any GPL libraries (notably x264), then the entire binary is licensed under the GPL.

Projects using FFmpeg

FFmpeg is used by software such as Blender, Cinelerra-GG Infinity, HandBrake, Kodi, MPC-HC, Plex, Shotcut, VirtualDub2 (a VirtualDub fork), [74] VLC media player, xine, Remotion and YouTube. [75] [76] It handles video and audio playback in Google Chrome [76] and the Linux version of Firefox. [77] GUI front-ends for FFmpeg have been developed, including Multimedia Xpert [78] and XMedia Recode.

FFmpeg is used by ffdshow, FFmpegInterop, the GStreamer FFmpeg plug-in, LAV Filters and OpenMAX IL to expand the encoding and decoding capabilities of their respective multimedia platforms.

As part of NASA's Mars 2020 mission, FFmpeg is used by the Perseverance rover on Mars for image and video compression before footage is sent to Earth. [79]

See also

Related Research Articles

<span class="mw-page-title-main">MPlayer</span> Free and open source media player

MPlayer is a free and open-source media player software application. It is available for Linux, OS X and Microsoft Windows. Versions for OS/2, Syllable, AmigaOS, MorphOS and AROS Research Operating System are also available. A port for DOS using DJGPP is also available. Versions for the Wii Homebrew Channel and Amazon Kindle have also been developed.

Advanced Audio Coding (AAC) is an audio coding standard for lossy digital audio compression. It was designed to be the successor of the MP3 format and generally achieves higher sound quality than MP3 at the same bit rate.

RealVideo, or also spelled as Real Video, is a suite of proprietary video compression formats developed by RealNetworks — the specific format changes with the version. It was first released in 1997 and as of 2008 was at version 10. RealVideo is supported on many platforms, including Windows, Mac, Linux, Solaris, and several mobile phones.

<span class="mw-page-title-main">GStreamer</span> Multimedia framework

GStreamer is a pipeline-based multimedia framework that links together a wide variety of media processing systems to complete complex workflows. For instance, GStreamer can be used to build a system that reads files in one format, processes them, and exports them in another. The formats and processes can be changed in a plug and play fashion.

FAAC or Freeware Advanced Audio Coder is a software project which includes the AAC encoder FAAC and decoder FAAD2. It supports MPEG-2 AAC as well as MPEG-4 AAC. It supports several MPEG-4 Audio object types, file formats, multichannel and gapless encoding/decoding and MP4 metadata tags. The encoder and decoder is compatible with standard-compliant audio applications using one or more of these object types and facilities. It also supports Digital Radio Mondiale.

<span class="mw-page-title-main">Indeo</span> Audio and video formats by Intel

Indeo Video is a family of audio and video formats and codecs first released in 1992, and designed for real-time video playback on desktop CPUs. While its original version was related to Intel's DVI video stream format, a hardware-only codec for the compression of television-quality video onto compact discs, Indeo was distinguished by being one of the first codecs allowing full-speed video playback without using hardware acceleration. Also unlike Cinepak and TrueMotion S, the compression used the same Y'CbCr 4:2:0 colorspace as the ITU's H.261 and ISO's MPEG-1. Indeo use was free of charge to allow for broadest usage.

libavcodec is a free and open-source library of codecs for encoding and decoding video and audio data.

FFV1 is a lossless intra-frame video coding format. It can use either variable-length coding or arithmetic coding for entropy coding. FFV1 is particularly popular for its performance regarding speed and size, compared to other lossless preservation codecs, such as M-JPEG2000.

Video Acceleration API (VA-API) is an open source application programming interface that allows applications such as VLC media player or GStreamer to use hardware video acceleration capabilities, usually provided by the graphics processing unit (GPU). It is implemented by the free and open-source library libva, combined with a hardware-specific driver, usually provided together with the GPU driver.

<span class="mw-page-title-main">VP8</span> Open and royalty-free video coding format released by Google in 2010

VP8 is an open and royalty-free video compression format released by On2 Technologies in 2008.

The following comparison of audio players compares general and technical information for a number of software media player programs. For the purpose of this comparison, "audio players" are defined as any media player explicitly designed to play audio files, with limited or no support for video playback. Multi-media players designed for video playback, which can also play music, are included under comparison of video player software.

libvpx Codec library implementing VP8 and VP9 encoders and decoders

libvpx is a free software video codec library from Google and the Alliance for Open Media (AOMedia). It serves as the reference software implementation for the VP8 and VP9 video coding formats, and for AV1 a special fork named libaom that was stripped of backwards compatibility.

<span class="mw-page-title-main">Libav</span> Multimedia framework

Libav is an abandoned free software project, forked from FFmpeg in 2011, that contains libraries and programs for handling multimedia data.

<span class="mw-page-title-main">Opus (audio format)</span> Lossy audio coding format

Opus is a lossy audio coding format developed by the Xiph.Org Foundation and standardized by the Internet Engineering Task Force, designed to efficiently code speech and general audio in a single format, while remaining low-latency enough for real-time interactive communication and low-complexity enough for low-end embedded processors. Opus replaces both Vorbis and Speex for new applications, and several blind listening tests have ranked it higher-quality than any other standard audio format at any given bitrate until transparency is reached, including MP3, AAC, and HE-AAC.

Intel Quick Sync Video is Intel's brand for its dedicated video encoding and decoding hardware core. Quick Sync was introduced with the Sandy Bridge CPU microarchitecture on 9 January 2011 and has been found on the die of Intel CPUs ever since.

<span class="mw-page-title-main">VP9</span> Open and royalty-free video coding format released by Google in 2013

VP9 is an open and royalty-free video coding format developed by Google.

Fraunhofer FDK AAC is an open-source library for encoding and decoding digital audio in the Advanced Audio Coding (AAC) format. Fraunhofer IIS, developed this library for Android 4.1. It supports several Audio Object Types including MPEG-2 and MPEG-4 AAC LC, HE-AAC, HE-AACv2 as well AAC-LD and AAC-ELD for real-time communication. The encoding library supports sample rates up to 96 kHz and up to eight channels.

AOMedia Video 1 (AV1) is an open, royalty-free video coding format initially designed for video transmissions over the Internet. It was developed as a successor to VP9 by the Alliance for Open Media (AOMedia), a consortium founded in 2015 that includes semiconductor firms, video on demand providers, video content producers, software development companies and web browser vendors. The AV1 bitstream specification includes a reference video codec. In 2018, Facebook conducted testing that approximated real-world conditions, and the AV1 reference encoder achieved 34%, 46.2%, and 50.3% higher data compression than libvpx-vp9, x264 High profile, and x264 Main profile respectively.

References

  1. ↑ "Bobby announces work on libavfilter as GsOC project". 2008-02-09. Archived from the original on 2021-10-07. Retrieved 2021-10-07.
  2. ↑ "Initial revision - git.videolan.org/ffmpeg.git/commit". git.videolan.org. 2000-12-20. Archived from the original on 2013-12-25. Retrieved 2013-05-11.
  3. ↑ "FFmpeg 6.1.1 "Heaviside"".
  4. ↑ "Developer Documentation". ffmpeg.org. 2011-12-08. Archived from the original on 2012-02-04. Retrieved 2012-01-04.
  5. ↑ "Platform Specific Information". FFmpeg.org. Archived from the original on 25 February 2020. Retrieved 25 February 2020.
  6. ↑ "Download". ffmpeg.org. FFmpeg. Archived from the original on 2011-10-06. Retrieved 2012-01-04.
  7. ↑ FFmpeg can be compiled with various external libraries, some of which have licenses that are incompatible with the FFmpeg's primary license, the GNU GPL.
  8. 1 2 "FFmpeg: Lavf: I/O and Muxing/Demuxing Library". ffmpeg.org. Archived from the original on 3 December 2016. Retrieved 21 October 2016.
  9. ↑ "Libavfilter Documentation". ffmpeg.org. Archived from the original on 2021-10-07. Retrieved 2021-10-07.
  10. ↑ ijkplayer, bilibili, 2021-10-05, archived from the original on 2021-10-05, retrieved 2021-10-05
  11. ↑ Niedermayer, Michael (31 July 2015). "[FFmpeg-devel] FFmpegs future and resigning as leader". Archived from the original on 2015-08-15. Retrieved 2015-09-22.
  12. ↑ Bellard, Fabrice (18 February 2006). "FFmpeg naming and logo". FFmpeg developer mailing list. FFmpeg website. Archived from the original on 26 April 2012. Retrieved 24 December 2011.
  13. ↑ Carlsen, Steve (1992-06-03). "TIFF 6.0 specification" (PS). Aldus Corporation. p. 98. Retrieved 2016-08-14. Zig-Zag Scan[ dead link ] Alt URL Archived 2012-07-03 at the Wayback Machine
  14. ↑ Libav project site, archived from the original on 2012-01-03, retrieved 2012-01-04
  15. ↑ Ronald S. Bultje (2011-03-14), Project renamed to Libav, archived from the original on 2016-11-07, retrieved 2012-01-04
  16. ↑ A group of FFmpeg developers just forked as Libav, Phoronix, 2011-03-14, archived from the original on 2011-09-15, retrieved 2012-01-04
  17. ↑ What happened to FFmpeg, 2011-03-30, archived from the original on 2018-09-02, retrieved 2012-05-19
  18. ↑ FFMpeg turmoil, 2011-01-19, archived from the original on 2012-01-12, retrieved 2012-01-04
  19. ↑ "The FFmpeg/Libav situation". blog.pkh.me. Archived from the original on 2012-07-01. Retrieved 2015-09-22.
  20. ↑ "FFmpeg and a thousand fixes". googleblog.com. January 10, 2014. Archived from the original on 22 October 2016. Retrieved 21 October 2016.
  21. ↑ "ffserver – FFmpeg". trac.ffmpeg.org. Archived from the original on 2018-02-04. Retrieved 2018-02-03.
  22. ↑ "ffserver program being dropped". ffmpeg.org. 2016-07-10. Archived from the original on 2016-07-16. Retrieved 2018-02-03.
  23. ↑ "ffmpeg.org/download.html#releases". ffmpeg.org. Archived from the original on 2011-10-06. Retrieved 2015-04-27.
  24. 1 2 "NUT". Multimedia Wiki. 2012. Archived from the original on 2014-01-03. Retrieved 2014-01-03.
  25. ↑ Glaser, Fiona (2010-07-23), Diary Of An x264 Developer: Announcing the world's fastest VP8 decoder, archived from the original on 2010-09-30, retrieved 2012-01-04
  26. ↑ FFmpeg Announces High-Performance VP8 Decoder, Slashdot, 2010-07-24, archived from the original on 2011-12-21, retrieved 2012-01-04
  27. ↑ "FFmpeg Goes WebM, Enabling VP8 for Boxee & Co". newteevee.com. 2010-06-17. Archived from the original on 2010-06-20. Retrieved 2012-01-04. ...with VLC, Boxee, MythTV, Handbrake and MPlayer being some of the more popular projects utilizing FFmpeg...
  28. 1 2 "Native VP9 decoder is now in the Git master branch". Launchpad . 2013-10-03. Archived from the original on 2013-10-22. Retrieved 2013-10-21.
  29. 1 2 "FFmpeg Now Features Native HEVC/H.265 Decoder Support". Softpedia. 2013-10-16. Archived from the original on 2014-06-15. Retrieved 2013-10-16.
  30. ↑ FFmpeg (2016-02-15). "February 15th, 2016, FFmpeg 3.0 "Einstein"". Archived from the original on 2016-07-16. Retrieved 2016-04-02.
  31. ↑ FFmpeg (2017-10-15). "October 15th, 2017, FFmpeg 3.4 "Cantor"". Archived from the original on 2016-07-16. Retrieved 2019-05-10.
  32. ↑ FFmpeg (2018-11-06). "November 6th, 2018, FFmpeg 4.1 "al-Khwarizmi"". Archived from the original on 2016-07-16. Retrieved 2019-05-10.
  33. ↑ Jan Ozer (2019-03-04). "Good News: AV1 Encoding Times Drop to Near-Reasonable Levels". StreamingMedia.com. Archived from the original on 2021-05-14. Retrieved 2019-05-10.
  34. ↑ This video of Linux desktop (X11) was captured by ffmpeg and encoded in realtime [ circular reference ]
  35. ↑ "FFmpeg Automated Testing Environment". Fate.multimedia.cx. Archived from the original on 2016-04-10. Retrieved 2012-01-04.
  36. ↑ "FFmpeg Hardware Acceleration". ffmpeg.org Wiki. Archived from the original on 2016-12-04. Retrieved 2016-11-12.
  37. ↑ "Hardware/VAAPI – FFmpeg". trac.ffmpeg.org. Archived from the original on 2017-10-16. Retrieved 2017-10-16.
  38. ↑ "HEVC Video Encoder User Manual" (PDF). Qualcomm Developer Network. Archived (PDF) from the original on 2021-04-16. Retrieved 2021-02-23.
  39. ↑ "FFmpeg Changelog". GitHub . Archived from the original on 2017-03-21. Retrieved 2016-11-12.
  40. ↑ "HWAccelIntro – FFmpeg". trac.ffmpeg.org.
  41. 1 2 3 4 5 6 "Changelog". FFmpeg trunk SVN. FFmpeg. 17 April 2007. Retrieved 26 April 2007.[ permanent dead link ]
  42. ↑ "FFmpeg Lands JPEG-XL Support". www.phoronix.com. Retrieved 2022-04-26.
  43. ↑ "git.ffmpeg.org Git - ffmpeg.git/commit". git.ffmpeg.org. Archived from the original on 2018-04-23. Retrieved 2018-04-23.
  44. 1 2 FFmpeg 5.1 Released With Many Improvements To This Important Multimedia Project. Phoronix. July 22, 2022
  45. 1 2 3 4 5 FFmpeg 1.1 Brings New Support, Encoders/Decoders. Phoronix. January 7, 2013
  46. 1 2 FFmpeg 4.1 Brings AV1 Parser & Support For AV1 In MP4. Phoronix. November 6, 2018
  47. ↑ FFmpeg 3.0 Released, Supports VP9 VA-API Acceleration. Phoronix. February 15, 2016
  48. ↑ FFmpeg 4.4 Released With AV1 VA-API Decoder, SVT-AV1 Encoding. Phoronix. April 9, 2021
  49. 1 2 3 4 FFmpeg 0.11 Has Blu-Ray Protocol, New Encoders. Phoronix. May 26, 2012
  50. 1 2 FFmpeg 3.3 Brings Native Opus Encoder, Support For Spherical Videos. Phoronix. April 17, 2017
  51. ↑ FFmpeg 5.0 Released For This Popular, Open-Source Multimedia Library. Phoronix. January 14, 2022
  52. 1 2 FFmpeg 2.2 Release Adds The Libx265 Encoder. Phoronix. March 23, 2014
  53. ↑ FFmpeg 4.2 Released With AV1 Decoding Support, GIF Parser. Phoronix. August 6, 2019
  54. ↑ FFmpeg 0.6 Released With H.264, VP8 Love. Phoronix. June 16, 2010
  55. 1 2 FFmpeg 2.5 Brings Animated PNG, WebP Decoding Support. Phoronix. December 4, 2014
  56. 1 2 "FFmpeg development mailing list". FFmpeg development. FFmpeg. 7 May 2007. Archived from the original on 11 August 2007. Retrieved 24 December 2010.
  57. ↑ vitor (13 April 2008). "FFmpeg development mailing list". FFmpeg development. FFmpeg website. Retrieved 14 April 2008.[ permanent dead link ]
  58. ↑ vitor (30 March 2008). "FFmpeg development mailing list". FFmpeg development. FFmpeg website. Retrieved 30 March 2008.[ permanent dead link ]
  59. ↑ "FFmpeg: MaxisXADemuxContext Struct Reference". FFmpeg development. FFmpeg website. Retrieved 17 March 2024.
  60. ↑ Michael Niedermayer, Timothy Gu (2014-12-05). "RELEASE NOTES for FFmpeg 2.5 "Bohr"". VideoLAN. Archived from the original on 2014-12-08. Retrieved 2014-12-05.
  61. ↑ ramiro (18 March 2008). "FFmpeg development mailing list". FFmpeg development. FFmpeg website. Archived from the original on 17 August 2008. Retrieved 18 March 2008.
  62. ↑ banan (8 June 2008). "FFmpeg development mailing list". FFmpeg development. FFmpeg website. Archived from the original on 14 January 2009. Retrieved 8 June 2008.
  63. ↑ faust3 (21 March 2008). "FFmpeg development mailing list". FFmpeg development. FFmpeg website. Archived from the original on 25 April 2008. Retrieved 21 March 2008.{{cite web}}: CS1 maint: numeric names: authors list (link)
  64. ↑ van Kesteren, Anne (2010-09-01). "Internet Drafts are not Open Standards". annevankesteren.nl. Self-published. Archived from the original on 2010-09-02. Retrieved 2015-03-22.
  65. ↑ Real Time Streaming Protocol 2.0 (RTSP) Archived 2023-10-25 at the Wayback Machine P.231
  66. ↑ "rtsp: Support tls-encapsulated RTSP - git.videolan.org Git - ffmpeg.git/commit". videolan.org. Archived from the original on 18 October 2016. Retrieved 21 October 2016.
  67. ↑ "FFmpeg Filters". ffmpeg.org. Archived from the original on 2017-03-28. Retrieved 2017-03-27.
  68. ↑ How it works earwax.ca
  69. ↑ "FFmpeg Devices Documentation". ffmpeg.org. Archived from the original on 2021-10-25. Retrieved 2021-10-25.
  70. ↑ "Codecs list". ffmpeg.org. Archived from the original on 2012-01-06. Retrieved 2012-01-01.
  71. ↑ "Legal information on FFmpeg's website". ffmpeg.org. Archived from the original on 2012-01-03. Retrieved 2012-01-04.
  72. ↑ "The European Patent Convention". www.epo.org. European Patent Office. 2020-11-29. Archived from the original on 2021-11-19. Retrieved 2021-11-24.
  73. ↑ "VirtualDub2". Archived from the original on 2020-08-07. Retrieved 2020-08-15.
  74. ↑ "Google's YouTube Uses FFmpeg | Breaking Eggs And Making Omelettes". Multimedia.cx. 2011-02-08. Archived from the original on 2012-08-14. Retrieved 2012-08-06.
  75. 1 2 "FFmpeg-based Projects". ffmpeg.org. Archived from the original on 2016-02-20. Retrieved 2012-01-04..
  76. ↑ "Firefox Enables FFmpeg Support By Default". Phoronix. 2015-11-15. Archived from the original on 2017-09-25. Retrieved 2015-11-18.
  77. ↑ "Multimedia Xpert". Atlas Informatik. Retrieved 2022-05-26.
  78. ↑ Maki, J. N.; Gruel, D.; McKinney, C.; Ravine, M. A.; Morales, M.; Lee, D.; Willson, R.; Copley-Woods, D.; Valvo, M.; Goodsall, T.; McGuire, J.; Sellar, R. G.; Schaffner, J. A.; Caplinger, M. A.; Shamah, J. M.; Johnson, A. E.; Ansari, H.; Singh, K.; Litwin, T.; Deen, R.; Culver, A.; Ruoff, N.; Petrizzo, D.; Kessler, D.; Basset, C.; Estlin, T.; Alibay, F.; Nelessen, A.; Algermissen, S. (2020). "The Mars 2020 Engineering Cameras and Microphone on the Perseverance Rover: A Next-Generation Imaging System for Mars Exploration". Space Science Reviews. Springer Nature Switzerland AG. 216 (8): 137. Bibcode:2020SSRv..216..137M. doi:10.1007/s11214-020-00765-9. PMC   7686239 . PMID   33268910.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.