Versatile Video Coding

Last updated

VVC / H.266 / MPEG-I Part 3
Versatile video coding
Versatile Video Coding (logo).svg
StatusIn force
Year started2017
First published2020
Latest version3rd Edition
29 September 2023
Organization ITU-T, ISO, IEC
Committee SG16 (Secretary: Simao Campos) (VCEG), MPEG
Base standards H.261, H.262, H.263, H.264, H.265, ISO/IEC 14496-2, MPEG-1
Domain Video compression
License RAND
Website www.itu.int/rec/T-REC-H.266

Versatile Video Coding (VVC), also known as H.266, [1] ISO/IEC 23090-3, [2] and MPEG-I Part 3, is a video compression standard finalized on 6 July 2020, by the Joint Video Experts Team (JVET) [3] of the VCEG working group of ITU-T Study Group 16 and the MPEG working group of ISO/IEC JTC 1/SC 29. It is the successor to High Efficiency Video Coding (HEVC, also known as ITU-T H.265 and MPEG-H Part 2). It was developed with two primary goals –improved compression performance and support for a very broad range of applications. [4] [5] [6]

Contents

Concept

In October 2015, the MPEG and VCEG formed the Joint Video Exploration Team (JVET) to evaluate available compression technologies and study the requirements for a next-generation video compression standard. The new standard has about 50% better compression rate for the same perceptual quality compared to HEVC, [7] with support for lossless and lossy compression. It supports resolutions ranging from very low resolution up to 4K and 16K as well as 360° videos. VVC supports YCbCr 4:4:4, 4:2:2 and 4:2:0 with 8–10 bits per component, BT.2100 wide color gamut and high dynamic range (HDR) of more than 16 stops (with peak brightness of 1,000, 4,000 and 10,000 nits), auxiliary channels (for depth, transparency, etc.), variable and fractional frame rates from 0 to 120 Hz and higher, scalable video coding for temporal (frame rate), spatial (resolution), SNR, color gamut and dynamic range differences, stereo/multiview coding, panoramic formats, and still-picture coding. Work on high bit depth support (12 to 16 bits per component) started in October 2020 [8] and was included in the second edition published in 2022. Encoding complexity of several times (up to ten times) that of HEVC is expected, depending on the quality of the encoding algorithm (which is outside the scope of the standard). The decoding complexity is about twice that of HEVC.

VVC development has been made using the VVC Test Model (VTM), a reference software codebase that was started with a minimal set of coding tools. Further coding tools have been added after being tested in Core Experiments (CEs). Its predecessor was the Joint Exploration Model (JEM), an experimental software codebase that was based on the reference software used for HEVC.

Like its predecessor, VVC uses motion-compensated DCT video coding. While HEVC supports integer discrete cosine transform (DCT) square block sizes between 4×4 and 32×32, VVC adds support for non-square DCT rectangular block sizes. VVC also introduces several intra-frame prediction modes based on these rectangular DCT blocks to provide improved motion compensation prediction. [9]

History

JVET issued a final Call for Proposals in October 2017, and the standardization process officially began in April 2018 when the first working draft of the standard was produced. [10] [11]

At IBC 2018, a preliminary implementation based on VVC was demonstrated that was said to compress video 40% more efficiently than HEVC. [12]

The content of the final standard was approved on 6 July 2020. [7] [13] [14]

Schedule

Licensing

To reduce the risk of the problems seen when licensing HEVC implementations, for VVC a new group called the Media Coding Industry Forum (MC-IF) was founded. [16] [17] However, MC-IF had no power over the standardization process, which was based on technical merit as determined by consensus decisions of JVET. [18]

Four companies were initially vying to be patent pool administrators for VVC, in a situation similar to the previous AVC [19] and HEVC [20] codecs. Two companies later formed patent pools: Access Advance and MPEG LA (now known as Via-LA). [21]

Access Advance published their licensing fee in April 2021. [22] Via-LA published their licensing fee in January 2022. [23]

Companies known not to be a part of the Access Advance or Via-LA patent pools as of November 2023 are: Apple, Canon, Ericsson, Fraunhofer, Google, Huawei, Humax, Intel, LG, Interdigital, Maxell, Microsoft, Oppo, Qualcomm, Samsung, Sharp and Sony.

Adoption

Content providers

Software

Encoders/decoders

Players

Hardware

CompanyChip/architectureTypeThroughputRef
Allegro DVTAL-D320Decoder IP core 8K@120 [42] [43]
AL-E320Encoder IP core [44] [45]
AmlogicS905X5Set-top box SoC 2x 4K@60 10 bit [46]
Intel Xe2-LPG GPU/iGPU [47]
MediaTek Pentonic 2000 SoC for TV sets8K@120 [48]
Pentonic 10004K@144 [49]
Pentonic 800 [50]
Pentonic 700 [51]
Realtek RTD1319DSet-top box SoC 4K@60 [52]
VeriSiliconHantro VC9000DDecoder8K@120 [53]
Hantro VC9800D [54]

Broadcast

The Brazilian SBTVD Forum will adopt the MPEG-I VVC codec in its forthcoming broadcast television system, TV 3.0, expected to launch in 2024. It will be used alongside MPEG-5 LCEVC as a video base layer encoder for broadcast and broadband delivery. [55]

The European organization DVB Project, which governs digital television broadcasting standards, announced 24 February 2022 that VVC was now part of its tools for broadcasting. [56] The DVB tuner specification used throughout Europe, Australia, and many other regions has been revised to support the VVC (H.266) video codec, the successor to HEVC. [57]

See also

Notes

  1. ↑ License withholds patent rights and is not OSI-approved.

Related Research Articles

<span class="mw-page-title-main">Video codec</span> Digital video processing

A video codec is software or hardware that compresses and decompresses digital video. In the context of video compression, codec is a portmanteau of encoder and decoder, while a device that only compresses is typically called an encoder, and one that only decompresses is a decoder.

<span class="mw-page-title-main">FFmpeg</span> Multimedia framework

FFmpeg is a free and open-source software project consisting of a suite of libraries and programs for handling video, audio, and other multimedia files and streams. At its core is the command-line ffmpeg tool itself, designed for processing video and audio files. It is widely used for format transcoding, basic editing, video scaling, video post-production effects, and standards compliance.

Audio Video Coding Standard (AVS) refers to the digital audio and digital video series compression standard formulated by the Audio and Video coding standard workgroup of China. Work began in 2002, and three generations of standards were published.

MPEG-4 Part 2, MPEG-4 Visual is a video compression format developed by the Moving Picture Experts Group (MPEG). It belongs to the MPEG-4 ISO/IEC standards. It uses block-wise motion compensation and a discrete cosine transform (DCT), similar to previous standards such as MPEG-1 Part 2 and H.262/MPEG-2 Part 2.

libavcodec is a free and open-source library of codecs for encoding and decoding video and audio data.

The Video Coding Experts Group or Visual Coding Experts Group is a working group of the ITU Telecommunication Standardization Sector (ITU-T) concerned with standards for compression coding of video, images, audio signals, biomedical waveforms, and other signals. It is responsible for standardization of the "H.26x" line of video coding standards, the "T.8xx" line of image coding standards, and related technologies.

In video coding, a group of pictures, or GOP structure, specifies the order in which intra- and inter-frames are arranged. The GOP is a collection of successive pictures within a coded video stream. Each coded video stream consists of successive GOPs, from which the visible frames are generated. Encountering a new GOP in a compressed video stream means that the decoder doesn't need any previous frames in order to decode the next ones, and allows fast seeking through the video.

Video Acceleration API (VA-API) is an open source application programming interface that allows applications such as VLC media player or GStreamer to use hardware video acceleration capabilities, usually provided by the graphics processing unit (GPU). It is implemented by the free and open-source library libva, combined with a hardware-specific driver, usually provided together with the GPU driver.

High Efficiency Video Coding (HEVC), also known as H.265 and MPEG-H Part 2, is a video compression standard designed as part of the MPEG-H project as a successor to the widely used Advanced Video Coding. In comparison to AVC, HEVC offers from 25% to 50% better data compression at the same level of video quality, or substantially improved video quality at the same bit rate. It supports resolutions up to 8192×4320, including 8K UHD, and unlike the primarily 8-bit AVC, HEVC's higher fidelity Main 10 profile has been incorporated into nearly all supporting hardware.

libvpx Codec library implementing VP8 and VP9 encoders and decoders

libvpx is a free software video codec library from Google and the Alliance for Open Media (AOMedia). It serves as the reference software implementation for the VP8 and VP9 video coding formats, and for AV1 a special fork named libaom that was stripped of backwards compatibility.

Intel Quick Sync Video is Intel's brand for its dedicated video encoding and decoding hardware core. Quick Sync was introduced with the Sandy Bridge CPU microarchitecture on 9 January 2011 and has been found on the die of Intel CPUs ever since.

A video coding format is a content representation format of digital video content, such as in a data file or bitstream. It typically uses a standardized video compression algorithm, most commonly based on discrete cosine transform (DCT) coding and motion compensation. A specific software, firmware, or hardware implementation capable of compression or decompression in a specific video coding format is called a video codec.

<span class="mw-page-title-main">VP9</span> Open and royalty-free video coding format released by Google in 2013

VP9 is an open and royalty-free video coding format developed by Google.

Nvidia NVENC is a feature in Nvidia graphics cards that performs video encoding, offloading this compute-intensive task from the CPU to a dedicated part of the GPU. It was introduced with the Kepler-based GeForce 600 series in March 2012.

The Alliance for Open Media (AOMedia) is a non-profit industry consortium headquartered in Wakefield, Massachusetts, and formed to develop open, royalty-free technology for multimedia delivery. It uses the ideas and principles of open web standard development to create video standards that can serve as alternatives to the hitherto dominant standards of the Moving Picture Experts Group (MPEG).

<span class="mw-page-title-main">AV1</span> Open and royalty-free video coding format developed by the Alliance for Open Media

AOMedia Video 1 (AV1) is an open, royalty-free video coding format initially designed for video transmissions over the Internet. It was developed as a successor to VP9 by the Alliance for Open Media (AOMedia), a consortium founded in 2015 that includes semiconductor firms, video on demand providers, video content producers, software development companies and web browser vendors. The AV1 bitstream specification includes a reference video codec. In 2018, Facebook conducted testing that approximated real-world conditions, and the AV1 reference encoder achieved 34%, 46.2%, and 50.3% higher data compression than libvpx-vp9, x264 High profile, and x264 Main profile respectively.

MPEG-5 Essential Video Coding (EVC), standardized as ISO/IEC 23094-1, is a video compression standard that has been completed in April 2020 by decision of MPEG Working Group 11 at its 130th meeting.

<span class="mw-page-title-main">LCEVC</span> Video coding standard

Low Complexity Enhancement Video Coding (LCEVC) is a ISO/IEC video coding standard developed by the Moving Picture Experts Group (MPEG) under the project name MPEG-5 Part 2 LCEVC.

References

  1. ↑ "H.266: Versatile video coding". International Telecommunication Union . Archived from the original on 21 June 2021. Retrieved 21 June 2021.
  2. ↑ "Information technology — Coded representation of immersive media — Part 3: Versatile video coding". International Organization for Standardization (2nd ed.). September 2022. ISO/IEC 23090-3:2022. Retrieved 16 February 2021.
  3. ↑ "JVET - Joint Video Experts Team". International Telecommunication Union . Retrieved 21 January 2019.
  4. ↑ Bross, Benjamin; Chen, Jianle; Ohm, Jens-Rainer; Sullivan, Gary J.; Wang, Ye-Kui (September 2021). "Developments in International Video Coding Standardization After AVC, With an Overview of Versatile Video Coding (VVC)". Proceedings of the IEEE . 109 (9): 1463–1493. doi: 10.1109/JPROC.2020.3043399 . S2CID   234183758.
  5. ↑ Bross, Benjamin; Wang, Ye-Kui; Ye, Yan; Liu, Shan; Sullivan, Gary J.; Ohm, Jens-Rainer (October 2021). "Overview of the Versatile Video Coding (VVC) Standard and its Applications". IEEE Trans. Circuits & Systs. For Video Technol. 31 (10): 3736–3764. doi: 10.1109/TCSVT.2021.3101953 . S2CID   238243504.
  6. ↑ Boyce, Jill M.; Chen, Jianle; Liu, Shan; Ohm, Jens-Rainer; Sullivan, Gary J.; Wiegand, Thomas; Ye, Yan; Zhu, Wenwu (October 2021). "Guest Editorial Introduction to the Special Section on the VVC Standard". IEEE Trans. Circuits & Systs. For Video Technol. 31 (10): 3731–3735. doi: 10.1109/TCSVT.2021.3111712 . S2CID   238425004.
  7. 1 2 "Fraunhofer HHI is proud to present the new state-of-the-art in global video coding: H.266/VVC brings video transmission to new speeds". Fraunhofer Institute for Telecommunications . 6 July 2020. Retrieved 8 July 2020.
  8. ↑ T. Ikai; T. Zhou; T. Hashimoto. "AHG12: VVC coding tool evaluation for high bit-depth coding". JVET document management system.
  9. ↑ Bailey, Donald G. (14 August 2023). Design for Embedded Image Processing on FPGAs. John Wiley & Sons. p. 359. ISBN   978-1-119-81979-0.
  10. ↑ "N17195, Joint Call for Proposals on Video Compression with Capability beyond HEVC". mpeg.chiariglione.org. Retrieved 21 January 2019.
  11. ↑ "N17669, Working Draft 1 of Versatile Video Coding". mpeg.chiariglione.org. Retrieved 18 August 2019.
  12. ↑ Richter, Thomas (12 September 2018). "Fraunhofer Institut zeigt 50% besseren HEVC Nachfolger VVC auf der // IBC 2018". slashCAM (in German). Archived from the original on 8 November 2018. Retrieved 21 January 2019.
  13. ↑ "Versatile Video Coding | MPEG". mpeg.chiariglione.org. Retrieved 21 January 2019.
  14. ↑ ITU (27 April 2018). "Beyond HEVC: Versatile Video Coding project starts strongly in Joint Video Experts Team". ITU News. Archived from the original on 21 June 2021. Retrieved 21 June 2021.
  15. ↑ "JVET-J1001: Versatile Video Coding (Draft 1)". April 2018.
  16. ↑ Ozer, Jan (13 January 2019). "A Video Codec Licensing Update". Streaming Media. Retrieved 21 January 2019.
  17. ↑ "MC-IF". mc-if. Retrieved 21 January 2019.
  18. ↑ Feldman, Christian (7 May 2019). "Video Engineering Summit East 2019 – AV1/VVC Update". New York. Archived from the original on 20 June 2019. Retrieved 20 June 2019. No change to the standardization has been done, so it could theoretically happen that the same thing with HEVC happens again. No measures have been done to prevent that, unfortunately. Also, JVET is not directly responsible; they are just a technical committee. (…) There is the Media Coding Industry Forum (…), but they don't have any real power.
  19. ↑ Siglin, Timothy (12 February 2009). "The H.264 Licensing Labyrinth". Streaming Media. Retrieved 8 July 2020.
  20. ↑ Ozer, Jan (17 January 2020). "Balance of Power Shifts Among HEVC Patent Pools". Streaming Media. Retrieved 8 July 2020.
  21. ↑ Ozer, Jan (28 January 2021). "VVC Patent Pools: And Then There Were Two". Streaming Media. Retrieved 23 February 2021.
  22. ↑ "access advance royalties".
  23. ↑ "via-la licensing fees".
  24. ↑ "MX Player cuts down video streaming data consumption by half; upgrades its video encoding and compression technology to H.266". businessinsider.in. 15 June 2021.
  25. ↑ "How the H.266 video standard will help stream content way faster". The Next Web . 7 September 2021.
  26. ↑ "Fraunhofer HHI has developed a software encoder that fully exploits the compression potential of VVC. Its source code is available on GitHub". hhi.fraunhofer.de. Retrieved 29 June 2021.
  27. ↑ "Fraunhofer HHI has developed a resource efficient, multithreaded VVC software decoder that enables live decoding. Its source code is available on GitHub". hhi.fraunhofer.de. Retrieved 29 June 2021.
  28. ↑ Tencent (22 June 2021). "High performance Real-time H.266/VVC decoder now available from Tencent Media Lab". Tencent. Archived from the original on 22 June 2021. Retrieved 22 June 2021.
  29. ↑ Tencent (16 July 2021). "Tencent Cloud Becomes First Cloud Service Provider to Support H.266/VVC Standard".
  30. ↑ "FFmpeg". ffmpeg.org. Retrieved 5 April 2024.
  31. ↑ "git.videolan.org Git - ffmpeg.git/commitdiff". git.videolan.org. Retrieved 6 September 2024.
  32. ↑ "Support PALETTE · Issue #8 · ffvvc/FFmpeg". GitHub. Retrieved 7 April 2024.
  33. ↑ "git.ffmpeg.org Git - ffmpeg.git/commit". git.ffmpeg.org. Retrieved 3 January 2024.
  34. ↑ "Release 0.79 · Nevcairiel/LAVFilters". GitHub. Retrieved 17 April 2024.
  35. ↑ "Project". OpenVVC. Retrieved 25 August 2024.
  36. ↑ OpenVVC/OpenVVC, OpenVVC, 27 July 2024, retrieved 25 August 2024
  37. ↑ "Spin Digital – 8K VVC Media Player (Spin Player VVC)". Spin Digital. Retrieved 20 August 2021.
  38. ↑ Rudd, Emilia. "Elmedia Player for Mac Version History | KB". Electronic Team, Inc. Retrieved 23 July 2023.
  39. ↑ "Release 2.2.0 · clsid2/mpc-hc". GitHub. Retrieved 2 April 2024.
  40. ↑ "Release MPC-BE 1.7.0 · Aleksoid1978/MPC-BE". GitHub.
  41. ↑ "Steam :: Zoom Player Steam Edition :: Announcing Zoom Player v19 beta 6". store.steampowered.com. 12 April 2024. Retrieved 17 April 2024.
  42. ↑ "IP Decoder AV1 8K IP Video Multiformats AV1 422 Scalable". Allegro DVT - Leading Video Compression Expertise. Retrieved 2 July 2021.
  43. ↑ "First hardware VVC/H.266 video decoder IP core". 1 July 2021. Retrieved 2 July 2021.
  44. ↑ "Allegro DVT Launches The Industry's First Real-Time VVC/H.266 Encoder IP". AFP.com. 17 April 2012. Retrieved 17 July 2024.
  45. ↑ "Allegro DVT Launches The Industry's First Real-Time VVC/H.266 Encoder IP". www.allegrodvt.com. Retrieved 17 July 2024.
  46. ↑ Aufranc (CNXSoft), Jean-Luc (18 September 2023). "Amlogic S905X5 Armv9 TV Box SoC supports AV1, H.266, Ai-SR - CNX Software". CNX Software - Embedded Systems News. Retrieved 29 October 2024.
  47. ↑ Bonshor, Gavin. "Intel Unveils Lunar Lake Architecture: New P and E cores, Xe2-LPG Graphics, New NPU 4 Brings More AI Performance". www.anandtech.com. Retrieved 4 June 2024.
  48. ↑ MediaTek. "MediaTek Announces New Pentonic Smart TV Family with New Pentonic 2000 for Flagship 8K 120Hz TVs". www.prnewswire.com (Press release). Retrieved 20 November 2021.
  49. ↑ de Looper, Christian (10 November 2022). "MediaTek wants to power next-generation TVs and Chromebooks". BGR .
  50. ↑ "MediaTek Kompanio 838 and Pentonic 800 chipsets announced". www.fonearena.com. Retrieved 5 June 2024.
  51. ↑ Roy, Avik (20 August 2022). "MediaTek launches Pentonic 700 chip for 4K televisions". TechnoSports.
  52. ↑ "Realtek Launches World's First 4K UHD Set-top Box SoC (RTD1319D) Supports VVC/H.266 Video Decoding, GPU with 10-bit Graphics, Multiple CAS, and HDMI 2.1a". Realtek. 29 August 2022. Retrieved 5 September 2022.
  53. ↑ "VeriSilicon delivered multi-format hardware video decoder Hantro VC9000D supporting 8K@120FPS VVC/H.266 to customers". www.verisilicon.com. Retrieved 21 March 2023.
  54. ↑ "Hantro VC9800D". www.verisilicon.com. Retrieved 9 January 2024.
  55. ↑ "Brazilian SBTVD Forum Selects V-Nova LCEVC for Brazil's Upcoming TV 3.0". digitalmediaworld.tv. 13 January 2022.
  56. ↑ "DVB adds the VVC (H.266) codec to its video standards, for 8K?". 24 February 2022.
  57. ↑ "Next-gen video codec VVC (H.266) added to DVB tuner specification". 28 February 2022.

Further reading

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.