Low Complexity Enhancement Video Coding MPEG-5 Part 2 | |
Year started | 2018 |
---|---|
Latest version | June 2021 |
Organization | ITU-T (SG16), ISO, IEC |
Committee | ISO, VCEG, MPEG |
Base standards | H.261, H.262 (aka MPEG-2 Video), H.263, MPEG-1 |
Related standards | H.264 (aka AVC), H.265 (aka HEVC), H.266 (aka VVC) |
Domain | Video compression |
Website | https://www.lcevc.org/ |
Low Complexity Enhancement Video Coding (LCEVC) is a ISO/IEC video coding standard developed by the Moving Picture Experts Group (MPEG) under the project name MPEG-5 Part 2 LCEVC. [1] [2]
LCEVC specifies an enhancement layer which, when combined with a base video encoded with a separate codec, produces an enhanced video stream. The base layer is decodable by a hardware decoder, and the enhancement layer is suitable for software processing implementation with sustainable power consumption.[ further explanation needed ] The enhancement layer provides improved features to existing codecs, such as compression capability extension and lower encoding/decoding complexity, for live streaming or broadcasting applications. [3]
LCEVC leverages a base video codec (e.g., AVC, HEVC, VP9, AV1, EVC or VVC) and employs an efficient low-complexity enhancement that adds up to two layers of encoded residuals, along with normative signalled up-sampling methods, that correct artifacts produced by the base video codec and add detail and sharpness for the final output video. [4]
It provides additional compression efficiency to any existing or future video codec and reduces the processing complexity of encoding and decoding. [5] [6]
LCEVC can be implemented with software updates for encoders and decoders, and was designed to leverage available hardware acceleration for graphics processing. [7]
It is possible for licensed users of the V-NOVA P+ codec to encode LCEVC files. [3]
In October 2018, MPEG issued a set of requirements for a new video coding standard and a Call for Proposals for Low Complexity Enhancement Video Coding. [8] [9]
At IBC 2019 a preliminary implementation for encoding and decoding the forthcoming MPEG-5 Part 2 LCEVC was demonstrated. [10]
October 2020 at the 132nd MPEG meeting, LCEVC is completed reaching Final Draft stage. [11]
In April 2021, MPEG Video validated the Verification Test of LCEVC (Low Complexity Enhancement Video Coding) standard (ISO/IEC 23094-2). Test results tended to indicate an overall benefit also when using LCEVC to enhance AVC, HEVC, EVC and VVC. [12] [13]
In May 2021, V-NOVA LCEVC Licensing Terms were announced for Entertainment Video Services. It is a software development kit and a wide range of reference integrations that add MPEG-5 Part 2 LCEVC (ISO/IEC 23094-2) encoding and decoding to any existing video delivery workflow. V-NOVA LCEVC is an implementation of MPEG-5 Part 2 LCEVC, the codec-agnostic (ISO/IEC) enhancement standard capable of providing higher quality at up to 40% lower bitrates than codecs used natively. [14] [15]
As per Jan Ozer's report, LCEVC Technology entitled LCEVC x264 Report: Live Sports & eGames, ABR Ladder. [16]
In January 2022, SBTVD Forum approved a selection of technologies for SBTVD 3.0 which include MPEG-5 LCEVC, V-NOVA & Harmonic's submission. [17] [18]
In January 2022, ISO/IEC published a set of tests and procedures to verify whether bitstreams and decoders meet normative requirements specified in the MPEG-5 LCEVC part 2 standard in order for implementers of LCEVC to be able to test the functioning and verify the conformance of their implementations. [19]
Stefano Battista, Guido Meardi, Simone Ferrara, Lorenzo Ciccarelli, Massimo Conti and Simone Orcioni are the co-authors of Low Complexity Enhancement Video Coding (LCEVC) Standard. [20] [21]
Licensing is free of cost per decoder or encoder, but broadcaster or encoder-side use of enhancement layers is subject to fees. [24]
LCEVC is proprietary to V-Nova and subject to V-Nova's proprietary licence. Therefore, distribution of any pre-compiled subsystem is strictly prohibited, even between group companies. [25]
H.263 is a video compression standard originally designed as a low-bit-rate compressed format for videotelephony. It was standardized by the ITU-T Video Coding Experts Group (VCEG) in a project ending in 1995/1996. It is a member of the H.26x family of video coding standards in the domain of the ITU-T.
The Moving Picture Experts Group (MPEG) is an alliance of working groups established jointly by ISO and IEC that sets standards for media coding, including compression coding of audio, video, graphics, and genomic data; and transmission and file formats for various applications. Together with JPEG, MPEG is organized under ISO/IEC JTC 1/SC 29 – Coding of audio, picture, multimedia and hypermedia information.
MPEG-1 is a standard for lossy compression of video and audio. It is designed to compress VHS-quality raw digital video and CD audio down to about 1.5 Mbit/s without excessive quality loss, making video CDs, digital cable/satellite TV and digital audio broadcasting (DAB) practical.
MPEG-2 is a standard for "the generic coding of moving pictures and associated audio information". It describes a combination of lossy video compression and lossy audio data compression methods, which permit storage and transmission of movies using currently available storage media and transmission bandwidth. While MPEG-2 is not as efficient as newer standards such as H.264/AVC and H.265/HEVC, backwards compatibility with existing hardware and software means it is still widely used, for example in over-the-air digital television broadcasting and in the DVD-Video standard.
MPEG-1 Audio Layer II or MPEG-2 Audio Layer II is a lossy audio compression format defined by ISO/IEC 11172-3 alongside MPEG-1 Audio Layer I and MPEG-1 Audio Layer III (MP3). While MP3 is much more popular for PC and Internet applications, MP2 remains a dominant standard for audio broadcasting.
Advanced Audio Coding (AAC) is an audio coding standard for lossy digital audio compression. Designed to be the successor of the MP3 format, AAC generally achieves higher sound quality than MP3 encoders at the same bit rate.
MPEG-4 Part 3 or MPEG-4 Audio is the third part of the ISO/IEC MPEG-4 international standard developed by Moving Picture Experts Group. It specifies audio coding methods. The first version of ISO/IEC 14496-3 was published in 1999.
High-Efficiency Advanced Audio Coding (HE-AAC) is an audio coding format for lossy data compression of digital audio defined as an MPEG-4 Audio profile in ISO/IEC 14496–3. It is an extension of Low Complexity AAC (AAC-LC) optimized for low-bitrate applications such as streaming audio. The usage profile HE-AAC v1 uses spectral band replication (SBR) to enhance the modified discrete cosine transform (MDCT) compression efficiency in the frequency domain. The usage profile HE-AAC v2 couples SBR with Parametric Stereo (PS) to further enhance the compression efficiency of stereo signals.
MPEG-4 Part 2, MPEG-4 Visual is a video compression format developed by the Moving Picture Experts Group (MPEG). It belongs to the MPEG-4 ISO/IEC standards. It uses block-wise motion compensation and a discrete cosine transform (DCT), similar to previous standards such as MPEG-1 Part 2 and H.262/MPEG-2 Part 2.
The Video Coding Experts Group or Visual Coding Experts Group is a working group of the ITU Telecommunication Standardization Sector (ITU-T) concerned with standards for compression coding of video, images, audio, and other signals. It is responsible for standardization of the "H.26x" line of video coding standards, the "T.8xx" line of image coding standards, and related technologies.
MPEG-4 Part 14 or MP4 is a digital multimedia container format most commonly used to store video and audio, but it can also be used to store other data such as subtitles and still images. Like most modern container formats, it allows streaming over the Internet. The only filename extension for MPEG-4 Part 14 files as defined by the specification is .mp4. MPEG-4 Part 14 is a standard specified as a part of MPEG-4.
MPEG Surround, also known as Spatial Audio Coding (SAC) is a lossy compression format for surround sound that provides a method for extending mono or stereo audio services to multi-channel audio in a backwards compatible fashion. The total bit rates used for the core and the MPEG Surround data are typically only slightly higher than the bit rates used for coding of the core. MPEG Surround adds a side-information stream to the core bit stream, containing spatial image data. Legacy stereo playback systems will ignore this side-information while players supporting MPEG Surround decoding will output the reconstructed multi-channel audio.
High Efficiency Video Coding (HEVC), also known as H.265 and MPEG-H Part 2, is a video compression standard designed as part of the MPEG-H project as a successor to the widely used Advanced Video Coding. In comparison to AVC, HEVC offers from 25% to 50% better data compression at the same level of video quality, or substantially improved video quality at the same bit rate. It supports resolutions up to 8192×4320, including 8K UHD, and unlike the primarily 8-bit AVC, HEVC's higher fidelity Main 10 profile has been incorporated into nearly all supporting hardware.
Part 3 of the MPEG-2 standard defines audio coding:
Versatile Video Coding (VVC), also known as H.266, ISO/IEC 23090-3, and MPEG-I Part 3, is a video compression standard finalized on 6 July 2020, by the Joint Video Experts Team (JVET), a joint video expert team of the VCEG working group of ITU-T Study Group 16 and the MPEG working group of ISO/IEC JTC 1/SC 29. It is the successor to High Efficiency Video Coding. It was developed with two primary goals – improved compression performance and support for a very broad range of applications.
JPEG XS is an interoperable, visually lossless, low-latency and lightweight image and video coding system used in professional applications. Applications of the standard include streaming high quality content for virtual reality, drones, autonomous vehicles using cameras, gaming, and broadcasting. In this respect, JPEG XS is unique, being the first ISO codec ever designed for this specific purpose. JPEG XS, built on core technology from both intoPIX and Fraunhofer IIS, is formally standardized as ISO/IEC 21122 by the Joint Photographic Experts Group with the first edition published in 2019. Although not official, the XS acronym was chosen to highlight the eXtra Small and eXtra Speed characteristics of the codec. Today, the JPEG committee is still actively working on further improvements to XS, with the second edition scheduled for publication and initial efforts being launched towards a third edition.
MPEG-5 Essential Video Coding (EVC) is a current video compression standard that has been completed in April 2020 by decision of MPEG Working Group 11 at its 130th meeting.
V-NOVA is a multinational IP and Technology company headquartered in London, UK. It is best known for innovation in data compression technology for video and images. V-Nova has partnered with large organizations including Sky, Xilinx, Nvidia, Eutelsat, and Amazon Web Services to provide its video compression technology.