Intel Quick Sync Video

Last updated

Intel Quick Sync Video is Intel's brand for its dedicated video encoding and decoding hardware core. Quick Sync was introduced with the Sandy Bridge CPU microarchitecture on 9 January 2011 and has been found on the die of Intel CPUs ever since.

Contents

The name "Quick Sync" refers to the use case of quickly transcoding ("converting") a video from, for example, a DVD or Blu-ray Disc to a format appropriate to, for example, a smartphone. This becomes critically-important in the professional video workplace, in which source-material may have been shot in any number of video-formats, all of which must be brought into a common format (commonly H.264) for inter-cutting.

Unlike video encoding on a CPU or a general-purpose GPU, Quick Sync is a dedicated hardware core on the processor die. This allows for much more power-efficient video processing. [1] [2]

Availability

Quick Sync Video is available on Core i3, Core i5, Core i7, and Core i9 processors starting with Sandy Bridge, and Celeron & Pentium processors starting with Haswell. [3] [4]

Performance and quality

Like most desktop hardware-accelerated encoders, Quick Sync has been praised for its speed. [5] The eighth annual MPEG-4 AVC/H.264 video codecs comparison showed that Quick Sync was comparable to x264 superfast preset in terms of speed, compression ratio and quality (SSIM); [6] tests were performed on an Intel Core i7 3770 (Ivy Bridge) processor. However, Quick Sync could not be configured to spend more time to achieve higher quality, whereas x264 improved significantly when allowed to use more time using the recommended settings. [6]

A 2012 evaluation by AnandTech showed that QuickSync on Intel's Ivy Bridge produced similar image quality compared to the NVENC encoder on Nvidia's GTX 680 while performing much better at resolutions lower than 1080p. [7]

Development

Quick Sync was first unveiled at Intel Developer Forum 2010 (September 13) but, according to Tom's Hardware, Quick Sync had been conceptualized five years before that. [1] The older Clarkdale microarchitecture had hardware video decoding support, but no hardware encoding support; [5] it was known as Intel Clear Video.

Version 1 (Sandy Bridge)
Quick Sync was initially built into some Sandy Bridge CPUs, but not into Sandy Bridge Pentiums or Celerons. It adds H.264/AVC encoding and VC-1 decoding acceleration. [8]
Version 2 (Ivy Bridge, Bay Trail)
The Ivy Bridge microarchitecture included a "next-generation" implementation of Quick Sync. [9]
Version 3 (Haswell)
The Haswell microarchitecture implementation adds H.262/MPEG-2 Part 2 encoding acceleration. [1] An open-source hybrid driver was developed which supports partial VP8 encoding and VP9 decoding acceleration under Linux by utilizing both the integrated GPU and CPU. [10] [11] Started from Haswell, Pentiums and Celerons have included QSV technology. [12]
Version 4 (Broadwell)
The Broadwell microarchitecture implementation adds VP8 hardware decoding. [13] Also, it has two independent bit stream decoder (BSD) rings to process video commands on GT3 GPUs; this allows one BSD ring to process decoding and the other BSD ring to process encoding at the same time. [14]
Version 5 (Skylake)
The Skylake microarchitecture implementation adds a full fixed-function H.265/HEVC 8-bit 4:2:0 decoding and encoding acceleration, hybrid and partial HEVC 10-bit decoding acceleration, JPEG encoding acceleration for resolutions up to 16,000×16,000 pixels, and partial VP9 decoding and encoding acceleration. [15]
Version 6 (Kaby Lake, Coffee Lake, Whiskey Lake, Comet Lake)
The Kaby Lake, Coffee Lake, Whiskey Lake and Comet Lake microarchitectures implementation adds full fixed-function H.265/HEVC 10-bit 4:2:0 decoding and encoding acceleration, and full fixed-function VP9 8-bit and 10-bit decoding acceleration and 8-bit encoding acceleration. [16] [17]
Version 7 (Ice Lake)
The Ice Lake microarchitecture implementation adds VP9 8-bit and 10-bit decoding and encoding acceleration, H.265/HEVC 8-bit and 10-bit decoding and encoding acceleration with 4:2:2 and 4:4:4 chroma subsampling, [18] HDR10 Tone Mapping [19] and Open Source Media Shaders. [20] HEVC hardware encoding quality has also been improved. [21]
Version 8 (Tiger Lake, Rocket Lake, Alder Lake, Raptor Lake)
The Tiger Lake, Rocket Lake, Alder Lake & Raptor Lake microarchitectures implementation adds VP9 12-bit & 12-bit 4:4:4 hardware decoding and HEVC 12-bit 4:2:0, 4:2:2 and 4:4:4 hardware decoding. [22] Gen12 Xe will also support native AV1 decode, which includes 10-bit 4:2:0 16K stills and 10-bit 4:2:0 8K, 4K and 2K video. [23] Hardware encoding for VP8 was dropped and hardware decoding is only available on Tiger Lake. [18]
Version 9 (Intel Arc Alchemist, Meteor Lake, Arrow Lake)
Intel Arc Alchemist (discrete GPUs) adds 8K 10-bit AV1 hardware encoding. [24]

Operating system support

The Quick Sync Video SIP core needs to be supported by the device driver. The device driver provides one or more interfaces, for example VDPAU, Video Acceleration API (VA-API) or DXVA for video decoding, and OpenMAX IL or VA API for video encoding. One of these interfaces is then used by end-user software, for example VLC media player or GStreamer, to access the Quick Sync Video hardware and make use of it.

Linux

Quick Sync support on Linux is available by both Intel VAAPI Driver (legacy, pre-Broadwell) and Intel Media Driver (Broadwell and newer) which also uses VA-API, [25] [26] and through the Intel Media SDK. As of November 2013 it is supported by Wowza Streaming Engine (formerly known as Wowza Media Server) for transcoding of media streams using their transcoder add-on. [27]

Windows

Microsoft offers support for Quick Sync in Windows (in Windows Vista and later) based on supporting driver software from Intel and support through both DirectX as well as WMF (Windows Media Foundation). A wide range of applications are based upon this base support for the technology in Windows.

macOS

Apple added Quick Sync support in OS X Mountain Lion for AirPlay, FaceTime, iTunes, Safari, QuickTime X, iMovie, Final Cut Pro X, Motion and Compressor. Third-party software includes Adobe Premiere Pro, Adobe Media Encoder, DaVinci Resolve and others.

Hardware decoding and encoding

Support for Quick Sync hardware accelerated decoding of H.264, MPEG-2, and VC-1 video is widely available. One common way to gain access to the technology on Microsoft Windows is by use of the free ffdshow filter. Some other free software like VLC media player (since version 2.1.0 "Rincewind") supports Quick Sync as well. Many commercial applications also benefit from the technology today, including CyberLink PowerDVD, CyberLink PowerDirector and MacroMotion Bogart "gold" edition.

According to the ffdshow documentation, Quick Sync has very low CPU utilization while being about twice as fast as libavcodec. [28]

Support for hardware-assisted media encoding tailored for Quick Sync is widely available. Examples of such software with Quick Sync support during encoding processes are Emby Media Server, [29] Plex Media Server, [30] Badaboom Media Converter, CyberLink MediaShow, CyberLink MediaEspresso, ArcSoft MediaConverter, MAGIX Video Pro X, Pinnacle Studio (since version 18), Roxio Toast, Roxio Creator, XSplit Broadcaster, [31] XSplit Gamecaster [32] (all commercial) and projects like HandBrake, [33] [34] Open Broadcaster Software [35] or applications for operation with a video content entering in Adobe CC2018.

The following table shows fixed-function encode/decode support for various Intel platforms. [36] [37] Support for hybrid and/or partial decode/encode are not detailed.

Fixed-function Quick Sync Video format support
Cantiga Clarkdale / Arrandale Sandy Bridge Ivy Bridge / Haswell Broadwell Braswell / Cherry Trail Skylake Apollo Lake [38] Kaby Lake / Coffee Lake / Comet Lake [39] / Whiskey Lake [40] Gemini Lake [41] Ice Lake [42] / Jasper Lake Tiger Lake Rocket Lake / Alder Lake / Raptor Lake [18] Arc Alchemist [43] / Meteor Lake / Arrow Lake
MPEG-2 Decode onlyYesDecode only
AVC NoDecode only

(High 10 not supported)

Yes

(High 10 not supported)

Yes (L5.2/L5.1)Yes (L5.1)Yes (L5.2)Yes (L5.1)Yes (L5.2)Yes (L5.2/L5.1)Yes

(High 10 not supported)

VC-1 NoDecode onlyNo
JPEG NoDecode onlyYes
VP8 NoPartial encode on Linux only (Haswell)Decode only, partial encode on Linux onlyYesDecode onlyNo
HEVC NoDecode only (L5)Yes (L5.1)Yes (L5.1/L5)Yes (L5.1)Yes (L5.1/L5)Yes (L5.1)Yes
HEVC 10-bitNoDecode only (8K)Yes [44]
HEVC 12-bitNoYes

(Encode at 4:2:0 only) [45]

VP9 NoPartially-accelerated decoding on Linux only

(Haswell Refresh to Skylake) [46]

Decode onlyYes
VP9 10-bitNoDecode onlyYes [47]
VP9 12-bitNoDecode only
AV1 No [48] Decode onlyYes
AV1 10-bitNoDecode onlyYes
AV1 12-bitNoDecode only

Certain low-end and high-end parts (including multi-socket Xeons and some Extreme Edition CPUs expected to be used with a dedicated GPU) do not contain the hardware core to support Quick Sync.

See also

Video Hardware Technologies

AMD

Intel

  • Quick Sync Video
  • Clear Video – video decoding using a general purpose Intel GPU

Nvidia

Others

Related Research Articles

<span class="mw-page-title-main">Sandy Bridge</span> Intel processor microarchitecture

Sandy Bridge is the codename for Intel's 32 nm microarchitecture used in the second generation of the Intel Core processors. The Sandy Bridge microarchitecture is the successor to Nehalem and Westmere microarchitecture. Intel demonstrated an A1 stepping Sandy Bridge processor in 2009 during Intel Developer Forum (IDF), and released first products based on the architecture in January 2011 under the Core brand.

Unified Video Decoder is the name given to AMD's dedicated video decoding ASIC. There are multiple versions implementing a multitude of video codecs, such as H.264 and VC-1.

PureVideo is Nvidia's hardware SIP core that performs video decoding. PureVideo is integrated into some of the Nvidia GPUs, and it supports hardware decoding of multiple video codec standards: MPEG-2, VC-1, H.264, HEVC, and AV1. PureVideo occupies a considerable amount of a GPU's die area and should not be confused with Nvidia NVENC. In addition to video decoding on chip, PureVideo offers features such as edge enhancement, noise reduction, deinterlacing, dynamic contrast enhancement and color enhancement.

Video Acceleration API (VA-API) is an open source application programming interface that allows applications such as VLC media player or GStreamer to use hardware video acceleration capabilities, usually provided by the graphics processing unit (GPU). It is implemented by the free and open-source library libva, combined with a hardware-specific driver, usually provided together with the GPU driver.

<span class="mw-page-title-main">Haswell (microarchitecture)</span> Intel processor microarchitecture

Haswell is the codename for a processor microarchitecture developed by Intel as the "fourth-generation core" successor to the Ivy Bridge. Intel officially announced CPUs based on this microarchitecture on June 4, 2013, at Computex Taipei 2013, while a working Haswell chip was demonstrated at the 2011 Intel Developer Forum. With Haswell, which uses a 22 nm process, Intel also introduced low-power processors designed for convertible or "hybrid" ultrabooks, designated by the "U" suffix.

Video Decode and Presentation API for Unix (VDPAU) is a royalty-free application programming interface (API) as well as its implementation as free and open-source library distributed under the MIT License. VDPAU is also supported by Nvidia.

<span class="mw-page-title-main">Intel Core</span> Line of CPUs by Intel

Intel Core is a line of multi-core central processing units (CPUs) for midrange, embedded, workstation and enthusiast computer markets marketed by Intel Corporation. These processors displaced the existing mid- to high-end Pentium processors at the time of their introduction, moving the Pentium to the entry level. Identical or more capable versions of Core processors are also sold as Xeon processors for the server and workstation markets.

<span class="mw-page-title-main">Intel Graphics Technology</span> Series of integrated graphics processors by Intel

Intel Graphics Technology (GT) is the collective name for a series of integrated graphics processors (IGPs) produced by Intel that are manufactured on the same package or die as the central processing unit (CPU). It was first introduced in 2010 as Intel HD Graphics and renamed in 2017 as Intel UHD Graphics.

<span class="mw-page-title-main">Skylake (microarchitecture)</span> CPU microarchitecture by Intel

Skylake is Intel's codename for its sixth generation Core microprocessor family that was launched on August 5, 2015, succeeding the Broadwell microarchitecture. Skylake is a microarchitecture redesign using the same 14 nm manufacturing process technology as its predecessor, serving as a tock in Intel's tick–tock manufacturing and design model. According to Intel, the redesign brings greater CPU and GPU performance and reduced power consumption. Skylake CPUs share their microarchitecture with Kaby Lake, Coffee Lake, Whiskey Lake, and Comet Lake CPUs.

<span class="mw-page-title-main">Broadwell (microarchitecture)</span> Fifth generation of Intel Core processors

Broadwell is the fifth generation of the Intel Core processor. It is Intel's codename for the 14 nanometer die shrink of its Haswell microarchitecture. It is a "tick" in Intel's tick–tock principle as the next step in semiconductor fabrication. Like some of the previous tick-tock iterations, Broadwell did not completely replace the full range of CPUs from the previous microarchitecture (Haswell), as there were no low-end desktop CPUs based on Broadwell.

High Efficiency Video Coding implementations and products covers the implementations and products of High Efficiency Video Coding (HEVC).

Nvidia NVENC is a feature in Nvidia graphics cards that performs video encoding, offloading this compute-intensive task from the CPU to a dedicated part of the GPU. It was introduced with the Kepler-based GeForce 600 series in March 2012.

<span class="mw-page-title-main">Kaby Lake</span> Intel microprocessor, released in 2016

Kaby Lake is Intel's codename for its seventh generation Core microprocessor family announced on August 30, 2016. Like the preceding Skylake, Kaby Lake is produced using a 14 nanometer manufacturing process technology. Breaking with Intel's previous "tick–tock" manufacturing and design model, Kaby Lake represents the optimized step of the newer process–architecture–optimization model. Kaby Lake began shipping to manufacturers and OEMs in the second quarter of 2016, with its desktop chips officially launched in January 2017.

Ice Lake is Intel's codename for the 10th generation Intel Core mobile and 3rd generation Xeon Scalable server processors based on the Sunny Cove microarchitecture. Ice Lake represents an Architecture step in Intel's process–architecture–optimization model. Produced on the second generation of Intel's 10 nm process, 10 nm+, Ice Lake is Intel's second microarchitecture to be manufactured on the 10 nm process, following the limited launch of Cannon Lake in 2018. However, Intel altered their naming scheme in 2020 for the 10 nm process. In this new naming scheme, Ice Lake's manufacturing process is called simply 10 nm, without any appended pluses.

Tiger Lake is Intel's codename for the 11th generation Intel Core mobile processors based on the Willow Cove Core microarchitecture, manufactured using Intel's third-generation 10 nm process node known as 10SF. Tiger Lake replaces the Ice Lake family of mobile processors, representing an optimization step in Intel's process–architecture–optimization model.

Nvidia NVDEC is a feature in its graphics cards that performs video decoding, offloading this compute-intensive task from the CPU.

Goldmont Plus is a microarchitecture for low-power Atom, Celeron and Pentium Silver branded processors used in systems on a chip (SoCs) made by Intel. The Gemini Lake platform with 14 nm Goldmont Plus core was officially launched on December 11, 2017. Intel launched the Gemini Lake Refresh platform on November 4, 2019.

Video Core Next is AMD's brand for its dedicated video encoding and decoding hardware core. It is a family of hardware accelerator designs for encoding and decoding video, and is built into AMD's GPUs and APUs since AMD Raven Ridge, released January 2018.

Rocket Lake is Intel's codename for its 11th generation Core microprocessors. Released on March 30, 2021, it is based on the new Cypress Cove microarchitecture, a variant of Sunny Cove backported to Intel's 14 nm process node. Rocket Lake cores contain significantly more transistors than Skylake-derived Comet Lake cores.

References

  1. 1 2 3 "Intel's Second-Gen Core CPUs: The Sandy Bridge Review - Sandy Bridge's Secret Weapon: Quick Sync". Tom's Hardware. 3 January 2011. Retrieved 2011-08-30.
  2. "The Sandy Bridge Review: Intel Core i7-2600K, i5-2500K and Core i3-2100 Tested". AnandTech. Retrieved 2014-04-05.
  3. Kevin Parrish (2014-02-27). "Intel Drivers Bring Quick Sync Video to Pentium, Celeron". Tom's Hardware. Retrieved 2022-11-29.
  4. "Release Notes Driver version: 15.36.38.5117" (PDF). 2020-01-10. Retrieved 2020-01-10.
  5. 1 2 "The Sandy Bridge Review: Intel Core i7-2600K, i5-2500K and Core i3-2100 Tested". Anandtech. Retrieved 2011-09-23.
  6. 1 2 "Eighth MPEG-4 AVC/H.264 Video Codecs Comparison". MSU Graphics & Media Lab (Video Group). pp. 135–137 (6.4 Speed/Quality Trade-Off).
  7. Anand Lal Shimpi; Ryan Smith. "The Intel Ivy Bridge (Core i7 3770K) Review". AnandTech . Retrieved 26 March 2019.
  8. "Intel Pentium Processor G620".
  9. "Intel's Roadmap: Ivy Bridge, Panther Point, and SSDs". Anandtech. Retrieved 2011-08-30.
  10. "AUR (en) - intel-hybrid-codec-driver". AUR. 16 July 2017.
  11. "intel/intel-hybrid-driver". GitHub . 27 August 2014.
  12. "Intel Pentium Processor G3250 3M Cache 3.20 GHz Product Specifications".
  13. "VA-API 1.3 Readies Broadwell Support, Adds VP8 Decoding". Phoronix.com. March 18, 2014. Retrieved June 10, 2015.
  14. "Intel Broadwell GT3 Graphics Have Dual BSD Rings". Phoronix.com. Retrieved April 17, 2014.
  15. Cutress, Ian. "The Intel 6th Gen Skylake Review: Core i7-6700K and i5-6600K Tested" . Retrieved 2015-08-06.
  16. Harsh Jain (2016-06-06). "What's New in Intel® Media SDK 2016 R2". Intel . Retrieved 2016-07-27.
  17. "Intel® Media Software Development Kit 2016, R2, Release Notes Version (7.0.0.358)" (PDF). Intel. 2016-06-06. Retrieved 2016-07-27.
  18. 1 2 3 "Intel Media Driver - HW Media Features". GitHub . 24 December 2020.
  19. "Default Driver Build Features". GitHub . 16 October 2021.
  20. "Open Source Shader Media Features". GitHub . 16 October 2021.
  21. "Evolution of Hardware HEVC Encode on 10th Generation Intel® Core™". Archived from the original on 2020-01-29.
  22. "HW Media Features". GitHub . 16 October 2021.
  23. "Release Intel Media Driver Q3'2020 Release · intel/Media-driver". GitHub .
  24. "Intel Arc Graphics for Creators".
  25. "Intel Media For Linux". 01.org. 2018-08-20. Retrieved 2022-09-11.
  26. "Intel® Video and Audio for Linux*". 01.org. 2019-01-14. Retrieved 2022-09-11.
  27. "Wowza Delivers Accelerated Streaming Performance with Intel Media SDK 2013 for Servers".
  28. "H.264/AVC". Codecs. ffdshow-tryout.sourceforge.net.
  29. "Hardware Acceleration Overview". MediaBrowserWiki. Retrieved March 6, 2019.
  30. "Using Hardware-Accelerated Streaming". Plex Support. Retrieved 2018-10-11.
  31. "XSplit Broadcaster". Archived from the original on 2014-03-14.
  32. "XSplit Gamecaster". Archived from the original on 2014-03-14.
  33. "HandBrake Documentation - Intel QuickSync Video". handbrake.fr. Retrieved 2019-10-07.
  34. "HandBrake 1.2.0 Released". handbrake.fr. 2018-12-22. Retrieved 2019-10-07.
  35. "Open Broadcaster Software".
  36. "Intel VA-API driver readme". GitHub . 12 October 2021.
  37. "Intel Quicksync generations by FFMPEG".
  38. Zak Killian (2017-12-05). "Intel takes the lid off the full specs of its Apollo Lake NUCs". The Tech Report. Retrieved 2017-10-20.
  39. "Encode and Decode Capabilities for 7th Generation Intel® Core™ Processors and Newer". 6 August 2021.
  40. "Supported Platforms". GitHub . 3 April 2022.
  41. "New Features of Intel Gemini Lake Processors – HDMI 2.0, 10-bit VP9 Codec, 4-Wide Pipeline, and More". CNXSoft. 2017-08-13. Retrieved 2017-10-20.
  42. "Intel Media Driver - HW Media Features". GitHub . 25 January 2019.
  43. "Intel(R) Media Driver for VAAPI - Decoding/Encoding Features". GitHub . 29 March 2022. Retrieved 2 December 2022.
  44. "VA-API 1.7.3 changelog". GitHub . 12 October 2021.
  45. "except 4:2:2 and 4:4:4".
  46. "Hardware video acceleration - ArchWiki (VA-API drivers comparison table)". ArchWiki. 16 October 2021.
  47. "Known Issues and Limitations #5". GitHub . 16 October 2021.
  48. "Intel Details Gen11 Graphics & Sunny Cove For Icelake".