Filename extension | .heif, .heifs; .heic, .heics; .avci, .avcs; .HIF |
---|---|
Internet media type | image/heif , image/heif-sequence ; image/heic , image/heic-sequence ; image/avif |
Uniform Type Identifier (UTI) | public.heif, public.heic |
Developed by | Moving Picture Experts Group (MPEG) |
Type of format | Image container |
Extended from | ISOBMFF |
Standard | ISO/IEC 23008-12 (MPEG-H Part 12) |
Open format? | Depends on contained format (e.g. HEIC vs. free AV1 Image File Format) |
Website | www |
High Efficiency Image File Format (HEIF) is an international standard defined by MPEG-H Part 12 (ISO/IEC 3008-12), first published by ISO in 2017. It is designed as a container for photographic images in any image encoding. HEIF is a special case of the general ISO BMFF format, in which all data is encapsulated in typed boxes, with a mandatory ftyp box that is used to indicate particular file types. The initial specification for HEIF provided usage details for three compression schemes, the widely supported JPEG encoding for still raster images and two video encodings that are also applicable to still image items, namely Advanced Video Coding (AVC, aka MPEG-4, Part 10 and H.264) and High Efficiency Video Coding (HEVC aka PEG-H Part 2 and H.265).
ISO Base Media File Format official specification (of which HEIF is a special case) defines multiple subtypes in relations to possible encodings:
BMFF HEIC/HEIX Registered Brands
Specific implementations of HEIF encoding are registered by MP4RA and are officially called "brands".
According to official specifications Apple HEIC registered brand is using Main or Main Still Picture profile of HEVC with an 8-bit per channel color depth and chroma subsampling of 4:2:0, while Sony and Canon HIEX registered brand may additionally increase the bit-depth to 10 bits per channel and chroma subsampling to 4:2:2 or 4:4:4.
Licensing and Patents
If BMFF HEIF is used with HEVC encoding it is worth noting that HEV is heavily encumbered with patents and Library of Congress does not recommend of using such heavily patent troublesome formats. The parties holding patents on HEVC include but are not limited to:
The uncertainty of patent encumbering is farther strengthened by unclear patents holders wordings. Holders of relevant patents, stated to the ISO that "the holders of these patent rights have assured the ISO and IEC that they are willing to negotiate licenses under reasonable and non-discriminatory terms." The specification also cautions that "some of the elements . . . may be the subject of patent rights other than those identified."
The requirements and main use cases of HEIF were defined in 2013. [1] [2] The technical development of the specification took about one and a half years and was finalized in the middle of 2015. [3]
Apple was the first major adopter of the format in 2017 with the introduction of iOS 11 using HEIC variant. While HEIC became the default for iPhones, it remains possible to revert the settings to allow photos to be recorded in the more recognizable JPEG format. [4]
Android devices containing the appropriate hardware encoders received support for HEIC files with the release of Android 10 (2019). [5]
On some systems, pictures stored in the HEIC format are converted automatically to the older JPEG format when they are sent outside of the system, although incompatibility has led to problems such as US Advanced Placement test takers failing due to their phones uploading unsupported HEIC images by default, [6] leading the College Board to request students change the settings to send only JPEG files. [7]
Although HEIC is gaining in popularity there are issues with compatibility. For example, Adobe Photoshop is a popular image editing software that only supports 8-bit HEIC and not 10-bit or 12-bit HEIC yet. [8]
Camera hardware (including mobile devices) are increasingly supporting outputting HEIC files and with color depth often higher than 8-bit color. [9]
HEIF files can store the following types of data: [10]
The HEIF container specification describes various encodings that can be stored inside it:
These may lead to confusion, since if a user creates or receives a .heif
image, they cannot immediately determine which image encoding was used. Furthermore, presenting HEIF as better than JPEG may be misleading since the truth of that statement depends on chosen encoding.
The Multi-Image Application Format (MIAF) is a restricted subset of HEIF specified as part of MPEG-A. It defines a set of additional constraints to simplify format options, specific alpha plane formats, profiles, and levels as well as metadata formats and brands, and rules for how to extend the format. [11]
High Efficiency Video Coding (HEVC, ITU-T H.265) [12] is an encoding format for graphic data, first standardized in 2013. It is the primarily used and implied default codec for HEIF as specified in the normative Annex B to ISO/IEC 23008-12 HEVC Image File Format.
While not introduced formally in the standard, the acronym HEIC (High-Efficiency Image Codec) is used as a brand and in the MIME subtypes image/heic
and image/heic-sequence
. If the content conforms to certain HEVC profiles, more specific brands can be used: HEIX for Main 10 of HEVC, HEIM for (Multiview) Main profile, and HEIS for (Scalable) Main (10) profile of L-HEVC.
A HEIC photo takes up about half the space of an equivalent quality JPEG file. [13] The initial HEIF specification already defined the means of storing HEVC-encoded intra images (i-frames) and HEVC-encoded image sequences in which inter prediction is applied in a constrained manner.
HEVC image players are required to support rectangular cropping and rotation by one, two, and three quarter-turns. The primary use case for the mandatory support for rotation by 90 degrees is for images where the camera orientation is incorrectly detected or inferred. The rotation requirement makes it possible to manually adjust the orientation of a still image or an image sequence without needing to re-encode it. Cropping enables the image to be re-framed without re-encoding. The HEVC file format also includes the option to store pre-derived images. [14]
Samples in image sequence tracks must be either intra-coded images or inter-picture predicted images with reference to only intra-coded images. These constraints of inter-picture prediction reduce the decoding latency for accessing any particular image within a HEVC image sequence track.
The .heic and .heics file name extensions are conventionally used for HEVC-coded HEIF files. [15] Apple products, for instance, [16] will only produce files with these extensions, which indicate clearly that the data went through HEVC encoding. [17]
Advanced Video Coding (AVC, ITU-T H.264) is an older encoding format for video and images, first standardized in 2003. It is also specified as a codec to be supported in HEIF in normative Annex 5 to ISO/IEC 23008-12. The registered MIME types are image/avci
for still images and image/avcs
for sequences. The format is simply known as AVCI.
Apple products support playback of AVC-encoded .avci still image files and .avcs image sequence files [16] but will only generate .heic files.
AV1 is a video encoding format that is intended to be royalty-free, developed by the Alliance for Open Media (AOMedia). AV1 Image File Format (AVIF) is an image format based on this codec. [18]
The registered MIME type is image/avif
for both still images and image sequences, and .avif is the file name extension. [19]
The original JPEG standard is the most commonly used and widely supported lossy image coding format. It was first released in 1992 by ITU-T and ISO/IEC. Although Annex H to ISO/IEC 23008-12 specifies JPEG (and indirectly Motion JPEG) as a possible format for HEIF coded image data, it is used in HEIF only for thumbnails and other secondary images. Therefore, neither a dedicated MIME subtype nor a special file extension is available for storage of JPEG files in HEIF container files.
Several other compression formats defined by the JPEG group can be stored in HEIF files:
In 2017, Apple announced that it would adopt HEIC as the default image format in its new operating systems, gradually replacing JPEG. [27]
This section may require cleanup to meet Wikipedia's quality standards. The specific problem is: reliable and independent English sources are hard to find.(December 2021) |
The proprietary image format WXAM (or wxHEPC) developed by Tencent (used within, e.g., WeChat) is apparently based upon HEVC, [28] as is SharpP, which was developed by their SNG (Social Network Group) division. [29] [30] However, their container format may not be HEIF-compatible. In March 2017, SharpP switched to AVS2 [31] and was renamed TPG (Tiny Portable Graphics). [30] [32]
As of August 2024 [update] , only Safari supports HEIC format natively. [51]
For AVIF, Chrome, Firefox and Opera for desktop and Android support it. Safari on iOS 16 and iPadOS 16 supports AVIF format. [52]
HEIF itself is a container that may not be subject to additional royalty fees for commercial ISOBMFF licensees. Note however that Nokia also grants its patents on a royalty-free basis for non-commercial purposes. [82] When containing images and image sequences encoded in a particular format (e.g. HEVC or AVC) its use becomes subject to the licensing of patents on the coding format. [83] [84] [85]
JPEG is a commonly used method of lossy compression for digital images, particularly for those images produced by digital photography. The degree of compression can be adjusted, allowing a selectable tradeoff between storage size and image quality. JPEG typically achieves 10:1 compression with little perceptible loss in image quality. Since its introduction in 1992, JPEG has been the most widely used image compression standard in the world, and the most widely used digital image format, with several billion JPEG images produced every day as of 2015.
A video codec is software or hardware that compresses and decompresses digital video. In the context of video compression, codec is a portmanteau of encoder and decoder, while a device that only compresses is typically called an encoder, and one that only decompresses is a decoder.
JPEG 2000 (JP2) is an image compression standard and coding system. It was developed from 1997 to 2000 by a Joint Photographic Experts Group committee chaired by Touradj Ebrahimi, with the intention of superseding their original JPEG standard, which is based on a discrete cosine transform (DCT), with a newly designed, wavelet-based method. The standardized filename extension is .jp2 for ISO/IEC 15444-1 conforming files and .jpx for the extended part-2 specifications, published as ISO/IEC 15444-2. The MIME types for JPEG 2000 are defined in RFC 3745. The MIME type for JPEG 2000 is image/jp2.
Motion JPEG is a video compression format in which each video frame or interlaced field of a digital video sequence is compressed separately as a JPEG image.
These tables compare features of multimedia container formats, most often used for storing or streaming digital video or digital audio content. To see which multimedia players support which container format, look at comparison of media players.
An image file format is a file format for a digital image. There are many formats that can be used, such as JPEG, PNG, and GIF. Most formats up until 2022 were for storing 2D images, not 3D ones. The data stored in an image file format may be compressed or uncompressed. If the data is compressed, it may be done so using lossy compression or lossless compression. For graphic design applications, vector formats are often used. Some image file formats support transparency.
High dynamic range (HDR), also known as wide dynamic range, extended dynamic range, or expanded dynamic range, is a signal with a higher dynamic range than usual.
JPEG XR is an image compression standard for continuous tone photographic images, based on the HD Photo specifications that Microsoft originally developed and patented. It supports both lossy and lossless compression, and is the preferred image format for Ecma-388 Open XML Paper Specification documents.
The Video Coding Experts Group or Visual Coding Experts Group is a working group of the ITU Telecommunication Standardization Sector (ITU-T) concerned with standards for compression coding of video, images, audio signals, biomedical waveforms, and other signals. It is responsible for standardization of the "H.26x" line of video coding standards, the "T.8xx" line of image coding standards, and related technologies.
High Efficiency Video Coding (HEVC), also known as H.265 and MPEG-H Part 2, is a video compression standard designed as part of the MPEG-H project as a successor to the widely used Advanced Video Coding. In comparison to AVC, HEVC offers from 25% to 50% better data compression at the same level of video quality, or substantially improved video quality at the same bit rate. It supports resolutions up to 8192×4320, including 8K UHD, and unlike the primarily 8-bit AVC, HEVC's higher fidelity Main 10 profile has been incorporated into nearly all supporting hardware.
The ISO base media file format (ISOBMFF) is a container file format that defines a general structure for files that contain time-based multimedia data such as video and audio. It is standardized in ISO/IEC 14496-12, a.k.a. MPEG-4 Part 12, and was formerly also published as ISO/IEC 15444-12, a.k.a. JPEG 2000 Part 12.
WebP is a raster graphics file format developed by Google intended as a replacement for JPEG, PNG, and GIF file formats. It supports both lossy and lossless compression, as well as animation and alpha transparency.
A video coding format is a content representation format of digital video content, such as in a data file or bitstream. It typically uses a standardized video compression algorithm, most commonly based on discrete cosine transform (DCT) coding and motion compensation. A computer software or hardware component that compresses or decompresses a specific video coding format is a video codec.
Better Portable Graphics (BPG) is a file format for coding digital images, which was created by programmer Fabrice Bellard in 2014. He has proposed it as a replacement for the JPEG image format as the more compression-efficient alternative in terms of image quality or file size. It is based on the intra-frame encoding of the High Efficiency Video Coding (HEVC) video compression standard. Tests on photographic images in July 2014 found that BPG produced smaller files for a given quality than JPEG, JPEG XR and WebP.
AOMedia Video 1 (AV1) is an open, royalty-free video coding format initially designed for video transmissions over the Internet. It was developed as a successor to VP9 by the Alliance for Open Media (AOMedia), a consortium founded in 2015 that includes semiconductor firms, video on demand providers, video content producers, software development companies and web browser vendors. The AV1 bitstream specification includes a reference video codec. In 2018, Facebook conducted testing that approximated real-world conditions, and the AV1 reference encoder achieved 34%, 46.2%, and 50.3% higher data compression than libvpx-vp9, x264 High profile, and x264 Main profile respectively.
High-dynamic-range television (HDR-TV) is a technology that uses high dynamic range (HDR) to improve the quality of display signals. It is contrasted with the retroactively-named standard dynamic range (SDR). HDR changes the way the luminance and colors of videos and images are represented in the signal, and allows brighter and more detailed highlight representation, darker and more detailed shadows, and more intense colors.
JPEG XL is a royalty-free open standard for the compressed representation of raster graphics images. It defines a graphics file format and the abstract device for coding JPEG XL bitstreams. It is developed by the Joint Photographic Experts Group (JPEG) and standardized by the International Electrotechnical Commission (IEC) and the International Organization for Standardization (ISO) as the international standard ISO/IEC 18181 as a superset of JPEG/JFIF encoding, with a compression mode built on a traditional block-based transform coding core and a "modular mode" for synthetic image content and lossless compression. Optional lossy quantization enables both lossless and lossy compression.
AV1 Image File Format (AVIF) is an open, royalty-free image file format specification for storing images or image sequences compressed with AV1 in the HEIF container format. It competes with HEIC, which uses the same container format built upon ISOBMFF, but HEVC for compression. Version 1.0.0 of the AVIF specification was finalized in February 2019. Version 1.1.0 was finalized in April 2022.
JPEG XS is an interoperable, visually lossless, low-latency and lightweight image and video coding system used in professional applications. Target applications of the standard include streaming high-quality content for professional video over IP in broadcast and other applications, virtual reality, drones, autonomous vehicles using cameras, gaming. Although there is not an official acronym definition, XS was chosen to highlight the extra small and extra speed characteristics of the codec.
SharpP工具从17年3月开始,已采用AVS2作为新的内核;17年5月正式对外推出基于AVS2的图片格式,联合北大、AVS组织一起完善相关规范,并命名为TPG(Tiny Portable Graphics)[Since March 2017, SharpP uses AVS2 as its new core. In May 2017, [we] made the new AVS2-based format public, completing the standard with Peking University and AVS the organization, and named it TPG (Tiny Portable Graphics)]
{{cite web}}
: CS1 maint: archived copy as title (link)If there's one major downside to both HEVC and HEIF, it's that they're covered by patents that may need to be licensed for use in various apps and services.
HEIF and HEVC are extensively covered by patents, which means there could be legal implications to implementing HEIF support, particularly in paid software or a hardware product.