Academy Color Encoding System

Last updated September 05, 2024

The Academy Color Encoding System (ACES) is a color image encoding system created under the auspices of the Academy of Motion Picture Arts and Sciences. ACES is characterised by a color accurate workflow, with "seamless interchange of high quality motion picture images regardless of source".^[1]

The system defines its own color primaries based on spectral locus as defined by the CIE xyY specification. The white point is approximate to the chromaticity of CIE Daylight with a Correlated Color Temperature (CCT) of 6000K.^[2] Most ACES compliant image files are encoded in 16-bit half-floats, thus allowing ACES OpenEXR files to encode 30 stops of scene information.^[1] The ACESproxy format uses integers with a log encoding. ACES supports both high dynamic range (HDR) and wide color gamut (WCG).^[1]

The version 1.0 release occurred in December 2014. ACES received a Primetime Engineering Emmy Award in 2012.^[3] The system is standardized in part by the Society of Motion Picture and Television Engineers (SMPTE) standards body.

History

Background

The ACES project began its development in 2004 in collaboration with 50 industry technologists.^[4] The project began due to the recent incursion of digital technologies into the motion picture industry. The traditional motion picture workflow had been based on film negatives, and with the digital transition, scanning of negatives and digital camera acquisition. The industry lacked a color management scheme for diverse sources coming from a variety of digital motion picture cameras and film. The ACES system is designed to control the complexity inherent in managing a multitude of file formats, image encoding, metadata transfer, color reproduction, and image interchanges that are present in the current motion picture workflow.

Versions

The following versions are available for the reference implementation:^[5]

A number of pre-release versions were tagged from 0.1 (March 1, 2012) to 0.7.1 (February 26, 2014).
ACES 1.0 (December 2014) is first release version. Three small patches followed.
ACES 1.1 (June 21, 2018) adds some ODTs for P3, Rec. 2020, and DCDM.
ACES 1.2 (April 1, 2020) introduces three new specification documents: ACES Metadata File (AML), updated Common LUT Format, new ACES Project Organization and Development Procedure. It also adds some transformations.
ACES 1.3 (April 30, 2021) adds a colorspace conversion for Sony Venice, a gamut compression method for saturated objects, and some AMF refinements.^[6]

System overview

The system comprises several components which are designed to work together to create a uniform workflow:

Academy Color Encoding Specification (ACES): The specification that defines the ACES color space, allowing half-float high-precision encoding in scene linear light as exposed in a camera, and archival storage in files.
Input Device Transform (IDT): This name was deprecated in ACES version 1.0 and replaced by Input Transform.
Input Transform (IT): The process that takes captured images from any indigestible source material and transforms the content into the ACES color space and encoding specifications. There are many IT’s, which are specific to each class of capture device and likely specified by the manufacturer using ACES guidelines. It is recommended that a different IT be used for tungsten versus daylight lighting conditions.
Look Modification Transform (LMT): A specific change in look that is applied systematically in combination with the RRT and ODT’s. (part of the ACES Viewing Transform)
Output Transform: As per ACES version 1.0 naming convention, this is the overall mapping from the standard scene-referred ACES colorimetry (SMPTE 2065-1 color space) to the output-referred colorimetry of a specific device or family of devices. It is always the concatenation of the Reference Rendering Transform (RRT) and a specific Output Device Transform (ODT), as defined below. For this reason the Output Transform is usually shortened in "RRT+ODT".
Reference Rendering Transform (RRT): Converts the scene-referred colorimetry to display-referred, and resembles traditional film image rendering with an S-shaped curve. It has a larger gamut and dynamic range available to allow for rendering to any output device (even ones not yet in existence).
Output Device Transform (ODT): A guideline for rendering the large gamut and wide dynamic range of the RRT to a physically realized output device with limited gamut and dynamic range. There are many ODT’s, which will be likely generated by the manufacturers to the ACES guidelines.
Academy Viewing Transform: A combined reference of a LMT and an Output Transform, i.e. "LMT+RRT+ODT".
Academy Printing Density (APD): A reference printing density defined by the AMPAS for calibrating film scanners and film recorders.
Academy Density Exchange (ADX): A densitometric encoding similar to Kodak's Cineon used for capturing data from film scanners.
ACES color space SMPTE Standard 2065-1 (ACES2065-1): The principal scene-referred color space used in the ACES framework for storing images. Standardized by SMPTE as document ST2065-1. Its gamut includes the full CIE standard observer's gamut with radio-metrically linear transfer characteristics.
ACEScc (ACES color correction space): A color space definition that is slightly larger than the ITU Rec.2020 color space and logarithmic transfer characteristics for improved use within color correctors and grading tools.
ACEScct (ACES color correction space with toe): A color space definition that is slightly larger than the ITU Rec.2020 color space and logarithmic-ally encoded for improved use within color correctors and grading tools that resembles the toe behavior of Cineon files.
ACEScg (ACES computer graphics space): A color space definition that is slightly larger than the ITU Rec.2020 color space and linearly encoded for improved use within computer graphics rendering and compositing tools.
ACESproxy (ACES proxy color space): A color space definition that is slightly larger than the ITU Rec.2020 color space, logarithmic-ally encoded (like ACEScc, not like ACEScct) and represented with either 10-bits/channel or 12-bits/channel, integer-arithmetics digital representation. This encoding is exclusively designed for transport-only of code values across digital devices that don't support floating-point arithmetic encodings, like SDI cables, monitors, and infrastructure in general.

ACES Color Spaces

ACES 1.0 is a color encoding system, defining one core archival color space, and then four additional working color spaces, and additional file protocols. The ACES system is designed to cover the needs film and television production, relating to the capture, generation, transport, exchange, grading, processing, and short & long term storage of motion picture and still image data. These color spaces all have a few common characteristics:

They are based on the RGB color model.
The image data is scene-referred, i.e. the numerical values are related to the original scene lighting, as reflected or emitted from the real objects & lights on the set at the time of filming. The space refers to a "standard reference camera", an imaginary camera that can capture all of human visual perception. Scene-referred code values captured by a real camera are directly related to luminous exposure.
They are capable of holding 30 stops of exposure.
The reference white point is sometimes, and incorrectly, referred to as "D60" though there is no such thing as a CIE D60 standard illuminant. Further, the white point is not on the CIE Daylight Locus nor the Planckian Locus, and does not define the neutral axis. Filmmakers are allowed to choose whatever effective whitepoint they need for technical or artistic reasons.
The white point serves only as a mathematical reference for transforms, and should not be confused with a scene or display reference. It was chosen through an experiment, projecting film containing a LAD test patch onto a theater screen, using a projector with a xenon bulb. That measured white point was then adjusted to be close to, but not on, the CIE daylight locus. The CCT is close to 6000k, with CIE 1931 xy chromaticities of $(0.32168,0.33767)$ .^[7]

The five color spaces use one of two defined sets of RGB color primaries called AP0 and AP1 (“ACES Primaries” #0 and #1); The chromaticity coordinates are listed in the table below:

ACES Primary and White Point Coordinates
CIE 1931	AP0: ACES 2065-1			White Point	AP1: cg, cc, cct, proxy
CIE 1931	red	green	blue	White Point	red	green	blue
x	0.7347	0.0000	0.0001	0.32168	0.713	0.165	0.128
y	0.2653	1.0000	-0.0770	0.33767	0.293	0.830	0.044

AP0 is defined as the smallest set of primaries that encloses the entire CIE 1931 standard-observer spectral locus; thus theoretically including, and exceeding, all the color stimuli that can be seen by the average human eye. The concept of using non-realizable or imaginary primaries is not new, and is often employed with color systems that wish to render a larger portion of the visible spectral locus. The ProPhoto RGB (developed by Kodak) and the ARRI Wide Gamut (developed by Arri) are two such color spaces. Values outside the spectral locus are maintained with the assumption that they will later be manipulated through color timing or in other cases of image interchange to eventually lie within the locus. This results in color values not being “clipped” or “crushed” as a result of post-production manipulation.

AP1 gamut is smaller than the AP0 primaries, but is still considered “wide gamut”. The AP1 primaries are much closer to realizable primaries, but unlike AP0, none are negative. This is important for use as a working space, for a number of practical reasons:

color-imaging and color-grading operations acting independently on the three RGB channels produce variations naturally-perceived on red, green, blue components. This might not be naturally perceived when operating on the “unbent” RGB axes of AP0 primaries.
all the code values contained in the $[0,1]$ range represent colors that, converted into output-referred colorimetry via their respective Output Transforms (read above), can be displayed with either present or future projection/display technologies.

ACES2065-1

This is the core ACES color space, and the only one using the AP0 RGB primaries. It uses photo-metrically linear transfer characteristics (i.e. gamma of 1.0), and is the only ACES space intended for interchange among facilities, and most importantly, archiving image/video files.

ACES2065-1 code values are linear values scaled in an Input Transform so that:

a perfectly white diffuser would map to $(1,1,1)$ RGB code value.
a photographic exposure of an 18% grey card would map to $(0.18,0.18,0.18)$ RGB code value.

ACES2065-1 code values often exceed $1.0$ for ordinary scenes, and a very high range of speculars and highlights can be maintained in the encoding. The internal processing and storage of ACES2065-1 code values must be in floating-point arithmetics with at least 16 bits per channel. Pre-release versions of ACES, i.e. those prior to 1.0, defined ACES2065-1 as the only color space. Legacy applications might therefore refer to ACES2065-1 when referring to “the ACES color space”. Furthermore, because of its importance and linear characteristics, and being the one based on AP0 primaries, it is also improperly referred to as either “Linear ACES”, “ACES.lin”, “SMPTE2065-1” or even “the AP0 color space”.

Standards are defined for storing images in the ACES2065-1 color space, particularly on the metadata side of things, so that applications honoring ACES framework can acknowledge the color space encoding from the metadata rather than inferring it from other things. For example:

SMPTE ST2065-4 defines the correct encoding of ACES2065-1 still images within OpenEXR files and file sequences and their mandatory metadata flags/fields.
SMPTE 2065-5 defines the correct embedding of ACES2065-1 video sequences within MXF files and their mandatory metadata fields.

ACEScg

ACEScg is a scene-linear encoding, like ACES2065-1, but ACEScg is using the AP1 primaries, which are closer to realizable primaries. ACEScg was developed for use in visual effects work, when it became clear that ACES2065 was not a useful working space due to the negative blue primary, and the extreme distance of the other imaginary primaries.

The AP1 primaries are much closer to the chromaticity diagram of real colors, and importantly, none of them are negative. This is important for rendering and compositing image data as needed for visual effects.

ACEScc & ACEScct

Like ACEScg, ACEScc and ACEScct are using the AP1 primaries. What sets them apart is that instead of a scene-linear transfer encoding, ACEScc and ACEScct use logarithmic curves, which makes them better suited to color-grading. The grading workflow has traditionally used log encoded image data, in large part as the physical film used in cinematography has a logarithmic response to light.

ACEScc is a pure log function, but ACEScct has a "toe" near black, to simulate the minimum density of photographic negative film, and the legacy DPX or Cineon log curve.

Converting ACES2065-1 RGB values to CIE XYZ values

${\begin{bmatrix}X\\Y\\Z\end{bmatrix}}={\begin{bmatrix}0.9525523959&0.0000000000&0.0000936786\\0.3439664498&0.7281660966&-0.0721325464\\0.0000000000&0.0000000000&1.0088251844\end{bmatrix}}{\begin{bmatrix}R\\G\\B\end{bmatrix}}$

Converting CIE XYZ values to ACES2065-1 values

${\begin{bmatrix}R\\G\\B\end{bmatrix}}={\begin{bmatrix}1.0498110175&0.0000000000&-0.0000974845\\-0.4959030231&1.3733130458&0.0982400361\\0.0000000000&0.0000000000&0.9912520182\end{bmatrix}}{\begin{bmatrix}X\\Y\\Z\end{bmatrix}}$

Standards

ACES is defined by several Standards by SMPTE (ST2065 family) and documentations by AMPAS, which include:^[8]

SMPTE ST 2065-1:2012 - Academy Color Encoding Specification (ACES)
SMPTE ST 2065-2:2012 - Academy Printing Density (APD): Spectral Responsivities, Reference Measurement Device and Spectral Calculation
SMPTE ST 2065-3:2012 - Academy Density Exchange Encoding (ADX): Encoding Academy Printing Density (APD) Values
SMPTE ST 2065-4:2013 - ACES Image Container File Layout
SMPTE ST 2065-5:2016 - Material Exchange Format: Mapping ACES Image Sequences into the MXF Generic Container
S-2013-001 - ACESproxy: An Integer Log Encoding of ACES Image Data
S-2014-003 - ACEScc: A Logarithmic Encoding of ACES Data for use within Color Grading Systems
S-2014-004 - ACEScg: A Working Space for CGI Render and Compositing
S-2016-001 - ACEScct: A Quasi-Logarithmic Encoding of ACES Data for use within Color Grading Systems
P-2013-001 - Recommended Procedures for the Creation and Use of Digital Camera System Input Device Transforms (IDTs)
TB-2014-001 - Academy Color Encoding System (ACES) Documentation Guide
TB-2014-002 - Academy Color Encoding System (ACES) Version 1.0 User Experience Guidelines
TB-2014-004 - Informative Notes on SMPTE ST 2065-1 - Academy Color Encoding Specification (ACES)
TB-2014-005 - Informative Notes on SMPTE ST 2065-2 - Academy Printing Density (APD) – Spectral Responsivities, Reference Measurement Device and Spectral Calculation and SMPTE ST 2065-3 Academy Printing Density Exchange Encoding (ADX) - Encoding Printing Density (APD) Values
TB-2014-006 - Informative Notes on SMPTE ST 2065-4 - ACES Image Container File Layout
TB-2014-007 - Informative Notes on SMPTE ST 268:2014 – File Format for Digital Moving Picture Exchange (DPX)
TB-2014-009 - Academy Color Encoding System (ACES) Clip-level Metadata File Format Definition and Usage
TB-2014-010 - Design, Integration and Use of ACES Look Modification Transforms
TB-2014-012 - Academy Color Encoding System (ACES) Version 1.0 Component Names
TB-2018-001 - Derivation of the ACES White Point CIE Chromaticity Coordinates

A SMPTE standard is also under development to allow ACES code streams to be mapped to the Material Exchange Format (MXF) container.^[9]

Related Research Articles

The RGB color model is an additive color model in which the red, green and blue primary colors of light are added together in various ways to reproduce a broad array of colors. The name of the model comes from the initials of the three additive primary colors, red, green, and blue.

Gamma correction or gamma is a nonlinear operation used to encode and decode luminance or tristimulus values in video or still image systems. Gamma correction is, in the simplest cases, defined by the following power-law expression:

Y′UV, also written YUV, is the color model found in the PAL analogue color TV standard. A color is described as a Y′ component (luma) and two chroma components U and V. The prime symbol (') denotes that the luma is calculated from gamma-corrected RGB input and that it is different from true luminance. Today, the term YUV is commonly used in the computer industry to describe colorspaces that are encoded using YCbCr.

RGB color spaces is a category of additive colorimetric color spaces specifying part of its absolute color space definition using the RGB color model.

The CIELAB color space, also referred to as L*a*b*, is a color space defined by the International Commission on Illumination in 1976. It expresses color as three values: L* for perceptual lightness and a* and b* for the four unique colors of human vision: red, green, blue and yellow. CIELAB was intended as a perceptually uniform space, where a given numerical change corresponds to a similar perceived change in color. While the LAB space is not truly perceptually uniform, it nevertheless is useful in industry for detecting small differences in color.

In color reproduction and colorimetry, a gamut, or color gamut, is a convex set containing the colors that can be accurately represented, i.e. reproduced by an output device or measured by an input device. Devices with a larger gamut can represent more colors. Similarly, gamut may also refer to the colors within a defined color space, which is not linked to a specific device. A trichromatic gamut is often visualized as a color triangle. A less common usage defines gamut as the subset of colors contained within an image, scene or video.

<span class="mw-page-title-main">YCbCr</span> Family of digital colour spaces

YCbCr, Y′CbCr, or Y Pb/Cb Pr/Cr, also written as YC_BC_R or Y′C_BC_R, is a family of color spaces used as a part of the color image pipeline in video and digital photography systems. Y′ is the luma component and C_B and C_R are the blue-difference and red-difference chroma components. Y′ is distinguished from Y, which is luminance, meaning that light intensity is nonlinearly encoded based on gamma corrected RGB primaries.

sRGB is a standard RGB color space that HP and Microsoft created cooperatively in 1996 to use on monitors, printers, and the World Wide Web. It was subsequently standardized by the International Electrotechnical Commission (IEC) as IEC 61966-2-1:1999. sRGB is the current defined standard colorspace for the web, and it is usually the assumed colorspace for images that are neither tagged for a colorspace nor have an embedded color profile.

The Adobe RGB (1998) color space or opRGB is a color space developed by Adobe Inc. in 1998. It was designed to encompass most of the colors achievable on CMYK color printers, but by using RGB primary colors on a device such as a computer display. The Adobe RGB (1998) color space encompasses roughly 30% of the visible colors specified by the CIELAB color space – improving upon the gamut of the sRGB color space, primarily in cyan-green hues. It was subsequently standardized by the IEC as IEC 61966-2-5:1999 with a name opRGB and is used in HDMI.

The ProPhoto RGB color space, also known as ROMM RGB, is an output referred RGB color space developed by Kodak. It offers an especially large gamut designed for use with photographic output in mind. The ProPhoto RGB color space encompasses over 90% of possible surface colors in the CIE L*a*b* color space, and 100% of likely occurring real-world surface colors documented by Michael Pointer in 1980, making ProPhoto even larger than the Wide-gamut RGB color space. The ProPhoto RGB primaries were also chosen in order to minimize hue rotations associated with non-linear tone scale operations. One of the downsides to this color space is that approximately 13% of the representable colors are imaginary colors that do not exist and are not visible colors.

In 1931 the International Commission on Illumination (CIE) published the CIE 1931 color spaces which define the relationship between the visible spectrum and the visual sensation of specific colors by human color vision. The CIE color spaces are mathematical models that create a "standard observer", which attempts to predict the perception of unique hues of color. These color spaces are essential tools that provide the foundation for measuring color for industry, including inks, dyes, and paints, illumination, color imaging, etc. The CIE color spaces contributed to the development of color television, the creation of instruments for maintaining consistent color in manufacturing processes, and other methods of color management.

LMS, is a color space which represents the response of the three types of cones of the human eye, named for their responsivity (sensitivity) peaks at long, medium, and short wavelengths.

scRGB is a wide color gamut RGB color space created by Microsoft and HP that uses the same color primaries and white/black points as the sRGB color space but allows coordinates below zero and greater than one. The full range is −0.5 through just less than +7.5.

<span class="mw-page-title-main">Progressive Graphics File</span> File format

PGF is a wavelet-based bitmapped image format that employs lossless and lossy data compression. PGF was created to improve upon and replace the JPEG format. It was developed at the same time as JPEG 2000 but with a focus on speed over compression ratio.

Rec. 709, also known as Rec.709, BT.709, and ITU 709, is a standard developed by ITU-R for image encoding and signal characteristics of high-definition television.

A color space is a specific organization of colors. In combination with color profiling supported by various physical devices, it supports reproducible representations of color – whether such representation entails an analog or a digital representation. A color space may be arbitrary, i.e. with physically realized colors assigned to a set of physical color swatches with corresponding assigned color names, or structured with mathematical rigor. A "color space" is a useful conceptual tool for understanding the color capabilities of a particular device or digital file. When trying to reproduce color on another device, color spaces can show whether shadow/highlight detail and color saturation can be retained, and by how much either will be compromised.

DCI-P3 is a color space defined in 2005 as part of the Digital Cinema Initiative, for use in theatrical digital motion picture distribution (DCDM). Display P3 is a variant developed by Apple Inc. for wide-gamut displays.

IC_TC_P, ICtCp, or ITP is a color representation format specified in the Rec. ITU-R BT.2100 standard that is used as a part of the color image pipeline in video and digital photography systems for high dynamic range (HDR) and wide color gamut (WCG) imagery. It was developed by Dolby Laboratories from the IPT color space by Ebner and Fairchild. The format is derived from an associated RGB color space by a coordinate transformation that includes two matrix transformations and an intermediate nonlinear transfer function that is informally known as gamma pre-correction. The transformation produces three signals called I, C_T, and C_P. The IC_TC_P transformation can be used with RGB signals derived from either the perceptual quantizer (PQ) or hybrid log–gamma (HLG) nonlinearity functions, but is most commonly associated with the PQ function.

ITU-R Recommendation BT.2100, more commonly known by the abbreviations Rec. 2100 or BT.2100, introduced high-dynamic-range television (HDR-TV) by recommending the use of the perceptual quantizer or hybrid log–gamma (HLG) transfer functions instead of the traditional "gamma" previously used for SDR-TV.

References

1 2 3 "What are the Advantages of using ACES for Color Correction?". Oscars.org. 19 November 2015. Retrieved 2016-12-02.
↑ "Derivation of the ACES White Point CIE Chromaticity Coordinates". docs.acescentral.com. Retrieved 2022-07-01.
↑ "Winners of the 64th Primetime Emmy Engineering Awards Announced - InteractiveTV Today". Itvt.com. Archived from the original on 2013-05-09. Retrieved 2013-03-08.
↑ "Academy Color Encoding System | Science & Technology Council | Academy of Motion Picture Arts & Sciences". Oscars.org. 2012-08-24. Retrieved 2013-12-20.
↑ "aces-dev/CHANGELOG.md at dev · ampas/aces-dev". GitHub.
↑ Tobenkin, Steve (3 May 2021). "ACES 1.3 is Available!". ACESCentral.
↑ "TB-2018-001 Derivation of the ACES White Point CIE Chromaticity Coordinates" . Retrieved 26 June 2018.
↑ "ACES Documentation". Oscars.org. 29 April 2015. Retrieved 2016-09-24.
↑ "31FS ACES Codestreams in MXF". Oscars.org. Archived from the original on 2016-09-27. Retrieved 2016-09-24.

External links

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.

[oscars1-1] 1 2 3 "What are the Advantages of using ACES for Color Correction?". Oscars.org. 19 November 2015. Retrieved 2016-12-02.

[2] "Derivation of the ACES White Point CIE Chromaticity Coordinates". docs.acescentral.com. Retrieved 2022-07-01.

[3] "Winners of the 64th Primetime Emmy Engineering Awards Announced - InteractiveTV Today". Itvt.com. Archived from the original on 2013-05-09. Retrieved 2013-03-08.

[4] "Academy Color Encoding System | Science & Technology Council | Academy of Motion Picture Arts & Sciences". Oscars.org. 2012-08-24. Retrieved 2013-12-20.

[5] "aces-dev/CHANGELOG.md at dev · ampas/aces-dev". GitHub.

[6] Tobenkin, Steve (3 May 2021). "ACES 1.3 is Available!". ACESCentral.

[7] "TB-2018-001 Derivation of the ACES White Point CIE Chromaticity Coordinates" . Retrieved 26 June 2018.

[2016ACESdocumentation-8] "ACES Documentation". Oscars.org. 29 April 2015. Retrieved 2016-09-24.

[2016ACESCodestreamstoMXF-9] "31FS ACES Codestreams in MXF". Oscars.org. Archived from the original on 2016-09-27. Retrieved 2016-09-24.

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

v t e Color space
List of color spaces Color models
CAM	CIECAM02 iCAM CAM16 CIECAM16
CIE	XYZ (1931) RGB (1931) YUV (1960) UVW (1964) CIELAB (1976) CIELUV (1976) CIECAM02 CIECAM16
RGB	RGB color spaces sRGB rg chromaticity Adobe Wide-gamut ProPhoto scRGB DCI-P3 Rec. 601 SMPTE 240M/"C" Rec. 709 Rec. 2020 Rec. 2100
Y′UV	YUV PAL YDbDr SECAM YIQ NTSC YCbCr Rec. 601 Rec. 709 Rec. 2020 Rec. 2100 ICtCp Rec. 2100 YPbPr MAC xvYCC YCoCg
Other	CcMmYK CMYK ColorADD Coloroid LMS Hexachrome HSL, HSV HCL Imaginary color Oklab OSA-UCS PCCS RG RYB HWB YJK TSL
Color systems and standards	ACES ANPA Colour Index International CI list of dyes DIC Federal Standard 595 HKS ICC profile ISCC–NBS Munsell NCS Ostwald Pantone RAL list JIS Z8102 [ ja ]
For the vision capacities of organisms or machines, see Color vision.