Cryptomatte

Last updated
Cryptomatte
Original author(s) Jonah Friedman
Andy Jones
Developer(s) Psyop
Initial release10 July 2016;7 years ago (2016-07-10)
Stable release
1.4 / 3 May 2021;3 years ago (2021-05-03)
Preview release
1.5.0.beta / 10 March 2021;3 years ago (2021-03-10)
Repository github.com/Psyop/Cryptomatte
Written in Python, Lua
License BSD 3-clause license
Website github.com/Psyop/Cryptomatte
Blender 2.81 splash screen-render.jpg
Blender 2.81 splash screen-cryptomatte.jpg
Top: The splash screen of blender 2.81 as rendered image
Bottom: The same scene as cryptomatte image view

Cryptomatte is an open-source software created by Jonah Friedman and Andy Jones at Psyop, but is also used synonymously for the specific style of image created by the software or other software working alike.

Contents

Owing to its ubiquity, integration into popular 3D graphic software and rather easy usability, Cryptomatte became a quasi standard in the industry.

Render processing

The program itself creates an ID matte of a scene that can be used to create for example image masks for single or multiple objects in the scene. The ID matte has a very distinctive look and itself is sometimes referred to as cryptomatte. These cryptomatte images are in general very colourful assigning each object or material a different random colour. The program creates mattes that support motion blur, transparency and depth of field using data that is already available at render time. [1]

Supported render engines

Cryptomatte images can be created by several 3D graphic programs like Blender, [2] Autodesk Maya, [3] Autodesk 3ds Max [4] or Houdini [5] and are usually exported using the OpenEXR file format.

Whether a program is able to generate a cryptomatte or not is determined by the used render engine. If a program supports more than one render engine it is possible that it can generate cryptomatte images with one engine while being unable to do so with the other one. Blender, for example, had no option to create a cryptomatte image before version 2.80. [6] With version 2.80 only the path-tracing render engine „Cycles” supported creating a cryptomatte while the newly added real-time render engine „Eevee” did not. The support to create cryptomatte images was added to Eevee with version 2.92 that was published on February 25, 2021 [7] one and a half years after Eevee was first published. [8]

The following render engines are known to support creating cryptomatte images:

Render engine nameShipped withAdded with version
Arnold [9] [10] Autodesk 3ds Max
Autodesk Maya		Arnold 5.2
Cycles [6] BlenderBlender 2.80
Eevee [8] BlenderBlender 2.92
Mantra [11] Houdini Houdini 16.5
Karma [12] HoudiniHoudini 18.5
Modo renderer / mPath [13] Modo Modo 14.2
Redshift [14] Cinema 4D (CPU-only)Redshift 2.6.11
3Delight [15] Katana 3Delight 1.7.32 [15]
Unreal Engine (Movie Render Queue) [16] Unreal Engine4.26
Radeon ProRender [17] Radeon ProRender 3.1
Octane Render [18]
RenderMan [19]
V-Ray [20]

Supported compositing software

Compositing software nameAdded with version
Autodesk Flame 2020 [21]
After Effects 17.0 [22]
Nuke 13.0 [23]
Blender (Compositing Nodes)2.8
Houdini (COP)16.5 [11]
V-Ray (V-Ray Frame Buffer)5 Update 1 [24]
Adobe Photoshop Exr-IO 2.0 [25]
Gaffer0.61.2.0 [26]

Workflow example

In a 3D scene a cryptomatte image can be created that assigns a unique ID to each object. The objects usually also have distinct colours that make a scene with many objects very colourful. The ID matte can be used to pick one or more objects in a scene. The ID matte can either be exported or it can be used by the 3D software itself for compositing.

An example workflow would be to use the cryptomatte image to generate a mask that itself is used to limit an effect to only a certain part of the image. It can thereby be used to quickly create masks without the need of re-rendering a whole scene.

The example workflow for images:

The same workflow for video files:

The masks in the examples can be used to limit a visual effect so that only the cube in the middle is affected.

Licensing

The developers published the program's source code and licensed it under the BSD 3-clause license "to turn it into an ecosystem around an open standard". Their goal was "to see a diverse ecosystem of renderers that can create Cryptomatte images and plugins for compositing applications to decode them". [1]

See also

Related Research Articles

<span class="mw-page-title-main">Digital compositing</span>

Digital compositing is the process of digitally assembling multiple images to make a final image, typically for print, motion pictures or screen display. It is the digital analogue of optical film compositing. It’s part of the VFX processing.

<span class="mw-page-title-main">Blender (software)</span> 3D computer graphics software

Blender is a free and open-source 3D computer graphics software tool set used for creating animated films, visual effects, art, 3D-printed models, motion graphics, interactive 3D applications, virtual reality, and, formerly, video games. Blender's features include 3D modelling, UV mapping, texturing, digital drawing, raster graphics editing, rigging and skinning, fluid and smoke simulation, particle simulation, soft body simulation, sculpting, animation, match moving, rendering, motion graphics, video editing, and compositing.

<span class="mw-page-title-main">Autodesk Maya</span> 3D computer graphics software

Autodesk Maya, commonly shortened to just Maya, is a 3D computer graphics application that runs on Windows, macOS, and Linux, originally developed by Alias and currently owned and developed by Autodesk. It is used to create assets for interactive 3D applications, animated films, TV series, and visual effects.

Autodesk 3ds Max, formerly 3D Studio and 3D Studio Max, is a professional 3D computer graphics program for making 3D animations, models, games and images. It is developed and produced by Autodesk Media and Entertainment. It has modeling capabilities and a flexible plugin architecture and must be used on the Microsoft Windows platform. It is frequently used by video game developers, many TV commercial studios, and architectural visualization studios. It is also used for movie effects and movie pre-visualization. 3ds Max features shaders, dynamic simulation, particle systems, radiosity, normal map creation and rendering, global illumination, a customizable user interface, and its own scripting language.

<span class="mw-page-title-main">Cinema 4D</span> 3D software

Cinema 4D is a 3D software suite developed by the German company Maxon.

COLLADA is an interchange file format for interactive 3D applications. It is managed by the nonprofit technology consortium, the Khronos Group, and has been adopted by ISO as a publicly available specification, ISO/PAS 17506.

<span class="mw-page-title-main">Autodesk Softimage</span> Discontinued 3D graphics software

Autodesk Softimage, or simply Softimage was a 3D computer graphics application, for producing 3D computer graphics, 3D modeling, and computer animation. Now owned by Autodesk and formerly titled Softimage|XSI, the software has been predominantly used in the film, video game, and advertising industries for creating computer generated characters, objects, and environments.

Mudbox is a proprietary computer-based 3D sculpting and painting tool. Currently developed by Autodesk, Mudbox was created by Skymatter, founded by Tibor Madjar, David Cardwell and Andrew Camenisch, former artists of Weta Digital, where the tool was first used to produce the 2005 Peter Jackson remake of King Kong. Mudbox's primary application is high-resolution digital sculpting, texture painting, displacement map creation, and normal map creation, although it is also used as a design tool.

<span class="mw-page-title-main">Kerkythea</span> Standalone rendering system

Kerkythea is a standalone rendering system that supports raytracing and Metropolis light transport, uses physically accurate materials and lighting, and is distributed as freeware. Currently, the program can be integrated with any software that can export files in obj and 3ds formats, including 3ds Max, Blender, LightWave 3D, SketchUp, Silo and Wings3D.

<span class="mw-page-title-main">Digital sculpting</span> Use of software to manipulate a digital object

Digital sculpting, also known as sculpt modeling or 3D sculpting, is the use of software that offers tools to push, pull, smooth, grab, pinch or otherwise manipulate a digital object as if it were made of a real-life substance such as clay.

<span class="mw-page-title-main">3D computer graphics</span> Graphics that use a three-dimensional representation of geometric data

3D computer graphics, sometimes called CGI, 3-D-CGI or three-dimensional computer graphics, are graphics that use a three-dimensional representation of geometric data that is stored in the computer for the purposes of performing calculations and rendering digital images, usually 2D images but sometimes 3D images. The resulting images may be stored for viewing later or displayed in real time.

<span class="mw-page-title-main">LuxCoreRender</span> Open-source physically-based rendering engine

LuxCoreRender is a free and open-source physically based rendering software. It began as LuxRender in 2008 before changing its name to LuxCoreRender in 2017 as part of a project reboot. The LuxCoreRender software runs on Linux, Mac OS X, and Windows.

3D computer graphics software refers to programs used to create 3D computer-generated imagery.

Deep image compositing is a way of compositing and rendering digital images that emerged in the mid-2010s. In addition to the usual color and opacity channels a notion of spatial depth is created. This allows multiple samples in the depth of the image to make up the final resulting color. This technique produces high quality results and removes artifacts around edges that could not be dealt with otherwise.

Autodesk Arnold is a computer program for rendering three-dimensional, computer-generated scenes using unbiased, physically-based, Monte Carlo path tracing techniques. Created in Spain by Marcos Fajardo and later co-developed by his company Solid Angle SL and Sony Pictures Imageworks, Arnold is one of the most widely used photorealistic rendering systems in computer graphics worldwide, particularly in animation and VFX for film and TV. Notable feature films that have used Arnold include Monster House, Cloudy with a Chance of Meatballs, Alice in Wonderland, Thor, Captain America, X-Men: First Class, The Avengers, Space Pirate Captain Harlock, Elysium, Pacific Rim, Gravity, Guardians of the Galaxy, Star Wars: The Force Awakens, Arrival and Blade Runner 2049. Notable television series include Game of Thrones, Westworld, Trollhunters, LOVE DEATH + ROBOTS, Jelly Jamm and The Mandalorian.

<span class="mw-page-title-main">Art of Illusion</span>

Art of Illusion is a free software, and open source software package for making 3D graphics.

<span class="mw-page-title-main">Verge3D</span> Real-time renderer and toolkit software

Verge3D is a real-time renderer and a toolkit used for creating interactive 3D experiences running on websites.

Chaos Corona is a computer-generated imagery 3D rendering software developed by Chaos Czech, a subsidiary of Chaos. It was created by Ondřej Karlík as a student project in 2009 and was developed by a Prague-based company Render Legion under the name Corona Renderer. In 2017, Chaos Group acquired Render Legion, later rebranding the company to Chaos Czech. In 2022, Corona Renderer was rebranded to Chaos Corona.

References

  1. 1 2 Cryptomatte on github.com
  2. ↑ Cryptomatte Node on docs.blender.org
  3. ↑ Cryptomatte in Maya on rmanwiki.pixar.com
  4. ↑ Cryptomatte on docs.arnoldrenderer.com
  5. ↑ Cryptomatte on sidefx.com
  6. 1 2 Blender 2.80 Release Notes: Cycles on wiki.blender.org
  7. ↑ index of blender 2.92 release on download.blender.org
  8. 1 2 Blender 2.92 Release Notes: EEVEE on wiki.blender.org
  9. ↑ Cryptomatte Shader docs.arnoldrenderer.com
  10. ↑ Solid Angle ships Arnold 5.2.1. CG Channel. October 23, 2018
  11. 1 2 What’s new in Houdini 16.5 Side Effects Software
  12. ↑ Karma Renderer FAQs. SideFX
  13. ↑ Foundry ships Modo 14.2. CG Channel. November 13, 2020
  14. ↑ Redshift Version 2.6.11リリースノート (in Japanese). Born Digital. June 12, 2018
  15. 1 2 Changelog - 3DELIGHT. DNA Research
  16. ↑ Movie Render Queue Render Passes. Epic Games
  17. ↑ AMD ships Radeon ProRender 3.1 for Blender and Maya. CG Channel. April 1, 2021.
  18. ↑ CRYPTOMATTE on aoktar.com
  19. ↑ PxrCryptomatte on rmanwiki.pixar.com
  20. ↑ Using the Cryptomatte In V-Ray for 3ds Max on tutorials.cgrecord.net
  21. ↑ Autodesk ships Flame 2020. CG Channel. April 16, 2019
  22. ↑ Adobe ships After Effects 17.0. CG Channel. November 4, 2019
  23. ↑ Foundry ships Nuke, NukeX, Nuke Studio & Nuke Indie 13.0. CG Channel. March 17, 2021.
  24. ↑ Chaos releases V-Ray 5 for 3ds Max Update 1. CG Channel. February 24, 2021
  25. ↑ New: Exr-io 2.00 with cryptomatte support. Exr-IO is a third-party plugin
  26. ↑ "Release Gaffer 0.61.2.0 · GafferHQ/gaffer". GitHub. Retrieved 2023-07-21.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.