Cryptomatte

Last updated
Cryptomatte
Original author(s) Jonah Friedman
Andy Jones
Developer(s) Psyop
Initial release10 July 2016;8 years ago (2016-07-10)
Stable release
1.4 / 3 May 2021;3 years ago (2021-05-03)
Preview release
1.5.0.beta / 10 March 2021;3 years ago (2021-03-10)
Repository github.com/Psyop/Cryptomatte
Written in Python, Lua
License BSD 3-clause license
Website github.com/Psyop/Cryptomatte
Blender 2.81 splash screen-render.jpg
Blender 2.81 splash screen-cryptomatte.jpg
Top: The splash screen of blender 2.81 as rendered image
Bottom: The same scene as cryptomatte image view

Cryptomatte is a piece of open-source software created by Jonah Friedman and Andy Jones at Psyop. It is also used synonymously for the specific style of image created by the software or other software working alike.

Contents

Cryptomatte became a quasi-standard in the industry, because of its ubiquity, integration into popular 3D graphics software, and ease of use.

Render processing

The program itself creates an ID matte of a scene that can be used to create for example image masks for single or multiple objects in the scene. The ID matte has a very distinctive look and itself is sometimes referred to as cryptomatte. These cryptomatte images are in general very colourful assigning each object or material a different random colour. The program creates mattes that support motion blur, transparency and depth of field using data that is already available at render time. [1]

Supported render engines

Cryptomatte images can be created by several 3D graphic programs like Blender, [2] Autodesk Maya, [3] Autodesk 3ds Max [4] or Houdini [5] and are usually exported using the OpenEXR file format.

Whether a program is able to generate a cryptomatte or not is determined by the render engine being used. If a program supports more than one render engine it is possible that it can generate cryptomatte images with one engine while being unable to do so with the other one. Blender, for example, had no option to create a cryptomatte image before version 2.80. [6] With version 2.80, only the "Cycles" path-tracing render engine supported creating a cryptomatte whereas "Eevee", the newly added real-time render engine, did not. The support to create cryptomatte images was added to Eevee with version 2.92 that was published on February 25, 2021 [7] one and a half years after Eevee was first published. [8]

The following render engines are known to support creating cryptomatte images:

Render engine nameShipped withAdded with version
Arnold [9] [10] Autodesk 3ds Max
Autodesk Maya		Arnold 5.2
Cycles [6] BlenderBlender 2.80
Eevee [8] BlenderBlender 2.92
Mantra [11] Houdini Houdini 16.5
Karma [12] HoudiniHoudini 18.5
Modo renderer / mPath [13] Modo [14] Modo 14.2
Redshift [15] Cinema 4D (CPU-only)Redshift 2.6.11
3Delight [16] Katana 3Delight 1.7.32 [16]
Unreal Engine (Movie Render Queue) [17] Unreal Engine4.26
Radeon ProRender [18] Radeon ProRender 3.1
Octane Render [19]
RenderMan [20]
V-Ray [21]

Supported compositing software

Compositing software nameAdded with version
Autodesk Flame 2020 [22]
After Effects 17.0 [23]
Nuke 13.0 [24]
Blender (Compositing Nodes)2.8
Houdini (COP)16.5 [11]
V-Ray (V-Ray Frame Buffer)5 Update 1 [25]
Adobe Photoshop Exr-IO 2.0 [26]
Gaffer0.61.2.0 [27]

Workflow example

In a 3D scene a cryptomatte image can be created that assigns a unique ID to each object. The objects usually also have distinct colours that make a scene with many objects very colourful. The ID matte can be used to pick one or more objects in a scene. The ID matte can either be exported or it can be used by the 3D software itself for compositing.

An example workflow would be to use the cryptomatte image to generate a mask that itself is used to limit an effect to only a certain part of the image. It can thereby be used to quickly create masks without the need of re-rendering a whole scene.

The example workflow for images:

The same workflow for video files:

The masks in the examples can be used to limit a visual effect so that only the cube in the middle is affected.

Licensing

The developers published the program's source code and licensed it under the BSD 3-clause license "to turn it into an ecosystem around an open standard". Their goal was "to see a diverse ecosystem of renderers that can create Cryptomatte images and plugins for compositing applications to decode them". [1]

See also

Related Research Articles

<span class="mw-page-title-main">Digital compositing</span>

Digital compositing is the process of digitally assembling multiple images to make a final image, typically for print, motion pictures or screen display. It is the digital analogue of optical film compositing. It's part of VFX processing.

<span class="mw-page-title-main">Blender (software)</span> 3D computer graphics software

Blender is a free and open-source 3D computer graphics software tool set that runs on Windows, MacOS, BSD, Haiku, IRIX and Linux. It is used for creating animated films, visual effects, art, 3D-printed models, motion graphics, interactive 3D applications, virtual reality, and, formerly, video games.

<span class="mw-page-title-main">Autodesk Maya</span> 3D computer graphics software

Autodesk Maya, commonly shortened to just Maya, is a 3D computer graphics application that runs on Windows, macOS, and Linux, originally developed by Alias and currently owned and developed by Autodesk. It is used to create assets for interactive 3D applications, animated films, TV series, and visual effects.

Autodesk, Inc. is an American multinational software corporation that provides software products and services for the architecture, engineering, construction, manufacturing, media, education, and entertainment industries. Autodesk is headquartered in San Francisco, California, and has offices worldwide. Its U.S. offices are located in the states of California, Oregon, Colorado, Texas, Michigan, New Hampshire and Massachusetts. Its Canada offices are located in the provinces of Ontario, Quebec, and Alberta.

Autodesk 3ds Max, formerly 3D Studio and 3D Studio Max, is a professional 3D computer graphics program for making 3D animations, models, games and images. It is developed and produced by Autodesk Media and Entertainment. It has modeling capabilities and a flexible plugin architecture and must be used on the Microsoft Windows platform. It is frequently used by video game developers, many TV commercial studios, and architectural visualization studios. It is also used for movie effects and movie pre-visualization. 3ds Max features shaders, dynamic simulation, particle systems, radiosity, normal map creation and rendering, global illumination, a customizable user interface, and its own scripting language.

<span class="mw-page-title-main">Cinema 4D</span> 3D computer graphics software

Cinema 4D is a 3D software suite developed by the German company Maxon.

COLLADA is an interchange file format for interactive 3D applications. It is managed by the nonprofit technology consortium, the Khronos Group, and has been adopted by ISO as a publicly available specification, ISO/PAS 17506.

<span class="mw-page-title-main">Autodesk Softimage</span> Discontinued 3D graphics software

Autodesk Softimage is a discontinued 3D computer graphics application, for producing 3D computer graphics, 3D modeling, and computer animation. Now owned by Autodesk and formerly titled Softimage|XSI, the software has been predominantly used in the film, video game, and advertising industries for creating computer generated characters, objects, and environments.

<span class="mw-page-title-main">Nuke (software)</span> Compositing and VFX program

Nuke is a node-based digital compositing and visual effects application first developed by Digital Domain and used for television and film post-production. Nuke is available for Windows, macOS, and RHEL/CentOS. Foundry has further developed the software since Nuke was sold in 2007.

Mudbox is a proprietary computer-based 3D sculpting and painting tool. Currently developed by Autodesk, Mudbox was created by Skymatter, founded by Tibor Madjar, David Cardwell and Andrew Camenisch, former artists of Weta Digital, where the tool was first used to produce the 2005 Peter Jackson remake of King Kong. Mudbox's primary application is high-resolution digital sculpting, texture painting, displacement map creation, and normal map creation, although it is also used as a design tool.

<span class="mw-page-title-main">Digital sculpting</span> Use of software to manipulate a digital object

Digital sculpting, also known as sculpt modeling or 3D sculpting, is the use of software that offers tools to push, pull, smooth, grab, pinch or otherwise manipulate a digital object as if it were made of a real-life substance such as clay.

<span class="mw-page-title-main">3D computer graphics</span> Graphics that use a three-dimensional representation of geometric data

3D computer graphics, sometimes called CGI, 3-D-CGI or three-dimensional computer graphics, are graphics that use a three-dimensional representation of geometric data that is stored in the computer for the purposes of performing calculations and rendering digital images, usually 2D images but sometimes 3D images. The resulting images may be stored for viewing later or displayed in real time.

3D computer graphics software refers to packages used to create 3D computer-generated imagery.

Boris FX is a visual effects and video editing software plug-in developer based in Boston, Massachusetts, USA. The developer is known for its flagship products, Continuum, Sapphire, Mocha, and Silhouette.

An environment artist is a professional artist who works in the video game industry or film industry as a 3D modeler, specializing in outdoor and indoor locations for a game's setting. They are responsible for creating the majority of the overall asset and visuals the player will encounter on the screen, modeling, texturing and placing assets, buildings, streets, foliage, furniture, and all other elements into a scene using a method called set dressing. They also approximate collision so that the player isn't running through walls or other objects that block, optimize topology so that the level runs at a manageable framerate, and help bring life to the game world.

Deep image compositing is a way of compositing and rendering digital images that emerged in the mid-2010s. In addition to the usual color and opacity channels a notion of spatial depth is created. This allows multiple samples in the depth of the image to make up the final resulting color. This technique produces high quality results and removes artifacts around edges that could not be dealt with otherwise.

<span class="mw-page-title-main">Art of Illusion</span>

Art of Illusion is a free software, and open source software package for making 3D graphics.

<span class="mw-page-title-main">Verge3D</span> Real-time renderer and toolkit software

Verge3D is a real-time renderer and a toolkit used for creating interactive 3D experiences running on websites.

Chaos Corona is a computer-generated imagery 3D rendering software developed by Chaos Czech, a subsidiary of Chaos. It was created by Ondřej Karlík as a student project in 2009 and was developed by a Prague-based company Render Legion under the name Corona Renderer. In 2017, Chaos Group acquired Render Legion, later rebranding the company to Chaos Czech. In 2022, Corona Renderer was rebranded to Chaos Corona.

References

  1. 1 2 Cryptomatte on github.com
  2. ↑ Cryptomatte Node on docs.blender.org
  3. ↑ Cryptomatte in Maya on rmanwiki.pixar.com
  4. ↑ Cryptomatte on docs.arnoldrenderer.com
  5. ↑ Cryptomatte on sidefx.com
  6. 1 2 Blender 2.80 Release Notes: Cycles on wiki.blender.org
  7. ↑ index of blender 2.92 release on download.blender.org
  8. 1 2 Blender 2.92 Release Notes: EEVEE on wiki.blender.org
  9. ↑ Cryptomatte Shader docs.arnoldrenderer.com
  10. ↑ Solid Angle ships Arnold 5.2.1. CG Channel. October 23, 2018
  11. 1 2 What’s new in Houdini 16.5 Side Effects Software
  12. ↑ Karma Renderer FAQs. SideFX
  13. ↑ Foundry ships Modo 14.2. CG Channel. November 13, 2020
  14. ↑ Foundry announces strategic decision to wind down development of Modo. Foundry.com. November 7, 2024
  15. ↑ Redshift Version 2.6.11リリースノート (in Japanese). Born Digital. June 12, 2018
  16. 1 2 Changelog - 3DELIGHT. DNA Research
  17. ↑ Movie Render Queue Render Passes. Epic Games
  18. ↑ AMD ships Radeon ProRender 3.1 for Blender and Maya. CG Channel. April 1, 2021.
  19. ↑ CRYPTOMATTE on aoktar.com
  20. ↑ PxrCryptomatte on rmanwiki.pixar.com
  21. ↑ Using the Cryptomatte In V-Ray for 3ds Max on tutorials.cgrecord.net
  22. ↑ Autodesk ships Flame 2020. CG Channel. April 16, 2019
  23. ↑ Adobe ships After Effects 17.0. CG Channel. November 4, 2019
  24. ↑ Foundry ships Nuke, NukeX, Nuke Studio & Nuke Indie 13.0. CG Channel. March 17, 2021.
  25. ↑ Chaos releases V-Ray 5 for 3ds Max Update 1. CG Channel. February 24, 2021
  26. ↑ New: Exr-io 2.00 with cryptomatte support. Exr-IO is a third-party plugin
  27. ↑ "Release Gaffer 0.61.2.0 · GafferHQ/gaffer". GitHub. Retrieved 2023-07-21.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.