StageCraft

Last updated

StageCraft is an on-set virtual production visual effects technology composed of a video wall designed by Industrial Light & Magic (ILM) for the Disney+ series The Mandalorian . It has since been used in other productions and has been cited as a revolutionary visual effects technology. The soundstage in which StageCraft is implemented is called The Volume. [1]

Contents

History

Filming of the tornado sequence from Steven Spielberg's The Fabelmans (2022) on the StageCraft Volume at Manhattan Beach Studios (top) and the finished scene (below). Fabelmans ILM Before and After.jpeg
Filming of the tornado sequence from Steven Spielberg's The Fabelmans (2022) on the StageCraft Volume at Manhattan Beach Studios (top) and the finished scene (below).

While shooting the film Rogue One (2016), cinematographer Greig Fraser encountered multiple issues which inspired the idea to use large LED screens as a component of the set. This idea was further developed by a team including Industrial Light & Magic's (ILM) Richard Bluff and Rob Bredow, as well as Kim Libreri of Epic Games. During the development of The Lion King (2019), director Jon Favreau worked with ILM to develop technologies in order to better visualize shots within a CGI space. When Favreau began work on the Disney+ series The Mandalorian , ILM found a perfect opportunity to use the technology with a director prepared to use it. [2]

The StageCraft process involves shooting live-action actors and sets surrounded by large, very high-definition LED video walls. These walls display computer-generated imagery backdrops, once traditionally composited primarily in post-production after shooting with green screens. These facilities are known as "volumes". When shooting, the production team is able to realign the background instantly based on moving camera positions. The entire CGI background can be manipulated in real-time.[ citation needed ]

ILM used Epic Games' Unreal Engine, a popular game engine, to handle real-time 3-D rendering of computer-generated imagery environments. Other technology partners in StageCraft include FuseFX, Lux Machina, Profile Studios, Nvidia, and ARRI. [3]

ILM iterated the technology to "StageCraft 2.0" for the second season of The Mandalorian. This version featured a larger volume as well as more specialized software. One example of this software is Helios, a rendering engine designed by ILM specifically for StageCraft hardware. [4]

In September 2020, it was announced that a second permanent volume was being created at Manhattan Beach Studios in Los Angeles, in addition to the first built for The Mandalorian, which was expected to be completed in March 2021; one at Pinewood Studios in London, to open in February 2021; and a larger, custom one at Fox Studios Australia. These new volumes would be larger, use more LED panels, and offer higher resolution than the original Manhattan Beach one. ILM also has the ability to provide "pop up" virtual production configurations in other locations. [5] A volume was announced to be built in Vancouver in November 2021, and was planned to be opened in early 2022. [6]

Productions using StageCraft

Television series

Feature films

See also

Related Research Articles

<span class="mw-page-title-main">Lucasfilm</span> American film and television production company

Lucasfilm Ltd. LLC is an American film and television production company founded by filmmaker George Lucas in 1971 in San Rafael, California, and later moved to San Francisco in 2005. It has been a subsidiary of The Walt Disney Studios since 2012 and is best known for creating and producing the Star Wars and Indiana Jones franchises, as well as its leadership in developing special effects, sound, and computer animation for films.

Industrial Light & Magic (ILM) is an American motion picture visual effects company and computer animation studio that was founded on May 26, 1975 by George Lucas. It is a division of the film production company Lucasfilm, which Lucas founded, and was created when he began production on the original Star Wars, now the fourth episode of the Skywalker Saga.

<span class="mw-page-title-main">Unreal Engine</span> Video game engine developed by Epic Games

Unreal Engine (UE) is a 3D computer graphics game engine developed by Epic Games, first showcased in the 1998 first-person shooter video game Unreal. Initially developed for PC first-person shooters, it has since been used in a variety of genres of games and has been adopted by other industries, most notably the film and television industry. Unreal Engine is written in C++ and features a high degree of portability, supporting a wide range of desktop, mobiles, console, and virtual reality platforms.

<span class="mw-page-title-main">Virtual cinematography</span> Also referred to as CGI

Virtual cinematography is the set of cinematographic techniques performed in a computer graphics environment. It includes a wide variety of subjects like photographing real objects, often with stereo or multi-camera setup, for the purpose of recreating them as three-dimensional objects and algorithms for the automated creation of real and simulated camera angles. Virtual cinematography can be used to shoot scenes from otherwise impossible camera angles, create the photography of animated films, and manipulate the appearance of computer-generated effects.

Pixomondo (PXO) is an Academy and Emmy award-winning international visual effects and virtual production company with studios in Los Angeles, Frankfurt, Stuttgart, Vancouver, Toronto, Montreal, and London. The company provides virtual production and visual effects for feature films, television, and commercials. As of 2019, PXO employs over 655 people worldwide.

<span class="mw-page-title-main">Cinesite</span> Visual effects studio

Cinesite is an independent, multinational business which provides services to the media and entertainment industries. Its head office in London opened for business in 1994, initially offering services in visual effects for film and television, subsequently expanding to include animation.

In motion pictures, whether for film (cinema), television, or streaming, de-aging is a visual effects technique used to make an actor or actress look younger, especially for flashback scenes. This is often accomplished via digitally editing the image or using computer-generated imagery (CGI) overlays or touch-ups. Some media will even create de-aged digital actors from scratch or with a mixture of stand-ins and CGI.

The Mandalorian is an American space Western television series created by Jon Favreau for the streaming service Disney+. It is the first live-action series in the Star Wars franchise and begins five years after the events of the film Return of the Jedi (1983). It follows a lone bounty hunter who protects a Force-sensitive child, Grogu, from remnant Imperial forces.

<span class="mw-page-title-main">Chapter 2: The Child</span> 2nd episode of the 1st season of The Mandalorian

"Chapter 2: The Child" is the second episode of the first season of the American streaming television series The Mandalorian. It was written by the series' showrunner Jon Favreau and directed by Rick Famuyiwa. The episode takes place in the Star Wars universe five years after the events of Return of the Jedi (1983). In the episode, the Jawas strip the Mandalorian's ship the Razor Crest in several parts. Having successfully retrieved the asset which is revealed to be a Child but trapped on the planet, the Mandalorian is forced to negotiate with the Jawas to recover his ship components with the help of Kuiil.

<span class="mw-page-title-main">Chapter 4: Sanctuary</span> 4th episode of the 1st season of The Mandalorian

"Chapter 4: Sanctuary" is the fourth episode of the first season of the American streaming television series The Mandalorian. It was written by the series' showrunner Jon Favreau and directed by Bryce Dallas Howard. The episode takes place in the Star Wars universe five years after the events of Return of the Jedi (1983). In the episode, the Mandalorian and the Child arrive at the forest planet Sorgan seeking a place to hide. In exchange of a sanctuary, the former agrees to help a group of farmers to fight Klatoonian riders with the help of mercenary Cara Dune, who is also in hiding.

The Visual Effects Society Award for Outstanding Virtual Cinematography in a CG Project is one of the annual awards given by the Visual Effects Society. The award goes to artists whose work in virtual cinematography. It was first awarded in 2003 and 2004 for, under the title "Best Visual Effects Photography in a Motion Picture", before being scrapped from the ceremony. The award was given separately to artists in live-action film, animated film, and commercials/television. These categories were first awarded in 2012. The following year, the category specifically awarding animated film was dropped, with only live-action film and commercial/television being awarded. In 2015, only live-action films were awarded. The following year, the category's title changed to "Outstanding Virtual Cinematography in a Photoreal Project". It has held its current title since 2020.

<i>The Mandalorian</i> season 1 Season of television series

The first season of the American television series The Mandalorian is part of the Star Wars franchise, set after the events of the film Return of the Jedi (1983). It follows a lone bounty hunter who goes on the run to protect "The Child". The season was produced by Lucasfilm, Fairview Entertainment, and Golem Creations, with Jon Favreau serving as showrunner.

<i>Spellbound</i> (2024 film) Upcoming film directed by Vicky Jenson

Spellbound is an upcoming American animated musical adventure fantasy comedy film directed by Vicky Jenson from a screenplay by Julia Miranda and the writing team of Lauren Hynek and Elizabeth Martin. It features music composed by Alan Menken, who also wrote the songs with longtime collaborator and lyricist Glenn Slater. Produced by Skydance Animation, the film features the voices of Rachel Zegler, John Lithgow, Jenifer Lewis, Tituss Burgess, Nathan Lane, Javier Bardem, and Nicole Kidman. Set in the world of magic known as Lumbria, the story follows Princess Ellian (Zegler) who must break the spell that has turned her parents into monsters and split her kingdom in two.

<i>The Book of Boba Fett</i> American television miniseries

The Book of Boba Fett is an American space Western television miniseries created by Jon Favreau for the streaming service Disney+. It is part of the Star Wars franchise and a spin-off from The Mandalorian, taking place in the same timeframe as that series and its other interconnected spin-offs after the events of the film Return of the Jedi (1983). The Book of Boba Fett follows bounty hunter Boba Fett from The Mandalorian and other Star Wars media as he establishes himself as the new crime lord of Jabba the Hutt's former territory.

Ahsoka, also known as Star Wars: Ahsoka, is an American space fantasy television series created by Dave Filoni for the streaming service Disney+. It is part of the Star Wars franchise and a spin-off from The Mandalorian, taking place in the same timeframe as that series and its other interconnected spin-offs after the events of the film Return of the Jedi (1983). Ahsoka follows former Jedi apprentice Ahsoka Tano and her allies as they fight the remnants of the Galactic Empire during the time of the fledgling New Republic.

<i>The Fabelmans</i> 2022 film by Steven Spielberg

The Fabelmans is a 2022 American coming-of-age drama film directed and co-produced by Steven Spielberg, who co-wrote the screenplay with Tony Kushner. Loosely based on Spielberg's adolescence and first years as a filmmaker, the semi-autobiographical plot is told through an original story of the fictional Sammy Fabelman, a young aspiring filmmaker who explores how the power of films can help him see the truth about his dysfunctional family and those around him. It stars Gabriel LaBelle as Sammy, alongside Michelle Williams, Paul Dano, Seth Rogen, and Judd Hirsch in supporting roles. The film is dedicated to the memories of Spielberg's parents, Leah Adler and Arnold Spielberg, who died in 2017 and 2020, respectively.

<span class="mw-page-title-main">Jellyfish Pictures</span> Film and television production company

Jellyfish Pictures is a British VFX and animation company specializing in the creation of digital visual effects and animation.

ABBA Voyage is a virtual concert residency by the Swedish pop group ABBA. The concerts feature virtual avatars, depicting the group as they appeared in 1979, and use vocals re-recorded by the group in a Swedish studio specifically for this show, accompanied by a 10 piece live instrumental band on stage. The concerts are held in ABBA Arena, a purpose-built venue in the Queen Elizabeth Olympic Park in London.

On-set virtual production (OSVP) is an entertainment technology for television and film production in which LED panels are used as a backdrop for a set, on which video or computer-generated imagery can be displayed in real-time. The use of OSVP became widespread after its use in the first season of The Mandalorian (2019), which used Unreal Engine, developed by Epic Games.

<i>Star Wars: Skeleton Crew</i> Upcoming American science fiction television series

Star Wars: Skeleton Crew is an upcoming American science fiction television series created by Jon Watts and Christopher Ford for the streaming service Disney+. It is part of the Star Wars franchise, taking place in the same time frame as the series The Mandalorian and its interconnected spin-offs after the events of the film Return of the Jedi (1983). Skeleton Crew tells a coming-of-age story about four children who make a discovery on their home planet, get lost in the galaxy, and go on an adventure to get back home.

References

  1. Barnhardt, Adam (July 13, 2021). "Loki Crew Reveals Why They Didn't Use The Mandalorian's Volume". ComicBook.com . Archived from the original on July 13, 2021. Retrieved July 15, 2021.
  2. "How Cutting-Edge ILM Technology Brought 'The Mandalorian' to Life". No Film School. February 5, 2020. Retrieved June 26, 2021.
  3. Bill Desowitz (February 20, 2020). "'The Mandalorian': How ILM's Innovative StageCraft Tech Created a 'Star Wars' Virtual Universe". IndieWire . Retrieved June 26, 2021.
  4. Igor Bonifacic (April 1, 2021). "ILM explains how it used Stagecraft 2.0 for season two of 'The Mandalorian'". Engadget . Retrieved June 26, 2021.
  5. 1 2 Carolyn Giardina (September 10, 2020). "Industrial Light & Magic Expands Virtual Production Services, Supports 'Thor 4'". The Hollywood Reporter . Retrieved June 26, 2021.
  6. Chan, Kenneth (November 19, 2021). "Industrial Light & Magic building LED video wall film studio in Vancouver". Daily Hive. Retrieved April 7, 2023.
  7. Gartenberg, Chaim (February 20, 2020). "How The Mandalorian teamed up with Fortnite creator Epic Games to create its digital sets". The Verge . Archived from the original on February 20, 2020. Retrieved February 20, 2020.
  8. Lane, Carly (June 9, 2021). "Exclusive: Here's When 'The Mandalorian' Season 3 Is Filming; New Details on 'Book of Boba Fett' Connection". Collider . Archived from the original on June 9, 2021. Retrieved June 9, 2021.
  9. "ILM STAGECRAFT HONORED WITH ENGINEERING, SCIENCE & TECHNOLOGY EMMY® AWARD". Industrial Light & Magic . July 29, 2022. Retrieved July 29, 2022.
  10. Peterson, Karen M. (April 29, 2022). "How 'Our Flag Means Death' Designers Mixed History With Broad Theatricality". Variety. Retrieved July 16, 2022.
  11. Bui, Hoai-Tran (June 17, 2020). "The Obi-Wan Kenobi Disney+ Series Will Use the Same Technology as 'The Mandalorian'". /Film . Archived from the original on June 18, 2020. Retrieved June 18, 2020.
  12. Dominguez, Noah (November 14, 2022). "Andor Actually Used StageCraft Technology Despite Early Reports". ComicBook.com. Retrieved November 25, 2022.
  13. "HOUSE OF THE DRAGON MAY LOOK TOTALLY DIFFERENT IN SEASON 2 FOR ONE CONTROVERSIAL REASON". Inverse. Retrieved October 25, 2022.
  14. Giardina, Carolyn (October 19, 2022). "Too Much Volume? The Tech Behind 'Mandalorian' and 'House of the Dragon' Faces Growing Pains". The Hollywood Reporter . Archived from the original on February 4, 2023. Retrieved February 4, 2023.
  15. Giardina, Carolyn (June 28, 2022). "'Percy Jackson and the Olympians' Takes ILM Virtual Production Route (Exclusive)". The Hollywood Reporter . Archived from the original on June 28, 2022. Retrieved June 28, 2022.
  16. Rangel, Felipe (December 20, 2022). "Live-Action Avatar: Last Airbender Show Scene Detailed By Netflix Director". Screen Rant . Retrieved November 12, 2023.
  17. McPherson, Chris (May 5, 2024). "'Star Wars: Skeleton Crew' Uses Stop-Motion by Phil Tippett and Old School Matte Paintings [Exclusive]". Collider . Archived from the original on May 6, 2024. Retrieved May 6, 2024.
  18. Tantimedh, Adi (May 14, 2024). "'Doctor Who: "BOOM" Sees Steven Moffat Regenerate into Freelancer'". Bleeding Cool . Retrieved May 23, 2024.
  19. Mike Seymour (January 21, 2021). "The Midnight Sky's Virtual Production using StageCraft". Fxguide . Retrieved June 26, 2021.
  20. Giardina, Carolyn (October 19, 2020). "'The Batman' Using 'Mandalorian' Virtual Production Techniques". The Hollywood Reporter . Archived from the original on October 19, 2020. Retrieved October 19, 2020.
  21. Villaverde, Noah (June 8, 2022). "'Black Adam' Director Talks Using Lucasfilm's Volume & Other New Tech". Heroic Hollywood. Retrieved July 19, 2022.
  22. Industrial Light & Magic [@ILMVFX] (March 17, 2023). "Don't miss these behind-the-scenes images featuring ILM's exciting StageCraft work on Steven Spielberg's #TheFabelmans. Own it now on Digital and Blu-ray with exclusive Bonus Content" (Tweet). Retrieved March 18, 2023 via Twitter.
  23. Kadner, Noah (April 24, 2023). "Virtual Production—When The Fabelmans Met The Mandalorian". Frame.io Insider. Retrieved April 26, 2023.
  24. Erao, Math (May 17, 2021). "Ant-Man and the Wasp: Quantumania Director Shares Photo From The Mandalorian's Virtual Set". Comic Book Resources . Archived from the original on May 17, 2021. Retrieved May 17, 2021.
  25. Failes, Ian (January 10, 2024). "How ILM's StageCraft was used on 'The Marvels'". befores & afters. Archived from the original on January 10, 2024. Retrieved February 12, 2024.
  26. Daddio' Is the First Grounded Drama to Use 'Mandalorian' Technology
  27. Spangler, Todd (November 9, 2021). "Atlanta's Trilith Studios to Open 18,000-Square-Foot Virtual Production Facility With NEP (Exclusive)". Variety . Archived from the original on November 24, 2021. Retrieved January 14, 2022.