Mova (camera system)

Last updated

Mova Contour is a multi-camera high resolution facial capture system originally developed by former Apple Computer engineer Steve Perlman. [1] It records surfaces (specifically of actors' faces) digitally, by using fluorescent makeup and stereo triangulation, allowing for very detailed digitization and manipulation. The system captures images which are then used to generate dense per frame surface reconstructions. It then generates a temporally coherent mesh by tracking an invisible random pattern of fluorescent makeup that is applied to the capture surface.

Mova technology was first used in The Curious Case of Benjamin Button for building a realistic 3D face model of Brad Pitt. The first film credit that Mova technology received was for its use in The Incredible Hulk to capture Edward Norton's expressions and superimpose them onto the Hulk. [2] It has subsequently been used in over 15 feature films and games. [3] However, in recent years it attracted controversy due to a series of lawsuits filed by Perlman over its use in motion pictures such as Guardians of the Galaxy , Avengers: Age of Ultron , and Beauty and the Beast . [4] [5]

Related Research Articles

Computer animation Art of creating moving images using computers

Computer animation is the process used for digitally generating animated images. The more general term computer-generated imagery (CGI) encompasses both static scenes and dynamic images, while computer animation only refers to moving images. Modern computer animation usually uses 3D computer graphics to generate a three-dimensional picture. Sometimes, the target of the animation is the computer itself, but sometimes film as well.

Visual effects is the process by which imagery is created or manipulated outside the context of a live-action shot in filmmaking and video production. The integration of live-action footage and other live-action footage or CGI elements to create realistic imagery is called VFX.

Motion capture Process of recording the movement of objects or people

Motion capture is the process of recording the movement of objects or people. It is used in military, entertainment, sports, medical applications, and for validation of computer vision and robots. In filmmaking and video game development, it refers to recording actions of human actors, and using that information to animate digital character models in 2-D or 3-D computer animation. When it includes face and fingers or captures subtle expressions, it is often referred to as performance capture. In many fields, motion capture is sometimes called motion tracking, but in filmmaking and games, motion tracking usually refers more to match moving.

Facial recognition system Technology capable of matching a face from an image against a database of faces

A facial recognition system is a technology capable of matching a human face from a digital image or a video frame against a database of faces, typically employed to authenticate users through ID verification services, works by pinpointing and measuring facial features from a given image.

John Gaeta

John C. Gaeta is a designer and inventor best known for his work on the Matrix film trilogy, where he advanced methods and formats known as Bullet Time, Volumetric Cinematography and Universal Capture (UCAP). He is also known for exploring emergent and expressive new media platforms such as Photo Anime, NUI, HoloCinema and the Magicverse.

Computer facial animation is primarily an area of computer graphics that encapsulates methods and techniques for generating and animating images or models of a character face. The character can be a human, a humanoid, an animal, a legendary creature or character, etc. Due to its subject and output type, it is also related to many other scientific and artistic fields from psychology to traditional animation. The importance of human faces in verbal and non-verbal communication and advances in computer graphics hardware and software have caused considerable scientific, technological, and artistic interests in computer facial animation.

Virtual cinematography

Virtual cinematography is the set of cinematographic techniques performed in a computer graphics environment. It includes a wide variety of subjects like photographing real objects, often with stereo or multi-camera setup, for the purpose of recreating them as three-dimensional objects and algorithms for the automated creation of real and simulated camera angles. Virtual cinematography can be used to shoot scenes from otherwise impossible camera angles, create the photography of animated films, and manipulate the appearance of computer-generated effects.Virtual cinematography is the set of cinematographic techniques performed in a computer graphics environment

Facial motion capture is the process of electronically converting the movements of a person's face into a digital database using cameras or laser scanners. This database may then be used to produce computer graphics (CG), computer animation for movies, games, or real-time avatars. Because the motion of CG characters is derived from the movements of real people, it results in a more realistic and nuanced computer character animation than if the animation were created manually.

Stephen G. "Steve" Perlman is an entrepreneur and inventor of Internet, entertainment, multimedia, consumer electronics and communications technologies and services. He is best known for the development of QuickTime, WebTV, OnLive, pCell and Mova Contour facial capture technologies. In addition to founding startup companies, Perlman was a Microsoft division president and a principal scientist at Apple Computer.

Human image synthesis is technology that can be applied to make believable and even photorealistic renditions of human-likenesses, moving or still. It has effectively existed since the early 2000s. Many films using computer generated imagery have featured synthetic images of human-like characters digitally composited onto the real or other simulated film material. Towards the end of the 2010s deep learning artificial intelligence has been applied to synthesize images and video that look like humans, without need for human assistance, once the training phase has been completed, whereas the old school 7D-route required massive amounts of human work.

<i>The Incredible Hulk</i> (film) 2008 superhero film produced by Marvel Studios

The Incredible Hulk is a 2008 American superhero film based on the Marvel Comics character the Hulk. Produced by Marvel Studios and distributed by Universal Pictures, it is the second film in the Marvel Cinematic Universe (MCU). It was directed by Louis Leterrier from a screenplay by Zak Penn, and stars Edward Norton as Bruce Banner alongside Liv Tyler, Tim Roth, Tim Blake Nelson, Ty Burrell, and William Hurt. In the film, Bruce Banner becomes the Hulk as an unwitting pawn in a military scheme to reinvigorate the "Super-Soldier" program through gamma radiation. Banner goes on the run from the military while attempting to cure himself of the Hulk.

Image Metrics American company providing facial animation software for the visual effects industries

Image Metrics is a 3D facial animation and Virtual Try-on company headquartered in El Segundo, with offices in Las Vegas, and research facilities in Manchester. Image Metrics are the makers of the Live Driver and Portable You SDKs for software developers and are providers of facial animation software and services to the visual effects industries.

iClone is a real-time 3D animation and rendering software program. Real-time playback is enabled by using a 3D videogame engine for instant on-screen rendering.

The history of computer animation began as early as the 1940s and 1950s, when people began to experiment with computer graphics – most notably by John Whitney. It was only by the early 1960s when digital computers had become widely established, that new avenues for innovative computer graphics blossomed. Initially, uses were mainly for scientific, engineering and other research purposes, but artistic experimentation began to make its appearance by the mid-1960s – most notably by Dr Thomas Calvert. By the mid-1970s, many such efforts were beginning to enter into public media. Much computer graphics at this time involved 2-dimensional imagery, though increasingly as computer power improved, efforts to achieve 3-dimensional realism became the emphasis. By the late 1980s, photo-realistic 3D was beginning to appear in film movies, and by mid-1990s had developed to the point where 3D animation could be used for entire feature film production.

Computer-generated imagery Application of computer graphics to create or contribute to images

Computer-generated imagery (CGI) is the use of computer graphics to create or contribute to images in art, printed media, video games, simulators, computer animation and VFX in films, television programs, shorts, commercials, and videos. The images may be dynamic or static, and may be two-dimensional (2D), although the term "CGI" is most commonly used to refer to the 3-D computer graphics used for creating characters, scenes and special effects in films and television, which is described as "CGI animation".

Biometric device

A biometric device is a security identification and authentication device. Such devices use automated methods of verifying or recognising the identity of a living person based on a physiological or behavioral characteristic. These characteristics include fingerprints, facial images, iris and voice recognition.

Faceware Technologies is an American facial animation and motion capture development company. The company was established under Image Metrics and became its own company at the beginning of 2012.

DeepFace is a deep learning facial recognition system created by a research group at Facebook. It identifies human faces in digital images. The program employs a nine-layer neural network with over 120 million connection weights and was trained on four million images uploaded by Facebook users. The Facebook Research team has stated that the DeepFace method reaches an accuracy of 97.35% ± 0.25% on Labeled Faces in the Wild (LFW) data set where human beings have 97.53%. This means that DeepFace is sometimes more successful than human beings. As a result of growing societal concerns Meta announced that it plans to shut down Facebook facial recognition system, deleting the face scan data of more than one billion users. This change will represent one of the largest shifts in facial recognition usage in the technology’s history. Facebook planned to delete by December 2021 more than one billion facial recognition templates, which are digital scans of facial features. However, it did not plan to eliminate DeepFace which is the software that powers the facial recognition system. The company has also not ruled out incorporating facial recognition technology into future products, according to Meta spokesperson.

Visage SDK Software development kit

Visage SDK is a multi-platform software development kit (SDK) created by Visage Technologies AB. Visage|SDK allows software programmers to build facial motion capture and eye tracking applications.

Bruce Banner (Marvel Cinematic Universe) Fictional character in the Marvel Cinematic Universe

Bruce Banner is a fictional character in the Marvel Cinematic Universe (MCU) media franchise originally portrayed by Edward Norton and subsequently by Mark Ruffalo—based on the Marvel Comics character of the same name—known commonly by his alter ego, the Hulk. Banner is depicted as a genius physicist who after a failed experiment to replicate a super soldier program using gamma radiation, transforms into a large, muscular creature with green skin whenever his heart rate goes above 200 beats per minute or when facing mortal danger. As the Hulk, he possesses superhuman abilities including increased strength and durability. Over time, Banner demonstrates an increasing ability to control the transformation, and he becomes a founding member of the Avengers. Following the conflict with Ultron, Banner is unintentionally transported to Sakaar, where he remains the Hulk for a number of years until eventually returning to Earth to participate in the battle against Thanos. In the years after Thanos erases half of all life, Banner learns to retain the Hulk form with his mind still intact, and he is instrumental in the Avengers' mission to use time travel to obtain the Infinity Stones from the past. After the Avengers succeed, Banner himself restores trillions of lives across the universe using the Stones in a specially made gauntlet.

References

  1. "Camera System Creates Sophisticated 3-D Effects". The New York Times . Retrieved 2015-12-05.
  2. Takahashi, Dean (22 June 2008). "Mova reveals its work capturing faces for The Incredible Hulk film". VentureBeat. Retrieved 13 August 2022.
  3. "MOVA(R) Contour(R) Facial Capture System Recognized With Academy Award". Marketwired.com. 2015-01-21. Retrieved 2015-12-05.
  4. Wodecki, Ben. "Hollywood juggernauts face motion-capture lawsuit". IPPro The internet.
  5. Iovino, Nicholas. "Disney & Studios Can't Dodge Claims Over Stolen Technology". Courthouse News Service. Retrieved July 14, 2018.