Interactive video compositing

Last updated

Interactive video compositing, or IVC, is an interactive media production technique that uses pre-rendered videos and images to create visual coherence, allowing interactive environments to be created without the heavy processing load incurred by real-time 3D graphics.

Contents

The most popular examples of IVC are in video games using the technique prior to the propagation of real-time 3D graphics. On the Internet, some websites (generally in Adobe Flash) make use of this technique for visual rendering with other effects. [1]

The differences with interactive video compositing, as opposed to real-time graphics, lies in the finality of the product. IVC is used with the goal of creating an enriched interactive experience from a product's constituent media in a simple manner. [2]

Notable video games using IVC

Related Research Articles

Computer animation art of creating moving images using computers

Computer animation is the process used for digitally generating animated images. The more general term computer-generated imagery (CGI) encompasses both static scenes and dynamic images, while computer animation only refers to moving images. Modern computer animation usually uses 3D computer graphics, although 2D computer graphics are still used for stylistic, low bandwidth, and faster real-time renderings. Sometimes, the target of the animation is the computer itself, but sometimes film as well.

Digital art Collective term for art that is generated digitally with the computer

Digital art is an artistic work or practice that uses digital technology as part of the creative or presentation process. Since the 1970s, various names have been used to describe the process, including computer art and multimedia art. Digital art is itself placed under the larger umbrella term new media art.

Game engine Software-development environment designed for building video games

A game engine, also known as a game architecture, game framework or gameframe, is a software-development environment designed for people to build video games. Developers use game engines to construct games for consoles, mobile devices, and personal computers. The core functionality typically provided by a game engine includes a rendering engine ("renderer") for 2D or 3D graphics, a physics engine or collision detection, sound, scripting, animation, artificial intelligence, networking, streaming, memory management, threading, localization support, scene graph, and may include video support for cinematics. Implementers often economize on the process of game development by reusing/adapting, in large part, the same game engine to produce different games or to aid in porting games to multiple platforms.

Adobe Creative Suite collection of graphic design, video editing, and web development applications

Adobe Creative Suite (CS) is a now-discontinued software suite of graphic design, video editing, and web development applications developed by Adobe Systems. Each edition consisted of several Adobe applications, e.g., Photoshop, Acrobat, Premiere Pro or After Effects, InDesign, and Illustrator that are the industry standard applications for many graphic design positions.

Scanimate is an analog computer animation system developed from the late 1960s to the 1980s by Computer Image Corporation of Denver, Colorado.

Visualization (graphics) set of techniques for creating images, diagrams, or animations to communicate a message

Visualization or visualisation is any technique for creating images, diagrams, or animations to communicate a message. Visualization through visual imagery has been an effective way to communicate both abstract and concrete ideas since the dawn of humanity. Examples from history include cave paintings, Egyptian hieroglyphs, Greek geometry, and Leonardo da Vinci's revolutionary methods of technical drawing for engineering and scientific purposes.

Softimage, Co. was a company located in Montreal, Quebec, Canada that produced 3D animation software. A subsidiary of Microsoft in the 1990s, it was sold to Avid Technology, who would eventually sell the name and assets of Softimage's 3D-animation business to Autodesk.

Autodesk Media and Entertainment is a division of Autodesk which offers animation and visual effects products, and was formed by the combination of multiple acquisitions. In 2018, the company began operating as a single operating segment and reporting unit.

Virtual cinematography set of cinematographic techniques performed in a computer graphics environment

Virtual cinematography refers to the set of cinematographic techniques performed in a computer graphics environment. It includes a wide variety of subjects like photographing real objects, often with stereo or multi-camera setup, for the purpose of recreating them as three-dimensional objects and algorithms for the automated creation of real and simulated camera angles. Virtual cinematography can be used to shoot scenes from otherwise impossible camera angles, create the photography of animated films, and manipulate the appearance of computer-generated effects.

Pre-rendering is the process in which video footage is not rendered in real-time by the hardware that is outputting or playing back the video. Instead, the video is a recording of footage that was previously rendered on different equipment. Pre-rendered assets may also be outsourced by the developer to an outside production company. Such assets usually have a level of complexity that is too great for the target platform to render in real-time.

3D rendering

3D rendering is the 3D computer graphics process of converting 3D models into 2D images on a computer. 3D renders may include photorealistic effects or non-photorealistic styles.

Motion graphics digital footage or animation which create the illusion of motion or rotation

Motion graphics are pieces of animation or digital footage which create the illusion of motion or rotation, and are usually combined with audio for use in multimedia projects. Motion graphics are usually displayed via electronic media technology, but may also be displayed via manual powered technology. The term distinguishes still graphics from those with a transforming appearance over time, without over-specifying the form. While any form of experimental or abstract animation can be called motion graphics, the term typically more explicitly refers to the commercial application of animation and effects to video, film, TV, and interactive applications.

User experience design is the process of manipulating user behavior through usability, usefulness, and desirability provided in the interaction with a product. User experience design encompasses traditional human–computer interaction (HCI) design and extends it by addressing all aspects of a product or service as perceived by users. Experience design (XD) is the practice of designing products, processes, services, events, omnichannel journeys, and environments with a focus placed on the quality of the user experience and culturally relevant solutions. Experience design is not driven by a single design discipline. Instead, it requires a cross-discipline perspective that considers multiple aspects of the brand/ business/ environment/ experience from product, packaging, and retail environment to the clothing and attitude of employees. Experience design seeks to develop the experience of a product, service, or event along any or all of the following dimensions:

3D computer graphics graphics that use a three-dimensional representation of geometric data

3D computer graphics, or three-dimensional computer graphics, are graphics that use a three-dimensional representation of geometric data that is stored in the computer for the purposes of performing calculations and rendering 2D images. The resulting images may be stored for viewing later or displayed in real time.

Adobe Director multimedia application authoring platform

Adobe Director was a multimedia application authoring platform created by Macromedia and managed by Adobe Systems until its discontinuation.

A projection augmented model is an element sometimes employed in virtual reality systems. It consists of a physical three-dimensional model onto which a computer image is projected to create a realistic looking object. Importantly, the physical model is the same geometric shape as the object that the PA model depicts.

Computer graphics Graphics created using computers

Computer graphics is the discipline of generating images with the aid of computers. Today, computer graphics is a core technology in digital photography, film, video games, cell phone and computer displays, and many specialized applications. A great deal of specialized hardware and software has been developed, with the displays of most devices being driven by computer graphics hardware. It is a vast and recently developed area of computer science. The phrase was coined in 1960 by computer graphics researchers Verne Hudson and William Fetter of Boeing. It is often abbreviated as CG, or typically in the context of film as CGI.

Pixel artist artist who works in the raster graphics on the pixel level

A pixel artist is a graphic designer who specializes in computer art and can refer to a number of artistic and professional disciplines which focus on visual communication and presentation. Similar to chromoluminarism used in the pointillism style of painting, in which small distinct points of primary colors create the impression of a wide selection of secondary and intermediate colors, a pixel artist works with pixels, the smallest piece of information in an image. The technique relies on the perceptive ability of the eye and mind of the viewer to mix the color spots into a fuller range of tones. Pixel art is often utilitarian and anonymous. Pixel design can refer to both the process (designing) by which the communication is created and the products (designs) which are generated.

The history of computer animation began as early as the 1940s and 1950s, when people began to experiment with computer graphics - most notably by John Whitney. It was only by the early 1960s when digital computers had become widely established, that new avenues for innovative computer graphics blossomed. Initially, uses were mainly for scientific, engineering and other research purposes, but artistic experimentation began to make its appearance by the mid-1960s. By the mid-1970s, many such efforts were beginning to enter into public media. Much computer graphics at this time involved 2-dimensional imagery, though increasingly as computer power improved, efforts to achieve 3-dimensional realism became the emphasis. By the late 1980s, photo-realistic 3D was beginning to appear in film movies, and by mid-1990s had developed to the point where 3D animation could be used for entire feature film production.

Volumetric video is a technique that captures a three-dimensional space, such as a location or performance. This type of volumography acquires data that can be viewed on flat screens as well as using 3D displays and VR goggles. Consumer-facing formats are numerous and the required motion capture techniques lean on computer graphics, photogrammetry, and other computation-based methods. The viewer generally experiences the result in a real-time engine and has direct input in exploring the generated volume.

References

  1. "Flash Video Composited Original Website : The Podcats : DESIGN WEB & ART". 2010-09-05. Archived from the original on 2010-09-05. Retrieved 2020-02-13.
  2. Porter, T.; Duff, T.; Nishita, T.; Takita, S. (1984). "Compositing digital images". Computer Graphics (USA). 18 (1). ISSN   1478-0771.

Websites