Video synthesizer

Last updated
A video synthesizer (bottom) being operated which creates video images (top)
Video images created by a video synthesizer across multiple television sets.

A video synthesizer is a device that electronically creates a video signal. A video synthesizer is able to generate a variety of visual material without camera input through the use of internal video pattern generators. It can also accept and "clean up and enhance" or "distort" live television camera imagery. The synthesizer creates a wide range of imagery through purely electronic manipulations. This imagery is visible within the output video signal when this signal is displayed. The output video signal can be viewed on a wide range of conventional video equipment, such as TV monitors, theater video projectors, computer displays, etc.

Contents

Video pattern generators may produce static or moving or evolving imagery. Examples include geometric patterns (in 2D or 3D), subtitle text characters in a particular font, or weather maps.

Imagery from TV cameras can be altered in color or geometrically scaled, tilted, wrapped around objects, and otherwise manipulated.

A particular video synthesizer will offer a subset of possible effects.

Real-time performance instruments

Video generated by an LZX video synthesizer setup reacting as a live background for a musical band

The history of video synthesis is tied to a "real time performance" ethic. The equipment is usually expected to function on input camera signals the machine has never seen before, delivering a processed signal continuously and with a minimum of delay in response to the ever-changing live video inputs. Following in the tradition of performance instruments of the audio synthesis world such as the Theremin, video synthesizers were designed with the expectation they would be played in live concert theatrical situations or set up in a studio ready to process a videotape from a playback VCR in real time while recording the results on a second VCR. Venues of these performances included "Electronic Visualization Events" in Chicago, The Kitchen in NYC, and museum installations. Video artist/performer Don Slepian designed, built and performed a foot-controlled Visual Instrument at the Centre Pompidou in Paris (1983) and the NY Open Center that combined genlocked early micro-computers Apple II Plus with the Chromaton 14 Video Synthesizer. [1] and channels of colorized video feedback.

Analog and early real time digital synthesizers existed before modern computer 3D modeling. Typical 3D renderers are not real time, as they concentrate on computing each frame from, for example, a recursive ray tracing algorithm, however long it takes. This distinguishes them from video synthesizers, which must deliver a new output frame by the time the last one has been shown, and repeat this performance continuously (typically delivering a new frame regularly every 1/60 or 1/50 of a second). The real time constraint results in a difference in design philosophy between these two classes of systems.

Video synthesizers overlap with video special effects equipment used in real time network television broadcast and post-production situations. Many innovations in television broadcast equipment as well as computer graphics displays evolved from synthesizers developed in the video artists' community and these industries often support "electronic art projects" in this area to show appreciation of this history.

Confluence of ideas of electronics and arts

Many principles used in the construction of early video synthesizers reflected a healthy and dynamic interplay between electronic requirements and traditional interpretations of artistic forms. For example, Steve Rutt, Bill Etra and Daniel Sandin carried forward as an essential principle ideas of Robert Moog that standardized signal ranges so that any module's output could be connected to "voltage control" any other module's input. The consequence of this in a machine like the Rutt-Etra was that position, brightness, and color were completely interchangeable and could be used to modulate each other during the processing that led to the final image. Videotapes by Louise and Bill Etra and Steina and Woody Vasulka dramatized this new class of effects. This led to various interpretations of the multi-modal synesthesia of these aspects of the image in dialogues that extended the McLuhanesque language of film criticism of the time.

EMS Spectron

Image produced by Spectre video synthesizer Spectre image3-1977.jpg
Image produced by Spectre video synthesizer

In the UK, Richard Monkhouse, working for Electronic Music Studios (London) Limited (EMS), developed a hybrid video synthesiser – Spectre – later renamed 'Spectron' [2] [3] [4] which used the EMS patchboard system to allow completely flexible connections between module inputs and outputs. The video signals were digital, but they were controlled by analog voltages. There was a digital patchboard for image composition and an analog patchboard for motion control.

Evolution into frame buffers

Video synthesizers moved from analog to the precision control of digital. The first digital effects as exemplified by Stephen Beck's Video Weavings used digital oscillators optionally linked to horizontal, vertical, or frame resets to generate timing ramps. These ramps could be gated to create the video image itself and were responsible for its underlying geometric texture. Schier and Vasulka advanced the state of the art from address counters to programmable (microcodable) AMD Am2901 bit slice based address generators. On the data path, they used 74S181 arithmetic and logic units, previously thought of as a component for doing arithmetic instructions in minicomputers, to process real time video signals, creating new signals representing the sum, difference, AND, XOR, and so on, of two input signals. These two elements, the address generator, and the video data pipeline, recur as core features of digital video architecture.

The address generator supplied read and write addresses to a real time video memory, which can be thought of as evolution into the most flexible form of gating the address bits together to produce the video. While the video frame buffer is now present in every computer's graphics card, it has not carried forward a number of features of the early video synths. The address generator counts in a fixed rectangular pattern from the upper left hand corner of the screen, across each line, to the bottom. This discarded a whole technology of modifying the image by variations in the read and write addressing sequence provided by the hardware address generators as the image passed through the memory. Today, address based distortions are more often accomplished by blitter operations moving data in the memory, rather than changes in video hardware addressing patterns.

History

1960s

1970–1974

The 1971 Sandin Image Processor Sandin Image Processor.jpg
The 1971 Sandin Image Processor

1975–1979

Output from an Atari Video Music, with music from 2018

1980s

2000s–2020s

LZX Visionary video synthesizer - #basic #nye patch, little key little color, modulate & feedback... #codame booth ready to #cyber ghost yah (2013-12-31 20.25.52 by j bizzie).jpg
LZX modular video synthesizer in work.
Modular analog video synth #portrait @chibibby #codame #rackgeek ^ ^ (photo by j bizzie) 2013-11-14 11.55.34.jpg
A sample of processed video image.
Vidiot.jpg
An LZX 'Vidiot'
Video synth footage
An LZX video synth video

Other video synthesizers

Workshop on video synthesis - Stephane Lefrancois and the LZX Industries Visual Cortex

See also

Related Research Articles

<span class="mw-page-title-main">Modular synthesizer</span> Synthesizer composed of separate modules

Modular synthesizers are synthesizers composed of separate modules for different functions. The modules can be connected together by the user to create a patch. The outputs from the modules may include audio signals, analog control voltages, or digital signals for logic or timing conditions. Typical modules are voltage-controlled oscillators, voltage-controlled filters, voltage-controlled amplifiers and envelope generators.

<span class="mw-page-title-main">Component video</span> Video signal that has been split into component channels

Component video is an analog video signal that has been split into two or more component channels. In popular use, it refers to a type of component analog video (CAV) information that is transmitted or stored as three separate signals. Component video can be contrasted with composite video in which all the video information is combined into a single signal that is used in analog television. Like composite, component cables do not carry audio and are often paired with audio cables.

Scanimate is an analog computer animation system developed from the late 1960s to the 1980s by Computer Image Corporation of Denver, Colorado.

<span class="mw-page-title-main">Roland MT-32</span> Roland MT-32 Multi-Timbre Sound Module

The Roland MT-32 Multi-Timbre Sound Module is a MIDI synthesizer module first released in 1987 by Roland Corporation. It was originally marketed to amateur musicians as a budget external synthesizer with an original list price of $695. However, it became more famous along with its compatible modules as an early de facto standard in computer music. Since it was made prior to the release of the General MIDI standard, it uses its own proprietary format for MIDI file playback.

Electronic Music Studios (EMS) is a synthesizer company formed in Putney, London in 1969 by Peter Zinovieff, Tristram Cary and David Cockerell. It is now based in Ladock, Cornwall.

<span class="mw-page-title-main">Korg OASYS</span> Workstation synthesizer

The Korg OASYS is a workstation synthesizer released in early 2005, 1 year after the successful Korg Triton Extreme. Unlike the Triton series, the OASYS uses a custom Linux operating system that was designed to be arbitrarily expandable via software updates, with its functionality limited only by the PC-like hardware.

<span class="mw-page-title-main">Composite monitor</span>

A composite monitor or composite video monitor is any analog video display that receives input in the form of an analog composite video signal to a defined specification. A composite video signal encodes all information on a single conductor; a composite cable has a single live conductor plus earth. Other equipment with display functionality includes monitors with more advanced interfaces and connectors giving a better picture, including analog VGA, and digital DVI, HDMI, and DisplayPort; and television (TV) receivers which are self-contained, receiving and displaying video RF broadcasts received with an internal tuner. Video monitors are used for displaying computer output, closed-circuit television and other applications requiring a two-dimensional monochrome or colour image.

In a mixed-signal system, a reconstruction filter, sometimes called an anti-imaging filter, is used to construct a smooth analog signal from a digital input, as in the case of a digital to analog converter (DAC) or other sampled data output device.

<span class="mw-page-title-main">Sandin Image Processor</span>

The Sandin Image Processor is a video synthesizer, usually introduced as invented by Dan Sandin and designed between 1971 and 1974. Some called it the "video equivalent of a Moog audio synthesizer." It accepted basic video signals and mixed and modified them in a fashion similar to what a Moog synthesizer did with audio. An analog, Modular Synthesizer, real time, video processing instrument, it provided video processing performance and produced subtle and delicate video effects of a complexity not seen again until well into the digital video revolution.

William Etra was a live video pioneer and the co-inventor of the Rutt/Etra Video Synthesizer.

<span class="mw-page-title-main">Sound Blaster Live!</span>

Sound Blaster Live! is a PCI add-on sound card from Creative Technology Limited for PCs. Moving from ISA to PCI allowed the card to dispense with onboard memory, storing digital samples in the computer's main memory and then accessing them in real time over the bus. This allowed for a much wider selection of, and longer playing, samples. It also included higher quality sound output at all levels, quadrophonic output, and a new MIDI synthesizer with 64 sampled voices. The Live! was introduced in August 1998 and variations on the design remained Creative's primary sound card line into the early 2000's.

<span class="mw-page-title-main">VJing</span> Broad designation for realtime visual performance

VJing is a broad designation for realtime visual performance. Characteristics of VJing are the creation or manipulation of imagery in realtime through technological mediation and for an audience, in synchronization to music. VJing often takes place at events such as concerts, nightclubs, music festivals and sometimes in combination with other performative arts. This results in a live multimedia performance that can include music, actors and dancers. The term VJing became popular in its association with MTV's Video Jockey but its origins date back to the New York club scene of the 1970s. In both situations VJing is the manipulation or selection of visuals, the same way DJing is a selection and manipulation of audio.

<span class="mw-page-title-main">Daniel J. Sandin</span> American artist and researcher

Daniel J. Sandin is an American video and computer graphics artist, designer and researcher. He is a Professor Emeritus of the School of Art & Design at University of Illinois at Chicago, and co-director of the Electronic Visualization Laboratory (EVL) at the University of Illinois at Chicago. He is an internationally recognized pioneer in computer graphics, electronic art and visualization.

<span class="mw-page-title-main">Steina and Woody Vasulka</span> Collaborative video artist team

Steina Vasulka and Woody Vasulka are early pioneers of video art, and have been producing work since the early 1960s. The couple met in the early 1960s and moved to New York City in 1965, where they began showing video art at the Whitney Museum and founded The Kitchen in 1971. Steina and Woody both became Guggenheim fellows: Steina in 1976, and Woody in 1979.

Phil Morton (1945–2003) was an influential American video artist and activist who founded the Video Area in 1970 at the School of the Art Institute of Chicago, where he taught for many years.

<span class="mw-page-title-main">Rutt/Etra Video Synthesizer</span>

The Rutt/Etra Video Synthesizer is an analog raster manipulation device for image processing and real-time animation. The Rutt/Etra was co-invented by Steve Rutt and Bill Etra.

The Bell Labs Digital Synthesizer, better known as the Alles Machine or Alice, was an experimental additive synthesizer designed by Hal Alles at Bell Labs during the 1970s. The Alles Machine used computer-controlled 16-bit digital synthesizer operating at 30k samples/sec with 32 sine-wave oscillators. The Alles Machine has been called the first true digital additive synthesizer, following on earlier Bell experiments that were partially or wholly implemented as software on large computers. Only one full-length composition was recorded for the machine, before it was disassembled and donated to Oberlin Conservatory's TIMARA department in 1981. Several commercial synthesizers based on the Alles design were released during the 1980s, including the Atari AMY sound chip.

<span class="mw-page-title-main">Experimental Television Center</span> Nonprofit media arts organization

Experimental Television Center is a 501(c)(3) nonprofit electronic and media art center.

<span class="mw-page-title-main">Noisefields (1974)</span>

The Video Noisefields (1974) by Steina and Woody Vasulka is an important example of early formal and technical experimentation with analog video. The video runs for twelve minutes and five seconds and materially visualizes the deflected energy of the electronic signal. The video switches between two sources throughout, which creates a flickering effect. The imagery is based on the deflection of electronic signals, and a colorizer is used to add color variation. In the video, a circular form materializes on the screen and presents a division between inner and outer. A pulsation between the two is sustained throughout.

<span class="mw-page-title-main">Sound chip</span> Integrated circuit designed to produce audio signals

A sound chip is an integrated circuit (chip) designed to produce audio signals through digital, analog or mixed-mode electronics. Sound chips are typically fabricated on metal–oxide–semiconductor (MOS) mixed-signal chips that process audio signals. They normally contain audio components such as oscillators, envelope controllers, samplers, filters, amplifiers, and envelope generators.

References

  1. 1 2 "CHromaton 14". audiovisualizers.com. Archived from the original on 2000-07-11.
  2. Hinton, Graham (2001-06-17). "Spectron (formerly Spectre) (1974/5)". A Guide to the EMS Product Range - 1969 to 1979. Cornwall: Electronic Music Studios. Archived from the original on 2013-10-31. Designer: Richard Monkhouse. Innovative Video Synthesiser using analogue and digital techniques. ... The prototype was used to provide a projected lightshow for an early Tangerine Dream concert at the London Rainbow. 15 Built.
  3. "SPECTRE Color Video Synthesizer". AudioVisualizers.com. Archived from the original on 2013-05-23. This page is based upon an article by David Kirk, for FOCUS magazine ... .
  4. "Video Synthesizers". AudioVisualizers.com. Archived from the original on 2013-05-21.
    "Tool Shack". AudioVisualizers.com. Archived from the original on 2013-10-19.
    "EMS SPECTRE - User Manual". AudioVisualizers.com. Archived from the original on 2014-04-10.
  5. Anthony Singleton (12 October 2009). "Scanimate News Report" via YouTube.
  6. Kearns, Mary Ann (1988). The Role of Technology in the Art of Nam June Paik: Paik's Videotapes (Thesis). Unpublished manuscript for MA degree at School of the Arts of Virginia Commonwealth University. Retrieved 15 May 2023.
  7. More artworks created by this technology can be found in the Experimental Television Center Archived 2020-05-17 at the Wayback Machine in the Rose Goldsen Archive of New Media Art, Cornell University Library.
  8. "The Daniel Langlois Foundation - CR+D/Document". www.fondation-langlois.org.
  9. "Chromasope Video Synthesizer". Eyetrap.net.
  10. "Thump". Vice.
  11. "Video Scope". Critter & Guitari. 25 September 2011. Archived from the original on 2011-09-25.
  12. 1 2 "Blog". Critter & Guitari.
  13. Elliot, Patrick. "Ming Mecca, The Jazz Instrument for Videogame Improvisation". Kill Screen . 30 March 2015.
  14. Yocheeaka 7dex, V. J. (2018-05-27). "Cat Full Of Ghosts – Video Equations". Visual Society (in German). Retrieved 2021-01-23.{{cite web}}: CS1 maint: numeric names: authors list (link)
  15. Carman, Ashley (27 April 2016). "The Lumen app emulates an analog video synth". The Verge.
  16. Pangburn, DJ. "Meet Ming Micro, the Portable 8-Bit Video and Audio Synthesizer". Vice . 9 February 2016. ISSN   1077-6788
  17. "ETC Video Synthesizer". Critter & Guitari.
  18. "EYESY Video Synthesizer". Critter & Guitari.
  19. 1 2 "Waveblitter Video Synthesizer". Blittertech.

Bibliography

Books
Web

Further reading

AudioVisualizers.com historical archive of Video Synthesizer hardware. Now defunct, copy at archive,org

Commons-logo.svg Media related to Video synthesizers at Wikimedia Commons