Visual music

Last updated
Lichtspiel: Opus I (1921) by Walter Ruttmann

Visual music, sometimes called color music, refers to the creation of a visual analogue to musical form by adapting musical structures for visual composition, which can also include silent films or silent Lumia work. It also refers to methods or devices which can translate sounds or music into a related visual presentation. An expanded definition may include the translation of music to painting; this was the original definition of the term, as coined by Roger Fry in 1912 to describe the work of Wassily Kandinsky. [1] There are a variety of definitions of visual music, particularly as the field continues to expand. In some recent writing, usually in the fine art world, visual music is often confused with or defined as synaesthesia, though historically this has never been a definition of visual music. Visual music has also been defined as a form of intermedia.

Contents

Visual music also refers to systems which convert music or sound directly into visual forms, such as film, video, computer graphics, installations or performances by means of a mechanical instrument, an artist's interpretation, or a computer. The reverse is applicable also, literally converting images to sound by drawn objects and figures on a film's soundtrack, in a technique known as drawn or graphical sound. Famous visual music artists include Mary Ellen Bute, Jordan Belson, Oskar Fischinger, Norman McLaren, John Whitney Sr., and Thomas Wilfred, plus a number of contemporary artists.

Instruments

The history of this tradition includes many experiments with color organs. Artist or inventors "built instruments, usually called 'color organs,' that would display modulated colored light in some kind of fluid fashion comparable to music". [2] For example, the Farblichtspiele ('colored-light-plays') of former Bauhaus student Ludwig Hirschfeld Mack. Several different definitions of color music exist; one is that color music is generally formless projections of colored light. Some scholars and writers have used the term color music interchangeably with visual music.

The construction of instruments to perform visual music live, as with sonic music, has been a continuous concern of this art. Color organs, while related, form an earlier tradition extending as early as the eighteenth century with the Jesuit Louis Bertrand Castel building an ocular harpsichord in the 1730s (visited by Georg Philipp Telemann, who composed for it). Other prominent color organ artist-inventors include: Alexander Wallace Rimington, Bainbridge Bishop, Thomas Wilfred, Charles Dockum, Mary Hallock-Greenewalt and Kurt Laurenz Theinert.[ citation needed ]

On film

Visual music and abstract film or video often coincide. Some of the earliest known films of these two genres were hand-painted works produced by the Futurists Bruno Corra [3] and Arnaldo Ginna between 1911 and 1912 (as they report in the Futurist Manifesto of Cinema), which are now lost. Mary Hallock-Greenewalt produced several reels of hand-painted films (although not traditional motion pictures) that are held by the Historical Society of Philadelphia. Like the Futurist films, and many other visual music films, her 'films' were meant to be a visualization of musical form.

Notable visual music filmmakers include: Walter Ruttmann, Hans Richter, Viking Eggeling, Oskar Fischinger, Len Lye, Mary Ellen Bute, Jordan Belson, Norman McLaren, Harry Smith, Hy Hirsh, John, James Whitney, Steven Woloshen, Richard Reeves and many others up to present day.

Computer graphics

Oscilloscope showing a single pitch, a sine wave Oscilloscope diagram.svg
Oscilloscope showing a single pitch, a sine wave

The cathode ray tube made possible the oscilloscope, an early electronic device that can produce images that are easily associated with sounds from microphones. The modern Laser lighting display displays wave patterns produced by similar circuitry. The imagery used to represent audio in digital audio workstations is largely based on familiar oscilloscope patterns.

The Animusic company (originally called 'Visual Music') has repeatedly demonstrated the use of computers to convert music principally pop-rock based and composed as MIDI events to animations. Graphic artist-designed virtual instruments which either play themselves or are played by virtual objects are all, along with the sounds, controlled by MIDI instructions. [4]

In the image-to-sound sphere, MetaSynth [5] includes a feature which converts images to sounds. The tool uses drawn or imported bitmap images, which can be manipulated with graphic tools, to generate new sounds or process existing audio. A reverse function allows the creation of images from sounds. [6]

Virtual reality

With the increasing popularity of head mounted displays for virtual reality [7] [8] [9] there is an emerging new platform for visual music. While some developers have been focused on the impact of virtual reality on live music [10] or on the possibilities for music videos, [11] virtual reality is also an emerging field for music visualization [12] [13] [14] [15] and visual music. [16]

Graphic notation

Many composers have applied graphic notation to write compositions. Pioneering examples are the graphical scores of John Cage and Morton Feldman. Also known is the graphical score of György Ligeti's Artikulation designed by Rainer Wehinger, and Sylvano Bussotti.

Musical theorists such as Harry Partch, Erv Wilson, Ivor Darreg, Glenn Branca, and Yuri Landman applied geometry in detailed visual musical diagrams explaining microtonal structures and musical scales.

See also

Science

Industry

Similar types of art

Notes

  1. Ward, Ossian (9 June 2006). "The man who heard his paintbox hiss" via www.telegraph.co.uk.
  2. Moritz, W, (1997), The Dream of Color Music, And Machines That Made it Possible in Animation World Magazine
  3. Bruno Corra at IMDb
  4. Alberts, Randy (March 22, 2006). "Inside Animusic's Astonishing Computer Music Videos". O'Reilly Media, Inc. Retrieved 15 June 2010.
  5. "MetaSynth 5 for Mac OS". www.uisoftware.com.
  6. Sasso, Len (1 October 2005). "U&I SOFTWARE MetaSynth 4 (Mac)". Electronic Musician. Archived from the original on 1 March 2010. Retrieved 15 June 2010.
  7. "Tractica: Expect Big Sales of VR Head-Mounted Displays". www.wearabletechworld.com.
  8. "Global VR headset sales by brand 2016-2017 - Statistic". Statista.
  9. "How Big Is the Installed Base for Virtual Reality? - Studio Daily". studiodaily.com. 11 January 2017.
  10. "How virtual reality is redefining live music". nbcnews.com. 28 November 2016.
  11. Moylan, Brian (4 August 2016). "Virtual insanity: is VR the new frontier for music videos?". the Guardian.
  12. Mills, Chris (19 June 2015). "VR Music Visualizers Are Like Tripping Without Drugs". gizmodo.com.
  13. "Does anybody really want a virtual reality music visualizer?". theverge.com. 28 December 2015.
  14. "GrooVR Music Driven Virtual Reality - Music Visualizer". groovr.com.
  15. "PlayStation.Blog". PlayStation.Blog. 17 June 2015.
  16. "Inventor updates '70s creation to bring 3-D vision to music - The Boston Globe". bostonglobe.com.

Further reading

Related Research Articles

<span class="mw-page-title-main">Drawn-on-film animation</span> Animation technique

Drawn-on-film animation, also known as direct animation or animation without camera, is an animation technique where footage is produced by creating the images directly on film stock, as opposed to any other form of animation where the images or objects are photographed frame by frame with an animation camera.

Oskar Wilhelm Fischinger was a German-American abstract animator, filmmaker, and painter, notable for creating abstract musical animation many decades before the appearance of computer graphics and music videos. He created special effects for Fritz Lang's 1929 Woman in the Moon, one of the first sci-fi rocket films, and influenced Disney's Fantasia. He made over 50 short films and painted around 800 canvases, many of which are in museums, galleries, and collections worldwide. Among his film works is Motion Painting No. 1 (1947), which is now listed on the National Film Registry of the U.S. Library of Congress.

<span class="mw-page-title-main">Mary Hallock-Greenewalt</span> Inventor and pianist (1871-1950)

Mary Elizabeth Hallock-Greenewalt was an inventor and pianist who performed with the Philadelphia and Pittsburgh symphonies as a soloist. She is best known for her invention of a type of visual music she called Nourathar.

<span class="mw-page-title-main">Marco Brambilla</span> Italian-Canadian director

Marco Brambilla is an Italian-born Canadian contemporary artist and film director, known for re-contextualizations of popular and found imagery, and use of 3D imaging technologies in public installations and video art.

<span class="mw-page-title-main">Toshio Iwai</span> Japanese artist

Toshio Iwai is a Japanese interactive media and installation artist who has also created a number of commercial video games. In addition he has worked in television, music performance, museum design and digital musical instrument design.

The term color organ refers to a tradition of mechanical devices built to represent sound and accompany music in a visual medium. The earliest created color organs were manual instruments based on the harpsichord design. By the 1900s they were electromechanical. In the early 20th century, a silent color organ tradition (Lumia) developed. In the 1960s and 1970s, the term "color organ" became popularly associated with electronic devices that responded to their music inputs with light shows. The term "light organ" is increasingly being used for these devices; allowing "color organ" to reassume its original meaning.

<span class="mw-page-title-main">Music visualization</span> Generation of animated imagery based on a piece of music

Music visualization or music visualisation, a feature found in electronic music visualizers and media player software, generates animated imagery based on a piece of music. The imagery is usually generated and rendered in real time and in a way synchronized with the music as it is played.

William Moritz, film historian, specialized in visual music and experimental animation. His principal published works concerned abstract filmmaker and painter Oskar Fischinger. He also wrote extensively on other visual music artists who worked with motion pictures, including James and John Whitney and Jordan Belson; Moritz also published on German cinema, Visual Music, color organs, experimental animation, avant-garde film and the California School of Color Music.

<span class="mw-page-title-main">VJing</span> Broad designation for realtime visual performance

VJing is a broad designation for realtime visual performance. Characteristics of VJing are the creation or manipulation of imagery in realtime through technological mediation and for an audience, in synchronization to music. VJing often takes place at events such as concerts, nightclubs, music festivals and sometimes in combination with other performative arts. This results in a live multimedia performance that can include music, actors and dancers. The term VJing became popular in its association with MTV's Video Jockey but its origins date back to the New York club scene of the 1970s. In both situations VJing is the manipulation or selection of visuals, the same way DJing is a selection and manipulation of audio.

<span class="mw-page-title-main">Mary Ellen Bute</span> American film director and animator

Mary Ellen Bute was a pioneer American film animator, producer, and director. She was one of the first female experimental filmmakers, and was the creator of some of the first electronically generated film images. Her specialty was visual music; while working in New York City between 1934 and 1958, Bute made fourteen short abstract musical films. Many of these were seen in regular movie theaters, such as Radio City Music Hall, usually preceding a prestigious film. Several of her abstract films were part of her Seeing Sound series.

<span class="mw-page-title-main">Thomas Wilfred</span>

Thomas Wilfred, born Richard Edgar Løvstrøm, was a visual artist, inventor, designer and musician. He is best known for his art of light, which he named lumia, and his designs for color organs called Clavilux. Wilfred was not fond of the term "color organ", and coined the word "Clavilux" from Latin meaning "light played by key". His innovative, mobile works prefigured the kinetic and op art movement and the advent of light art in America, and influenced subsequent generations of visual artists.

<span class="mw-page-title-main">Michael Betancourt</span> American critical theorist, film theorist, art & film historian (b.1971)

Michael Betancourt is a critical theorist, film theorist, art & film historian, and animator. His principal published works focus on the critique of digital capitalism, motion graphics, visual music, new media art, theory, and formalist study of motion pictures.

The phrase synesthesia in art has historically referred to a wide variety of artists' experiments that have explored the co-operation of the senses in the genres of visual music, music visualization, audiovisual art, abstract film, and intermedia. The age-old artistic views on synesthesia have some overlap with the current neuroscientific view on neurological synesthesia, but also some major differences, e.g. in the contexts of investigations, types of synesthesia selected, and definitions. While in neuroscientific studies synesthesia is defined as the elicitation of perceptual experiences in the absence of the normal sensory stimulation, in the arts the concept of synaesthesia is more often defined as the simultaneous perception of two or more stimuli as one gestalt experience. The usage of the term synesthesia in art should, therefore, be differentiated from neurological synesthesia in scientific research. Synesthesia is by no means unique to artists or musicians. Only in the last decades have scientific methods become available to assess synesthesia in persons. For synesthesia in artists before that time one has to interpret (auto)biographical information. For instance, there has been debate on the neurological synesthesia of historical artists like Kandinsky and Scriabin. Additionally, Synesthetic art may refer to either art created by synesthetes or art created to elicit synesthetic experience in the general audience.

Clavilux is the term coined by the artist Thomas Wilfred to refer to his mechanical invention that allowed the creation and performance of lumia, which was Wilfred's term for light art.

<span class="mw-page-title-main">Immersion (virtual reality)</span> Perception of being physically present in a non-physical world

In virtual reality (VR), immersion is the perception of being physically present in a non-physical world. The perception is created by surrounding the user of the VR system in images, sound or other stimuli that provide an engrossing total environment.

<span class="mw-page-title-main">Synesthesia</span> Neurological condition involving the crossing of senses

Synesthesia or synaesthesia is a perceptual phenomenon in which stimulation of one sensory or cognitive pathway leads to involuntary experiences in a second sensory or cognitive pathway. For instance, people with synesthesia may experience colors when listening to music, see shapes when smelling certain scents, or perceive tastes when looking at words. People who report a lifelong history of such experiences are known as synesthetes. Awareness of synesthetic perceptions varies from person to person with the perception of synesthesia differing based on an individual's unique life experiences and the specific type of synesthesia that they have. In one common form of synesthesia, known as grapheme–color synesthesia or color–graphemic synesthesia, letters or numbers are perceived as inherently colored. In spatial-sequence, or number form synesthesia, numbers, months of the year, or days of the week elicit precise locations in space, or may appear as a three-dimensional map. Synesthetic associations can occur in any combination and any number of senses or cognitive pathways.

<span class="mw-page-title-main">Aaron Koblin</span> American digital media artist

Aaron Koblin is an American digital media artist and entrepreneur best known for his use of data visualization and his work in crowdsourcing, virtual reality, and interactive film. He is co-founder and president of virtual reality company Within, founded with Chris Milk. The company created the popular virtual reality fitness app Supernatural, which was acquired by Meta in 2023. Formerly he created and lead the Data Arts Team at Google in San Francisco, California from 2008 to 2015.

Non-narrative film is an aesthetic of cinematic film that does not narrate, or relate "an event, whether real or imaginary". It is usually a form of art film or experimental film, not made for mass entertainment.

<span class="mw-page-title-main">Harvey Goldman</span> American artist (born 1951)

Harvey Goldman is an American artist and educator.

Volumetric capture or volumetric video is a technique that captures a three-dimensional space, such as a location or performance. This type of volumography acquires data that can be viewed on flat screens as well as using 3D displays and VR goggles. Consumer-facing formats are numerous and the required motion capture techniques lean on computer graphics, photogrammetry, and other computation-based methods. The viewer generally experiences the result in a real-time engine and has direct input in exploring the generated volume.