Visual music, sometimes called color music, refers to the creation of a visual analogue to musical form by adapting musical structures for visual composition, which can also include silent films or silent Lumia work. It also refers to methods or devices which can translate sounds or music into a related visual presentation. An expanded definition may include the translation of music to painting; this was the original definition of the term, as coined by Roger Fry in 1912 to describe the work of Wassily Kandinsky.[1] There are a variety of definitions of visual music, particularly as the field continues to expand. In some recent writing, usually in the fine art world, visual music is often confused with or defined as synaesthesia, though historically this has never been a definition of visual music. Visual music has also been defined as a form of intermedia.
Visual music also refers to systems which convert music or sound directly into visual forms, such as film, video, computer graphics, installations or performances by means of a mechanical instrument, an artist's interpretation, or a computer. The reverse is applicable also, literally converting images to sound by drawn objects and figures on a film's soundtrack, in a technique known as drawn or graphical sound. Famous visual music artists include Mary Ellen Bute, Jordan Belson, Oskar Fischinger, Norman McLaren, John Whitney Sr., and Thomas Wilfred, plus a number of contemporary artists.
Instruments
The history of this tradition includes many experiments with color organs. Artist or inventors "built instruments, usually called 'color organs,' that would display modulated colored light in some kind of fluid fashion comparable to music".[2] For example, the Farblichtspiele ('colored-light-plays') of former Bauhaus student Ludwig Hirschfeld Mack. Several different definitions of color music exist; one is that color music is generally formless projections of colored light. Some scholars and writers have used the term color music interchangeably with visual music.
Visual music and abstract film or video often coincide. Some of the earliest known films of these two genres were hand-painted works produced by the Futurists Bruno Corra[3] and Arnaldo Ginna between 1911 and 1912 (as they report in the Futurist Manifesto of Cinema), which are now lost. Mary Hallock-Greenewalt produced several reels of hand-painted films (although not traditional motion pictures) that are held by the Historical Society of Philadelphia. Like the Futurist films, and many other visual music films, her 'films' were meant to be a visualization of musical form.
The cathode ray tube made possible the oscilloscope, an early electronic device that can produce images that are easily associated with sounds from microphones. The modern Laser lighting display displays wave patterns produced by similar circuitry. The imagery used to represent audio in digital audio workstations is largely based on familiar oscilloscope patterns.
The Animusic company (originally called 'Visual Music') has repeatedly demonstrated the use of computers to convert music — principally pop-rock based and composed as MIDI events — to animations. Graphic artist-designed virtual instruments which either play themselves or are played by virtual objects are all, along with the sounds, controlled by MIDI instructions.[4]
In the image-to-sound sphere, MetaSynth[5] includes a feature which converts images to sounds. The tool uses drawn or imported bitmap images, which can be manipulated with graphic tools, to generate new sounds or process existing audio. A reverse function allows the creation of images from sounds.[6]
Dina Riccò & Maria José de Cordoba (edited by), "MuVi. Video and moving image on synesthesia and visual music", Milan: Edizioni Poli.design, 2007. [Book + DVD]
Dina Riccò & Maria José de Cordoba (edited by), "MuVi3. Video and moving image on synesthesia and visual music", Ediciones Fundación Internacional Artecittà [Granada, 2012] [Book + DVD]
Augmented reality (AR) is an interactive experience that combines the real world and computer-generated 3D content. The content can span multiple sensory modalities, including visual, auditory, haptic, somatosensory and olfactory. AR can be defined as a system that incorporates three basic features: a combination of real and virtual worlds, real-time interaction, and accurate 3D registration of virtual and real objects. The overlaid sensory information can be constructive, or destructive. As such, it is one of the key technologies in the reality-virtuality continuum.
Drawn-on-film animation, also known as direct animation or animation without camera, is an animation technique where footage is produced by creating the images directly on film stock, as opposed to any other form of animation where the images or objects are photographed frame by frame with an animation camera.
Oskar Wilhelm Fischinger was a German-American abstract animator, filmmaker, and painter, notable for creating abstract musical animation many decades before the appearance of computer graphics and music videos. He created special effects for Fritz Lang's 1929 Woman in the Moon, one of the first sci-fi rocket films, and influenced Disney's Fantasia. He made over 50 short films and painted around 800 canvases, many of which are in museums, galleries, and collections worldwide. Among his film works is Motion Painting No. 1 (1947), which is now listed on the National Film Registry of the U.S. Library of Congress.
Mary Elizabeth Hallock-Greenewalt was an inventor and pianist who performed with the Philadelphia and Pittsburgh symphonies as a soloist. She is best known for her invention of a type of visual music she called Nourathar.
Marco Brambilla is an Italian-born Canadian contemporary artist and film director, known for re-contextualizations of popular and found imagery, and use of 3D imaging technologies in public installations and video art.
Toshio Iwai is a Japanese interactive media and installation artist who has also created a number of commercial video games. In addition he has worked in television, music performance, museum design and digital musical instrument design.
The term color organ refers to a tradition of mechanical devices built to represent sound and accompany music in a visual medium. The earliest created color organs were manual instruments based on the harpsichord design. By the 1900s they were electromechanical. In the early 20th century, a silent color organ tradition (Lumia) developed. In the 1960s and 1970s, the term "color organ" became popularly associated with electronic devices that responded to their music inputs with light shows. The term "light organ" is increasingly being used for these devices; allowing "color organ" to reassume its original meaning.
Music visualization or music visualisation, a feature found in electronic music visualizers and media player software, generates animated imagery based on a piece of music. The imagery is usually generated and rendered in real time and in a way synchronized with the music as it is played.
William Moritz, film historian, specialized in visual music and experimental animation. His principal published works concerned abstract filmmaker and painter Oskar Fischinger. He also wrote extensively on other visual music artists who worked with motion pictures, including James and John Whitney and Jordan Belson; Moritz also published on German cinema, Visual Music, color organs, experimental animation, avant-garde film and the California School of Color Music.
VJing is a broad designation for realtime visual performance. Characteristics of VJing are the creation or manipulation of imagery in realtime through technological mediation and for an audience, in synchronization to music. VJing often takes place at events such as concerts, nightclubs, music festivals and sometimes in combination with other performative arts. This results in a live multimedia performance that can include music, actors and dancers. The term VJing became popular in its association with MTV's Video Jockey but its origins date back to the New York club scene of the 1970s. In both situations VJing is the manipulation or selection of visuals, the same way DJing is a selection and manipulation of audio.
Mary Ellen Bute was a pioneer American film animator, producer, and director. She was one of the first female experimental filmmakers, and was the creator of some of the first electronically generated film images. Her specialty was visual music; while working in New York City between 1934 and 1958, Bute made fourteen short abstract musical films. Many of these were seen in regular movie theaters, such as Radio City Music Hall, usually preceding a prestigious film. Several of her abstract films were part of her Seeing Sound series.
Thomas Wilfred, born Richard Edgar Løvstrøm, was a visual artist, inventor, designer and musician. He is best known for his art of light, which he named lumia, and his designs for color organs called Clavilux. Wilfred was not fond of the term "color organ", and coined the word "Clavilux" from Latin meaning "light played by key". His innovative, mobile works prefigured the kinetic and op art movement and the advent of light art in America, and influenced subsequent generations of visual artists.
Michael Betancourt is a critical theorist, film theorist, art & film historian, and animator. His principal published works focus on the critique of digital capitalism, motion graphics, visual music, new media art, theory, and formalist study of motion pictures.
The phrase synesthesia in art has historically referred to a wide variety of artists' experiments that have explored the co-operation of the senses in the genres of visual music, music visualization, audiovisual art, abstract film, and intermedia. The age-old artistic views on synesthesia have some overlap with the current neuroscientific view on neurological synesthesia, but also some major differences, e.g. in the contexts of investigations, types of synesthesia selected, and definitions. While in neuroscientific studies synesthesia is defined as the elicitation of perceptual experiences in the absence of the normal sensory stimulation, in the arts the concept of synaesthesia is more often defined as the simultaneous perception of two or more stimuli as one gestalt experience. The usage of the term synesthesia in art should, therefore, be differentiated from neurological synesthesia in scientific research. Synesthesia is by no means unique to artists or musicians. Only in the last decades have scientific methods become available to assess synesthesia in persons. For synesthesia in artists before that time one has to interpret (auto)biographical information. For instance, there has been debate on the neurological synesthesia of historical artists like Kandinsky and Scriabin. Additionally, Synesthetic art may refer to either art created by synesthetes or art created to elicit synesthetic experience in the general audience.
Clavilux is the term coined by the artist Thomas Wilfred to refer to his mechanical invention that allowed the creation and performance of lumia, which was Wilfred's term for light art.
Synesthesia or synaesthesia is a perceptual phenomenon in which stimulation of one sensory or cognitive pathway leads to involuntary experiences in a second sensory or cognitive pathway. For instance, people with synesthesia may experience colors when listening to music, see shapes when smelling certain scents, or perceive tastes when looking at words. People who report a lifelong history of such experiences are known as synesthetes. Awareness of synesthetic perceptions varies from person to person with the perception of synesthesia differing based on an individual's unique life experiences and the specific type of synesthesia that they have. In one common form of synesthesia, known as grapheme–color synesthesia or color–graphemic synesthesia, letters or numbers are perceived as inherently colored. In spatial-sequence, or number form synesthesia, numbers, months of the year, or days of the week elicit precise locations in space, or may appear as a three-dimensional map. Synesthetic associations can occur in any combination and any number of senses or cognitive pathways.
Aaron Koblin is an American digital media artist and entrepreneur best known for his innovative use of data visualization and his pioneering work in crowdsourcing, virtual reality, and interactive film. He is co-founder and president of virtual reality company Within, founded with Chris Milk. The company created the popular virtual reality fitness app Supernatural, which was acquired by Meta in 2023. Formerly he created and lead the Data Arts Team at Google in San Francisco, California from 2008 to 2015.
Non-narrative film is an aesthetic of cinematic film that does not narrate, or relate "an event, whether real or imaginary". It is usually a form of art film or experimental film, not made for mass entertainment.
Indigenous futurisms is a movement in literature, visual art, comics, video games, and other media that expresses Indigenous perspectives of the future, past, and present in the context of science fiction and related sub-genres. Such perspectives may reflect Indigenous ways of knowing, oral history, historical or contemporary politics, and cultural perspectives.
Volumetric capture or volumetric video is a technique that captures a three-dimensional space, such as a location or performance. This type of volumography acquires data that can be viewed on flat screens as well as using 3D displays and VR goggles. Consumer-facing formats are numerous and the required motion capture techniques lean on computer graphics, photogrammetry, and other computation-based methods. The viewer generally experiences the result in a real-time engine and has direct input in exploring the generated volume.
This page is based on this Wikipedia article Text is available under the CC BY-SA 4.0 license; additional terms may apply. Images, videos and audio are available under their respective licenses.
