This article has multiple issues. Please help improve it or discuss these issues on the talk page . (Learn how and when to remove these template messages)
|
AudioCubes are a collection of wireless intelligent light-emitting objects, capable of detecting each other's location, orientation, and user gestures. They were created by Bert Schiettecatte as electronic musical instruments for use by musicians in live performance, sound design, musical composition, and for creating interactive applications in max/msp, pd and C++.
The concept of AudioCubes was first presented by Schiettecatte in April 2004 at the CHI2004 conference in Vienna. [1] An initial prototype of AudioCubes was shown at the Museum for Contemporary Art, MUHKA in Antwerp in December 2004. AudioCubes were also featured in an art installation created in collaboration with Peter Swinnen during the Champ D’Action Time Canvas festival. [2]
In January 2007, AudioCubes were released to the commercial market [3] and offered for sale on the website of Percussa, a company Schiettecatte founded in October 2004 to promote AudioCubes.
Each AudioCube is identical, and has a small built-in computer which is able to detect the position and location of the other cubes in a network and measure the distances between them. AudioCubes also work without drivers and communicate using high speed HID.
An AudioCube has four onboard infrared sensors (one on each horizonal face) to communicate and measure distances to objects nearby, digital signal processors (DSP), a USB-rechargeable battery, and a translucent housing.
The bottom and top sides of each do not have any such sensors. Thus any distance driven arrangement of cubes is limited to a single horizontal (e.g. table top) level of interactivity. That is, the cubes are not typically stacked on top of each other.
AudioCubes work wirelessly with MIDI-compatible software and hardware (e.g. FL Studio, Logic Pro, Reason, drum machines and Monome). A connection must be established using middleware such as MIDIBridge.
AudioCubes also come with an Open Sound Control (OSC) server to send and receive OSC data. [4]
Several applications have been created for use with AudioCubes, each with a different focus, such as sound design, music composition, live performance, or for creating applications in max/msp, pd and C++.
In addition, a number of Max/MSP patches were created to work with AudioCubes.
The AudioCubes can be used to send MIDI notes to MIDI compatible software/hardware using MIDIBridge. When two AudioCubes are put next to each other, they detect each other, and triggers are sent as MIDI notes. These triggers can then be used to control on/off type of signals, such as start and stop audio clips in a Digital Audio Workstation (DAW), such as Ableton Live. At each face of the cube, a different audio clip can be assigned in a DAW.
The AudioCubes can also measure distances to nearby objects or your hands when configured as a sensor cube in MIDIBridge. [5] In the same way, this sensor data is sent to the computer as a continuous controller (CC) which can be used to control parameters in the DAW. Since each cube has 4 sensors, up to 4 parameters can be controlled per AudioCube.
In addition, you can also control the RGB colors of the AudioCubes and use this information as feedback during a live performance. [5]
The sensors of the AudioCubes can also be used to shape sounds. By moving hands and fingers closer or further away from the 4 sensors, it generates 4 different MIDI CCs which can be sent to MIDI compatible instruments. When using an AudioCube in this way, it can be compared to a 4D optical theremin.
The AudioCubes can also be linked to LFOs by using the software application Evolvor. The LFO waveforms are designed in the graphical editors of Evolvor. Each AudioCube is then automatically linked to an LFO, because of the topology detection. LFO signals can be added and removed, by adding and removing AudioCubes. The signals can also be mixed and matched, by mixing and matching AudioCubes.
When using the Improvisor application, velocity as well as semitone patterns are automatically linked to every AudioCube. Every AudioCube plays the melody created by both patterns. When cubes are placed next to each other they can follow the same melody. In this way, music can be composed by mixing and rearranging AudioCubes.
Several tools have been created to make applications for the AudioCubes in max/msp, pure data, and C++.
AudioCubes have been used by some performers such as Mark Mosher, [6] Pearls for Swines, Richard Devine, Steve Baltes, Bostich from Nortec, Ilan Kriger, Arecio Smith, Julien Pauty, and the European Bridges Ensemble. [7]
AudioCubes are an example of a Tangible User Interface. In the past few years[ when? ] a lot of research has been done in the field of Tangible User Interfaces. The Reactable is another example of such an interface. It is an installation on which people can move around objects which are followed by a camera and projector on a surface.
For the creation of the AudioCubes, Bert Schiettecatte received in 2009 the prestigious Qwartz Electronic Music Awards in Paris. He was also invited to give a talk at TEDx Mediterranean in Cannes, September 2010. [8]
MIDI is a technical standard that describes a communication protocol, digital interface, and electrical connectors that connect a wide variety of electronic musical instruments, computers, and related audio devices for playing, editing, and recording music.
A music sequencer is a device or application software that can record, edit, or play back music, by handling note and performance information in several forms, typically CV/Gate, MIDI, or Open Sound Control, and possibly audio and automation data for digital audio workstations (DAWs) and plug-ins.
Open Sound Control (OSC) is a protocol for networking sound synthesizers, computers, and other multimedia devices for purposes such as musical performance or show control. OSC's advantages include interoperability, accuracy, flexibility and enhanced organization and documentation. Its disadvantages include inefficient coding of information, increased load on embedded processors, and lack of standardized messages/interoperability. The first specification was released in March 2002.
Virtual Studio Technology (VST) is an audio plug-in software interface that integrates software synthesizers and effects units into digital audio workstations. VST and similar technologies use digital signal processing to simulate traditional recording studio hardware in software. Thousands of plugins exist, both commercial and freeware, and many audio applications support VST under license from its creator, Steinberg.
A digital audio workstation is an electronic device or application software used for recording, editing and producing audio files. DAWs come in a wide variety of configurations from a single software program on a laptop, to an integrated stand-alone unit, all the way to a highly complex configuration of numerous components controlled by a central computer. Regardless of configuration, modern DAWs have a central interface that allows the user to alter and mix multiple recordings and tracks into a final produced piece.
Audio editing software is any software or computer program which allows editing and generating audio data. Audio editing software can be implemented completely or partly as a library, as a computer application, as a web application, or as a loadable kernel module. Wave editors are digital audio editors. There are many sources of software available to perform this function. Most can edit music, apply effects and filters, and adjust stereo channels.
Renoise is a digital audio workstation (DAW) based upon the heritage and development of tracker software. Its primary use is the composition of music using sound samples, soft synths, and effects plug-ins. It is also able to interface with MIDI and OSC equipment. The main difference between Renoise and other music software is the characteristic vertical timeline sequencer used by tracking software.
Max, also known as Max/MSP/Jitter, is a visual programming language for music and multimedia developed and maintained by San Francisco-based software company Cycling '74. Over its more than thirty-year history, it has been used by composers, performers, software designers, researchers, and artists to create recordings, performances, and installations.
Novation Digital Music Systems Ltd. is a British musical equipment manufacturer, founded in 1992 by Ian Jannaway and Mark Thompson as Novation Electronic Music Systems. Today the company specializes in MIDI controllers with and without keyboards, both analog and virtual analog performance synthesizers, grid-based performance controllers, and audio interfaces. At present, Novation products are primarily manufactured in China.
A MIDI controller is any hardware or software that generates and transmits Musical Instrument Digital Interface (MIDI) data to MIDI-enabled devices, typically to trigger sounds and control parameters of an electronic music performance. They most often use a musical keyboard to send data about the pitch of notes to play, although a MIDI controller may trigger lighting and other effects. A wind controller has a sensor that converts breath pressure to volume information and lip pressure to control pitch. Controllers for percussion and stringed instruments exist, as well as specialized and experimental devices. Some MIDI controllers are used in association with specific digital audio workstation software. The original MIDI specification has been extended to include a greater range of control features.
Logic Pro is a proprietary digital audio workstation (DAW) and MIDI sequencer software application for the macOS platform developed by Apple Inc. It was originally created in the early 1990s as Notator Logic, or Logic, by German software developer C-Lab which later went by Emagic. Apple acquired Emagic in 2002 and renamed Logic to Logic Pro. It was the second most popular DAW – after Ableton Live – according to a survey conducted in 2015.
A MIDI keyboard or controller keyboard is typically a piano-style electronic musical keyboard, often with other buttons, wheels and sliders, used as a MIDI controller for sending Musical Instrument Digital Interface (MIDI) commands over a USB or MIDI 5-pin cable to other musical devices or computers. MIDI keyboards lacking an onboard sound module cannot produce sounds themselves, however some models of MIDI keyboards contain both a MIDI controller and sound module.
The Lemur was a highly customizable multi-touch device from French company JazzMutant founded by Yoann Gantch, Pascal Joguet, Guillaume Largillier and Julien Olivier in 2002, which served as a controller for musical devices such as synthesizers and mixing consoles, as well as for other media applications such as video performances. As an audio tool, the Lemur's role was equivalent to that of a MIDI controller in a MIDI studio setup, except that the Lemur used the Open Sound Control (OSC) protocol, a high-speed networking replacement for MIDI. The controller was especially well-suited for use with Reaktor and Max/MSP, tools for building custom software synthesizers.
Human User Interface Protocol is a proprietary MIDI communications protocol for interfacing between a hardware audio control surface and digital audio workstation (DAW) software. It was first created by Mackie and Digidesign in 1997 for use with Pro Tools, and is now part of the Mackie Control Universal (MCU) protocol.
FluidSynth, formerly named iiwusynth, is a free open source software synthesizer which converts MIDI note data into an audio signal using SoundFont technology without need for a SoundFont-compatible soundcard. FluidSynth can act as a virtual MIDI device, able to receive MIDI data from any program and transform it into audio on-the-fly. It can also read in SMF (.mid) files directly. On the output side, it can send audio data directly to an audio device for playback, or to a Raw or Wave file. It can also convert a SMF file directly to an audio file in faster-than-real-time. The combination of these features gives FluidSynth the following major use cases:
Bidule is a commercial software application for the creation of interactive computer music and multimedia produced by the Canadian company Plogue Arts and Technology. It runs on both Windows and Mac computers.
I-CubeX comprises a system of sensors, actuators and interfaces that are configured by a personal computer. Using MIDI, Bluetooth or the Universal Serial Bus (USB) as the basis for all communication, the complexity is managed behind a variety of software tools, including an end-user configuration editor, Max (software) plugins, and a C++ Application Programming Interface (API), which allows applications to be developed in Mac OS X, Linux and Windows operating systems.
Cycling '74 is an American software development company founded in 1997 by David Zicarelli, headquartered in San Francisco, California and owned by Ableton. The company employs the digital signal processing software tool, Max.
Bert Schiettecatte is a Belgian entrepreneur who created the Audiocubes.
Making Waves (MW) is computer software designed to produce professional quality audio from basic Windows multimedia PCs. This application was among the first of the 16-bit digital sequencers that evolved from the MS-DOS WAV trackers of the Eighties to become the digital audio workstation software available today including Steinberg Cubase, Pro Tools and ACID Pro. Making Waves enabled a small community of independent artists to use existing hardware to record, sample, mix and render their own original work creating professional-quality audio with a modest investment of less than $100. This same dynamic user community played a significant role in the application's development, suggesting program revisions and performing extensive beta testing. These users were all organized and mentored by Stephen John Steele, the original programmer and developer of Making Waves as well as a founding director of Perceptive Solutions, Spacehead Systems and Making Waves Software Limited.