Sonochromatism or sonochromatopsia (Latin: sono-, (sound) + Greek: chromat- (colour) + Greek: -opsia (seeing)) is a neurological phenomenon in which colours are perceived as sounds. [1] The phenomenon is created by the union between a brain and a colour-to-sound software or chip. People who report such experiences are known as sonochromats. [2] The term was coined by Neil Harbisson to differentiate his experience of colour from people with chromesthesia or colour-to-sound synesthesia. [3]
The main difference between chromesthesia and sonochromatism is that sonochromatism is not the union between two existing senses, instead, it is the creation of a new sense. [4] Sonochromats do not necessarily sense colour as a visual experience and are able to perceive colours outside the limits of human vision such as infrareds and ultraviolets. Their experience of colour is not involuntary, instead, it is caused by voluntary action such as a colour-to-sound chip implant or constant use of an eyeborg. The sounds perceived for each colour are not subjective, they are objective and they are related to the light frequencies of colour. [5]
Implantable colour-to-sound chips, software, mobile apps and cyborg antennas use Harbisson's Sonochromatic Scales as a standard transposition of colour frequencies to sound frequencies.
The Sonochromatic Music Scale is a microtonal and logarithmic scale with 360 notes in an octave. Each note corresponds to a specific degree of the color wheel. [6]
Harbisson's Pure Sonochromatic Scale is a non-logarithmic scale based on the transposition of light frequencies to sound frequencies. The scale includes infrareds and ultraviolets, discards colour as being part of a colour wheel and ignores musical/logarithmic perception so it can overstep the limits of human perception. [7]
Color or colour is the visual perception based on the electromagnetic spectrum. Though color is not an inherent property of matter, color perception is related to an object's light absorption, reflection, emission spectra and interference. For most humans, color are perceived in the visible light spectrum with three types of cone cells (trichromacy). Other animals may have a different number of cone cell types or have eyes sensitive to different wavelength, such as bees that can distinguish ultraviolet, and thus has a different color sensitivity range. Animal perception of color originates from different light wavelength or spectral sensitivity in cone cell types, which is then processed by the brain.
The electromagnetic spectrum is the range of frequencies of electromagnetic radiation and their respective wavelengths and photon energies.
Light or visible light is electromagnetic radiation that can be perceived by the human eye. Visible light is usually defined as having wavelengths in the range of 400–700 nanometres (nm), corresponding to frequencies of 750–420 terahertz, between the infrared and the ultraviolet.
The visible spectrum is the portion of the electromagnetic spectrum that is visible to the human eye. Electromagnetic radiation in this range of wavelengths is called visible light or simply light. A typical human eye will respond to wavelengths from about 380 to about 750 nanometers. In terms of frequency, this corresponds to a band in the vicinity of 400–790 terahertz. These boundaries are not sharply defined and may vary per individual. Under optimal conditions these limits of human perception can extend to 310 nm (ultraviolet) and 1100 nm . The optical spectrum is sometimes considered to be the same as the visible spectrum, but some authors define the term more broadly, to include the ultraviolet and infrared parts of the electromagnetic spectrum as well.
Time stretching is the process of changing the speed or duration of an audio signal without affecting its pitch. Pitch scaling is the opposite: the process of changing the pitch without affecting the speed. Pitch shift is pitch scaling implemented in an effects unit and intended for live performance. Pitch control is a simpler process which affects pitch and speed simultaneously by slowing down or speeding up a recording.
Pitch is a perceptual property of sounds that allows their ordering on a frequency-related scale, or more commonly, pitch is the quality that makes it possible to judge sounds as "higher" and "lower" in the sense associated with musical melodies. Pitch is a major auditory attribute of musical tones, along with duration, loudness, and timbre.
The Weber–Fechner laws are two related hypotheses in the field of psychophysics, known as Weber's law and Fechner's law. Both laws relate to human perception, more specifically the relation between the actual change in a physical stimulus and the perceived change. This includes stimuli to all senses: vision, hearing, taste, touch, and smell.
Color vision, a feature of visual perception, is an ability to perceive differences between light composed of different frequencies independently of light intensity. Color perception is a part of the larger visual system and is mediated by a complex process between neurons that begins with differential stimulation of different types of photoreceptors by light entering the eye. Those photoreceptors then emit outputs that are propagated through many layers of neurons and then ultimately to the brain. Color vision is found in many animals and is mediated by similar underlying mechanisms with common types of biological molecules and a complex history of evolution in different animal taxa. In primates, color vision may have evolved under selective pressure for a variety of visual tasks including the foraging for nutritious young leaves, ripe fruit, and flowers, as well as detecting predator camouflage and emotional states in other primates.
The clavier à lumières, or tastiera per luce, as it appears in the score, was a musical instrument invented by Alexander Scriabin for use in his work Prometheus: Poem of Fire. Only one version of this instrument was constructed, for the performance of Prometheus: Poem of Fire in New York City in 1915. The instrument was supposed to be a keyboard, with notes corresponding to colors as given by Scriabin's synesthetic system, specified in the score. However, numerous synesthesia researchers have cast doubt on the claim that Scriabin was a synesthete.
A color wheel or color circle is an abstract illustrative organization of color hues around a circle, which shows the relationships between primary colors, secondary colors, tertiary colors etc.
Speech perception is the process by which the sounds of language are heard, interpreted, and understood. The study of speech perception is closely linked to the fields of phonology and phonetics in linguistics and cognitive psychology and perception in psychology. Research in speech perception seeks to understand how human listeners recognize speech sounds and use this information to understand spoken language. Speech perception research has applications in building computer systems that can recognize speech, in improving speech recognition for hearing- and language-impaired listeners, and in foreign-language teaching.
Chromesthesia or sound-to-color synesthesia is a type of synesthesia in which sound involuntarily evokes an experience of color, shape, and movement. Individuals with sound-color synesthesia are consciously aware of their synesthetic color associations/perceptions in daily life. Synesthetes that perceive color while listening to music experience the colors in addition to the normal auditory sensations. The synesthetic color experience supplements, but does not obscure real, modality-specific perceptions. As with other forms of synesthesia, individuals with sound-color synesthesia perceive it spontaneously, without effort, and as their normal realm of experience. Chromesthesia can be induced by different auditory experiences, such as music, phonemes, speech, and/or everyday sounds.
Virtual pitch is the pitch of a complex tone. Virtual pitch corresponds approximately to the fundamental of a harmonic series that is recognized among the audible partials. A virtual pitch may be perceived even if the perceived pattern is incomplete or mistuned. In that respect, virtual pitch perception is similar to other forms of pattern recognition. It corresponds to the phenomenon whereby one's brain extracts tones from everyday signals and music, even if parts of the signal are masked by other sounds. Virtual pitch is contrasted to spectral pitch, which is the pitch of a pure tone or spectral component. Virtual pitch is called "virtual" because there is no acoustical correlate at the frequency corresponding to the pitch: even when a virtual pitch corresponds to a physically present fundamental, as it often does in everyday harmonic complex tones, the exact virtual pitch depends on the exact frequencies of higher harmonics and is almost independent of the exact frequency of the fundamental.
Synesthesia or synaesthesia is a perceptual phenomenon in which stimulation of one sensory or cognitive pathway leads to involuntary experiences in a second sensory or cognitive pathway. People who report a lifelong history of such experiences are known as synesthetes. Awareness of synesthetic perceptions varies from person to person. In one common form of synesthesia, known as grapheme–color synesthesia or color–graphemic synesthesia, letters or numbers are perceived as inherently colored. In spatial-sequence, or number form synesthesia, numbers, months of the year, or days of the week elicit precise locations in space, or may appear as a three-dimensional map. Synesthetic associations can occur in any combination and any number of senses or cognitive pathways.
A sense is a biological system used by an organism for sensation, the process of gathering information about the world through the detection of stimuli. Although in some cultures five human senses were traditionally identified as such, it is now recognized that there are many more. Senses used by non-human organisms are even greater in variety and number. During sensation, sense organs collect various stimuli for transduction, meaning transformation into a form that can be understood by the brain. Sensation and perception are fundamental to nearly every aspect of an organism's cognition, behavior and thought.
An eyeborg or eye-borg is a body modification apparatus which fits on the wearer's head, and is designed to allow people to perceive color through sound waves. It works with a head-mounted antenna that senses the colors directly in front of a person, and converts them in real-time into sound waves through bone conduction.
Psychoacoustics is the branch of psychophysics involving the scientific study of sound perception and audiology—how human auditory system perceives various sounds. More specifically, it is the branch of science studying the psychological responses associated with sound. Psychoacoustics is an interdisciplinary field of many areas, including psychology, acoustics, electronic engineering, physics, biology, physiology, and computer science.
Neil Harbisson is a Catalan-born British-Irish-American cyborg artist and activist for transpecies rights. He is best known for being the first person in the world with an antenna implanted in his skull. Since 2004, international media has described him as the world's first legally recognised cyborg and as the world's first cyborg artist. His antenna sends audible vibrations through his skull to report information to him. This includes measurements of electromagnetic radiation, phone calls, and music, as well as videos or images which are translated into audible vibrations. His WiFi-enabled antenna also allows him to receive signals and data from satellites.
A cyborg antenna is an osseointegrated device implanted in a human skull. The antenna, composed of a wireless camera on one end and a wireless sound vibration implant on the other end, allows wireless communication and wireless transmission of images, sound or video from skull to skull. The antenna uses audible vibrations in the skull to report information. This includes measurements of electromagnetic radiation, phone calls, music, as well as video or images which are transmitted through audible vibrations. The Wi-Fi enabled antenna also allows the reception signals and data from satellites.
Cyborg art, also known as cyborgism, is an art movement that began in the mid-2000s in Britain. It is based on the creation and addition of new senses to the body via cybernetic implants and the creation of art works through new senses. Cyborg artworks are created by cyborg artists; artists whose senses have been voluntarily enhanced through cybernetic implants. Among the early artists shaping the cyborg art movement are Neil Harbisson, whose antenna implant allows him to perceive ultraviolet and infrared colours, and Moon Ribas whose implants in her feet allow her to feel earthquakes and moonquakes. Other cyborg artists include: