Data sonification

Last updated

Data sonification is the presentation of data as sound using sonification. It is the auditory equivalent of the more established practice of data visualization.

Contents

Process

The usual process for data sonification is directing digital media of a dataset through a software synthesizer and into a digital-to-analog converter to produce sound for humans to experience. [1] [2] [3] Benefits to interpreting data through sonification include accessibility, pattern recognition, education, and artistic expression. [4]

Applications

Applications of data sonification include astronomy studies of star creation, [5] interpreting cluster analysis, [6] and geoscience. [7] Various projects describe the production of sonifications as a collaboration between scientists and musicians. [8] [4] [9]

A target demographic for using data sonification is the blind community because of the inaccessibility of data visualizations. [10]

One of the earliest examples of data sonification is the Geiger counter, which measures ionizing radiation through sound. [11] Another notable example of data sonification is NASA's processing of images from space telescopes into sounds. [12]

See also

Related Research Articles

<span class="mw-page-title-main">Geiger counter</span> Instrument used for measuring ionizing radiation

A Geiger counter is an electronic instrument used for detecting and measuring ionizing radiation. It is widely used in applications such as radiation dosimetry, radiological protection, experimental physics and the nuclear industry.

Auditory illusions are illusions of real sound or outside stimulus. These false perceptions are the equivalent of an optical illusion: the listener hears either sounds which are not present in the stimulus, or sounds that should not be possible given the circumstance on how they were created.

The Earth Observing System (EOS) is a program of NASA comprising a series of artificial satellite missions and scientific instruments in Earth orbit designed for long-term global observations of the land surface, biosphere, atmosphere, and oceans. Since the early 1970s, NASA has been developing its Earth Observing System, launching a series of Landsat satellites in the decade. Some of the first included passive microwave imaging in 1972 through the Nimbus 5 satellite. Following the launch of various satellite missions, the conception of the program began in the late 1980s and expanded rapidly through the 1990s. Since the inception of the program, it has continued to develop, including; land, sea, radiation and atmosphere. Collected in a system known as EOSDIS, NASA uses this data in order to study the progression and changes in the biosphere of Earth. The main focus of this data collection surrounds climatic science. The program is the centrepiece of NASA's Earth Science Enterprise.

An audio game is an electronic game played on a device such as a personal computer. It is similar to a video game save that there is audible and tactile feedback but not visual.

<span class="mw-page-title-main">Scientific visualization</span> Interdisciplinary branch of science concerned with presenting scientific data visually

Scientific visualization is an interdisciplinary branch of science concerned with the visualization of scientific phenomena. It is also considered a subset of computer graphics, a branch of computer science. The purpose of scientific visualization is to graphically illustrate scientific data to enable scientists to understand, illustrate, and glean insight from their data. Research into how people read and misread various types of visualizations is helping to determine what types and features of visualizations are most understandable and effective in conveying information.

<span class="mw-page-title-main">Sonification</span> Use of sounds other than speech to convey information

Sonification is the use of non-speech audio to convey information or perceptualize data. Auditory perception has advantages in temporal, spatial, amplitude, and frequency resolution that open possibilities as an alternative or complement to visualization techniques.

Sensory substitution is a change of the characteristics of one sensory modality into stimuli of another sensory modality.

Software visualization or software visualisation refers to the visualization of information of and related to software systems—either the architecture of its source code or metrics of their runtime behavior—and their development process by means of static, interactive or animated 2-D or 3-D visual representations of their structure, execution, behavior, and evolution.

The Earth Observing System Data and Information System (EOSDIS) is a key core capability in NASA's Earth Science Data Systems Program. Designed and maintained by Raytheon Intelligence & Space, it is a comprehensive data and information system designed to perform a wide variety of functions in support of a heterogeneous national and international user community.

Computer audition (CA) or machine listening is the general field of study of algorithms and systems for audio interpretation by machines. Since the notion of what it means for a machine to "hear" is very broad and somewhat vague, computer audition attempts to bring together several disciplines that originally dealt with specific problems or had a concrete application in mind. The engineer Paris Smaragdis, interviewed in Technology Review, talks about these systems — "software that uses sound to locate people moving through rooms, monitor machinery for impending breakdowns, or activate traffic cameras to record accidents."

Auditory display is the use of sound to communicate information from a computer to the user. The primary forum for exploring these techniques is the International Community for Auditory Display (ICAD), which was founded by Gregory Kramer in 1992 as a forum for research in the field.

The Earth Observing System (EOS) Clearinghouse, or ECHO refers to a system that was used by the National Aeronautics and Space Administration (NASA) to spatially, temporally and otherwise index the petabytes of data that NASA's Earth Science projects collect. It does not hold the data itself, but serves as a search engine that other applications can access via a web service based interface. While ECHO has been set up to support both data and services, as of mid-2008, data is well represented and services are yet to be focused on.

Psychoacoustics is the branch of psychophysics involving the scientific study of the perception of sound by the human auditory system. It is the branch of science studying the psychological responses associated with sound including noise, speech, and music. Psychoacoustics is an interdisciplinary field including psychology, acoustics, electronic engineering, physics, biology, physiology, and computer science.

Sonic interaction design is the study and exploitation of sound as one of the principal channels conveying information, meaning, and aesthetic/emotional qualities in interactive contexts. Sonic interaction design is at the intersection of interaction design and sound and music computing. If interaction design is about designing objects people interact with, and such interactions are facilitated by computational means, in sonic interaction design, sound is mediating interaction either as a display of processes or as an input medium.

Audification is an auditory display technique for representing a sequence of data values as sound. By definition, it is described as a "direct translation of a data waveform to the audible domain." Audification interprets a data sequence and usually a time series, as an audio waveform where input data are mapped to sound pressure levels. Various signal processing techniques are used to assess data features. The technique allows the listener to hear periodic components as frequencies. Audification typically requires large data sets with periodic components.

Selective auditory attention, or selective hearing, is a process of the auditory system where an individual selects or focuses on certain stimuli for auditory information processing while other stimuli are disregarded. This selection is very important as the processing and memory capabilities for humans have a limited capacity. When people use selective hearing, noise from the surrounding environment is heard by the auditory system but only certain parts of the auditory information are chosen to be processed by the brain.

The Alaska Satellite Facility (ASF) is a data processing facility and satellite-tracking ground station within the Geophysical Institute at the University of Alaska Fairbanks. The facility’s mission is to make remote-sensing data accessible Its work is central to polar processes research including wetlands, glaciers, sea ice, climate change, permafrost, flooding and land cover such as changes in the Amazon rainforest.

<span class="mw-page-title-main">Andrea Polli</span>

Andrea Polli is an environmental artist and writer. Polli blends art and science to create widely varied media and technology artworks related to environmental issues. Her works are presented in various forms, she uses interactive websites, digital broadcasting, mobile applications, and performances, which allows her to reach a wider audience.

Wanda Díaz-Merced is a Puerto Rican astronomer known for using sonification to turn large data sets into audible sound. Currently at the European Gravitational Observatory Cascina, Italy, Wanda is the Director of the Arecibo Observatory. While losing her eyesight, Wanda brought attention to increasing equality of access to astronomy and using audible sound to study astrophysical data.. Wanda is a part of the 7 most trailblazing women in science by the BBC.

<span class="mw-page-title-main">Mark McInerney</span> NASA Director of UAP Research (2023-present)

Mark A. McInerney is an American meteorologist, climate data scientist, and employee at NASA. He is the NASA Director of UAP Research since 2023.

References

  1. ↑ Kaper, H.G.; Wiebel, E.; Tipei, S. (1999). "Data sonification and sound visualization". Computing in Science & Engineering. 1 (4): 48–58. arXiv: cs/0007007 . Bibcode:1999CSE.....1d..48K. doi:10.1109/5992.774840. S2CID   8087002.
  2. ↑ Madhyastha, Tara; Reed, Daniel (1995). "Data sonification: Do you see what I hear". IEEE Software. 12 (2): 45–56. doi:10.1109/52.368264.
  3. ↑ Scaletti, Carla (2018-02-05). Dean, Roger T.; McLean, Alex (eds.). Sonification ≠ Music. Vol. 1. Oxford University Press. doi:10.1093/oxfordhb/9780190226992.013.9.
  4. 1 2 Maroune, Dr Manil Maskey and Abdelhak (2023-04-28). "From Data to Melody: Data Sonification and Its Role in Open Science | Earthdata". www.earthdata.nasa.gov. Retrieved 2024-05-30.
  5. ↑ Guglielmi, Giorgia (21 July 2017). "Meet the scientist who turns data into music—and listen to the sound of a neutron star". Science.
  6. ↑ Hermann, T; Ritter, H (1999). "Listen to your Data: Model-Based Sonification for Data Analysis". Advances in intelligent computation and multimedia systems. International Institute for Advanced Studies in Systems Research and Cybernetics. ISBN   0-921836-80-5.
  7. ↑ Romans, Brian (11 April 2007). "Data Sonification". Wired.
  8. ↑ Beans, Carolyn (1 May 2017). "Science and Culture: Musicians join scientists to explore data through sound". Proceedings of the National Academy of Sciences. 114 (18): 4563–4565. Bibcode:2017PNAS..114.4563B. doi: 10.1073/pnas.1705325114 . PMC   5422826 . PMID   28461386.
  9. ↑ Middleton, Jonathan; Hakulinen, Jaakko; Tiitinen, Katariina; Hella, Juho; Keskinen, Tuuli; Huuskonen, Pertti; Culver, Jeffrey; Linna, Juhani; Turunen, Markku; Ziat, Mounia; Raisamo, Roope (2023-08-10). "Data-to-music sonification and user engagement". Frontiers in Big Data. 6. doi: 10.3389/fdata.2023.1206081 . ISSN   2624-909X. PMC   10448511 . PMID   37636320.
  10. ↑ Zhao, Haixia; Plaisant, Catherine; Shneiderman, Ben; Lazar, Jonathan (1 May 2008). "Data Sonification for Users with Visual Impairment". ACM Transactions on Computer-Human Interaction. 15 (1): 1–28. doi:10.1145/1352782.1352786. S2CID   17199537.
  11. ↑ "What is Sonification - Accessible Oceans". Accessible Oceans - what is sonification. Retrieved May 30, 2024.
  12. ↑ "Sonifications - NASA Science". science.nasa.gov. Retrieved 2024-05-30.

Further media

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.