Embodied music cognition

Last updated

Embodied music cognition is a direction within systematic musicology interested in studying the role of the human body in relation to all musical activities.

Contents

It considers the human body as the natural mediator between mind (focused on musical intentions, meanings, significations) and physical environment (containing musical sound and other types of energy that affords human action).

Introduction

Given the impact of body movement on musical meaning formation and signification, the musical mind is said to be embodied. Embodiment assumes that what happens in the mind is depending on properties of the body, such as kinaesthetic properties.

Embodied music cognition tends to see music perception as based on action. For example, many people move when they listen to music. Through movement, it is assumed that people give meaning to music. This type of meaning-formation is corporeal, rather than cerebral because it is understood through the body. This is different from a disembodied approach to music cognition, which sees musical meaning as being based on a perception-based analysis of musical structure. The embodied grounding of music perception is based on a multi-modal encoding of auditory information and on principles that ensure the coupling of perception and action.

During the last decade, research in embodied music cognition has been strongly motivated by a demand for new tools in view of the interactive possibilities offered by digital media technology.

With the advent of powerful computing tools, and in particular real-time interactive music systems, gradually more attention has been devoted to the role of gesture in music. This musical gestures research has been rather influential in that it puts more emphasis on sensorimotor feedback and integration, as well as on the coupling of perception and action. With new sensor technology, gesture-based research has meanwhile become a vast domain of music research, with consequences for the methodological and epistemological foundations of music cognition research.

Method

The scientific apparatus draws upon an empirical and evidence-based methodology, which is based on measurement of sound (via audio-recording), human movement (via video-recording, kinematic recording), human biology (via bioparameter-recording) and semantics (via questionnaires). Using a scientific apparatus for measurement, statistical analysis and computational modelling, embodied music cognition aims to build up reliable knowledge about the role of the human body in meaning formation.

Applications

Research in embodied music cognition has a strong connection with technology development, more particularly, in fields related to interactive music systems, and music information retrieval. Mediation technology is the technology by which the human body, and consequently also the human mind, can be given an extension in the digital musical domain.

How it is distinct from (disembodied) music cognition

Cartesian dualism had a tremendous impact on cognitive science and in particular on cognitive musicology.[ citation needed ] Influenced by Gestalt psychology, music cognition research of the last decades of the 20th Century was mainly focusing on the perception of structure, that is, the perception of pitch, melody, rhythm, harmony and tonality. It considered music perception as a faculty on its own, completely dissociated from musical action.[ citation needed ] Instead, in studies on embodied musical activity (such as listening and music performance), subjects are invited to actively engage in the signification process. This engagement is articulated by means of corporeal expression which can be measured, analyzed, modelled and related to the musical stimulus. René Descartes' idea that mental activity is of a separate order from body movement is refuted and, in fact reversed.

How it is distinct from traditional musicology

The difference with the traditional phenomenological and hermeneutic approaches to musical meaning formation is that embodied music cognition has a focus on an empirical and evidence-based methodology, rather than on subjective first-person descriptions. Embodied music cognition aims at giving a full account of the subjective involvement by taking into account the role of the social-cultural context, subjective background (involving gender, age, familiarity with music, degree of music education).

Embodied music cognition adopts a scientific methodology but its aim is not to reduce music to physics, nor to reduce gesture and embodied meaning to the biomechanics of the human body. Instead, embodied music cognition fully recognizes the contribution of all mental and bodily systems including subjective feelings, emotions and coinaesthetic (or body image) awareness.

See also

Further reading

Godøy, Rolf, y Marc Leman, eds. (2010): Musical gestures : sound, movement, and meaning , New York: Routledge.

Leman, Marc (2007): Embodied Music Cognition and Mediation Technology, Cambridge, Massachusetts: MIT Press.

López Cano, Rubén (2003): “Setting the body in music. Gesture, Schemata and Stylistic-Cognitive Types”. International Conference on Music and Gesture University of East Anglia 28–31 August 2003. (available on line)

López Cano, Rubén (2006). “What kind of affordances are musical affordances? A semiotic approach”. Paper presented at L’ascolto musicale: condotte, pratiche, grammatiche. Bologna 23–25 February 2006. (available on line)

López Cano, Rubén (2008). “Che tipo di affordances sono le affordances musicali? Una prospettiva semiotica”. En Daniele Barbieri, Luca Marconi e Francesco Spampinato (eds.). L'ascolto: condotte, pratiche, grammatiche. Lucca: LIM. pp. 43–54.

Matyja, J. R. (2016). Embodied Music Cognition: Trouble Ahead, Trouble Behind. Frontiers in Psychology, 7. https://doi.org/10.3389/fpsyg.2016.01891

Reybrouck, Mark. (2001a). “Biological roots of musical epistemology: Functional Cycles, Umwelt, and enactive listening”. Semiotica, 134 (1-4): 599-633.

Reybrouck, Mark. (2001b). "Musical Imagery between Sensory Processing and Ideomotor Simulation". En Musical Imagery, eds. I. Godøy y H.Jörgensen, 117-136, Lisse: Swets & Zeitlinger.

Reybrouck, Mark. (2005a). “A Biosemiotic and Ecological Approach to Music Cognition: Event Perception between Auditory Listening and Cognitive Economy”. Axiomathes. An International Journal in Ontology and Cognitive Systems, 15 (2): 229-266.

Reybrouck, Mark. (2005b.) “Body, mind and music: musical semantics between experiential cognition and cognitive economy”. TRANS 9. (available on line)

Zbikowski, Lawrence. (2002): ľ. Oxford University Press.

Related Research Articles

Cognitive science Interdisciplinary scientific study of the mind and its processes

Cognitive science is the interdisciplinary, scientific study of the mind and its processes with input from linguistics, psychology, neuroscience, philosophy, computer science/artificial intelligence, and anthropology. It examines the nature, the tasks, and the functions of cognition. Cognitive scientists study intelligence and behavior, with a focus on how nervous systems represent, process, and transform information. Mental faculties of concern to cognitive scientists include language, perception, memory, attention, reasoning, and emotion; to understand these faculties, cognitive scientists borrow from fields such as linguistics, psychology, artificial intelligence, philosophy, neuroscience, and anthropology. The typical analysis of cognitive science spans many levels of organization, from learning and decision to logic and planning; from neural circuitry to modular brain organization. One of the fundamental concepts of cognitive science is that "thinking can best be understood in terms of representational structures in the mind and computational procedures that operate on those structures."

Musicology is the scholarly analysis and research-based study of music. Musicology departments traditionally belong to the humanities, although some music research is scientific in focus. Some geographers and anthropologists have an interest in musicology so the social sciences also have an academic interest. A scholar who participates in musical research is a musicologist.

Cognitive linguistics is an interdisciplinary branch of linguistics, combining knowledge and research from cognitive science, cognitive psychology, neuropsychology and linguistics. Models and theoretical accounts of cognitive linguistics are considered as psychologically real, and research in cognitive linguistics aims to help understand cognition in general and is seen as a road into the human mind.

Cognition Act or process of knowing

Cognition refers to "the mental action or process of acquiring knowledge and understanding through thought, experience, and the senses". It encompasses many aspects of intellectual functions and processes such as: perception, attention, thought, the formation of knowledge, memory and working memory, judgment and evaluation, reasoning and "computation", problem solving and decision making, comprehension and production of language. Cognitive processes use existing knowledge and discover new knowledge.

Image schema

An image schema is a recurring structure within our cognitive processes which establishes patterns of understanding and reasoning. As an understudy to embodied cognition, image schemas are formed from our bodily interactions, from linguistic experience, and from historical context. The term is introduced in Mark Johnson's book The Body in the Mind; in case study 2 of George Lakoff's Women, Fire and Dangerous Things: and further explained by Todd Oakley in The Oxford handbook of cognitive linguistics; by Rudolf Arnheim in Visual Thinking; by the collection From Perception to Meaning: Image Schemas in Cognitive Linguistics edited by Beate Hampe and Joseph E. Grady.

Situated cognition is a theory that posits that knowing is inseparable from doing by arguing that all knowledge is situated in activity bound to social, cultural and physical contexts.

Ecological psychology is the scientific study of perception-action from a non-functionalism approach. Ecological psychology is a school of psychology that follows much of the writings of Roger Barker and James J. Gibson. Those in the field of Ecological Psychology reject the mainstream explanations of perception laid out by cognitive psychology. The ecological psychology can be broken into a few sub categories: perception, action, and dynamical systems. As a clarification, many in this field would reject the separation of perception and action, stating that perception and action are inseparable. These perceptions are shaped by an individual's ability to engage with their emotional experiences in relation to the environment and reflect on and process these. This capacity for emotional engagement leads to action, collective processing, social capital, and pro environmental behaviour.

Distributed cognition is an approach to cognitive science research that was developed by cognitive anthropologist Edwin Hutchins during the 1990s.

Evolutionary musicology is a subfield of biomusicology that grounds the cognitive mechanisms of music appreciation and music creation in evolutionary theory. It covers vocal communication in other animals, theories of the evolution of human music, and holocultural universals in musical ability and processing.

Music psychology Branch of both psychology and musicology

Music psychology, or the psychology of music, may be regarded as a branch of both psychology and musicology. It aims to explain and understand musical behaviour and experience, including the processes through which music is perceived, created, responded to, and incorporated into everyday life. Modern music psychology is primarily empirical; its knowledge tends to advance on the basis of interpretations of data collected by systematic observation of and interaction with human participants. Music psychology is a field of research with practical relevance for many areas, including music performance, composition, education, criticism, and therapy, as well as investigations of human attitude, skill, performance, intelligence, creativity, and social behavior.

Embodied cognitive science is an interdisciplinary field of research, the aim of which is to explain the mechanisms underlying intelligent behavior. It comprises three main methodologies: the modeling of psychological and biological systems in a holistic manner that considers the mind and body as a single entity; the formation of a common set of general principles of intelligent behavior; and the experimental use of robotic agents in controlled environments.

Enactivism is a position in cognitive science that argues that cognition arises through a dynamic interaction between an acting organism and its environment. It claims that the environment of an organism is brought about, or enacted, by the active exercise of that organism's sensorimotor processes. "The key point, then, is that the species brings forth and specifies its own domain of problems ...this domain does not exist "out there" in an environment that acts as a landing pad for organisms that somehow drop or parachute into the world. Instead, living beings and their environments stand in relation to each other through mutual specification or codetermination". "Organisms do not passively receive information from their environments, which they then translate into internal representations. Natural cognitive systems...participate in the generation of meaning ...engaging in transformational and not merely informational interactions: they enact a world." These authors suggest that the increasing emphasis upon enactive terminology presages a new era in thinking about cognitive science. How the actions involved in enactivism relate to age-old questions about free will remains a topic of active debate.

Musical gesture

In music, gesture is any movement, either physical (bodily) or mental (imaginary). As such "gesture" includes both categories of movements required to produce sound and categories of perceptual moves associated with those gestures. The concept of musical gestures has received much attention in various musicological disciplines in recent years.

Systematic musicology is an umbrella term, used mainly in Central Europe, for several subdisciplines and paradigms of musicology. "Systematic musicology has traditionally been conceived of as an interdisciplinary science, whose aim it is to explore the foundations of music from different points of view, such as acoustics, physiology, psychology, anthropology, music theory, sociology, and aesthetics." The most important subdisciplines today are music psychology, sociomusicology, philosophy of music, music acoustics, cognitive neuroscience of music, and the computer sciences of music. These subdisciplines and paradigms tend to address questions about music in general, rather than specific manifestations of music. In the Springer Handbook of Systematic Musicology "(the) sections follow the main topics in the field, Musical Acoustics, Signal Processing, Music Psychology, Psychophysics/Psychoacoustics and Music Ethnology while also taking recent research trends into consideration, like Embodied Music Cognition and Media Applications. Other topics, like Music Theory or Philosophy of Music are incorporated in the respective sections."

Basic science (psychology)

Some of the research that is conducted in the field of psychology is more "fundamental" than the research conducted in the applied psychological disciplines, and does not necessarily have a direct application. The subdisciplines within psychology that can be thought to reflect a basic-science orientation include biological psychology, cognitive psychology, neuropsychology, and so on. Research in these subdisciplines is characterized by methodological rigor. The concern of psychology as a basic science is in understanding the laws and processes that underlie behavior, cognition, and emotion. Psychology as a basic science provides a foundation for applied psychology. Applied psychology, by contrast, involves the application of psychological principles and theories yielded up by the basic psychological sciences; these applications are aimed at overcoming problems or promoting well-being in areas such as mental and physical health and education.

Cognitive musicology is a branch of cognitive science concerned with computationally modeling musical knowledge with the goal of understanding both music and cognition.

Wolff-Michael Roth is a learning scientist at the University of Victoria conducting research on how people across the life span know and learn mathematics and science. He has contributed to numerous fields of research: learning science in learning communities, coteaching, authentic school science education, cultural-historical activity theory, social studies of science, gesture studies, qualitative research methods, embodied cognition, situated cognition, and the role of language in learning science and mathematics.

Embodied cognition is the theory that many features of cognition, whether human or otherwise, are shaped by aspects of the entire body of the organism. The features of cognition include high level mental constructs and performance on various cognitive tasks. The aspects of the body include the motor system, the perceptual system, bodily interactions with the environment (situatedness), and the assumptions about the world that are built into the structure of the organism.

Embodied design

Embodied design grows from the idea of embodied cognition: that the actions of the body can play a role in the development of thought and ideas. Embodied design brings mathematics to life; studying the effects of the body on the mind, researchers learn how to design objects and activities for learning. Embodiment is an aspect of pattern recognition in all fields of human endeavor.

In philosophy of mind, the extended mind thesis (EMT) says that the mind does not exclusively reside in the brain or even the body, but extends into the physical world. The EMT proposes that some objects in the external environment can be part of a cognitive process and in that way function as extensions of the mind itself. Examples of such objects are written calculations, a diary, or a PC; in general, it concerns objects that store information. The EMT considers the mind to encompass every level of cognition, including a physical level.