Facial electromyography

Last updated
Facial electromyography
Corrugator supercilii.png
Corrugator supercilii muscle (associated with frowning)
Purposemeasures muscle activity by detecting electrical impulses(face)

Facial electromyography (fEMG) refers to an electromyography (EMG) technique that measures muscle activity by detecting and amplifying the tiny electrical impulses that are generated by muscle fibers when they contract.

Contents

It primarily focuses on two major muscle groups in the face, the corrugator supercilii group which is associated with frowning and the zygomaticus major muscle group which is associated with smiling. [1] [2]

Uses

Zygomaticus major muscle (associated with smiling) Zygomaticus.png
Zygomaticus major muscle (associated with smiling)

Facial EMG has been studied to assess its utility as a tool for measuring emotional reaction. [3] Studies have found that activity of the corrugator muscle, which lowers the eyebrow and is involved in producing frowns, varies inversely with the emotional valence of presented stimuli and reports of mood state[ citation needed ]. Activity of the zygomatic major muscle, which controls smiling, is said to be positively associated with positive emotional stimuli and positive mood state.

Facial EMG has been used as a technique to distinguish and track positive and negative emotional reactions to a stimulus as they occur. [4] A large number of those experiments have been conducted in controlled laboratory environments using a range of stimuli, e.g., still pictures, movie clips and music pieces.

It has also been used to investigate emotional responses in individuals with autism spectrum disorders. [5]

Although commonly used as an index of emotional responses, facial muscle activity is also influenced by the social context in which it is measured. [6] Using facial EMG in immersive virtual environments, Philipp, Storrs, and Vanman showed that even relatively impoverished social cues in a virtual environment can cause increases in zygomaticus major activity that are unrelated to self-reported emotional states. [7]

In a study in 2012 Durso et al. demonstrated that facial EMG could detect confusion in subjects who acknowledged they were confused and in those who did not. The authors considered facial EMG could effectively monitor loss of understanding or of situation awareness. [8]

Market research and gaming

Two areas where facial EMG techniques have been used are in advertising research [9] [10] and in video gaming. [11] [12]

  1. Advertising research - Of late, facial EMG has been used to test audience response to commercial advertising. Facial EMG activity measures during a viewing of commercials embedded in TV program clips have been used to describe a commercial's level of emotional activation and engagement. Measurement of the corrugator and zygomatic muscles, yield an overall positive and negative emotional activation score. The moment to moment activation that are recorded are said to measure the dynamic emotional response to a commercial and yield useful insights about the elements of the commercials. Lou et al. [10] showed that facial EMG activity can be used to forecast how game players would be addicted to an online game before the game is officially introduced to the market.
  2. Gaming and Human-Computer Interaction (HCI) - Ravaja, [11] Hazlett [13] and Mandryk [12] used facial EMG techniques to demonstrate that positive and negative emotions can be measured in real time during video game play. The emotional profiling of games give a useful evaluation of a game's impact on a player, how compelling they find the game, how the game measures up to other games in its genre, and how the different elements of the game enhance or detract from the game's approach to engaging the player. [14]

Advantages

Proponents of Facial EMG point to the following advantages:

  1. Facial Electromyography (or fEMG) is a precise and sensitive method to measure emotional expression.
  2. Unlike self-reports, fEMG does not depend upon language and does not require cognitive effort or memory.
  3. fEMG is capable of registering the response even when subjects were instructed to inhibit their emotional expression.
  4. Yields a lot of data and is continuous and scalar (hence more credible.)
  5. It is able to measure facial muscle activities to even weakly evocative emotional stimuli.
  6. Less intrusive than other physiological measures like fMRI and EEG.
  7. Like other physiological measures, facial EMG measurement technique is often the only useful approach when movement is not visible.

Criticisms

  1. The technique is intrusive and may alter natural expression.
  2. The number of muscles it can employ is limited by how many electrodes can be attached to the face.
  3. Certain medicines that act on the nervous system, such as muscle relaxants and anticholinergics, can change electromyography (EMG) results.

See also

Related Research Articles

Psychophysiology is the branch of psychology that is concerned with the physiological bases of psychological processes. While psychophysiology was a general broad field of research in the 1960s and 1970s, it has now become quite specialized, based on methods, topic of studies and scientific traditions. Methods vary as combinations of electrophysiological methods, neuroimaging, and neurochemistry. Topics have branched into subspecializations such as social, sport, cognitive, cardiovascular, clinical and other branches of psychophysiology.

Affective computing is the study and development of systems and devices that can recognize, interpret, process, and simulate human affects. It is an interdisciplinary field spanning computer science, psychology, and cognitive science. While some core ideas in the field may be traced as far back as to early philosophical inquiries into emotion, the more modern branch of computer science originated with Rosalind Picard's 1995 paper on affective computing and her book Affective Computing published by MIT Press. One of the motivations for the research is the ability to give machines emotional intelligence, including to simulate empathy. The machine should interpret the emotional state of humans and adapt its behavior to them, giving an appropriate response to those emotions.

<span class="mw-page-title-main">Biofeedback</span> Gaining awareness of biological processes

Biofeedback is the technique of gaining greater awareness of many physiological functions of one's own body by using electronic or other instruments, and with a goal of being able to manipulate the body's systems at will. Humans conduct biofeedback naturally all the time, at varied levels of consciousness and intentionality. Biofeedback and the biofeedback loop can also be thought of as self-regulation. Some of the processes that can be controlled include brainwaves, muscle tone, skin conductance, heart rate and pain perception.

<span class="mw-page-title-main">Electromyography</span> Electrodiagnostic medicine technique

Electromyography (EMG) is a technique for evaluating and recording the electrical activity produced by skeletal muscles. EMG is performed using an instrument called an electromyograph to produce a record called an electromyogram. An electromyograph detects the electric potential generated by muscle cells when these cells are electrically or neurologically activated. The signals can be analyzed to detect abnormalities, activation level, or recruitment order, or to analyze the biomechanics of human or animal movement. Needle EMG is an electrodiagnostic medicine technique commonly used by neurologists. Surface EMG is a non-medical procedure used to assess muscle activation by several professionals, including physiotherapists, kinesiologists and biomedical engineers. In computer science, EMG is also used as middleware in gesture recognition towards allowing the input of physical action to a computer as a form of human-computer interaction.

<span class="mw-page-title-main">Facial Action Coding System</span> System of classifying human facial movements

The Facial Action Coding System (FACS) is a system to taxonomize human facial movements by their appearance on the face, based on a system originally developed by a Swedish anatomist named Carl-Herman Hjortsjö. It was later adopted by Paul Ekman and Wallace V. Friesen, and published in 1978. Ekman, Friesen, and Joseph C. Hager published a significant update to FACS in 2002. Movements of individual facial muscles are encoded by the FACS from slight different instant changes in facial appearance. It has proven useful to psychologists and to animators.

<span class="mw-page-title-main">Corrugator supercilii muscle</span> Muscle near the eye

The corrugator supercilii muscle is a small, narrow, pyramidal muscle of the face. It arises from the medial end of the superciliary arch; it inserts into the deep surface of the skin of the eyebrow.

An emotional expression is a behavior that communicates an emotional state or attitude. It can be verbal or nonverbal, and can occur with or without self-awareness. Emotional expressions include facial movements like smiling or scowling, simple behaviors like crying, laughing, or saying "thank you," and more complex behaviors like writing a letter or giving a gift. Individuals have some conscious control of their emotional expressions; however, they need not have conscious awareness of their emotional or affective state in order to express emotion.

Affective neuroscience is the study of how the brain processes emotions. This field combines neuroscience with the psychological study of personality, emotion, and mood. The basis of emotions and what emotions are remains an issue of debate within the field of affective neuroscience.

<span class="mw-page-title-main">Facial muscles</span> Muscles of the face

The facial muscles are a group of striated skeletal muscles supplied by the facial nerve that, among other things, control facial expression. These muscles are also called mimetic muscles. They are only found in mammals, although they derive from neural crest cells found in all vertebrates. They are the only muscles that attach to the dermis.

Central facial palsy is a symptom or finding characterized by paralysis or paresis of the lower half of one side of the face. It usually results from damage to upper motor neurons of the facial nerve.

The facial feedback hypothesis, rooted in the conjectures of Charles Darwin and William James, is that one's facial expression directly affects their emotional experience. Specifically, physiological activation of the facial regions associated with certain emotions holds a direct effect on the elicitation of such emotional states, and the lack of or inhibition of facial activation will result in the suppression of corresponding emotional states.

<span class="mw-page-title-main">Posterior auricular muscle</span> Muscle that pulls the ear upward and backward

The posterior auricular muscle is a muscle behind the auricle of the outer ear. It arises from the mastoid part of the temporal bone, and inserts into the lower part of the cranial surface of the auricle of the outer ear. It draws the auricle backwards, usually a very slight effect.

Emotional self-regulation or emotion regulation is the ability to respond to the ongoing demands of experience with the range of emotions in a manner that is socially tolerable and sufficiently flexible to permit spontaneous reactions as well as the ability to delay spontaneous reactions as needed. It can also be defined as extrinsic and intrinsic processes responsible for monitoring, evaluating, and modifying emotional reactions. Emotional self-regulation belongs to the broader set of emotion regulation processes, which includes both the regulation of one's own feelings and the regulation of other people's feelings.

Emotional responsivity is the ability to acknowledge an affective stimuli by exhibiting emotion. It is a sharp change of emotion according to a person's emotional state. Increased emotional responsivity refers to demonstrating more response to a stimulus. Reduced emotional responsivity refers to demonstrating less response to a stimulus. Any response exhibited after exposure to the stimulus, whether it is appropriate or not, would be considered as an emotional response. Although emotional responsivity applies to nonclinical populations, it is more typically associated with individuals with schizophrenia and autism.

Paula M. Niedenthal is a social psychologist currently working as a professor of psychology at the University of Wisconsin–Madison. She also completed her undergraduate studies at the University of Wisconsin at Madison where she received a Bachelor's in Psychology. She then received her Ph.D. at the University of Michigan before becoming a faculty member of the departments of Psychology at Johns Hopkins University and Indiana University. Until recently, she served as the Director of Research in the National Centre for Scientific Research at the Université Blaise Pascal in Clermont-Ferrand France. The majority of Niedenthal's research focuses on several levels of analysis of emotional processes, this would include emotion-cognition interaction and representational models of emotion. Niedenthal has authored more than 80 articles and chapters, and several books. Niedenthal is a fellow of the Society for Personality and Social Psychology.

G&R(formerly Gallup & Robinson) is an independent marketing research firm specializing in advertising research. Founded in 1948, in Princeton, New Jersey by Dr. George Gallup and Dr. Claude Robinson, the company helps advertisers develop, evaluate and improve the effectiveness of their advertising in media.

<span class="mw-page-title-main">Music and emotion</span> Psychological relationship between human affect and music

Research into music and emotion seeks to understand the psychological relationship between human affect and music. The field, a branch of music psychology, covers numerous areas of study, including the nature of emotional reactions to music, how characteristics of the listener may determine which emotions are felt, and which components of a musical composition or performance may elicit certain reactions.

Emotion perception refers to the capacities and abilities of recognizing and identifying emotions in others, in addition to biological and physiological processes involved. Emotions are typically viewed as having three components: subjective experience, physical changes, and cognitive appraisal; emotion perception is the ability to make accurate decisions about another's subjective experience by interpreting their physical changes through sensory systems responsible for converting these observed changes into mental representations. The ability to perceive emotion is believed to be both innate and subject to environmental influence and is also a critical component in social interactions. How emotion is experienced and interpreted depends on how it is perceived. Likewise, how emotion is perceived is dependent on past experiences and interpretations. Emotion can be accurately perceived in humans. Emotions can be perceived visually, audibly, through smell and also through bodily sensations and this process is believed to be different from the perception of non-emotional material.

Optomyography (OMG) was proposed in 2015 as a technique that could be used to monitor muscular activity. It is possible to use OMG for the same applications where Electromyography (EMG) and Mechanomyography (MMG) are used. However, OMG offers superior signal-to-noise ratio and improved robustness against the disturbing factors and limitations of EMG and MMG. The basic principle of OMG is to use active near-infra-red optical sensors to measure the variations in the measured signals that are reflected from the surface of the skin while activating the muscles below and around the skin spot where the photoelectric sensor is focusing to measure the signals reflected from this spot.

Roland Clark Davis was an American psychologist recognized for his innovation in instrumentation and measurement of electrophysiological phenomena. Davis contributed to the measurement of electrodermal activity, gastric reflexes, and muscle action potentials. Davis published over 70 articles on psychophysiology and related topics across a 30-year career and mentored many graduate students at Indiana University Bloomington from 1931 through 1961.

References

  1. Larsen JT, Norris CJ, Cacioppo JT (September 2003). "Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii". Psychophysiology. 40 (5): 776–85. doi:10.1111/1469-8986.00078. PMID   14696731.
  2. Sato W, Fujimura T, Suzuki N (October 2008). "Enhanced facial EMG activity in response to dynamic facial expressions". Int J Psychophysiol. 70 (1): 70–4. doi:10.1016/j.ijpsycho.2008.06.001. PMID   18598725.
  3. Dimberg U (September 1990). "Facial electromyography and emotional reactions". Psychophysiology. 27 (5): 481–94. doi: 10.1111/j.1469-8986.1990.tb01962.x . PMID   2274612.
  4. Wolf K, Mass R, Ingenbleek T, Kiefer F, Naber D, Wiedemann K (October 2005). "The facial pattern of disgust, appetence, excited joy and relaxed joy: an improved facial EMG study". Scand J Psychol. 46 (5): 403–9. doi:10.1111/j.1467-9450.2005.00471.x. PMID   16179022.
  5. Oberman LM, Winkielman P, Ramachandran VS (July 2009). "Slow echo: facial EMG evidence for the delay of spontaneous, but not voluntary, emotional mimicry in children with autism spectrum disorders". Dev Sci. 12 (4): 510–20. doi:10.1111/j.1467-7687.2008.00796.x. PMID   19635079.
  6. Hess, U; Banse, R; Kappas, A (1995). "The intensity of facial expression is determined by underlying affective state and social situation". Journal of Personality and Social Psychology. 69 (2): 280–288. doi:10.1037/0022-3514.69.2.280.
  7. Philipp, MC; Storrs, K; Vanman, E (2012). "Sociality of facial expressions in immersive virtual environments: A facial EMG study". Biological Psychology. 91 (1): 17–21. doi:10.1016/j.biopsycho.2012.05.008. PMID   22652089. S2CID   14744015.
  8. Durso, F.T., Geldbach, K.M. and Cotbalis, P., "Detecting Confusion Using Facial Electromyography", Human Factors, Vol. 54, No. 1, February 2012.
  9. Boll, P.D., Lang, A., Potter, R.F., The Effects of Message Valence and Listener Arousal on Attention, Memory and Facial Muscular Responses to Radio Advertisements. Communication Research, Vol. 28 (2001).
  10. 1 2 Lou, Jing-Kai; Kuan-Ta Chen; Hwai-Jung Hsu; Chin-Laung Lei (November 2012), "Forecasting online game addictiveness", Proc. IEEE/ACM NetGames 2012, Venice, Italy, retrieved 2013-10-17{{citation}}: CS1 maint: location missing publisher (link)
  11. 1 2 Ravaja N, Turpeinen M, Saari T, Puttonen S, Keltikangas-Järvinen L (February 2008). "The psychophysiology of James Bond: phasic emotional responses to violent video game events". Emotion. 8 (1): 114–20. doi:10.1037/1528-3542.8.1.114. PMID   18266521.
  12. 1 2 Mandryk, R.L.; Atkins, M. (2007). "A Fuzzy Physiological Approach for Continuously Modeling Emotion During Interaction with Play Environments". International Journal of Human-Computer Studies. 6 (4): 329–47. doi:10.1016/j.ijhcs.2006.11.011. S2CID   1037743.
  13. Hazlett, R. L. (2006). "Measuring emotional valence during interactive experiences: Boys at video game play". Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. pp. 1023–6. doi:10.1145/1124772.1124925. ISBN   1595933727. S2CID   17119148.
  14. Nacke, L. E.; Lindley, C. (December 2009). "Affective Ludology, Flow and Immersion in a First- Person Shooter: Measurement of Player Experience". Loading. 3 (5). arXiv: 1004.0248 .