EmojiGrid

Last updated

The EmojiGrid is an affective self-report tool consisting of a rectangular grid that is labelled with emojis. It is trademark of Kikkoman. The facial expressions of the emoji labels vary from disliking via neutral to liking along the x-axis, and gradually increase in intensity along the y-axis. To report their affective appraisal of a given stimulus, users mark the location inside the grid that best represents their impression. The EmojiGrid can either be used as a paper or computer-based response tool. The images needed to implement the EmojiGrid are freely available from the OSF repository.

Contents

The EmojiGrid: an emoji-labelled Valence (horizontal axis) x Arousal (vertical axis) self-report tool. EmojiGrid.jpg
The EmojiGrid: an emoji-labelled Valence (horizontal axis) × Arousal (vertical axis) self-report tool.

Applications

The EmojiGrid was inspired by Russell's Affect Grid [1] and was originally developed and validated for the affective appraisal of food stimuli, [2] since conventional affective self-report tools (e.g., Self-Assessment Mannikin [3] are frequently misunderstood in that context. [2] [4] It has since been used and validated for the affective appraisal of a wide range of affective stimuli such as images, [5] [6] audio and video clips, [7] 360 VR videos, [8] touch events, [9] food, [10] and odors. [11] [12] [13] It has also been used for the affective analysis of architectural spaces [14] to assess affective experience of trail racing, [15] and to assess the emotional face evaluation capability of people with early dementia. [16] Since it is intuitive and language independent, the EmojiGrid is also suitable for cross-cultural research. [4] [17]

Implementation

In a computer-based response paradigm, only the image area inside the horizontal and vertical grid borders should be responsive (clickable), so that users can report their affective response by pointing and/or clicking inside the grid.  In practice, this may be achieved by superimposing (1) a clickable image of the unlabeled grid area on top of (2) a larger image showing the grid area together with the emoji labels. The images needed to implement the EmojiGrid are freely available from the OSF repository. An implementation of the EmojiGrid rating task in the Gorilla experiment builder is freely available from the Gorilla Open Materials platform.

See also

Further reading

Related Research Articles

<span class="mw-page-title-main">Emotion</span> Conscious subjective experience of humans

Emotions are mental states brought on by neurophysiological changes, variously associated with thoughts, feelings, behavioral responses, and a degree of pleasure or displeasure. There is no scientific consensus on a definition. Emotions are often intertwined with mood, temperament, personality, disposition, or creativity.

In psychology, a mood is an affective state. In contrast to emotions or feelings, moods are less specific, less intense and less likely to be provoked or instantiated by a particular stimulus or event. Moods are typically described as having either a positive or negative valence. In other words, people usually talk about being in a good mood or a bad mood. There are many different factors that influence mood, and these can lead to positive or negative effects on mood.

<span class="mw-page-title-main">Olfactory bulb</span> Neural structure

The olfactory bulb is a neural structure of the vertebrate forebrain involved in olfaction, the sense of smell. It sends olfactory information to be further processed in the amygdala, the orbitofrontal cortex (OFC) and the hippocampus where it plays a role in emotion, memory and learning. The bulb is divided into two distinct structures: the main olfactory bulb and the accessory olfactory bulb. The main olfactory bulb connects to the amygdala via the piriform cortex of the primary olfactory cortex and directly projects from the main olfactory bulb to specific amygdala areas. The accessory olfactory bulb resides on the dorsal-posterior region of the main olfactory bulb and forms a parallel pathway. Destruction of the olfactory bulb results in ipsilateral anosmia, while irritative lesions of the uncus can result in olfactory and gustatory hallucinations.

Amusement is the state of experiencing humorous and entertaining events or situations while the person or animal actively maintains the experience, and is associated with enjoyment, happiness, laughter and pleasure. It is an emotion with positive valence and high physiological arousal.

Affective neuroscience is the study of how the brain processes emotions. This field combines neuroscience with the psychological study of personality, emotion, and mood. The basis of emotions and what emotions are remains an issue of debate within the field of affective neuroscience.

<span class="mw-page-title-main">Affect (psychology)</span> Experience of feeling or emotion

Affect, in psychology, refers to the underlying experience of feeling, emotion, attachment, or mood. In psychology, "affect" refers to the experience of feeling or emotion. It encompasses a wide range of emotional states and can be positive or negative. Affect is a fundamental aspect of human experience and plays a central role in many psychological theories and studies. It can be understood as a combination of three components: emotion, mood, and affectivity. In psychology, the term "affect" is often used interchangeably with several related terms and concepts, though each term may have slightly different nuances. These terms encompass: emotion, feeling, mood, emotional state, sentiment, affective state, emotional response, affective reactivity, disposition. Researchers and psychologists may employ specific terms based on their focus and the context of their work.

The theory of constructed emotion is a theory in affective science proposed by Lisa Feldman Barrett to explain the experience and perception of emotion. The theory posits that instances of emotion are constructed predictively by the brain in the moment as needed. It draws from social construction, psychological construction, and neuroconstruction.

<span class="mw-page-title-main">Emotion classification</span> Contrast of one emotion from another

Emotion classification, the means by which one may distinguish or contrast one emotion from another, is a contested issue in emotion research and in affective science. Researchers have approached the classification of emotions from one of two fundamental viewpoints:

  1. that emotions are discrete and fundamentally different constructs
  2. that emotions can be characterized on a dimensional basis in groupings

Emotional self-regulation or emotion regulation is the ability to respond to the ongoing demands of experience with the range of emotions in a manner that is socially tolerable and sufficiently flexible to permit spontaneous reactions as well as the ability to delay spontaneous reactions as needed. It can also be defined as extrinsic and intrinsic processes responsible for monitoring, evaluating, and modifying emotional reactions. Emotional self-regulation belongs to the broader set of emotion regulation processes, which includes both the regulation of one's own feelings and the regulation of other people's feelings.

Emotional responsivity is the ability to acknowledge an affective stimuli by exhibiting emotion. It is a sharp change of emotion according to a person's emotional state. Increased emotional responsivity refers to demonstrating more response to a stimulus. Reduced emotional responsivity refers to demonstrating less response to a stimulus. Any response exhibited after exposure to the stimulus, whether it is appropriate or not, would be considered as an emotional response. Although emotional responsivity applies to nonclinical populations, it is more typically associated with individuals with schizophrenia and autism.

Emotion can have a powerful effect on humans and animals. Numerous studies have shown that the most vivid autobiographical memories tend to be of emotional events, which are likely to be recalled more often and with more clarity and detail than neutral events.

Affect measures are used in the study of human affect, and refer to measures obtained from self-report studies asking participants to quantify their current feelings or average feelings over a longer period of time. Even though some affect measures contain variations that allow assessment of basic predispositions to experience a certain emotion, tests for such stable traits are usually considered to be personality tests.

In psychology of art, the relationship between art and emotion has newly been the subject of extensive study thanks to the intervention of esteemed art historian Alexander Nemerov. Emotional or aesthetic responses to art have previously been viewed as basic stimulus response, but new theories and research have suggested that these experiences are more complex and able to be studied experimentally. Emotional responses are often regarded as the keystone to experiencing art, and the creation of an emotional experience has been argued as the purpose of artistic expression. Research has shown that the neurological underpinnings of perceiving art differ from those used in standard object recognition. Instead, brain regions involved in the experience of emotion and goal setting show activation when viewing art.

Emotion perception refers to the capacities and abilities of recognizing and identifying emotions in others, in addition to biological and physiological processes involved. Emotions are typically viewed as having three components: subjective experience, physical changes, and cognitive appraisal; emotion perception is the ability to make accurate decisions about another's subjective experience by interpreting their physical changes through sensory systems responsible for converting these observed changes into mental representations. The ability to perceive emotion is believed to be both innate and subject to environmental influence and is also a critical component in social interactions. How emotion is experienced and interpreted depends on how it is perceived. Likewise, how emotion is perceived is dependent on past experiences and interpretations. Emotion can be accurately perceived in humans. Emotions can be perceived visually, audibly, through smell and also through bodily sensations and this process is believed to be different from the perception of non-emotional material.

Motivational intensity is defined as the strength of the tendency to either approach a positive situation or event or to move away from a negative situation or event.

A functional account of emotions posits that emotions facilitate adaptive responses to environmental challenges. In other words, emotions are systems that respond to environmental input, such as a social or physical challenge, and produce adaptive output, such as a particular behavior. Under such accounts, emotions can manifest in maladaptive feelings and behaviors, but they are largely beneficial insofar as they inform and prepare individuals to respond to environmental challenges, and play a crucial role in structuring social interactions and relationships.

In cognitive psychology, the affect-as-information hypothesis, or 'approach', is a model of evaluative processing, postulating that affective feelings provide a source of information about objects, tasks, and decision alternatives. A goal of this approach is to understand the extent of influence that affect has on cognitive functioning. It has been proposed that affect has two major dimensions, namely affective valence and affective arousal, and in this way is an embodied source of information. Affect is thought to impact three main cognitive functions: judgement, thought processing and memory. In a variety of scenarios, the influence of affect on these processes is thought to be mediated by its effects on attention. The approach is thought to account for a wide variety of behavioural phenomena in psychology.

Affect labeling is an implicit emotional regulation strategy that can be simply described as "putting feelings into words". Specifically, it refers to the idea that explicitly labeling one's, typically negative, emotional state results in a reduction of the conscious experience, physiological response, and/or behavior resulting from that emotional state. For example, writing about a negative experience in one's journal may improve one's mood. Some other examples of affect labeling include discussing one's feelings with a therapist, complaining to friends about a negative experience, posting one's feelings on social media or acknowledging the scary aspects of a situation.

Affective priming, also called affect priming, is a type of response priming and was first proposed by Russell H. Fazio. This type of priming entails the evaluation of people, ideas, objects, goods, etc., not only based on the physical features of those things, but also on affective context. The affective context may come from previous life experiences, and therefore, primes may arouse emotions rather than ideas. Most research and concepts about affective priming derive from the affective priming paradigm, which looks to make judgments of neutral affective targets following positive, neutral, or negative primes. A prominent derivation of affective priming paradigm is the Affect Misattribution Procedure (AMP), developed by Payne, Cheng, Govorun, and Stewart. The main idea of AMP is to measure implicit attitudes, therefore, if the evaluation of the prime stimuli of an object is positive, it is said that the person has a positive attitude toward the object exposed.

The Self-Assessment Manikin (SAM) is a non-verbal pictorial questionnaire that directly measures a person's affect and feelings in response to exposure to an object or an event, such as a picture. It is widely used by scientists to determine emotional reactions of participants during psychology experiments due to its non-verbal nature. It was developed by Margaret Bradley and Peter Lang, and consists of three rows of pictograms, each of which uses a stylized diagram to show a five point scale in each of the three domain: valence, arousal and dominance.

References

  1. Russell, James A.; Weiss, Anna; Mendelsohn, Gerald A. (1989). "Affect Grid: A single-item scale of pleasure and arousal". Journal of Personality and Social Psychology. 57 (3): 493–502. doi:10.1037/0022-3514.57.3.493. ISSN   1939-1315. S2CID   4837807.
  2. 1 2 Toet, Alexander; Kaneko, Daisuke; Ushiama, Shota; Hoving, Sofie; de Kruijf, Inge; Brouwer, Anne-Marie; Kallen, Victor; van Erp, Jan B. F. (2018). "EmojiGrid: A 2D Pictorial Scale for the Assessment of Food Elicited Emotions". Frontiers in Psychology. 9: 2396. doi: 10.3389/fpsyg.2018.02396 . ISSN   1664-1078. PMC   6279862 . PMID   30546339.
  3. Bradley, Margaret M.; Lang, Peter J. (1994). "Measuring emotion: The self-assessment manikin and the semantic differential". Journal of Behavior Therapy and Experimental Psychiatry. 25 (1): 49–59. doi:10.1016/0005-7916(94)90063-9. PMID   7962581. S2CID   17630161.
  4. 1 2 Kaneko, Daisuke; Toet, Alexander; Ushiama, Shota; Brouwer, Anne-Marie; Kallen, Victor; van Erp, Jan B.F. (2019). "EmojiGrid: A 2D pictorial scale for cross-cultural emotion assessment of negatively and positively valenced food". Food Research International. 115: 541–551. doi:10.1016/j.foodres.2018.09.049. PMID   30599977. S2CID   58653600.
  5. Toet; van Erp (2019). "The EmojiGrid as a Tool to Assess Experienced and Perceived Emotions". Psych. 1 (1): 469–481. doi: 10.3390/psych1010036 . ISSN   2624-8611.
  6. Brouwer, Anne-Marie; van Beers, Jasper J.; Sabu, Priya; Stuldreher, Ivo V.; Zech, Hilmar G.; Kaneko, Daisuke (2021-06-22). "Measuring Implicit Approach–Avoidance Tendencies towards Food Using a Mobile Phone outside the Lab". Foods. 10 (7): 1440. doi: 10.3390/foods10071440 . ISSN   2304-8158. PMC   8305314 . PMID   34206278.
  7. Toet, Alexander; van Erp, Jan B. F. (2020). "Affective rating of audio and video clips using the EmojiGrid". F1000Research. 9: 970. doi: 10.12688/f1000research.25088.1 . ISSN   2046-1402. PMC   8080979 . PMID   33968373.
  8. Toet, Alexander; Heijn, Fabienne; Brouwer, Anne-Marie; Mioch, Tina; van Erp, Jan B. F. (2019), Bourdot, Patrick; Interrante, Victoria; Nedel, Luciana; Magnenat-Thalmann, Nadia (eds.), "The EmojiGrid as an Immersive Self-report Tool for the Affective Assessment of 360 VR Videos", Virtual Reality and Augmented Reality, Lecture Notes in Computer Science, Cham: Springer International Publishing, vol. 11883, pp. 330–335, doi:10.1007/978-3-030-31908-3_24, ISBN   978-3-030-31907-6, S2CID   203847617 , retrieved 2021-11-28
  9. Toet, Alexander; van Erp, Jan B. F. (2020). Scilingo, Enzo Pasquale (ed.). "The EmojiGrid as a rating tool for the affective appraisal of touch". PLOS ONE. 15 (9): e0237873. Bibcode:2020PLoSO..1537873T. doi: 10.1371/journal.pone.0237873 . ISSN   1932-6203. PMC   7467219 . PMID   32877409.
  10. de Wijk, Rene A.; Ushiama, Shota; Ummels, Meeke J.; Zimmerman, Patrick H.; Kaneko, Daisuke; Vingerhoeds, Monique H. (2021-05-13). "Effect of Branding and Familiarity of Soy Sauces on Valence and Arousal as Determined by Facial Expressions, Physiological Measures, Emojis, and Ratings". Frontiers in Neuroergonomics. 2: 651682. doi: 10.3389/fnrgo.2021.651682 . ISSN   2673-6195.
  11. Liu, Yingxuan; Toet, Alexander; Krone, Tanja; van Stokkum, Robin; Eijsman, Sophia; van Erp, Jan B. F. (2020). Greco, Alberto (ed.). "A network model of affective odor perception". PLOS ONE. 15 (7): e0236468. Bibcode:2020PLoSO..1536468L. doi: 10.1371/journal.pone.0236468 . ISSN   1932-6203. PMC   7392242 . PMID   32730278.
  12. Toet, Alexander; Eijsman, Sophia; Liu, Yingxuan; Donker, Stella; Kaneko, Daisuke; Brouwer, Anne-Marie; van Erp, Jan B.F. (2020). "The Relation Between Valence and Arousal in Subjective Odor Experience". Chemosensory Perception. 13 (2): 141–151. doi:10.1007/s12078-019-09275-7. ISSN   1936-5802. S2CID   208302660.
  13. Van der Burg, Erik; Toet, Alexander; Brouwer, Anne-Marie; van Erp, Jan B. F. (2021). "Sequential Effects in Odor Perception". Chemosensory Perception. 15: 19–25. doi:10.1007/s12078-021-09290-7. ISSN   1936-5802. S2CID   235650532.
  14. Sanatani, R.P. (2020). User-specific predictive affective modeling for enclosure analysis and design assistance", Imaginable Futures: Design Thinking, and the Scientific Method. 54th International Conference of the Architectural Science Association 2020. Auckland, New Zealand: Architectural Science Association (ANZAScA). pp. 1341–1350.
  15. Aitken, John A.; Kaplan, Seth A.; Pagan, Olivia; Wong, Carol M.; Sikorski, Eric; Helton, William (2021-10-02). "Affective Forecasts for the Experience Itself: An Investigation of the Impact Bias during an Affective Experience". Current Psychology. 42 (13): 10581–10587. doi:10.1007/s12144-021-02337-8. ISSN   1046-1310. S2CID   244197232.
  16. Rutkowski, Tomasz M.; Abe, Masato S.; Koculak, Marcin; Otake-Matsuura, Mihoko (July 2020). "Classifying Mild Cognitive Impairment from Behavioral Responses in Emotional Arousal and Valence Evaluation Task – AI Approach for Early Dementia Biomarker in Aging Societies". 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). Vol. 2020. Montreal, QC, Canada: IEEE. pp. 5537–5543. doi:10.1109/EMBC44109.2020.9175805. ISBN   978-1-7281-1990-8. PMID   33019233. S2CID   221385462.
  17. Kaneko, Daisuke; Stuldreher, Ivo; Reuten, Anne J. C.; Toet, Alexander; van Erp, Jan B. F.; Brouwer, Anne-Marie (2021). "Comparing Explicit and Implicit Measures for Assessing Cross-Cultural Food Experience". Frontiers in Neuroergonomics. 2: 646280. doi: 10.3389/fnrgo.2021.646280 . ISSN   2673-6195.