Face space

Last updated

Face space is a theoretical idea in psychology such that it is a multidimensional space in which recognizable faces are stored. The representation of faces within this space are according to invariant features of the face itself. [1] However, recently it was theoretically demonstrated that faces can be stored in the face space according to their dynamic features as well, and that in this case the resulting space exhibits a twofold structure. [2]

Contents

The face space framework has been highly influential in recent face processing theory; cited in almost 1000 scientific articles and recently revisited in a special edition of the journal Quarterly Journal of Experimental Psychology featuring the top 10 ideas that have appeared in the journal's pages. [3]

Face space is useful for accounting various aspects of face recognition including, the own-race bias, [4] distinctiveness and caricature effects. [5] The framework has also provided useful applications in the design of forensic techniques for eyewitness identification, such as facial composites and police lineups. [3]

Characteristics

The face-space framework is a psychological model that explains how (adult) humans process and store facial information, which we use for facial recognition. It is multidimensional, with each dimension categorised by certain facial features, some of which may be: face shape, hair colour and length, distance between the eyes, age and masculinity. [1] [3] However, these are not categorically identified, and face-space dimensions could theoretically include any distinguishing facial feature. [1] The model assumes that every face is mentally represented as a specific location within this psychological space (according to its dimensions) and that the faces’ likeness correspond with the distance between them; similar faces being nearer to each other, and different faces further. [3]

Mathematical assumptions are also necessary to explain the features of face-space. The central point of face-space (i.e. the origin) represents the central tendency of all the dimensions of facial features, [1] with stored faces assumed to have a normal distribution in each of these dimensions. As such, faces are arranged most densely, and look the most typical at the origin, and become sparser and more distinctive with greater distance from the origin. [3]

Storing a face in a specific location within face-space involves the encoding of facial data into the dimensions of the framework. However, encoding is never perfect; any factor that hinders face recognition can induce encoding error. [3] Factors like negative colours, minimal viewing time and inversion (seen upside-down) when viewing a face can substantially increase its encoding error. [3] Whilst other factors like race, distinctiveness [1] and caricature effects [6] can circumstantially make encoding easier or more difficult.

Norm and exemplar models

Two slightly different models of face-space are standard: norm and exemplar-based face-spaces. Both models encode faces in a multidimensional psychological space and account for factors like race and inversion. However, they differ in terms of their explanation of a face’s location in the space; either as a vector from a ‘norm face’, or as distance from other faces. [1]

In the norm-based model, the encoding of faces is relative to a central face at the origin: a ‘norm face’. [1] Faces are arranged using vectors from this norm, with the vector’s parameters of length and direction determined by the distinctiveness and features of the face respectively. [3]

In the exemplar-based model, faces are encoded as individual points in the space, rather than as vectors relative to a norm face. Similarity to other faces in this model is defined by the relative distance between the faces. [1]

Facial recognition explanations

Distinctiveness and caricature effects

Multiple studies have found that faces with distinctive features are recognised more easily than typical faces. [6] The face-space framework is able to explain this finding as it assumes that faces are distributed normally across its dimensions. Therefore, numerous typical faces are found at the origin of the model, with increasingly distinctive, yet infrequent, faces found further away. [7] Thus, since distinctive faces are located as more distant from other faces in the face-space (low exemplar density), confusion with these other faces is less likely, leading to better recognition. [7]

A caricature effect denotes the finding that caricatured faces are more easily recognised than veridical (original) ones. [6] Caricatures compare individual faces with an ‘average’ face (simplified version of original) and exaggerate the facial differences that are found, thus giving the original face more distinctive features. [6] The increased distinctiveness induced by the caricature explains the caricature effect: [6] the original face is more typical than the caricature and therefore in a more crowded area of face-space, whereas the more distinctive caricature is further away, and thus has less scope for confusion.

Own-race bias

An own-race bias is the tendency to more easily recognise faces of people of the same race as yourself, compared to those of different races. Numerous studies have provided evidence for this phenomenon, [8] and face-space presents multiple explanations.

An interpretation of the location of faces within face-space using multidimensional scaling, reveals that other-race faces are densely packed within a more distant area of face-space, while own-race faces are more unbiasedly distributed around the origin. [8] This is explained in terms of the difference in exemplar density (how close faces are positioned to other faces) between own and other-race faces. Because other-race faces are encoded with less emphasis on distinguishing facial features, and more on race (the opposite of own-race faces), they are grouped close together, yet are distant from the central point of face-space. Unlike distinctiveness however, distance in this case does not facilitate facial recognition, due to the higher exemplar density (many faces are close together) of other-race faces. [8] [1]

Norm-based face-space on the other hand explains the own-race bias as a consequence of distance from the ‘norm face’. [1] Own-race faces are located nearer the norm, whereas other-race faces are grouped further from it, making own-race faces quicker to process and recognise. [1]

Forensic applications

The face-space framework has been very influential in the development of modern eyewitness identification techniques. In particular, for both the fourth generation of facial composite systems [9] as well as fairer police line-ups for suspects with distinguishing features. [10]

Facial composites

Face-space puts an emphasis on facial identification according to similarities or differences between whole faces, rather than individual facial features. [9] Accordingly, principal component analysis is used to derive certain dimensions or ‘eigenfaces’ from sample faces, which can be combined and encoded upon to construct new, whole, faces. [9] This can be used to create more accurate facial composite systems, as holistic face representations are better recognised than representations using individual features, [11] such as those used by older facial composite systems. [9]

Police lineup design

In a police lineup, choosing the sole suspect that has a distinguishing feature described by the eyewitness (such as a piercing) on the basis of that feature alone, is not fair to that potentially innocent suspect. [3] To correct for this partiality, you can either cover up the feature on the individual, or replicate the feature on all suspects. [10] Distinctive features replicated on multiple faces would mean they are nearer in face-space, and therefore perceived as more similar, according to the hybrid-similarity model. [10] Consequently, this model correctly predicts replication as a more effective procedure for correct identification of target individuals than concealment, as a result of a more difficult decision induced through lesser variance within the lineup. [10]

See also

Conceptual space

Related Research Articles

<span class="mw-page-title-main">Face</span> Part of the body that is at the front of the head

The face is the front of an animal's head that features the eyes, nose and mouth, and through which animals express many of their emotions. The face is crucial for human identity, and damage such as scarring or developmental deformities may affect the psyche adversely.

Categorization is a type of cognition involving conceptual differentiation between characteristics of conscious experience, such as objects, events, or ideas. It involves the abstraction and differentiation of aspects of experience by sorting and distinguishing between groupings, through classification or typification on the basis of traits, features, similarities or other criteria that are universal to the group. Categorization is considered one of the most fundamental cognitive abilities, and it is studied particularly by psychology and cognitive linguistics.

<span class="mw-page-title-main">Caricature</span> Simplified or exaggerated artistic image

A caricature is a rendered image showing the features of its subject in a simplified or exaggerated way through sketching, pencil strokes, or other artistic drawings. Caricatures can be either insulting or complimentary, and can serve a political purpose, be drawn solely for entertainment, or for a combination of both. Caricatures of politicians are commonly used in newspapers and news magazines as political cartoons, while caricatures of movie stars are often found in entertainment magazines.

<span class="mw-page-title-main">Physiognomy</span> Assessment of a persons character or personality from their outer appearance

Physiognomy or Face Reading is the practice of assessing a person's character or personality from their outer appearance—especially the face. The term can also refer to the general appearance of a person, object, or terrain without reference to its implied characteristics—as in the physiognomy of an individual plant or of a plant community.

<span class="mw-page-title-main">Face perception</span> Cognitive process of visually interpreting the human face

Facial perception is an individual's understanding and interpretation of the face. Here, perception implies the presence of consciousness and hence excludes automated facial recognition systems. Although facial recognition is found in other species, this article focuses on facial perception in humans.

Similarity refers to the psychological degree of identity of two mental representations. It is fundamental to human cognition since it provides the basis for categorization of entities into kinds and for various other cognitive processes. It underpins our ability to interact with unknown entities by predicting how they will behave based on their similarity to entities we are familiar with. Research in cognitive psychology has taken a number of approaches to the concept of similarity. Each of them is related to a particular set of assumptions about knowledge representation.

<span class="mw-page-title-main">Facial composite</span> Graphical representation of one or more eyewitnesses memories of a face

A facial composite is a graphical representation of one or more eyewitnesses' memories of a face, as recorded by a composite artist. Facial composites are used mainly by police in their investigation of crimes. These images are used to reconstruct the suspect's face in hope of identifying them. Facial reconstruction can also be used in archeological studies to get a visualization of ancient mummies or human remains.

In physical attractiveness studies, averageness describes the physical beauty that results from averaging the facial features of people of the same gender and approximately the same age. The majority of averageness studies have focused on photographic overlay studies of human faces, in which images are morphed together. The term "average" is used strictly to denote the technical definition of the mathematical mean. An averaged face is not unremarkable, but is, in fact, quite good looking. Nor is it typical in the sense of common or frequently occurring in the population, though it appears familiar, and is typical in the sense that it is a good example of a face that is representative of the category of faces.

The cross-race effect is the tendency to more easily recognize faces that belong to one's own racial group, or racial groups that one has been in contact with. In social psychology, the cross-race effect is described as the "ingroup advantage," whereas in other fields, the effect can be seen as a specific form of the "ingroup advantage" since it is only applied in interracial or inter-ethnic situations. The cross-race effect is thought to contribute to difficulties in cross-race identification, as well as implicit racial bias.

<span class="mw-page-title-main">Forensic arts</span> Art used in law enforcement or legal proceedings

Forensic art is any art used in law enforcement or legal proceedings. Forensic art is used to assist law enforcement with the visual aspects of a case, often using witness descriptions and video footage.

Eyewitness memory is a person's episodic memory for a crime or other witnessed dramatic event. Eyewitness testimony is often relied upon in the judicial system. It can also refer to an individual's memory for a face, where they are required to remember the face of their perpetrator, for example. However, the accuracy of eyewitness memories is sometimes questioned because there are many factors that can act during encoding and retrieval of the witnessed event which may adversely affect the creation and maintenance of the memory for the event. Experts have found evidence to suggest that eyewitness memory is fallible.

<span class="mw-page-title-main">Chingis Izmailov</span> Russian neuroscientist (1944–2011)

Chingis A. Izmailov was a Russian psychophysiologist and psychophysicist, the principal author of the spherical model of color space.

Steve Penrod is a distinguished professor of psychology at the John Jay College of Criminal Justice. His education and career have led him to become an expert in the areas of psychology and law. He has contributed heavily to the field of psychology in the area of eyewitness memory, specifically the accuracy of eyewitness identification.

Roderick Cameron Lodge Lindsay is a Canadian psychologist who studies the area of psychology and law, and focuses on eyewitness memory. In 1974, he received his bachelor's degree at the University of Toronto and in 1978 he received his master's degree from the University of Alberta. Lindsay also received his Ph. D from the University of Alberta in 1982.

Ethnic identity development includes the identity formation in an individual's self-categorization in, and psychological attachment to, (an) ethnic group(s). Ethnic identity is characterized as part of one's overarching self-concept and identification. It is distinct from the development of ethnic group identities.

<span class="mw-page-title-main">Reconstructive memory</span> A theory of memory recall

Reconstructive memory is a theory of memory recall, in which the act of remembering is influenced by various other cognitive processes including perception, imagination, motivation, semantic memory and beliefs, amongst others. People view their memories as being a coherent and truthful account of episodic memory and believe that their perspective is free from an error during recall. However, the reconstructive process of memory recall is subject to distortion by other intervening cognitive functions such as individual perceptions, social influences, and world knowledge, all of which can lead to errors during reconstruction.

A neurological look at race is multifaceted. The cross-race effect has been neurologically explained by there being differences in brain processing while viewing same-race and other-race faces. There is a debate over the cause of the cross-race effect.

Emotion perception refers to the capacities and abilities of recognizing and identifying emotions in others, in addition to biological and physiological processes involved. Emotions are typically viewed as having three components: subjective experience, physical changes, and cognitive appraisal; emotion perception is the ability to make accurate decisions about another's subjective experience by interpreting their physical changes through sensory systems responsible for converting these observed changes into mental representations. The ability to perceive emotion is believed to be both innate and subject to environmental influence and is also a critical component in social interactions. How emotion is experienced and interpreted depends on how it is perceived. Likewise, how emotion is perceived is dependent on past experiences and interpretations. Emotion can be accurately perceived in humans. Emotions can be perceived visually, audibly, through smell and also through bodily sensations and this process is believed to be different from the perception of non-emotional material.

Verbal overshadowing is a phenomenon where giving a verbal description of sensory input impairs formation of memories of that input. This was first reported by Schooler and Engstler-Schooler (1990) where it was shown that the effects can be observed across multiple domains of cognition which are known to rely on non-verbal knowledge and perceptual expertise. One example of this is memory, which has been known to be influenced by language. Seminal work by Carmichael and collaborators (1932) demonstrated that when verbal labels are connected to non-verbal forms during an individual's encoding process, it could potentially bias the way those forms are reproduced. Because of this, memory performance relying on reportable aspects of memory that encode visual forms should be vulnerable to the effects of verbalization.

John Kendall Kruschke is an American psychologist and statistician known for his work in connectionist models of human learning, and in Bayesian statistical analysis. He is Provost Professor Emeritus in the Department of Psychological and Brain Sciences at Indiana University Bloomington. He won the Troland Research Award from the National Academy of Sciences in 2002.

References

  1. 1 2 3 4 5 6 7 8 9 10 11 Valentine, T. (1991). A unified account of the effects of distinctiveness, inversion, and race in face recognition. The Quarterly Journal of Experimental Psychology, 43(2), 161-204.
  2. Vitale, J., & Johnston, B., & Williams, M. (2016). The face-space duality hypothesis: a computational model. Proceedings of the 38th Annual Conference of the Cognitive Science Society.
  3. 1 2 3 4 5 6 7 8 9 Valentine, T., Lewis, M. B., & Hills, P. J. (2015). Face-space: A unifying concept in face recognition research. The Quarterly Journal of Experimental Psychology, (ahead-of-print), 1-24.
  4. Valentine, T., & Endo, M. (1992). Towards an exemplar model of face processing: The effects of race and distinctiveness. The Quarterly Journal of Experimental Psychology, 44(4), 671-703.
  5. Lewis, M. (2004). Face‐space‐R: Towards a unified account of face recognition. Visual Cognition, 11(1), 29-69.
  6. 1 2 3 4 5 Lee, K., Byatt, G., & Rhodes, G. (2000). Caricature effects, distinctiveness, and identification: Testing the face-space framework. Psychological Science, 11(5), 379–385. https://doi.org/10.1111/1467-9280.00274
  7. 1 2 Valentine, T. (2001). Face-space models of face recognition. . In M. J. Wenger & J. T. Townsend (Eds.), Computational, geometric, and process perspectives on facial cognition: Contexts and challenges (pp. 83–113). L. Erlbaum Associates.
  8. 1 2 3 Byatt, G., & Rhodes, G. (2004). Identification of own-race and other-race faces: Implications for the representation of race in face space. Psychonomic Bulletin & Review, 11(4), 735-741.
  9. 1 2 3 4 Davies, G. M., & Valentine, T. (2013). Facial composites: Forensic utility and psychological research. Handbook of eyewitness psychology, 2, 59-83.
  10. 1 2 3 4 Zarkadi, T., Wade, K. A., & Stewart, N. (2009). Creating fair lineups for suspects with distinctive features. Psychological Science, 20(12), 1448-1453.
  11. Wells, G. L., & Hasel, L. E. (2007). Facial composite production by eyewitnesses. Current Directions in Psychological Science, 16(1), 6-10.