Synthetic Aperture Personality Assessment

Last updated

Synthetic Aperture Personality Assessment (SAPA) is a method used for telemetric assessment of individual differences, primarily in the context of online surveys. The SAPA method uses data collected from the administration of large inventories of personality assessment items to large pools of participants, though it differs from traditional data collection methods in that each participant responds to only a small subset of all available items. In other words, each participant receives a random (or partially random) subset of the items under study. As long as some of the items are overlapping between pairs of participants, the smaller subset is more palatable for individual participants yet can be combined to synthesize large covariance matrices (with considerable data missing at random). In this way, the SAPA methodology is well-suited for assessing personality and individual differences across multiple domains. [1] It is also a highly efficient means for new item prototyping and scale construction. [2]

Contents

The SAPA Methodology

The procedure is straightforward. From a large set of personality and ability items (P), a smaller subset of items (n) are presented to any one subject. With random sampling of the items, all possible pairs of items are eventually presented together. As the number of subjects (N) grows, each item has been given to N × (n / P) subjects, and each pair of items has been given to N × (n / P)2 subjects. The online survey [3] developed by William Revelle (and maintained by the Personality, Motivation, & Cognition Lab [4] at Northwestern University) has used this technique with approximately 200,000 participants (N) as of 2012. In this example, each participant receives a subset of items (n) equal to approximately 75, though the full set of items (P) being administered at any given time may be as high as 500.

The Traditional Method Used for Internet Surveys

Studies of individual differences in cognitive and non-cognitive aspects of personality are frequently limited by the sample sizes available in the typical university research setting. Small but stable relationships are difficult to detect when one is limited to 50 to 100 subjects, and detecting complex relationships between multiple measures is difficult when participants are limited to short one or two-hour studies. Alternative procedures involve large research groups collecting data across many research sites (e.g., the Programme for International Student Assessment - PISA). Since the 1990s, an increasing number of psychologists have begun to employ web-based data collection techniques as a means of increasing both the size and breadth of samples with little loss of validity (Fraley, 2004; Gosling, Vazire, Srivastava, & John, 2004; Skitka & Sargis, 2006). While several online surveys have collected data from very large samples (e.g., the >300,000 reported by Gosling et al., 2004), most of these studies administer short questionnaires or basic cognitive tasks (Greenwald, Nosek, & Banaji, 2003).

Explanation of the "Synthetic-Aperture" Analogy

As a variation of standard web-based assessment methods, the SAPA methodology borrows by analogy a technique used in radio and optical astronomy: Synthetic Aperture Measurement. The resolution of a telescope is limited by its diameter which may be functionally increased a great deal by combining input from multiple, linked sites into one coherent image. Effectively, a very large telescope is created by synthesizing the input of many smaller ones. A classic example in radio astronomy is the Very Large Array, part of the National Radio Astronomy Observatory in Socorro, New Mexico, where 27 relatively small (≈ 25 meter) radio telescopes are spread out in a Y-shaped configuration to simulate the resolution of a 36 km telescope. The configuration is adjustable so that the telescope can either emphasize resolution (by maximizing the distance covered) or sensitivity (by concentrating the telescopes close to each other). In optical astronomy similar techniques are used in inferometry at the W. M. Keck Observatory in Hawaii with "outriggers" to supplement the main telescope. Similar techniques are available for "telemetric assessment" of psychological constructs. Rather than combining signals from the same source using different telescopes as is done in astronomy, the structure of personality can be studied by combining the responses of many people across more items than any one person is willing to take. This is not an entirely novel procedure. The Educational Testing Service, for example, has long used the very large samples available when students take the SAT or GRE to develop new items by randomly giving small subsets of items to much smaller (but still quite large) subsamples of students. The SAPA methodology allows for these techniques to be used by a broader population of researchers by making use of open source and public domain software.

Public-Domain Item Pools

During the past century, the measurement of personality and ability has tended to be fragmented by separate groups of individuals using proprietary sets of measures. Indeed, the proprietary nature is partly seen in the choice of names for these inventories and tests: the Minnesota Multiphasic Personality Inventory, the California Psychological Inventory, the Eysenck Personality Questionnaire, the Freiburger Persönlichkeitsinventar, the Guilford-Zimmerman Temperament Survey, the Hogan Personality Inventory, the Jackson Personality Research Form, the Myers-Briggs Type Indicator, the Stanford–Binet Intelligence Scales, the Wechsler Adult Intelligence Scale, the Wechsler Intelligence Scale for Children, etc. Each of these tests was carefully developed by research groups and each is protected by copyright. Although some groups will allow non-profit use of the measures for minimal cost, this is the exception. Many of these inventories have similar sounding scales, but given the expense, there are a limited number of studies directly comparing the inventories (Grucza & Goldberg, 2007).

An alternative to the proprietary nature of personality measurement is the International Personality Item Pool (IPIP) [5] developed by Lewis Goldberg (1999). Including more than 2,400 items in the form of sentence stems, the IPIP collaboratory has at least 269 scales targeted at everything from achievement striving to vitality/zest and includes public domain scales meant to reflect constructs found in at least 17 commonly used personality inventories. All of the IPIP items and the common personality inventories have been given to the same community sample in Eugene/Springfield, Oregon, and item statistics are freely available from Goldberg and his associates. Some have questioned the open and free use of the IPIP items with respect to the possibility of the public learning to fake personality tests used in employment settings. Others have worried about whether the freedom to select items will lead to fragmentation of constructs rather than the hoped for integration (Goldberg et al., 2006).

Even more proprietary than non-cognitive personality scales and items are measures of intellectual ability. Items and scales are either under copyright or are completely idiosyncratic to particular labs and yet still not openly published. As a result, there are currently few alternatives for researchers in search of validated, open source measures of cognitive ability.

Sample Characteristics

As discussed in reviews of web-based research (Fraley, 2004; Gosling et al., 2004; Skitka & Sargis, 2006), the participants in non-directed online surveys are demographically diverse but not a representative sample of anybody other than those who want to take web-based surveys. Samples tend to be about two-thirds female and have a median age of 25. Many techniques are available for recruiting participants with specific demographic profiles, though these efforts necessarily limit the potential size of the total participant pool.

Related Research Articles

<span class="mw-page-title-main">Psychometrics</span> Theory and technique of psychological measurement

Psychometrics is a field of study within psychology concerned with the theory and technique of measurement. Psychometrics generally refers to specialized fields within psychology and education devoted to testing, measurement, assessment, and related activities. Psychometrics is concerned with the objective measurement of latent constructs that cannot be directly observed. Examples of latent constructs include intelligence, introversion, mental disorders, and educational achievement. The levels of individuals on nonobservable latent variables are inferred through mathematical modeling based on what is observed from individuals' responses to items on tests and scales.

<span class="mw-page-title-main">Psychological testing</span> Administration of psychological tests

Psychological testing is the administration of psychological tests. Psychological tests are administered by trained evaluators. A person's responses are evaluated according to carefully prescribed guidelines. Scores are thought to reflect individual or group differences in the construct the test purports to measure. The science behind psychological testing is psychometrics.

The Minnesota Multiphasic Personality Inventory (MMPI) is a standardized psychometric test of adult personality and psychopathology. Psychologists and other mental health professionals use various versions of the MMPI to help develop treatment plans, assist with differential diagnosis, help answer legal questions, screen job candidates during the personnel selection process, or as part of a therapeutic assessment procedure.

<span class="mw-page-title-main">Personality test</span> Method of assessing human personality constructs

A personality test is a method of assessing human personality constructs. Most personality assessment instruments are in fact introspective self-report questionnaire measures or reports from life records (L-data) such as rating scales. Attempts to construct actual performance tests of personality have been very limited even though Raymond Cattell with his colleague Frank Warburton compiled a list of over 2000 separate objective tests that could be used in constructing objective personality tests. One exception however, was the Objective-Analytic Test Battery, a performance test designed to quantitatively measure 10 factor-analytically discerned personality trait dimensions. A major problem with both L-data and Q-data methods is that because of item transparency, rating scales and self-report questionnaires are highly susceptible to motivational and response distortion ranging all the way from lack of adequate self-insight to downright dissimulation depending on the reason/motivation for the assessment being undertaken.

Conscientiousness is the personality trait of being careful, or diligent. Conscientiousness implies a desire to do a task well, and to take obligations to others seriously. Conscientious people tend to be efficient and organized as opposed to easy-going and disorderly. They exhibit a tendency to show self-discipline, act dutifully, and aim for achievement; they display planned rather than spontaneous behavior; and they are generally dependable. It is manifested in characteristic behaviors such as being neat, and systematic; also including such elements as carefulness, thoroughness, and deliberation.

<span class="mw-page-title-main">Big Five personality traits</span> Personality model consisting of five broad dimensions

The Big Five personality traits is a suggested taxonomy, or grouping, for personality traits, developed from the 1980s onward in psychological trait theory.

Personality Assessment Inventory (PAI), developed by Leslie Morey, is a self-report 344-item personality test that assesses a respondent's personality and psychopathology. Each item is a statement about the respondent that the respondent rates with a 4-point scale. It is used in various contexts, including psychotherapy, crisis/evaluation, forensic, personnel selection, pain/medical, and child custody assessment. The test construction strategy for the PAI was primarily deductive and rational. It shows good convergent validity with other personality tests, such as the Minnesota Multiphasic Personality Inventory and the Revised NEO Personality Inventory.

In social science research, social-desirability bias is a type of response bias that is the tendency of survey respondents to answer questions in a manner that will be viewed favorably by others. It can take the form of over-reporting "good behavior" or under-reporting "bad", or undesirable behavior. The tendency poses a serious problem with conducting research with self-reports. This bias interferes with the interpretation of average tendencies as well as individual differences.

Lewis R. Goldberg is an American personality psychologist and a professor emeritus at the University of Oregon. He is closely associated with the lexical hypothesis that any culturally important personality characteristic will be represented in the language of that culture. This hypothesis led to a five factor structure of personality trait adjectives. When applied to personality items this structure is also known as the five-factor model (FFM) of personality. He is the creator of the International Personality Item Pool(IPIP), a website that provides public-domain personality measures.

The California Psychological Inventory (CPI) is a self-report inventory created by Harrison G. Gough and currently published by Consulting Psychologists Press. The text containing the test was first published in 1956, and the most recent revision was published in 1996. It was created in a similar manner to the Minnesota Multiphasic Personality Inventory (MMPI)—with which it shares 194 items. But unlike the MMPI, which focuses on maladjustment or clinical diagnosis, the CPI was created to assess the everyday "folk-concepts" that ordinary people use to describe the behavior of the people around them.

Openness to experience is one of the domains which are used to describe human personality in the Five Factor Model. Openness involves six facets, or dimensions: active imagination (fantasy), aesthetic sensitivity, attentiveness to inner feelings, preference for variety (adventurousness), intellectual curiosity, and challenging authority. A great deal of psychometric research has demonstrated that these facets or qualities are significantly correlated. Thus, openness can be viewed as a global personality trait consisting of a set of specific traits, habits, and tendencies that cluster together.

The Millon Clinical Multiaxial Inventory – Fourth Edition (MCMI-IV) is the most recent edition of the Millon Clinical Multiaxial Inventory. The MCMI is a psychological assessment tool intended to provide information on personality traits and psychopathology, including specific mental disorders outlined in the DSM-5. It is intended for adults with at least a 5th grade reading level who are currently seeking mental health services. The MCMI was developed and standardized specifically on clinical populations, and the authors are very specific that it should not be used with the general population or adolescents. However, there is evidence base that shows that it may still retain validity on non-clinical populations, and so psychologists will sometimes administer the test to members of the general population, with caution. The concepts involved in the questions and their presentation make it unsuitable for those with below average intelligence or reading ability.

Psychological evaluation is a method to assess an individual's behavior, personality, cognitive abilities, and several other domains. A common reason for a psychological evaluation is to identify psychological factors that may be inhibiting a person's ability to think, behave, or regulate emotion functionally or constructively. It is the mental equivalent of physical examination. Other psychological evaluations seek to better understand the individual's unique characteristics or personality to predict things like workplace performance or customer relationship management.

Affect measures are used in the study of human affect, and refer to measures obtained from self-report studies asking participants to quantify their current feelings or average feelings over a longer period of time. Even though some affect measures contain variations that allow assessment of basic predispositions to experience a certain emotion, tests for such stable traits are usually considered to be personality tests.

The Revised NEO Personality Inventory is a personality inventory that assesses an individual on five dimensions of personality, the so-called Big Five personality traits. These traits are openness to experience, conscientiousness, extraversion, agreeableness, and neuroticism. In addition, the NEO PI-R also reports on six subcategories of each Big Five personality trait.

The Psychopathic Personality Inventory (PPI-Revised) is a personality test for traits associated with psychopathy in adults. The PPI was developed by Scott Lilienfeld and Brian Andrews to assess these traits in non-criminal populations, though it is still used in clinical populations as well. In contrast to other psychopathy measures, such as the Hare Psychopathy Checklist (PCL), the PPI is a self-report scale, rather than interview-based, assessment. It is intended to comprehensively index psychopathic personality traits without assuming particular links to anti-social or criminal behaviors. It also includes measures to detect impression management or careless responding.

The Levenson Self-Report Psychopathy scale (LSRP) is a 26-item, 4-point Likert scale, self-report inventory to measure primary and secondary psychopathy in non-institutionalised populations. It was developed in 1995 by Michael R. Levenson, Kent A. Kiehl and Cory M. Fitzpatrick. The scale was created for the purpose of conducting a psychological study examining antisocial disposition among a sample of 487 undergraduate students attending psychology classes at the University of California, Davis.

The International Personality Item Pool (IPIP) is a public domain collection of items for use in personality tests. It is managed by the Oregon Research Institute.

The New Zealand Attitudes and Values Study (NZAVS) is a longitudinal study conducted in New Zealand. The NZAVS was started in 2009 by Chris Sibley, a professor in psychology at the University of Auckland. The NZAVS was inspired by major social surveys conducted internationally, such as the National Election Studies, the World Values Survey and the General Social Survey, and aims to provide a similar resource for New Zealand. As of November 8, 2016, the NZAVS research team had published 100 peer reviewed publications using data from the study.

<span class="mw-page-title-main">Peter J. Rentfrow</span>

Peter Jason Rentfrow is professor of personality and individual differences in the Psychology Department at Cambridge University, where he directs the Social Dynamics Research Center. He is an elected Fellow of the Association for Psychological Science, the Society for Personality and Social Psychology, and the Alan Turing Institute.

References

  1. ↑ "Archived copy" (PDF). Archived from the original (PDF) on 2017-08-11. Retrieved 2017-08-11.{{cite web}}: CS1 maint: archived copy as title (link)
  2. ↑ http://www.personality-project.org/condon/ISSID.pdf [ dead link ]
  3. ↑ http://sapa-project.org/
  4. ↑ "Personality, Motivation and Cognition Laboratory".
  5. ↑ "Home". ipip.ori.org.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.