Rorschach Performance Assessment System

Last updated

The Rorschach Performance Assessment System (R-PAS) [1] [2] is a scoring and interpretive method to be used with the Rorschach inkblot test. [3] This system is being developed by several members of the Rorschach Research Council, a group established by John Exner to advance the research on the Comprehensive System, the most widely used scoring system for the Rorschach. Following Exner's death, the council admitted that the current Comprehensive System scoring was in need of revision. R-PAS was developed as an empirically based revision of the Exner Comprehensive System.

Contents

The R-PAS is an empirically based, and internationally normed scoring system that is easier to use than Exner's Comprehensive System. [4] The R-PAS manual is intended to be a comprehensive tool for administering, scoring, and interpreting the Rorschach. The manual consists of two chapters that are basics of scoring and interpretation, aimed for use for novice Rorschach users, followed by numerous chapters containing more detailed and technical information. [5] The manual is supplemented by a website in which additional information and resources are available to aid administration of the Rorschach.

Administration

R-optimized procedures of administration instruct examiners to ask the respondents to provide two or three responses for each of the 10 Rorschach cards. Examiners may use “prompts” to encourage examinees to give more responses or “pulls” to ask examinees to give the card back to the examiner. This procedure is meant to increase the stability of the administration and attempt to eliminate the extremes of responding; too few responses or too many responses. [6]

Scoring

The authors did not create new variables or indices to be coded, but systematically reviewed variables that had been used in past systems. [3] While all of these codes have been used in the past, many have been renamed to be more face valid and readily understood. Scoring of the indices has been updated (e.g. utilizing percentiles and Standard Scores) to make the Rorschach more in line with other popular personality measures.

In addition to providing coding guidelines to score examinee responses, the R-PAS provides a system to code an examinee's behavior during Rorschach administration. These behavioral codes are included as it is believed that the behaviors exhibited during testing are a reflection of someone's task performance and supplements the actual responses given. This allows generalizations to be made between someone's responses to the cards and their actual behavior.

Normative data

The R-PAS also recognized that scoring on many of the Rorschach variables differed across countries. [3] Therefore, starting in 1997, Rorschach protocols from researchers around the world were compiled. [7] After compiling protocols for over a decade, a total of 15 adult samples were used to provide a normative basis for the R-PAS. The protocols represent data gathered in the United States, Europe, Israel, Argentina and Brazil.

New Variables

The R-PAS includes new variables not from the Comprehensive System including Complexity, Space Integration, Space Reversal, Oral Dependency Language, the Mutuality of Autonomy scale, the Ego Impairment Index, and Aggressive Content. All of the variables selected for the R-PAS have been used by others in the past, either as part of previous systems for using the Rorschach, or as stand-alone independently coded variables. Prior research on these variables have shown correlation coefficients around approximately 0.9. [8]

Inter-rater reliability

Preliminary data used to evaluate the reliability of the R-PAS scoring system shows that two different raters scored the same responses similarly. In the study, 50 records of responses to Rorschach cards were randomly selected and given to two different raters to be coded. The coded responses were compared and the results indicate an average intraclass correlation of 0.88 and median of 0.92 across all of the variables. The findings indicate good to excellent inter-rater reliability which is consistent with previous findings for the variables used in the scoring. [9]

Forensic Application

There are advantages to using the R-PAS in forensic evaluations, and authors have described appropriated and inappropriate use of it in court. [10] Some advantages to its use include incremental validity over self-report measures, protection against inaccurate symptom presentation, information regarding states and traits, adjustments for abnormal response records, accurate pathology interpretations, organization of results, and easily understood interpretations. [11]

However, some present the argument the R-PAS fails to meet the necessary criteria for admissibility according to the Frye and Daubert guidelines. Some of the major concerns regarding the R-PAS include its psychometric properties, lack of current normative data, and the absence of independent groups completing research in the area. [12] [13] There is not consensus regarding the admissibility of the R-PAS in court, however, as others would argue the criteria are met. [14]

Related Research Articles

<span class="mw-page-title-main">Psychometrics</span> Theory and technique of psychological measurement

Psychometrics is a field of study within psychology concerned with the theory and technique of measurement. Psychometrics generally refers to specialized fields within psychology and education devoted to testing, measurement, assessment, and related activities. Psychometrics is concerned with the objective measurement of latent constructs that cannot be directly observed. Examples of latent constructs include intelligence, introversion, mental disorders, and educational achievement. The levels of individuals on nonobservable latent variables are inferred through mathematical modeling based on what is observed from individuals' responses to items on tests and scales.

<span class="mw-page-title-main">Psychological testing</span> Administration of psychological tests

Psychological testing is the administration of psychological tests. Psychological tests are administered by trained evaluators. A person's responses are evaluated according to carefully prescribed guidelines. Scores are thought to reflect individual or group differences in the construct the test purports to measure. The science behind psychological testing is psychometrics.

<span class="mw-page-title-main">Rorschach test</span> Psychological test created in 1921

The Rorschach test is a projective psychological test in which subjects' perceptions of inkblots are recorded and then analyzed using psychological interpretation, complex algorithms, or both. Some psychologists use this test to examine a person's personality characteristics and emotional functioning. It has been employed to detect underlying thought disorder, especially in cases where patients are reluctant to describe their thinking processes openly. The test is named after its creator, Swiss psychologist Hermann Rorschach. The Rorschach can be thought of as a psychometric examination of pareidolia, the active pattern of perceiving objects, shapes, or scenery as meaningful things to the observer's experience, the most common being faces or other pattern of forms that are not present at the time of the observation. In the 1960s, the Rorschach was the most widely used projective test.

Thematic apperception test (TAT) is a projective psychological test developed during the 1930s by Henry A. Murray and Christiana D. Morgan at Harvard University. Proponents of the technique assert that subjects' responses, in the narratives they make up about ambiguous pictures of people, reveal their underlying motives, concerns, and the way they see the social world. Historically, the test has been among the most widely researched, taught, and used of such techniques.

<span class="mw-page-title-main">Hermann Rorschach</span> Swiss Freudian psychiatrist and psychoanalyst (1884–1922)

Hermann Rorschach was a Swiss psychiatrist and psychoanalyst. His education in art helped to spur the development of a set of inkblots that were used experimentally to measure various unconscious parts of the subject's personality. His method has come to be referred to as the Rorschach test, iterations of which have continued to be used over the years to help identify personality, psychotic, and neurological disorders. Rorschach continued to refine the test until his premature death at age 37.

In psychology, a projective test is a personality test designed to let a person respond to ambiguous stimuli, presumably revealing hidden emotions and internal conflicts projected by the person into the test. This is sometimes contrasted with a so-called "objective test" / "self-report test", which adopt a "structured" approach as responses are analyzed according to a presumed universal standard, and are limited to the content of the test. The responses to projective tests are content analyzed for meaning rather than being based on presuppositions about meaning, as is the case with objective tests. Projective tests have their origins in psychoanalysis, which argues that humans have conscious and unconscious attitudes and motivations that are beyond or hidden from conscious awareness.

<span class="mw-page-title-main">Holtzman inkblot technique</span> Projective personality test

The Holtzman inkblot technique (HIT), also known as the Holtzman inkblot test, is an ink blot test aimed at detecting personality and was conceived by Wayne H. Holtzman and colleagues. It was first introduced in 1961 as a projective personality test similar to the Rorschach. The HIT is a standardized measurement. The Holtzman Inkblot Test was developed as an attempt to address some controversial issues surrounding the Rorschach Inkblot Test.

Objective tests are measures in which responses maximize objectivity, in the sense that response options are structured such that examinees have only a limited set of options. Structuring a measure in this way is intended to minimize subjectivity or bias on the part of the individual administering the measure so that administering and interpreting the results does not rely on the judgment of the examiner.

The Wechsler Preschool and Primary Scale of Intelligence (WPPSI) is an intelligence test designed for children ages 2 years 6 months to 7 years 7 months developed by David Wechsler in 1967. It is a descendant of the earlier Wechsler Adult Intelligence Scale and the Wechsler Intelligence Scale for Children tests. Since its original publication the WPPSI has been revised three times in 1989, 2002, and 2012. The current version, WPPSI–IV, published by Pearson Education, is a revision of the WPPSI-R and the WPPSI-III. It provides subtest and composite scores that represent intellectual functioning in verbal and performance cognitive domains, as well as providing a composite score that represents a child’s general intellectual ability.

Bruno Klopfer was a German psychologist, born in Bavaria.

John E. Exner, Jr., born in Syracuse, New York, was an American psychologist. He received a BS and an MS degree in psychology from Trinity University and a PhD in clinical psychology from Cornell University in 1958. From 1968 to 1969 he served as a director for the East Asia/Pacific and North Africa, Near East, South Asia Regions of the Office of Selection, Peace Corps of the United States of America. Later he became a faculty member at Long Island University, where he was director of clinical training from 1969 to 1979. He became professor emeritus in 1984.

<span class="mw-page-title-main">Ink blot test</span>

An ink blot test is a personality test that involves the evaluation of a subject's response to ambiguous ink blots. This test was published in 1921 by Swiss psychiatrist Hermann Rorschach. The interpretation of people's responses to the Rorschach Inkblot Test was originally based on psychoanalytical theory but investigators have used it in an empirical fashion. When this test is used empirically, the quality of the responses is related to the measurements of personality.

The Das–Naglieri cognitive assessment system (CAS) test is an individually administered test of cognitive functioning for children and adolescents ranging from 5 through 17 years of age that was designed to assess the planning, attention, simultaneous and successive cognitive processes as described in the PASS theory of intelligence.

The California Verbal Learning Test (CVLT) is one of the most widely used neuropsychological tests in North America. As an instrument, it represents a relatively new approach to clinical psychology and the cognitive science of memory. It measures episodic verbal learning and memory, and demonstrates sensitivity to a range of clinical conditions. The test does this by attempting to link memory deficits with impaired performance on specific tasks. It assesses encoding, recall and recognition in a single modality of item presentation (auditory-verbal). The CVLT is considered to be a more sensitive measure of episodic memory than other verbal learning tests. It was designed to not only measure how much a subject learned, but also reveal strategies employed and the types of errors made. The CVLT indexes free and cued recall, serial position effects, semantic clustering, intrusions, interference and recognition. Delis et al. (1994) released the California Verbal Learning Test for Children (CVLT-C). The California Verbal Learning Test-II (CVLT-II) is an updated version of the original CVLT, which has been standardized and provides normative data.

The Sixteen Personality Factor Questionnaire (16PF) is a self-report personality test developed over several decades of empirical research by Raymond B. Cattell, Maurice Tatsuoka and Herbert Eber. The 16PF provides a measure of personality and can also be used by psychologists, and other mental health professionals, as a clinical instrument to help diagnose psychiatric disorders, and help with prognosis and therapy planning. The 16PF can also provide information relevant to the clinical and counseling process, such as an individual's capacity for insight, self-esteem, cognitive style, internalization of standards, openness to change, capacity for empathy, level of interpersonal trust, quality of attachments, interpersonal needs, attitude toward authority, reaction toward dynamics of power, frustration tolerance, and coping style. Thus, the 16PF instrument provides clinicians with a normal-range measurement of anxiety, adjustment, emotional stability and behavioral problems. Clinicians can use 16PF results to identify effective strategies for establishing a working alliance, to develop a therapeutic plan, and to select effective therapeutic interventions or modes of treatment. It can also be used within other areas of psychology, such as career and occupational selection.

Psychometric software is software that is used for psychometric analysis of data from tests, questionnaires, or inventories reflecting latent psychoeducational variables. While some psychometric analyses can be performed with standard statistical software like SPSS, most analyses require specialized tools.

Irving B. Weiner is an American psychologist and past president of Division 12 of the American Psychological Association. and past president of the Society for Personality Assessment. He is the author and editor of many books on psychology.

A psychological injury is the psychological or psychiatric consequence of a traumatic event or physical injury. Such an injury might result from events such as abusive behavior, whistleblower retaliation, bullying, kidnapping, rape, motor vehicular collision or other negligent action. It may cause impairments, disorders, and disabilities perhaps as an exacerbation of a pre-existing condition.

The Boston Naming Test (BNT), introduced in 1983 by Edith Kaplan, Harold Goodglass and Sandra Weintraub, is a widely used neuropsychological assessment tool to measure confrontational word retrieval in individuals with aphasia or other language disturbance caused by stroke, Alzheimer's disease, or other dementing disorder. A common and debilitating feature is anomic aphasia, an impairment in the ability to name objects. The BNT contains 60 line drawings graded in difficulty. Patients with anomia often have greater difficulties with the naming of not only difficult and low frequency objects but also easy and high frequency objects. Naming difficulties may be rank ordered along a continuum. Items are rank ordered in terms of their ability to be named, which is correlated with their frequency. This type of picture-naming test is also useful in the examination of children with learning disabilities and the evaluation of brain-injured adults.

The Delis–Kaplan Executive Function System (D-KEFS) is a neuropsychological test used to measure a variety of verbal and nonverbal executive functions for both children and adults. This assessment was developed over the span of a decade by Dean Delis, Edith Kaplan, and Joel Kramer, and it was published in 2001. The D-KEFS comprises nine tests that were designed to stand alone. Therefore, there are no aggregate measures or composite scores for an examinee's performance. A vast majority of these tests are modified, pre-existing measures ; however, some of these measures are new indices of executive functions.

References

  1. Meyer, G. J., Viglione, D. J., Mihura, J. L., Erard, R. E., & Erdberg, P. (2011). Rorschach Performance Assessment System: Administration, coding, interpretation, and technical manual. Rorschach Performance Assessment System LLC.
  2. "R-PAS Home Page". r-pas.org. Retrieved 2021-04-10.
  3. 1 2 3 Meyer, G. J.; Eblin, J. J. (2012). "An overview of the Rorschach Performance Assessment System (R-PAS)". Psychological Injury and Law . 5 (2): 107–121. doi:10.1007/s12207-012-9130-y. S2CID   143393022.
  4. "R-PAS Description". R-pas.org. Retrieved 2014-03-21.
  5. http://www.r-pas.org/Docs/Manual_TOC.pdf [ bare URL PDF ]
  6. Meyer, G. J. & Eblin, J. J. (2012). An overview of the Rorschach performance assessment system (R-PAS). Psychological Injury and Law, 5, 107-121.
  7. Shaffer, T. W., Erdberg, P., & Meyer, G. J. (2007). Introduction to the JPA special supplement on international reference samples for the Rorschach Comprehensive System. Journal of Personality Assessment, 89, S2-S6.
  8. Meyer, G. J. & Eblin, J. J. (2012), "An overview of the Rorschach performance assessment system (R-PAS)", Psychological Injury and Law , 5, pp.107-121.
  9. Viglione, D. J., Blume-Marcovici, A., Miller, H. L., Giromini, L., & Meyer, G. (2012), "An inter-rater reliability study for the Rorschach performance assessment system", Journal of Personality Assessment , 94, pp.607-612.
  10. Viglione, Donald J.; de Ruiter, Corine; King, Christopher M.; Meyer, Gregory J.; Kivisto, Aaron J.; Rubin, Benjamin A.; Hunsley, John (2022-03-04). "Legal Admissibility of the Rorschach and R-PAS: A Review of Research, Practice, and Case Law". Journal of Personality Assessment. 104 (2): 137–161. doi: 10.1080/00223891.2022.2028795 . ISSN   0022-3891. PMID   35180040. S2CID   246974081.
  11. Erard, R. E. (2012). Expert testimony using the Rorschach performance assessment system in psychological injury cases. Psychological Injury and Law, 5, 122-134.
  12. Gurley, J. R.; Sheeham, B. L.; Piechowski, L.D.; Gray, J. (2014). "The admissibility of the R-PAS in court". Psychological Injury and Law . 7 (7): 9–17. doi:10.1007/s12207-014-9182-2. S2CID   143591599.
  13. Kivisto, A. J.; Gacono, C. B.; Medoff, D. (2013). "Does the R-PAS meet standards for forensic use? Considerations with introducing a new Rorschach coding system". Journal of Forensic Psychology Practice. 13 (5): 389–410. doi:10.1080/15228932.2013.838106. S2CID   143696818.
  14. Erard, R. E.; Meyer, G. J.; Viglione, D. J. (2014). "Setting the record straight: Comment on Gurley, Piechowski, Sheehan, and Gray (2014) on the admissibility of the Rorschach performance assessment system (R-PAS) in court". Psychological Injury and Law . 7 (2): 165–177. doi:10.1007/s12207-014-9195-x. S2CID   144034589..