Statement analysis

Last updated

Statement analysis, also called scientific content analysis (SCAN), is a technique for analyzing the words people use to try to determine if what they said is accurate. Proponents claim this technique can be used to detect concealed information, missing information, embedded confessions and whether the information that person has provided is true or false. [1] [2] [3]

Contents

Proponents say statement analysis has proven effective as a police interrogation technique, but critics argue that it has not been subjected to objective analysis, with most of the studies failing to have used any outside criteria to confirm whether the statements were actually true or false. As it has not been proven experimentally and is generally unaccepted by courts, skeptics call it an example of pseudoscience. [2] [1]

About

Related to statement analysis is a different technique for analyzing the words people use called "statement validity assessment" (SVA). The SVA is a tool that was originally designed to determine the credibility of child witnesses testimonies in trials for sexual offences. The "criteria-based content analysis" (CBCA) is a core component of the SVA and is a tool used to distinguish true statements from false statements as CBCA scores are expected to be higher for truth tellers than liars. [4] A qualitative review of the CBCA analyzed 37 studies, strong support for the tool was established as truth tellers obtained significantly higher CBCA scores compared to the liars. [5] More recently, a meta-analytic review found CBCA criteria to be a valid technique for discriminating between memories of real self-experienced events and invented or false accounts. [6]

Countries such as The Netherlands, Germany and Sweden use these techniques as scientific evidence in court. [4] However, countries such as the United States, Canada and the UK do not consider these techniques as legally valid evidence in court. [7] Studies have raised serious questions and concerns about the validity of CBCA for assessing the credibility of children's testimonies. One study using 114 children showed that CBCA scores were higher for the group of children describing a familiar event compared to the group of children describing an unfamiliar event. [8] The potential influence of familiarity on CBCA scores raises concerns about the validity of the tool for assessing credibility in children.

It has also been noted that the error rate of CBCA in the laboratory is high, that the error rate of SVA in practice is unknown and that the methodology continues to be disputed among the scientific community. [9] In conclusion, there is still great controversy surrounding the use of the SVA and many studies have investigated its core component, the CBCA, in order to determine its validity and reliability. More research is needed to conclude whether or not the information obtained from these tests should be admissible in court.

Example

Statement analysis involves an investigator searching for linguistic cues and gaps in a subject's testimony or preliminary statements. Ideally, the technique would guide investigators to ask follow-up questions to uncover discrepancies. The creator of Scientific Content Analysis (SCAN), Avinoam Sapir, gives the example of someone saying, "I counted the money, put the bag on the counter, and proceeded to go home." Sapir says the statement was literally true:

He counted the money (when you steal you want to know how much you are stealing), and then the subject put the bag on the counter. The subject didn't say that he put the money back in the bag after counting it, because he didn't; he left the empty bag on the counter and walked away with the money. [1] [2]

Sapir says that a fundamental principle of statement analysis is that "denying guilt is not the same as denying the act. When one says 'I am not guilty' or 'I am innocent,' they are not denying the act; they are only denying guilt." Sapir claims that it is almost impossible for a guilty person to say "I didn't do it." He asserts that guilty people tend to speak in even greater circumlocutions by saying things like "I had nothing to do with it" or "I am not involved in that". [1] [2]

Criticism

Aldert Vrij, one of the leading authorities on detection of deception (DOD) techniques, points out that most studies of the technique did not rely on the ground truth being established and thus examiners could not be certain if "examinees were actually telling the truth or lying". [10] He also notes that there is no standardization among the different methods of analysis and this "implies that much depends on the subjective interpretation and skill of the individual" performing the analysis. Vrij attributes this to an absence of theoretical underpinning behind SCAN/statement analysis. [10] Vrij characterizes SCAN/statement analysis as weaker than CBCA because SCAN/statement analysis lacks "a set of cohesive criteria", being instead "a list of individual criteria". [10] Vrij argues that SCAN/statement analysis is best used as a technique to guide investigative interviews rather than as a "lie detection tool". [11]

Critics argue that the technique encourages investigators to prejudge a suspect as deceptive and affirm a presumption of guilt before the interrogation process has even begun. Statement analysis in general has been criticized as "theoretically vague" with little or no empirical evidence in its favor, and SCAN in particular has been characterized as "junk science" [1] with the Skeptic's Dictionary and Skeptical Inquirer magazine [12] classifying it as a form of pseudoscience. [2] In 2016, the High-Value Detainee Interrogation Group (HIG), a federal agency group consisting of the FBI, the CIA, and the United States Department of Defense, released a report which found that studies commonly cited in favor of SCAN were scientifically flawed and that SCAN's evaluative criteria did not withstand scrutiny in laboratory testing. [13]

See also

Related Research Articles

Psychometrics is a field of study within psychology concerned with the theory and technique of measurement. Psychometrics generally covers specialized fields within psychology and education devoted to testing, measurement, assessment, and related activities. Psychometrics is concerned with the objective measurement of latent constructs that cannot be directly observed. Examples of latent constructs include intelligence, introversion, mental disorders, and educational achievement. The levels of individuals on nonobservable latent variables are inferred through mathematical modeling based on what is observed from individuals' responses to items on tests and scales.

<span class="mw-page-title-main">Polygraph</span> Device that attempts to infer lying

A polygraph, often incorrectly referred to as a lie detector test, is a junk science device or procedure that measures and records several physiological indicators such as blood pressure, pulse, respiration, and skin conductivity while a person is asked and answers a series of questions. The belief underpinning the use of the polygraph is that deceptive answers will produce physiological responses that can be differentiated from those associated with non-deceptive answers; however, there are no specific physiological reactions associated with lying, making it difficult to identify factors that separate those who are lying from those who are telling the truth.

<span class="mw-page-title-main">Graphology</span> Pseudoscientific analysis of handwriting

Graphology is the analysis of handwriting in an attempt to determine the writer's personality traits. Its methods and conclusions are not supported by scientific evidence, and as such it is considered to be a pseudoscience. However, graphological conclusions have been used as evidence in some historical court cases. It is sometimes conflated with forensic document examination techniques regarding handwriting, which is sometimes referred to as graphanalysis.

Validity is the main extent to which a concept, conclusion, or measurement is well-founded and likely corresponds accurately to the real world. The word "valid" is derived from the Latin validus, meaning strong. The validity of a measurement tool is the degree to which the tool measures what it claims to measure. Validity is based on the strength of a collection of different types of evidence described in greater detail below.

The Reid technique is a method of interrogation. The system was developed in the United States by John E. Reid in the 1950s. Reid was a polygraph expert and former Chicago police officer. The technique is known for creating a high pressure environment for the interviewee, followed by sympathy and offers of understanding and help, but only if a confession is forthcoming. Since its spread in the 1970s, it has been widely utilized by police departments in the United States.

Educational research refers to the systematic collection and analysis of data related to the field of education. Research may involve a variety of methods and various aspects of education including student learning, interaction, teaching methods, teacher training, and classroom dynamics.

<span class="mw-page-title-main">Content analysis</span> Research method for studying documents and communication artifacts

Content analysis is the study of documents and communication artifacts, which might be texts of various formats, pictures, audio or video. Social scientists use content analysis to examine patterns in communication in a replicable and systematic manner. One of the key advantages of using content analysis to analyse social phenomena is their non-invasive nature, in contrast to simulating social experiences or collecting survey answers.

In psychology, a projective test is a personality test designed to let a person respond to ambiguous stimuli, presumably revealing hidden emotions and internal conflicts projected by the person into the test. This is sometimes contrasted with a so-called "objective test" / "self-report test", which adopt a "structured" approach as responses are analyzed according to a presumed universal standard, and are limited to the content of the test. The responses to projective tests are content analyzed for meaning rather than being based on presuppositions about meaning, as is the case with objective tests. Projective tests have their origins in psychoanalysis, which argues that humans have conscious and unconscious attitudes and motivations that are beyond or hidden from conscious awareness.

<span class="mw-page-title-main">Miscarriage of justice</span> Conviction of a person for a crime that they did not commit

A miscarriage of justice occurs when an unfair outcome occurs in a criminal or civil proceeding, such as the conviction and punishment of a person for a crime they did not commit. Miscarriages are also known as wrongful convictions. Innocent people have sometimes ended up in prison for years before their conviction has eventually been overturned. They may be exonerated if new evidence comes to light or it is determined that the police or prosecutor committed some kind of misconduct at the original trial. In some jurisdictions this leads to the payment of compensation.

<span class="mw-page-title-main">Grounded theory</span> Qualitative research methodology

Grounded theory is a systematic methodology that has been largely applied to qualitative research conducted by social scientists. The methodology involves the construction of hypotheses and theories through the collecting and analysis of data. Grounded theory involves the application of inductive reasoning. The methodology contrasts with the hypothetico-deductive model used in traditional scientific research.

Job analysis is a family of procedures to identify the content of a job in terms of the activities it involves in addition to the attributes or requirements necessary to perform those activities. Job analysis provides information to organizations that helps them determine which employees are best fit for specific jobs.

Personnel selection is the methodical process used to hire individuals. Although the term can apply to all aspects of the process the most common meaning focuses on the selection of workers. In this respect, selected prospects are separated from rejected applicants with the intention of choosing the person who will be the most successful and make the most valuable contributions to the organization. Its effect on the group is discerned when the selected accomplish their desired impact to the group, through achievement or tenure. The procedure of selection takes after strategy to gather data around a person so as to figure out whether that individual ought to be utilized. The strategies used must be in compliance with the various laws in respect to work force selection.

<span class="mw-page-title-main">Narrative inquiry</span> Discipline within qualitative research

Narrative inquiry or narrative analysis emerged as a discipline from within the broader field of qualitative research in the early 20th century, as evidence exists that this method was used in psychology and sociology. Narrative inquiry uses field texts, such as stories, autobiography, journals, field notes, letters, conversations, interviews, family stories, photos, and life experience, as the units of analysis to research and understand the way people create meaning in their lives as narratives.

<span class="mw-page-title-main">Systematic review</span> Comprehensive review of research literature using systematic methods

A systematic review is a scholarly synthesis of the evidence on a clearly presented topic using critical methods to identify, define and assess research on the topic. A systematic review extracts and interprets data from published studies on the topic, then analyzes, describes, critically appraises and summarizes interpretations into a refined evidence-based conclusion. For example, a systematic review of randomized controlled trials is a way of summarizing and implementing evidence-based medicine.

<span class="mw-page-title-main">Thought Field Therapy</span> Fringe psychological treatment recognized as a pseudoscience.

Thought Field Therapy (TFT) is a fringe psychological treatment developed by American psychologist Roger Callahan. Its proponents say that it can heal a variety of mental and physical ailments through specialized "tapping" with the fingers at meridian points on the upper body and hands. The theory behind TFT is a mixture of concepts "derived from a variety of sources. Foremost among these is the ancient Chinese philosophy of chi, which is thought to be the 'life force' that flows throughout the body". Callahan also bases his theory upon applied kinesiology and physics. There is no scientific evidence that TFT is effective, and the American Psychological Association has stated that it "lacks a scientific basis" and consists of pseudoscience.

Lie detection is an assessment of a verbal statement with the goal to reveal a possible intentional deceit. Lie detection may refer to a cognitive process of detecting deception by evaluating message content as well as non-verbal cues. It also may refer to questioning techniques used along with technology that record physiological functions to ascertain truth and falsehood in response. The latter is commonly used by law enforcement in the United States, but rarely in other countries because it is based on pseudoscience.

In qualitative research, a member check, also known as informant feedback or respondent validation, is a technique used by researchers to help improve the accuracy, credibility, validity, and transferability of a study. There are many subcategories of members checks, including: narrative accuracy checks, interpretive validity, descriptive validity, theoretical validity, and evaluative validity. In many member checks, the interpretation and report is given to members of the sample (informants) in order to check the authenticity of the work. Their comments serve as a check on the viability of the interpretation.

Computer-assistedqualitative data analysis software (CAQDAS) offers tools that assist with qualitative research such as transcription analysis, coding and text interpretation, recursive abstraction, content analysis, discourse analysis, grounded theory methodology, etc.

<span class="mw-page-title-main">Interrogational torture</span> Use of torture to obtain information in interrogation

Interrogational torture is the use of torture to obtain information in interrogation, as opposed to the use of torture to extract a forced confession, regardless of whether it is true or false. Torture has been used throughout history during interrogation, although it is now illegal and a violation of international law.

Thematic analysis is one of the most common forms of analysis within qualitative research. It emphasizes identifying, analysing and interpreting patterns of meaning within qualitative data. Thematic analysis is often understood as a method or technique in contrast to most other qualitative analytic approaches - such as grounded theory, discourse analysis, narrative analysis and interpretative phenomenological analysis - which can be described as methodologies or theoretically informed frameworks for research. Thematic analysis is best thought of as an umbrella term for a variety of different approaches, rather than a singular method. Different versions of thematic analysis are underpinned by different philosophical and conceptual assumptions and are divergent in terms of procedure. Leading thematic analysis proponents, psychologists Virginia Braun and Victoria Clarke distinguish between three main types of thematic analysis: coding reliability approaches, code book approaches and reflexive approaches. They describe their own widely used approach first outlined in 2006 in the journal Qualitative Research in Psychology as reflexive thematic analysis. Their 2006 paper has over 120,000 Google Scholar citations and according to Google Scholar is the most cited academic paper published in 2006. The popularity of this paper exemplifies the growing interest in thematic analysis as a distinct method.

References

  1. 1 2 3 4 5 Leo, Richard A. (2008). Police interrogation and American justice. Harvard University Press. ISBN   978-0-674-02648-3.
  2. 1 2 3 4 5 Carroll, Robert T. (2009-02-23). "L.S.I. SCAN - Too Good To Be True". The Skeptic's Dictionary. Retrieved 14 September 2010.
  3. Adams, Susan H. (October 1996). "Statement Analysis: What Do Suspects' Words Really Reveal?". Polygraph Volume:25 Issue:4. pp. 266–278. Archived from the original on 7 March 2016. Retrieved 14 September 2010. Alt URL
  4. 1 2 Amado, Bárbara G., Ramón Arce, and Francisca Fariña. "Undeutsch hypothesis and Criteria Based Content Analysis: A meta-analytic review". The European Journal of Psychology Applied to Legal Context 7.1 (2015): 3–12.
  5. Vrij, A. (2005). Criteria-Based Content Analysis: A Qualitative Review of the First 37 Studies. Psychology, Public Policy, and Law, 11(1), 3.
  6. Amado, Bárbara G., Ramón Arce, and Francisca Fariña. "Undeutsch hypothesis and Criteria Based Content Analysis: A meta-analytic review". The European Journal of Psychology Applied to Legal Context 7.1 (2015): 3–12
  7. Pérez, Mercedes Novo, and María Dolores Seijo Martínez. "Judicial judgement-making and legal criteria of testimonial credibility". The European Journal of Psychology Applied to Legal Context 2.2 (2010): 9–115.
  8. Pezdek, Kathy, et al. "Detecting deception in children: event familiarity affects criterion-based content analysis ratings". Journal of Applied Psychology 89.1 (2004): 119
  9. Vrij, A. (2005). Criteria-Based Content Analysis: A Qualitative Review of the First 37 Studies. Psychology, Public Policy, and Law, 11(1), 3
  10. 1 2 3 Aldert Vrij, Detecting Lies and Deceit: Pitfalls and Opportunities, 2nd ed., Chichester, England: John Wiley & Sons, 2008, p. 290.
  11. Aldert Vrij, Detecting Lies and Deceit: Pitfalls and Opportunities, 2nd ed., Chichester, England: John Wiley & Sons, 2008, p. 291.
  12. "Statement Analysis Scan or Scam?", by Robert A. Shearer, Skeptical Inquirer, May/June 1999
  13. Armstrong, Ken; Sheckler, Christian (2019-12-07). "Why Are Cops Around the World Using This Outlandish Mind-Reading Tool?". The South Bend Tribune and ProPublica. Retrieved 2019-12-09.