Statement analysis

Last updated

Statement analysis, also called scientific content analysis (SCAN), is a pseudoscientific technique for analyzing the words people use to try to determine if what they said is accurate. Proponents claim this technique can be used to detect concealed information, missing information, embedded confessions and whether the information that person has provided is true or false. [1] [2] [3]

Contents

Multiple empirical studies have found SCAN techniques to be unreliable at correctly separating true and false statements. SCAN is generally not accepted by courts and has been described as a form of pseudoscience. [2] [1]

About

Related to statement analysis is a different technique for analyzing the words people use called "statement validity assessment" (SVA). The SVA is a tool that was originally designed to determine the credibility of child witnesses testimonies in trials for sexual offences. The "criteria-based content analysis" (CBCA) is a core component of the SVA and is a tool used to distinguish true statements from false statements as CBCA scores are expected to be higher for truth tellers than liars. [4] A qualitative review of the CBCA analyzed 37 studies, strong support for the tool was established as truth tellers obtained significantly higher CBCA scores compared to the liars. [5] More recently, a meta-analytic review found CBCA criteria to be a valid technique for discriminating between memories of real self-experienced events and invented or false accounts. [6]

Countries such as The Netherlands, Germany and Sweden use these techniques as scientific evidence in court. [4] However, countries such as the United States, Canada and the UK do not consider these techniques as legally valid evidence in court. [7] Studies have raised serious questions and concerns about the validity of CBCA for assessing the credibility of children's testimonies. One study using 114 children showed that CBCA scores were higher for the group of children describing a familiar event compared to the group of children describing an unfamiliar event. [8] The potential influence of familiarity on CBCA scores raises concerns about the validity of the tool for assessing credibility in children.

It has also been noted that the error rate of CBCA in the laboratory is high, that the error rate of SVA in practice is unknown and that the methodology continues to be disputed among the scientific community. [9] In conclusion, there is still great controversy surrounding the use of the SVA and many studies have investigated its core component, the CBCA, in order to determine its validity and reliability. More research is needed to conclude whether or not the information obtained from these tests should be admissible in court.

Example

Statement analysis involves an investigator searching for linguistic cues and gaps in a subject's testimony or preliminary statements. Ideally, the technique would guide investigators to ask follow-up questions to uncover discrepancies. The creator of Scientific Content Analysis (SCAN), Avinoam Sapir, gives the example of someone saying, "I counted the money, put the bag on the counter, and proceeded to go home." Sapir says the statement was literally true:

He counted the money (when you steal you want to know how much you are stealing), and then the subject put the bag on the counter. The subject didn't say that he put the money back in the bag after counting it, because he didn't; he left the empty bag on the counter and walked away with the money. [1] [2]

Sapir says that a fundamental principle of statement analysis is that "denying guilt is not the same as denying the act. When one says 'I am not guilty' or 'I am innocent,' they are not denying the act; they are only denying guilt." Sapir claims that it is almost impossible for a guilty person to say "I didn't do it." He asserts that guilty people tend to speak in even greater circumlocutions by saying things like "I had nothing to do with it" or "I am not involved in that". [1] [2]

Criticism

Aldert Vrij, one of the leading authorities on detection of deception (DOD) techniques, points out that most studies of the technique did not rely on the ground truth being established and thus examiners could not be certain if "examinees were actually telling the truth or lying". [10] He also notes that there is no standardization among the different methods of analysis and this "implies that much depends on the subjective interpretation and skill of the individual" performing the analysis. Vrij attributes this to an absence of theoretical underpinning behind SCAN/statement analysis. [10] Vrij characterizes SCAN/statement analysis as weaker than CBCA because SCAN/statement analysis lacks "a set of cohesive criteria", being instead "a list of individual criteria". [10] Vrij argues that SCAN/statement analysis is best used as a technique to guide investigative interviews rather than as a "lie detection tool". [11]

Subsequent empirical studies have concurred with these findings, finding that SCAN/statement analysis techniques are applied inconsistently and are not reliable at detecting deceptive statements. [12] [13] [14] [15] The use of SCAN techniques has also been found to be vulnerable to contextual bias on the part of investigators. [16]

Critics argue that the technique encourages investigators to prejudge a suspect as deceptive and affirm a presumption of guilt before the interrogation process has even begun. Statement analysis in general has been criticized as "theoretically vague" with little or no empirical evidence in its favor, and SCAN in particular has been characterized as "junk science" [1] with the Skeptic's Dictionary and Skeptical Inquirer magazine [17] classifying it as a form of pseudoscience. [2] In 2016, the High-Value Detainee Interrogation Group (HIG), a federal agency group consisting of the FBI, the CIA, and the United States Department of Defense, released a report which found that studies commonly cited in favor of SCAN were scientifically flawed and that SCAN's evaluative criteria did not withstand scrutiny in laboratory testing. [18]

See also

Related Research Articles

Psychometrics is a field of study within psychology concerned with the theory and technique of measurement. Psychometrics generally covers specialized fields within psychology and education devoted to testing, measurement, assessment, and related activities. Psychometrics is concerned with the objective measurement of latent constructs that cannot be directly observed. Examples of latent constructs include intelligence, introversion, mental disorders, and educational achievement. The levels of individuals on nonobservable latent variables are inferred through mathematical modeling based on what is observed from individuals' responses to items on tests and scales.

<span class="mw-page-title-main">Polygraph</span> Device that attempts to infer lying

A polygraph, often incorrectly referred to as a lie detector test, is a junk science device or procedure that measures and records several physiological indicators such as blood pressure, pulse, respiration, and skin conductivity while a person is asked and answers a series of questions. The belief underpinning the use of the polygraph is that deceptive answers will produce physiological responses that can be differentiated from those associated with non-deceptive answers; however, there are no specific physiological reactions associated with lying, making it difficult to identify factors that separate those who are lying from those who are telling the truth.

Validity is the main extent to which a concept, conclusion, or measurement is well-founded and likely corresponds accurately to the real world. The word "valid" is derived from the Latin validus, meaning strong. The validity of a measurement tool is the degree to which the tool measures what it claims to measure. Validity is based on the strength of a collection of different types of evidence described in greater detail below.

The Reid technique is a method of interrogation. The system was developed in the United States by John E. Reid in the 1950s. Reid was a polygraph expert and former Chicago police officer. The technique is known for creating a high pressure environment for the interviewee, followed by sympathy and offers of understanding and help, but only if a confession is forthcoming. Since its spread in the 1970s, it has been widely utilized by police departments in the United States.

<span class="mw-page-title-main">Microexpression</span> Innate result of voluntary, involuntary, and conflicting emotional responses

A microexpression is a facial expression that only lasts for a short moment. It is the innate result of a voluntary and an involuntary emotional response occurring simultaneously and conflicting with one another, and occurs when the amygdala responds appropriately to the stimuli that the individual experiences and the individual wishes to conceal this specific emotion. This results in the individual very briefly displaying their true emotions followed by a false emotional reaction.

In psychology, a projective test is a personality test designed to let a person respond to ambiguous stimuli, presumably revealing hidden emotions and internal conflicts projected by the person into the test. This is sometimes contrasted with a so-called "objective test" / "self-report test", which adopt a "structured" approach as responses are analyzed according to a presumed universal standard, and are limited to the content of the test. The responses to projective tests are content analyzed for meaning rather than being based on presuppositions about meaning, as is the case with objective tests. Projective tests have their origins in psychoanalysis, which argues that humans have conscious and unconscious attitudes and motivations that are beyond or hidden from conscious awareness.

Brain fingerprinting (BF) is a lie detection technique which uses brain waves from a electroencephalography (EEG) to determine whether specific information is stored in the subject's cognitive memory. It was invented by Larry Farwell, a Harvard-graduated neuroscientist, and published in 1995. The technique involves presenting words, phrases, or pictures containing salient details about a crime on a computer screen, in a series with other, irrelevant stimuli to identify whether the suspect recognizes the crime-related items. Although brain fingerprinting has been used in investigations, the test results themselves can not be admitted as evidence in a legal trial.

<span class="mw-page-title-main">Near-infrared spectroscopy</span> Analytical method

Near-infrared spectroscopy (NIRS) is a spectroscopic method that uses the near-infrared region of the electromagnetic spectrum. Typical applications include medical and physiological diagnostics and research including blood sugar, pulse oximetry, functional neuroimaging, sports medicine, elite sports training, ergonomics, rehabilitation, neonatal research, brain computer interface, urology, and neurology. There are also applications in other areas as well such as pharmaceutical, food and agrochemical quality control, atmospheric chemistry, combustion research and knowledge.

Personnel selection is the methodical process used to hire individuals. Although the term can apply to all aspects of the process the most common meaning focuses on the selection of workers. In this respect, selected prospects are separated from rejected applicants with the intention of choosing the person who will be the most successful and make the most valuable contributions to the organization. Its effect on the group is discerned when the selected accomplish their desired impact to the group, through achievement or tenure. The procedure of selection takes after strategy to gather data around a person so as to figure out whether that individual ought to be utilized. The strategies used must be in compliance with the various laws in respect to work force selection.

<span class="mw-page-title-main">Turnitin</span> Internet-based plagiarism-prevention service

Turnitin is an Internet-based similarity detection service run by the American company Turnitin, LLC, a subsidiary of Advance Publications.

<span class="mw-page-title-main">Hyperspectral imaging</span> Multi-wavelength imaging method

Hyperspectral imaging collects and processes information from across the electromagnetic spectrum. The goal of hyperspectral imaging is to obtain the spectrum for each pixel in the image of a scene, with the purpose of finding objects, identifying materials, or detecting processes. There are three general types of spectral imagers. There are push broom scanners and the related whisk broom scanners, which read images over time, band sequential scanners, which acquire images of an area at different wavelengths, and snapshot hyperspectral imagers, which uses a staring array to generate an image in an instant.

Lie detection is an assessment of a verbal statement with the goal to reveal a possible intentional deceit. Lie detection may refer to a cognitive process of detecting deception by evaluating message content as well as non-verbal cues. It also may refer to questioning techniques used along with technology that record physiological functions to ascertain truth and falsehood in response. The latter is commonly used by law enforcement in the United States, but rarely in other countries because it is based on pseudoscience.

The FBI method of profiling is a system created by the Federal Bureau of Investigation (FBI) used to detect and classify the major personality and behavioral characteristics of an individual based upon analysis of the crime or crimes the person committed.

Plagiarism detection or content similarity detection is the process of locating instances of plagiarism or copyright infringement within a work or document. The widespread use of computers and the advent of the Internet have made it easier to plagiarize the work of others.

<span class="mw-page-title-main">Forensic footwear evidence</span>

Forensic footwear evidence can be used in legal proceedings to help prove that a shoe was at a crime scene. Footwear evidence is often the most abundant form of evidence at a crime scene and in some cases can prove to be as specific as a fingerprint. Initially investigators will look to identify the make and model of the shoe or trainer which made an impression. This can be done visually or by comparison with evidence in a database; both methods focus heavily on pattern recognition and brand or logo marks. Information about the footwear can be gained from the analysis of wear patterns which are dependent on angle of footfall and weight distribution. Detailed examination of footwear impressions can help to link a specific piece of footwear to a footwear imprint as each shoe will have unique characteristics.

Character encoding detection, charset detection, or code page detection is the process of heuristically guessing the character encoding of a series of bytes that represent text. The technique is recognised to be unreliable and is only used when specific metadata, such as a HTTP Content-Type: header is either not available, or is assumed to be untrustworthy.

The Silent Talker Lie Detector is an attempt to increase the accuracy of the most common lie detector, the polygraph, which does not directly measure whether the subject is truthful, but records physiological measures that are associated with emotional responses. The Silent Talker gives the evaluator access to viewing microexpressions by adding a camera to the process. The creators claim that microexpressions are actual indicators of lying, while many other things could cause an emotional response. Since microexpressions are fleeting, the camera allows the examiner to capture data that otherwise would have been missed. However, the scientific community is not convinced that this system accomplishes what it claims and some call it pseudoscience.

<span class="mw-page-title-main">Interrogational torture</span> Use of torture to obtain information in interrogation

Interrogational torture is the use of torture to obtain information in interrogation, as opposed to the use of torture to extract a forced confession, regardless of whether it is true or false. Torture has been used throughout history during interrogation, although it is now illegal and a violation of international law.

<span class="mw-page-title-main">Forensic geophysics</span> Use of geophysics tools in forensic science

Forensic geophysics is a branch of forensic science and is the study, the search, the localization and the mapping of buried objects or elements beneath the soil or the water, using geophysics tools for legal purposes. There are various geophysical techniques for forensic investigations in which the targets are buried and have different dimensions. Geophysical methods have the potential to aid the search and the recovery of these targets because they can non-destructively and rapidly investigate large areas where a suspect, illegal burial or, in general, a forensic target is hidden in the subsoil. When in the subsurface there is a contrast of physical properties between a target and the material in which it is buried, it is possible to individuate and define precisely the concealing place of the searched target. It is also possible to recognize evidences of human soil occupation or excavation, both recent and older. Forensic geophysics is an evolving technique that is gaining popularity and prestige in law enforcement.

Aldert Vrij is a professor of applied social psychology in the department of psychology at the University of Portsmouth in Portsmouth, England. His main area of expertise is utilizing nonverbal and verbal cues of deception, also called lie detection. Author of numerous research articles, Vrij has found that human beings can become more accurate judges of truth and deception not by passive observation of a speaker's verbal and nonverbal behavior but by tactically outsmarting liars through use of various techniques.

References

  1. 1 2 3 4 5 Leo, Richard A. (2008). Police interrogation and American justice. Harvard University Press. ISBN   978-0-674-02648-3.
  2. 1 2 3 4 5 Carroll, Robert T. (2009-02-23). "L.S.I. SCAN - Too Good To Be True". The Skeptic's Dictionary. Retrieved 14 September 2010.
  3. Adams, Susan H. (October 1996). "Statement Analysis: What Do Suspects' Words Really Reveal?". Polygraph Volume:25 Issue:4. pp. 266–278. Archived from the original on 7 March 2016. Retrieved 14 September 2010. Alt URL
  4. 1 2 Amado, Bárbara G., Ramón Arce, and Francisca Fariña. "Undeutsch hypothesis and Criteria Based Content Analysis: A meta-analytic review". The European Journal of Psychology Applied to Legal Context 7.1 (2015): 3–12.
  5. Vrij, A. (2005). Criteria-Based Content Analysis: A Qualitative Review of the First 37 Studies. Psychology, Public Policy, and Law, 11(1), 3.
  6. Amado, Bárbara G., Ramón Arce, and Francisca Fariña. "Undeutsch hypothesis and Criteria Based Content Analysis: A meta-analytic review". The European Journal of Psychology Applied to Legal Context 7.1 (2015): 3–12
  7. Pérez, Mercedes Novo, and María Dolores Seijo Martínez. "Judicial judgement-making and legal criteria of testimonial credibility". The European Journal of Psychology Applied to Legal Context 2.2 (2010): 9–115.
  8. Pezdek, Kathy, et al. "Detecting deception in children: event familiarity affects criterion-based content analysis ratings". Journal of Applied Psychology 89.1 (2004): 119
  9. Vrij, A. (2005). Criteria-Based Content Analysis: A Qualitative Review of the First 37 Studies. Psychology, Public Policy, and Law, 11(1), 3
  10. 1 2 3 Aldert Vrij, Detecting Lies and Deceit: Pitfalls and Opportunities, 2nd ed., Chichester, England: John Wiley & Sons, 2008, p. 290.
  11. Aldert Vrij, Detecting Lies and Deceit: Pitfalls and Opportunities, 2nd ed., Chichester, England: John Wiley & Sons, 2008, p. 291.
  12. Bogaard, Glynis; Meijer, Ewout H.; Vrij, Aldert; Broers, Nick J.; Merckelbach, Harald (2014-05-28). "SCAN is largely driven by 12 criteria: results from sexual abuse statements". Psychology, Crime & Law. 20 (5): 430–449. doi:10.1080/1068316X.2013.793338. ISSN   1068-316X.
  13. Vrij, Aldert; Granhag, Pär Anders; Ashkenazi, Tzachi; Ganis, Giorgio; Leal, Sharon; Fisher, Ronald P. (2022-12-01). "Verbal Lie Detection: Its Past, Present and Future". Brain Sciences. 12 (12): 1644. doi: 10.3390/brainsci12121644 . ISSN   2076-3425. PMC   9775025 . PMID   36552104.
  14. Vanderhallen, Miet; Jaspaert, Emma; Vervaeke, Geert (2016-05-03). "SCAN as an investigative tool". Police Practice and Research. 17 (3): 279–293. doi:10.1080/15614263.2015.1008479. ISSN   1561-4263.
  15. Kleinberg, Bennett; Arntz, Arnoud; Verschuere, Bruno (2019-08-08). "Being accurate about accuracy in verbal deception detection". PLOS ONE. 14 (8): e0220228. doi: 10.1371/journal.pone.0220228 . ISSN   1932-6203. PMC   6687387 . PMID   31393894.
  16. Bogaard, Glynis; Meijer, Ewout H.; Vrij, Aldert; Broers, Nick J.; Merckelbach, Harald (2013-10-29). "Contextual Bias in Verbal Credibility Assessment: Criteria‐Based Content Analysis, Reality Monitoring and Scientific Content Analysis". Applied Cognitive Psychology. 28 (1): 79–90. doi:10.1002/acp.2959. ISSN   0888-4080.
  17. "Statement Analysis Scan or Scam?", by Robert A. Shearer, Skeptical Inquirer, May/June 1999
  18. Armstrong, Ken; Sheckler, Christian (2019-12-07). "Why Are Cops Around the World Using This Outlandish Mind-Reading Tool?". The South Bend Tribune and ProPublica. Retrieved 2019-12-09.