Critical incident technique

Last updated

The critical incident technique (or CIT) is a set of procedures used for collecting direct observations of human behavior that have critical significance and meet methodically defined criteria. These observations are then kept track of as incidents, which are then used to solve practical problems and develop broad psychological principles. A critical incident can be described as one that makes a contribution—either positively or negatively—to an activity or phenomenon. Critical incidents can be gathered in various ways, but typically respondents are asked to tell a story about an experience they have had.

Contents

CIT is a flexible method that usually relies on five major areas. The first is determining and reviewing the incident, then fact-finding, which involves collecting the details of the incident from the participants. When all of the facts are collected, the next step is to identify the issues. Afterwards a decision can be made on how to resolve the issues based on various possible solutions. The final and most important aspect is the evaluation, which will determine if the solution that was selected will solve the root cause of the situation and will cause no further problems.

History

The studies of Sir Francis Galton are said to have laid the foundation for the critical incident technique, but it is the work of Colonel John C. Flanagan, that resulted in the present form of CIT. [1] Flanagan defined the critical incident technique as:

[A] set of procedures for collecting direct observations of human behaviour in such a way as to facilitate their potential usefulness in solving practical problems and developing broad psychological principles ... By an incident is meant any specifiable human activity that is sufficiently complete in itself to permit inferences and predictions to be made about the person performing the act. To be critical the incident must occur in a situation where the purpose or intent of the act seems fairly clear to the observer and where its consequences are sufficiently definite to leave little doubt concerning its effects. [2]

Flanagan's work was carried out as part of the Aviation Psychology Program [3] of the United States Army Air Forces during World War II, where Flanagan conducted a series of studies focused on differentiating effective and ineffective work behaviors. Flanagan went on to found American Institutes for Research continuing to use the critical incident technique in a variety of research. [4] Since then CIT has spread as a method to identify job requirements, develop recommendations for effective practices, and determine competencies for a vast number of professionals in various disciplines. In particular, it has been used in service research. [5]

Principal uses

CIT can be used in training, systems design and accident investigation. It is an integral part of large scale task analysis. It identifies the most costly happenings in a complex environment where people and machines work as a system. Its origin in investigating pilot errors in wartime, [2] 328 et seq and other life-and-death situations, means it identifies top priorities in a man-machine system or other complex action-oriented situation. These priorities then feed into procedures for selection and training, and also (continuing the pilot example) into cockpit instrument design. [6] [7]

In healthcare, CIT is used in situations where direct examination of clinical staff and researchers can help them better understand their roles and help them solve practical problems. CIT allows clinical staff to better understand their roles in the clinical setting. Another advantage is that it helps them gain better knowledge about their interactions with patients and other clinicians. It also helps clinical staff better understand their practice from a variety of roles (e.g., physician, nurse, clinical educator, nurse informatician, faculty member). In healthcare research, CIT can be a good resource in identifying the experiences of a patient in the healthcare setting, exploring the dimensions of patient–provider interactions and determining patient responses to illnesses and treatments.

CIT is also widely used in organizational development as a research technique for identification of organizational problems and is suitable for knowledge management in project-based organizations. [8] CIT is used as an interview technique, where the informants are encouraged to talk about unusual organizational incidents instead of answering direct questions. Using CIT deemphasizes the inclusion of general opinions about management and working procedures, instead focusing on specific incidents.

In market research, CIT has been used more frequently in the last ten years. Although the CIT method first appeared in the marketing literature thirty years ago, the major catalyst for use of the CIT method in service research appears to have been a Journal of Marketing study conducted by Bitner, Booms, and Tetreault (1990) that investigated sources of satisfaction and dissatisfaction in service encounters. Since the Bitner et al. article, nearly 200 CIT studies have appeared in marketing-related literature. [9]

CIT has also been used in studies of information-seeking behavior. [10] [11] [12]

The employment of CIT may also allow construction of typical scenarios of user behavior when they interact with various technologies including information systems. For this, researchers should solicit:

  1. the cause, description and outcome of a critical incident;
  2. users' feelings and perceptions of the situation;
  3. actions taken during the incident;
  4. changes (if any) in their future behavior.

The typical scenarios may be presented visually as a diagram or a causal model. [13]

Advantages and disadvantages

By identifying possible problems associated with major user–system or product complications, CIT recommendations try to ensure that the same type of situations do not result in a similar loss. There are both advantages and disadvantages to using this method, as shown below.[ citation needed ] Overall, however, CIT has been demonstrated to be a sound method since first presented in 1954.[ citation needed ] Relatively few modifications have been suggested to the method in the more than 50 years since it was introduced, and only minor changes have been made to Flanagan's original approach, indicating reasonable robustness.

Advantages

Disadvantages

Related Research Articles

<span class="mw-page-title-main">Educational psychology</span> Branch of psychology concerned with the scientific study of human learning

Educational psychology is the branch of psychology concerned with the scientific study of human learning. The study of learning processes, from both cognitive and behavioral perspectives, allows researchers to understand individual differences in intelligence, cognitive development, affect, motivation, self-regulation, and self-concept, as well as their role in learning. The field of educational psychology relies heavily on quantitative methods, including testing and measurement, to enhance educational activities related to instructional design, classroom management, and assessment, which serve to facilitate learning processes in various educational settings across the lifespan.

<span class="mw-page-title-main">Industrial and organizational psychology</span> Branch of psychology

Industrial and organizational psychology is the science of human behavior in the workplace. It is an applied discipline within psychology. Depending on the country or region of the world, I-O psychology is also known as occupational psychology in the United Kingdom, organisational psychology in Australia and New Zealand, and work and organizational (WO) psychology throughout Europe and Brazil. Industrial, work, and organizational (IWO) psychology is the broader, more global term for the science and profession.

<span class="mw-page-title-main">Psychology</span> Study of mental functions and behaviours

Psychology is the scientific study of mind and behavior in humans and non-humans. Psychology includes the study of conscious and unconscious phenomena, including feelings and thoughts. It is an academic discipline of immense scope, crossing the boundaries between the natural and social sciences. Psychologists seek an understanding of the emergent properties of brains, linking the discipline to neuroscience. As social scientists, psychologists aim to understand the behavior of individuals and groups. Ψ (psi), the first letter of the Greek word psyche from which the term psychology is derived, is commonly associated with the science.

<span class="mw-page-title-main">Applied psychology</span> Application of psychological theories or findings

Applied psychology is the use of psychological methods and findings of scientific psychology to solve practical problems of human and animal behavior and experience. Educational and organizational psychology, business management, law, health, product design, ergonomics, behavioural psychology, psychology of motivation, psychoanalysis, neuropsychology, psychiatry and mental health are just a few of the areas that have been influenced by the application of psychological principles and scientific findings. Some of the areas of applied psychology include counseling psychology, industrial and organizational psychology, engineering psychology, occupational health psychology, legal psychology, school psychology, sports psychology, community psychology, neuropsychology, medical psychology and clinical psychology, evolutionary psychology, human factors, forensic psychology and traffic psychology. In addition, a number of specialized areas in the general area of psychology have applied branches. However, the lines between sub-branch specializations and major applied psychology categories are often mixed or in some cases blurred. For example, a human factors psychologist might use a cognitive psychology theory. This could be described as human factor psychology or as applied cognitive psychology. When applied psychology is used in the treatment of behavioral disorders there are many experimental approaches to try and treat an individual. This type of psychology can be found in many of the subbranches in other fields of psychology.

<span class="mw-page-title-main">Clinical psychology</span> Branch of medicine devoted to mental disorders

Clinical psychology is an integration of human science, behavioral science, theory, and clinical knowledge for the purpose of understanding, preventing, and relieving psychologically-based distress or dysfunction and to promote subjective well-being and personal development. Central to its practice are psychological assessment, clinical formulation, and psychotherapy, although clinical psychologists also engage in research, teaching, consultation, forensic testimony, and program development and administration. In many countries, clinical psychology is a regulated mental health profession.

<span class="mw-page-title-main">Personality test</span> Method of assessing human personality constructs

A personality test is a method of assessing human personality constructs. Most personality assessment instruments are in fact introspective self-report questionnaire measures or reports from life records (L-data) such as rating scales. Attempts to construct actual performance tests of personality have been very limited even though Raymond Cattell with his colleague Frank Warburton compiled a list of over 2000 separate objective tests that could be used in constructing objective personality tests. One exception however, was the Objective-Analytic Test Battery, a performance test designed to quantitatively measure 10 factor-analytically discerned personality trait dimensions. A major problem with both L-data and Q-data methods is that because of item transparency, rating scales and self-report questionnaires are highly susceptible to motivational and response distortion ranging all the way from lack of adequate self-insight to downright dissimulation depending on the reason/motivation for the assessment being undertaken.

In psychology, a projective test is a personality test designed to let a person respond to ambiguous stimuli, presumably revealing hidden emotions and internal conflicts projected by the person into the test. This is sometimes contrasted with a so-called "objective test" / "self-report test", which adopt a "structured" approach as responses are analyzed according to a presumed universal standard, and are limited to the content of the test. The responses to projective tests are content analyzed for meaning rather than being based on presuppositions about meaning, as is the case with objective tests. Projective tests have their origins in psychoanalysis, which argues that humans have conscious and unconscious attitudes and motivations that are beyond or hidden from conscious awareness.

The Behavioral Analysis Unit (BAU) is a department of the Federal Bureau of Investigation's National Center for the Analysis of Violent Crime (NCAVC) that uses behavioral analysts to assist in criminal investigations. The mission of the NCAVC and the BAU is to provide behavioral based investigative and/or operational support by applying case experience, research, and training to complex and time-sensitive crimes, typically involving acts or threats of violence.

<span class="mw-page-title-main">Health psychology</span> Study of psychological and behavioral processes in health, illness, and healthcare

Health psychology is the study of psychological and behavioral processes in health, illness, and healthcare. The discipline is concerned with understanding how psychological, behavioral, and cultural factors contribute to physical health and illness. Psychological factors can affect health directly. For example, chronically occurring environmental stressors affecting the hypothalamic–pituitary–adrenal axis, cumulatively, can harm health. Behavioral factors can also affect a person's health. For example, certain behaviors can, over time, harm or enhance health. Health psychologists take a biopsychosocial approach. In other words, health psychologists understand health to be the product not only of biological processes but also of psychological, behavioral, and social processes.

<span class="mw-page-title-main">Problem solving</span> Approaches to problem solving

Problem solving is the process of achieving a goal by overcoming obstacles, a frequent part of most activities. Problems in need of solutions range from simple personal tasks to complex issues in business and technical fields. The former is an example of simple problem solving (SPS) addressing one issue, whereas the latter is complex problem solving (CPS) with multiple interrelated obstacles. Another classification is into well-defined problems with specific obstacles and goals, and ill-defined problems in which the current situation is troublesome but it is not clear what kind of resolution to aim for. Similarly, one may distinguish formal or fact-based problems requiring psychometric intelligence, versus socio-emotional problems which depend on the changeable emotions of individuals or groups, such as tactful behavior, fashion, or gift choices.

Behaviour therapy or behavioural psychotherapy is a broad term referring to clinical psychotherapy that uses techniques derived from behaviourism and/or cognitive psychology. It looks at specific, learned behaviours and how the environment, or other people's mental states, influences those behaviours, and consists of techniques based on behaviorism's theory of learning: respondent or operant conditioning. Behaviourists who practice these techniques are either behaviour analysts or cognitive-behavioural therapists. They tend to look for treatment outcomes that are objectively measurable. Behaviour therapy does not involve one specific method, but it has a wide range of techniques that can be used to treat a person's psychological problems.

External validity is the validity of applying the conclusions of a scientific study outside the context of that study. In other words, it is the extent to which the results of a study can be generalized to and across other situations, people, stimuli, and times. In contrast, internal validity is the validity of conclusions drawn within the context of a particular study. Because general conclusions are almost always a goal in research, external validity is an important property of any study. Mathematical analysis of external validity concerns a determination of whether generalization across heterogeneous populations is feasible, and devising statistical and computational methods that produce valid generalizations.

Competence is the set of demonstrable characteristics and skills that enable and improve the efficiency or performance of a job. Competency is a series of knowledge, abilities, skills, experiences and behaviors, which leads to effective performance in an individual's activities. Competency is measurable and can be developed through training. The term "competence" first appeared in an article authored by R.W. White in 1959 as a concept for performance motivation. In 1970, Craig C. Lundberg defined this concept as "Planning the Executive Development Program". The term gained traction in 1973 when David McClelland wrote a seminal paper entitled, "Testing for Competence Rather Than for Intelligence". The term, created by McClelland, was commissioned by the State Department to explain characteristics common to high-performing agents of embassy, as well as help them in recruitment and development. It has since been popularized by Richard Boyatzis, and many others including T.F. Gilbert (1978), who used the concept in performance improvement. Its uses vary widely, which has led to considerable misunderstanding.

<span class="mw-page-title-main">Outline of thought</span> Overview of and topical guide to thought

The following outline is provided as an overview of and topical guide to thought (thinking):

<span class="mw-page-title-main">Psychological research</span> Research about behaviors of individuals or groups

Psychological research refers to research that psychologists conduct for systematic study and for analysis of the experiences and behaviors of individuals or groups. Their research can have educational, occupational and clinical applications.

<span class="mw-page-title-main">Basic science (psychology)</span> Subdisciplines within psychology

Some of the research that is conducted in the field of psychology is more "fundamental" than the research conducted in the applied psychological disciplines, and does not necessarily have a direct application. The subdisciplines within psychology that can be thought to reflect a basic-science orientation include biological psychology, cognitive psychology, neuropsychology, and so on. Research in these subdisciplines is characterized by methodological rigor. The concern of psychology as a basic science is in understanding the laws and processes that underlie behavior, cognition, and emotion. Psychology as a basic science provides a foundation for applied psychology. Applied psychology, by contrast, involves the application of psychological principles and theories yielded up by the basic psychological sciences; these applications are aimed at overcoming problems or promoting well-being in areas such as mental and physical health and education.

<span class="mw-page-title-main">Sport psychology</span> Branch of psychology

Sport psychology was defined by the European Federation of Sport in 1996, as the study of the psychological basis, processes, and effects of sport. Otherwise, sport is considered as any physical activity where the individuals engage for competition and health. Sport psychology is recognized as an interdisciplinary science that draws on knowledge from many related fields including biomechanics, physiology, kinesiology and psychology. It involves the study of how psychological factors affect performance and how participation in sport and exercise affect psychological and physical factors. Sport psychologists teach cognitive and behavioral strategies to athletes in order to improve their experience and performance in sports. In addition to instruction and training of psychological skills for performance improvement, applied sport psychology may include work with athletes, coaches, and parents regarding injury, rehabilitation, communication, team building, and career transitions.

<span class="mw-page-title-main">Subfields of psychology</span> Psychology subdisciplines

Psychology encompasses a vast domain, and includes many different approaches to the study of mental processes and behavior. Below are the major areas of inquiry that taken together constitute psychology. A comprehensive list of the sub-fields and areas within psychology can be found at the list of psychology topics and list of psychology disciplines.

The social sciences are the sciences concerned with societies, human behaviour, and social relationships.

<span class="mw-page-title-main">American Institutes for Research</span> Nonprofit social science organization

The American Institutes for Research (AIR) is a nonprofit, nonpartisan behavioral and social science research, evaluation and technical assistance organization based in Arlington, Virginia. One of the world's largest social science research organizations, AIR has more than 1,800 staff in locations across the United States and abroad.

References

  1. Flanagan, John C. Psychological Bulletin, Vol. 51, No. 4, July 1954.
  2. 1 2 Page 327.
  3. "Charged with recruiting other psychologists, Dr. Flanagan was asked to develop the Army Air Corp's program, and, by the end of the war, he had overseen the commissioning of over 150 psychologists. Within its ranks were some of the finest psychologists of the day, including five forthcoming presidents of the American Psychological Association and 11 members of its board of directors. Toward the close of the war, this group of psychologists was involved not only in conducting research regarding the selection and classification of aviators but was also involved in developing training programs and human factors engineering." http://www.apadivisions.org/division-19/publications/newsletters/military/2014/04/aviation-psychology.aspx, paragraph 6
  4. A Timeline of AIR History, American Institutes for Research http://www.air.org/page/air-history
  5. Lisch, Ralf (2014). Measuring Service Performance. Practical Research for Better Quality. Routledge. pp. 147, 150–152. ISBN   9781472411914.
  6. Fitts P.M. & Jones R.E 1947. Psychological aspects of instrument display: I. Analysis of 270 "pilot-error" experiences in reading and interpreting aircraft instruments. U.S. Air Forces Materiel Command, Report No. TSEAA-694-12A.
  7. Chapanis, Alphonse 1959. Research techniques in human engineering. Baltimore: Johns Hopkins Press, Chapter 3, Methods for the study of accidents and near-accidents.
  8. Haussner et al (2018). "Exploring Internationally Operated Construction Projects through the critical incident technique". Journal of Management in Engineering 34(5).
  9. Gremler's article in Journal of Service Research, Vol. 7, No. 1, August 2004.
  10. "How senior managers acquire and use information in environmental scanning" by Ethel Auster and Chun Wei Choo (1996).
  11. "Information sources used by lawyers in problem-solving: An empirical exploration" by Margaret Ann Wilkinson (2001).
  12. "When Is 'Enough' Enough? Modeling the Information-Seeking and Stopping Behavior of Senior Arts Administrators" by Lisl Zach (2004).
  13. Serenko, A. (2006). "The use of interface agents for email notification in critical incidents". International Journal of Human-Computer Studies 64(11): 1084–1098.

Bibliography

Examples in informatics / case studies