Ecological validity

Last updated

In the behavioral sciences, ecological validity is often used to refer to the judgment of whether a given study's variables and conclusions (often collected in lab) are sufficiently relevant to its population (e.g. the "real world" context). Psychological studies are usually conducted in laboratories though the goal of these studies is to understand human behavior in the real-world. Ideally, an experiment would have generalizable results that predict behavior outside of the lab, thus having more ecological validity. Ecological validity can be considered a commentary on the relative strength of a study's implication(s) for policy, society, culture, etc.

Contents

This term was originally coined by Egon Brunswik [1] and held a specific meaning. He regarded ecological validity as the utility of a perceptual cue to predict a property (basically how informative the cue is). For example, high school grades have moderate ecological validity for predicting college grades. [2] Hammond [3] argued that the now common use of the term to refer to generality of research results to the "real world" is inappropriate because it robs the original usage of its meaning.

Due to the evolving and broad definition of ecological validity, problematic usage of this term in modern scientific studies occurs because it is often not clearly defined. In fact, in many cases just being specific about what behavior/context you are testing makes addressing ecological validity unnecessary. [4]

Comparing ecological validity to mundane realism and external validity

The term "ecological validity" is now widely used by researchers unfamiliar with the origins and technical meaning of the term to be broadly equivalent to mundane realism. [5] Mundane realism references the extent to which the experimental situation is similar to situations people are likely to encounter outside the laboratory. For example, mock-jury research is designed to study how people might act if they were jurors during a trial, but many mock-jury studies simply provide written transcripts or summaries of trials while in a classroom or office settings. Such experiments do not approximate the actual look, feel, and procedure of a real courtroom trial, and therefore lack mundane realism.

The better-recognized concern is that of external validity: if the results from such a mock-jury study are reproduced in and generalized across trials where these stimulus materials, settings, and other background characteristics vary, then the measurement process may be deemed externally valid. External validity refers to the ability to generalize study findings in other contexts. Ecological validity, the ability to generalize study findings to the real world, is a subcategory of external validity. [6]  

Another example highlighting the differences between these terms is from an experiment that studied pointing [7] —a trait originally attributed uniquely to humans—in captive chimpanzees. This study certainly had external validity because when testing if captive chimps will gesture towards food by pointing, the results were reproduced in different trials and under different conditions. Nevertheless, the ecological validity and mundane realism of this study came into question because researchers were attempting to do cognitive research while disrupting these animals’ natural environment.

Because the experimental conditions that are conducive to pointing (i.e. watching humans point) will never be experienced by chimpanzees outside the laboratory, this study is by definition lacking mundane realism. Furthermore, pointing doesn't emerge in wild chimpanzees; therefore, one could argue that because captive chimps were taken out of their natural environment, there is no point in studying a trait that wasn't adaptive through natural selection (holding no ecological validity). However, a counter-argument to this claim is that captive chimpanzees are under the ecological framework merely by existing. It is plausible that captivity is the context that leads to the development of this trait. Furthermore, if this trait can be taught to captive chimpanzees, it is certainly possible that if faced with particular circumstances, wild chimpanzees would also learn to point.

Thus, ecological validity is a sliding scale. Humans have dramatically changed the natural world to the extent that behavior traits that animals adapt in response to human intervention (such as pointing) could technically hold ecological validity. With this in mind, perhaps instead of attempting to broaden the definition of this term, a new term should be identified to define traits that have only emerged due to direct human interference.

See also

Related Research Articles

Emotional intelligence (EI), also known as emotional quotient (EQ), is the ability to perceive, use, understand, manage, and handle emotions. High emotional intelligence includes emotional recognition of emotions of the self and others, using emotional information to guide thinking and behavior, discerning between and labeling of different feelings, and adjusting emotions to adapt to environments.

Validity is the main extent to which a concept, conclusion, or measurement is well-founded and likely corresponds accurately to the real world. The word "valid" is derived from the Latin validus, meaning strong. The validity of a measurement tool is the degree to which the tool measures what it claims to measure. Validity is based on the strength of a collection of different types of evidence described in greater detail below.

Deindividuation is a concept in social psychology that is generally thought of as the loss of self-awareness in groups, although this is a matter of contention. For the social psychologist, the level of analysis is the individual in the context of a social situation. As such, social psychologists emphasize the role of internal psychological processes. Other social scientists, such as sociologists, are more concerned with broad social, economic, political, and historical factors that influence events in a given society.

External validity is the validity of applying the conclusions of a scientific study outside the context of that study. In other words, it is the extent to which the results of a study can generalize or transport to other situations, people, stimuli, and times. Generalizability refers to the applicability of a predefined sample to a broader population while transportability refers to the applicability of one sample to another target population. In contrast, internal validity is the validity of conclusions drawn within the context of a particular study.

<span class="mw-page-title-main">Egon Brunswik</span> Psychologist

Egon Brunswik Edler von Korompa was a psychologist who is known for his theory of probabilisitic functionalism and his proposition that representative design is essential in psychological research.

This entry will describe the proper narrow and technical meaning of "ecological validity" as proposed by Egon Brunswik as part of the Brunswik Lens Model, the relation of "ecological validity" in "representative design" of research, and will outline the common misuses of the "ecological validity." For a more detailed explanation, see Hammond (1998).

In perceptual psychology, a sensory cue is a statistic or signal that can be extracted from the sensory input by a perceiver, that indicates the state of some property of the world that the perceiver is interested in perceiving.

Cue reactivity is a type of learned response which is observed in individuals with an addiction and involves significant physiological and psychological reactions to presentations of drug-related stimuli. The central tenet of cue reactivity is that cues previously predicting receipt of drug reward under certain conditions can evoke stimulus associated responses such as urges to use drugs. In other words, learned cues can signal drug reward, in that cues previously associated with drug use can elicit cue-reactivity such as arousal, anticipation, and changes in behavioral motivation. Responses to a drug cue can be physiological, behavioral, or symbolic expressive. The clinical utility of cue reactivity is based on the conceptualization that drug cues elicit craving which is a critical factor in the maintenance and relapse to drug use. Additionally, cue reactivity allows for the development of testable hypotheses grounded in established theories of human behavior. Therefore, researchers have leveraged the cue reactivity paradigm to study addiction, antecedents of relapse, and craving, translate pre-clinical findings to clinical samples, and contribute to the development of new treatment methods. Testing cue reactivity in human samples involves exposing individuals with a substance use disorder to drug-related cues and drug neutral cues, and then measuring their reactions by assessing changes in self-reported drug craving and physiological responses.

Social perception is the study of how people form impressions of and make inferences about other people as sovereign personalities. Social perception refers to identifying and utilizing social cues to make judgments about social roles, rules, relationships, context, or the characteristics of others. This domain also includes social knowledge, which refers to one's knowledge of social roles, norms, and schemas surrounding social situations and interactions. People learn about others' feelings and emotions by picking up information they gather from physical appearance, verbal, and nonverbal communication. Facial expressions, tone of voice, hand gestures, and body position or movement are a few examples of ways people communicate without words. A real-world example of social perception is understanding that others disagree with what one said when one sees them roll their eyes. There are four main components of social perception: observation, attribution, integration, and confirmation.

<span class="mw-page-title-main">Quasi-experiment</span> Empirical interventional study

A quasi-experiment is an empirical interventional study used to estimate the causal impact of an intervention on target population without random assignment. Quasi-experimental research shares similarities with the traditional experimental design or randomized controlled trial, but it specifically lacks the element of random assignment to treatment or control. Instead, quasi-experimental designs typically allow the researcher to control the assignment to the treatment condition, but using some criterion other than random assignment.

Ayumu is a chimpanzee currently living at the Primate Research Institute of Kyoto University. He is the son of chimpanzee Ai and has been a participant since infancy in the Ai Project, an ongoing research effort aimed at understanding chimpanzee cognition. As part of the Ai Project, Ayumu participated in a series of short-term memory tasks, such as to remember the sequential order of numbers displaying on a touch-sensitive computer screen. His performance in the tasks was superior to that of comparably trained university students, leading to a possible conclusion that young chimpanzees have better working memory than adult humans. This conclusion has been disputed.

The person–situation debate in personality psychology refers to the controversy concerning whether the person or the situation is more influential in determining a person's behavior. Personality trait psychologists believe that a person's personality is relatively consistent across situations. Situationists, opponents of the trait approach, argue that people are not consistent enough from situation to situation to be characterized by broad personality traits. The debate is also an important discussion when studying social psychology, as both topics address the various ways a person could react to a given situation.

<span class="mw-page-title-main">Personality in animals</span>

Personality in animals has been investigated across a variety of different scientific fields including agricultural science, animal behaviour, anthropology, psychology, veterinary medicine, and zoology. Thus, the definition for animal personality may vary according to the context and scope of study. However, there is recent consensus in the literature for a broad definition that describes animal personality as individual differences in behaviour that are consistent across time and ecological context. Here, consistency refers to the repeatability of behavioural differences between individuals and not a trait that presents itself the same way in varying environments.

<span class="mw-page-title-main">Trait activation theory</span>

Trait activation theory is based on a specific model of job performance, and can be considered an elaborated or extended view of personality-job fit. Specifically, it is how an individual expresses their traits when exposed to situational cues related to those traits. These situational cues may stem from organization, social, and/or task cues. These cues can activate personality traits that are related to job tasks and organizational expectations that the organization values. These cues may also elicit trait-related behaviors that are not directly related to job performance.

A zero-acquaintance situation requires a perceiver to make a judgment about a target with whom the perceiver has had no prior social interaction. These judgments can be made using a variety of cues, including brief interactions with the target, video recordings of the target, photographs of the target, and observations of the target's personal environments, among others. In zero-acquaintance studies, the target's actual personality is determined through the target's self-rating and/or ratings from close acquaintance(s) of that target. Consensus in ratings is determined by how consistently perceivers rate the target's personality when compared to other raters. Accuracy in ratings is determined by how well perceivers' ratings of a target compare to that target's self-ratings on the same scale, or to that target's close acquaintances' ratings of the target. Zero-acquaintance judgments are regularly made in day-to-day life. Given that these judgments tend to remain stable, even as the length of interaction increases, they can influence important interpersonal outcomes.

Theory of mind in animals is an extension to non-human animals of the philosophical and psychological concept of theory of mind (ToM), sometimes known as mentalisation or mind-reading. It involves an inquiry into whether non-human animals have the ability to attribute mental states to themselves and others, including recognition that others have mental states that are different from their own. To investigate this issue experimentally, researchers place non-human animals in situations where their resulting behavior can be interpreted as supporting ToM or not.

Inclusive fitness in humans is the application of inclusive fitness theory to human social behaviour, relationships and cooperation.

<span class="mw-page-title-main">Cooperative pulling paradigm</span> Experimental design

The cooperative pulling paradigm is an experimental design in which two or more animals pull rewards toward themselves via an apparatus that they cannot successfully operate alone. Researchers use cooperative pulling experiments to try to understand how cooperation works and how and when it may have evolved.

Brunswik's lens model is a conceptual framework for describing and studying how people make judgments. For example, a person judging the size of a distant object, physicians assessing the severity of disease, investors judging the quality of stocks, weather forecasters predicting tomorrow's weather and personnel officers rating job candidates all face similar tasks. In each case, they must use whatever information is at hand ("cues") to make an inference about some unknown quantity. The cues for judgment are analogous to a lens through which the person views an unknown object. 

Vicarious mediation is the potential level of substitutability in the task itself, the different potential ways that exist for achieving an outcome or performing a task successfully. For example, what is the substitutability of potential cues for accurate judgments about the size of objects in a visual field, particularly when all the cues are not available or are not perfect predictors of size? Similarly, what is the substitutability of potential behaviors to accomplish one’s goals when all actions may not be available or equally effective? The focus is on the task, the various potentially substitutable pathways mediating success in the task itself.

References

  1. ↑ Kieffer, Suzanne (2017-06-30). "ECOVAL: Ecological Validity of Cues and Representative Design in User Experience Evaluations". AIS Transactions on Human-Computer Interaction. 9 (2): 149–172. doi: 10.17705/1thci.00093 . ISSN   1944-3900.
  2. ↑ Allensworth, Elaine M.; Clark, Kallie (2020). "High School GPAs and ACT Scores as Predictors of College Completion: Examining Assumptions About Consistency Across High Schools". Educational Researcher. 49 (3): 198–211. doi: 10.3102/0013189X20902110 .
  3. ↑ Hammond, Kenneth R. (September 1998). "Ecological Validity: Then and Now" (PDF). The Brunswik Society. Retrieved March 3, 2024.
  4. ↑ Holleman, Gijs A.; Hooge, Ignace T. C.; Kemner, Chantal; Hessels, Roy S. (2020-04-30). "The 'Real-World Approach' and Its Problems: A Critique of the Term Ecological Validity". Frontiers in Psychology. 11: 721. doi: 10.3389/fpsyg.2020.00721 . ISSN   1664-1078. PMC   7204431 . PMID   32425850.
  5. ↑ Aronson, E., & Carlsmith, J. M. (1968). Experimentation in social psychology. In G. Lindzey & E. Aronson (Eds.), The handbook of social psychology (2nd ed., Vol. 2, pp. 1–79). Reading, MA: Addison-Wesley.
  6. ↑ Andrade, Chittaranjan (September 1, 2018). "Internal, External, and Ecological Validity in Research Design, Conduct, and Evaluation". Indian Journal of Psychological Medicine. 40 (5): 498–499. doi: 10.4103/IJPSYM.IJPSYM_334_18 . ISSN   0253-7176. PMC   6149308 . PMID   30275631.
  7. ↑ Leavens, David A.; Hopkins, William D.; Bard, Kim A. (September 2008). "Understanding the Point of Chimpanzee Pointing: Epigenesis and Ecological Validity". Current Directions in Psychological Science. 14 (4): 185–189. doi:10.1111/j.0963-7214.2005.00361.x. ISSN   0963-7214. PMC   2151757 . PMID   18159225.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.