Philip E. Tetlock

Last updated
Philip E. Tetlock
Philip Tetlock at World Economic Forum.jpg
Tetlock at the 2017 World Economic Forum
Born1954 (age 6970)
Toronto, Ontario, Canada
Alma mater Yale University (Ph.D.) (1979)
Scientific career
Fields political forecasting, political psychology, forecasting, decision making
Institutions University of Pennsylvania
Annenberg University Professor at the Wharton School and the School of Arts and Sciences (2011–present),
University of California, Berkeley
Mitchell Endowed Chair at the Haas School of Business (2002–2010)
Ohio State University
Burtt Endowed Chair in Psychology and Political Science (1996–2001)
University of California, Berkeley
(1979–1995)

Philip E. Tetlock (born 1954) is a Canadian-American political science writer, and is currently the Annenberg University Professor at the University of Pennsylvania, where he is cross-appointed at the Wharton School and the School of Arts and Sciences. He was elected a Member of the American Philosophical Society in 2019.

Contents

He has written several non-fiction books at the intersection of psychology, political science and organizational behavior, including Superforecasting: The Art and Science of Prediction ; Expert Political Judgment: How Good Is It? How Can We Know? ; Unmaking the West: What-if Scenarios that Rewrite World History; and Counterfactual Thought Experiments in World Politics. Tetlock is also co-principal investigator of The Good Judgment Project, a multi-year study of the feasibility of improving the accuracy of probability judgments of high-stakes, real-world events.

Biography

Tetlock was born in 1954 in Toronto, Canada and completed his undergraduate work at the University of British Columbia and doctoral work at Yale University, obtaining his PhD in 1979.

He has served on the faculty of the University of California, Berkeley (1979–1995, assistant professor), the Ohio State University (the Burtt Endowed Chair in Psychology and Political Science, 1996–2001) and again at the University of California Berkeley (the Mitchell Endowed Chair at the Haas School of Business, 2002–2010). Since 2011, he has been the Annenberg University Professor at the University of Pennsylvania.

Tetlock has received awards from scientific societies and foundations, including the American Psychological Association, American Political Science Association, American Association for the Advancement of Science, International Society of Political Psychology, American Academy of Arts and Sciences, the National Academy of Sciences and the MacArthur, Sage, Grawemeyer, and Carnegie Foundations.

Work

He has published over 200 articles in peer-reviewed journals and has edited or written ten books. [1]

Tetlock's research program over the last four decades has explored five themes:

  1. the concept of good judgment (with special emphasis on the usefulness of forecasting tournaments in assessing one key component of good judgment: accuracy);
  2. the impact of accountability on judgment and choice;
  3. the constraints that sacred values place on the boundaries of the thinkable;
  4. the difficult-to-define distinction between political versus politicized psychology; and
  5. the usefulness of hypothetical-society experiments in disentangling fact and value judgments of the impact of competing policy proposals.

The Good Judgment Project

In his early work on good judgment, summarized in Expert Political Judgment: How Good Is It? How Can We Know? , [2] Tetlock conducted a set of small scale forecasting tournaments between 1984 and 2003. The forecasters were 284 experts from a variety of fields, including government officials, professors, journalists, and others, with many opinions, from Marxists to free-marketeers.

The tournaments solicited roughly 28,000 predictions about the future and found the forecasters were often only slightly more accurate than chance, and usually worse than basic extrapolation algorithms, especially on longer–range forecasts three to five years out. Forecasters with the biggest news media profiles were also especially bad. This work suggests that there is an inverse relationship between fame and accuracy.

As a result of this work, he received the 2008 University of Louisville Grawemeyer Award for Ideas Improving World Order, as well as the 2006 Woodrow Wilson Award for best book published on government, politics, or international affairs and the Robert E. Lane Award for best book in political psychology, both from the American Political Science Association in 2005. The expert political judgment project also compared the accuracy track records of "foxes" and "hedgehogs" (two personality types identified in Isaiah Berlin's 1950 essay "The Hedgehog and the Fox"). "Hedgehogs" performed less well, especially on long-term forecasts within the domain of their expertise.

These findings were reported widely in the media and came to the attention of Intelligence Advanced Research Projects Activity (IARPA) inside the United States intelligence community—a fact that was partly responsible for the 2011 launch of a four-year geopolitical forecasting tournament that engaged tens of thousands of forecasters and drew over one million forecasts across roughly 500 questions of relevance to U.S. national security, broadly defined.

Since 2011, Tetlock and his wife/research partner Barbara Mellers have been co-leaders of the Good Judgment Project (GJP), a research collaborative that emerged as the winner of the IARPA tournament. [3] The original aim of the tournament was to improve geo-political and geo-economic forecasting. Illustrative questions include "What is the chance that a member will withdraw from the European Union by a target date?" or "What is the likelihood of naval clashes claiming over 10 lives in the East China Sea?" or "How likely is the head of state of Venezuela to resign by a target date?" The tournament challenged GJP and its competitors at other academic institutions to come up with innovative methods of recruiting gifted forecasters, methods of training forecasters in basic principles of probabilistic reasoning, methods of forming teams that are more than the sum of their individual parts and methods of developing aggregation algorithms that most effectively distill the wisdom of the crowd. [3] [4] [5] [6] [7] [8]

Among the more surprising findings from the tournament were:

  1. the degree to which simple training exercises improved the accuracy of probabilistic judgments as measured by Brier scores; [3] [4]
  2. the degree to which the best forecasters could learn to distinguish many degrees of uncertainty along the zero to 1.0 probability scale (many more distinctions than the traditional 7-point verbal scale used by the National Intelligence Council); [4] [9]
  3. the consistency of the performance of the elite forecasters (superforecasters) across time and categories of questions; [4] [5] [6]
  4. the power of a log-odds extremizing aggregation algorithm to out-perform competitors; [7] [8] and
  5. the apparent ability of GJP to generate probability estimates that were "reportedly 30% better than intelligence officers with access to actual classified information." [9]

These and other findings are laid out in particularly accessible form in the Tetlock and Gardner (2015) book on "Superforecasting." The book also profiles several "superforecasters." The authors stress that good forecasting does not require powerful computers or arcane methods. It involves gathering evidence from a variety of sources, thinking probabilistically, working in teams, keeping score, and being willing to admit error and change course.

There is a tension, if not contradiction, between the positions taken in the Good Judgment Project and those that Tetlock took in his earlier book Expert Political Judgment: How Good Is It? How Can We Know? (2005). The more pessimistic tone of Expert Political Judgment (2005) and optimistic tone of Superforecasting (2015) reflects less a shift in Tetlock's views on the feasibility of forecasting than it does the different sources of data in the two projects. The Superforecasting book focused on shorter-range forecasts, the longest of which, about 12 months, being only as long as the shortest forecasts in the Expert Political Judgment project. Tetlock and Gardner (2015) also suggest that the public accountability of participants in the later IARPA tournament boosted performance. Apparently, "even the most opinionated hedgehogs become more circumspect" [9] when they feel their accuracy will soon be compared to that of ideological rivals.

Tetlock and Mellers [10] see forecasting tournaments as a possible mechanism for helping intelligence agencies escape from blame-game (or accountability) ping-pong in which agencies find themselves whipsawed between clashing critiques that they were either too slow to issue warnings (false negatives such as 9/11) and too fast to issue warnings (false positives). They argue that tournaments are ways of signaling that an organization is committed to playing a pure accuracy game – and generating probability estimates that are as accurate as possible (and not tilting estimates to avoid the most recent "mistake"). [10] [11]

Tetlock is also President and Chief Scientist of Forecasting Research Institute, [12] which organized, among other things "the Existential Risk Persuasion Tournament" that involved 169 experts recording probability judgements on existential risks between June and October 2022. They asked 80 subject matter experts and 89 "superforecasters" to estimate probabilities for various events by 2030, 2050, and 2100 that might involve either a "catastrophe" (leading to the deaths of at least 10 percent of humanity) or "human extinction" (where the human population would drop below 1,000). Overall, their superforecasters gave a median estimate of 9.05 percent for a catastrophe from whatever source by 2100 while the median according to the experts was 20 percent, with 95 percent confidence intervals of [6.13, 10.25] and [15.44, 27.60] percent for superforecasters and experts, respectively. [13]

Accountability and judgment processes

In a 1985 essay, Tetlock proposed that accountability is a key concept for linking the individual levels of analysis to the social-system levels of analysis. [14] Accountability binds people to collectivities by specifying who must answer to whom, for what, and under what ground rules. [14] [15] In his earlier work in this area, he showed that some forms of accountability can make humans more thoughtful and constructively self-critical (reducing the likelihood of biases or errors), whereas other forms of accountability can make us more rigid and defensive (mobilizing mental effort to defend previous positions and to criticize critics). [16] In a 2009 essay, Tetlock argues that much is still unknown about how psychologically deep the effects of accountability run—for instance, whether it is or is not possible to check automatic or implicit association-based biases, [17] a topic with legal implications for companies in employment discrimination class actions. [18]

In addition to his work on the bias-attenuating versus bias-amplifying effects of accountability, Tetlock has explored the political dimensions of accountability. When, for instance, do liberals and conservatives diverge in the preferences for "process accountability" that holds people responsible for respecting rules versus "outcome accountability" that holds people accountable for bottom-line results? [19] [20] Tetlock uses the phrase "intuitive politician research program" to describe this line of work. [21]

Taboo cognition and sacred values

Tetlock uses a different "functionalist metaphor" to describe his work on how people react to threats to sacred values—and how they take pains to structure situations so as to avoid open or transparent trade-offs involving sacred values. [22] [23] [24] [25] Real-world implications of this claim are explored largely in business-school journals such as the Journal of Consumer Research , California Management Review , and Journal of Consumer Psychology . This research argues that most people recoil from the specter of relativism: the notion that the deepest moral-political values are arbitrary inventions of mere mortals desperately trying to infuse moral meaning into an otherwise meaningless universe. [26] [27] [28] [29] Rather, humans prefer to believe that they have sacred values that provide firm foundations for their moral-political opinions. People can become very punitive "intuitive prosecutors" when they feel sacred values have been seriously violated, going well beyond the range of socially acceptable forms of punishment when given chances to do so covertly. [30]

Political versus politicized psychology

Tetlock has a long-standing interest in the tensions between political and politicized psychology. He argues that most political psychologists tacitly assume that, relative to political science, psychology is the more basic discipline in their hybrid field. [31] [32] In this view, political actors—be they voters or national leaders—are human beings whose behavior should be subject to fundamental psychological laws that cut across cultures and historical periods. Although he too occasionally adopts this reductionist view of political psychology in his work, he has also raised the contrarian possibility in numerous articles and chapters that reductionism sometimes runs in reverse—and that psychological research is often driven by ideological agenda (of which the psychologists often seem to be only partly conscious). Tetlock has advanced variants of this argument in articles on the links between cognitive styles and ideology (the fine line between rigid and principled) [33] [34] as well as on the challenges of assessing value-charged concepts like symbolic racism [35] and unconscious bias (is it possible to be a "Bayesian bigot"?). [36] [37] [38] [39] Tetlock has also co-authored papers on the value of ideological diversity in psychological and social science research. [40] [41] One consequence of the lack of ideological diversity in high-stakes, soft-science fields is frequent failures of what Tetlock calls turnabout tests. [42] [43] [44]

Experimental political philosophy

In collaboration with Greg Mitchell and Linda Skitka, Tetlock has conducted research on hypothetical societies and intuitions about justice ("experimental political philosophy"). The spotlight here is on a fundamental question in political theory: who should get what from whom, when, how, and why? In real-world debates over distributive justice, however, Tetlock argues it is virtually impossible to disentangle the factual assumptions that people are making about human beings from the value judgments people are making about end-state goals, such as equality and efficiency. [45] [46] [47] [48] [49] Hypothetical society studies make it possible for social scientists to disentangle these otherwise hopelessly confounded influences on public policy preferences.

Related Research Articles

<span class="mw-page-title-main">Cognitive bias</span> Systematic pattern of deviation from norm or rationality in judgment

A cognitive bias is a systematic pattern of deviation from norm or rationality in judgment. Individuals create their own "subjective reality" from their perception of the input. An individual's construction of reality, not the objective input, may dictate their behavior in the world. Thus, cognitive biases may sometimes lead to perceptual distortion, inaccurate judgment, illogical interpretation, and irrationality.

Confirmation bias is the tendency to search for, interpret, favor, and recall information in a way that confirms or supports one's prior beliefs or values. People display this bias when they select information that supports their views, ignoring contrary information, or when they interpret ambiguous evidence as supporting their existing attitudes. The effect is strongest for desired outcomes, for emotionally charged issues, and for deeply entrenched beliefs. Confirmation bias is insuperable for most people, but they can manage it, for example, by education and training in critical thinking skills.

The anchoring effect is a psychological phenomenon in which an individual's judgements or decisions are influenced by a reference point or "anchor" which can be completely irrelevant. Both numeric and non-numeric anchoring have been reported in research. In numeric anchoring, once the value of the anchor is set, subsequent arguments, estimates, etc. made by an individual may change from what they would have otherwise been without the anchor. For example, an individual may be more likely to purchase a car if it is placed alongside a more expensive model. Prices discussed in negotiations that are lower than the anchor may seem reasonable, perhaps even cheap to the buyer, even if said prices are still relatively higher than the actual market value of the car. Another example may be when estimating the orbit of Mars, one might start with the Earth's orbit and then adjust upward until they reach a value that seems reasonable.

Moral psychology is a field of study in both philosophy and psychology. Historically, the term "moral psychology" was used relatively narrowly to refer to the study of moral development. Moral psychology eventually came to refer more broadly to various topics at the intersection of ethics, psychology, and philosophy of mind. Some of the main topics of the field are moral judgment, moral reasoning, moral sensitivity, moral responsibility, moral motivation, moral identity, moral action, moral development, moral diversity, moral character, altruism, psychological egoism, moral luck, moral forecasting, moral emotion, affective forecasting, and moral disagreement.

The implicit-association test (IAT) is an assessment intended to detect subconscious associations between mental representations of objects (concepts) in memory. Its best-known application is the assessment of implicit stereotypes held by test subjects, such as associations between particular racial categories and stereotypes about those groups. The test has been applied to a variety of belief associations, such as those involving racial groups, gender, sexuality, age, and religion but also the self-esteem, political views, and predictions of the test taker. The implicit-association test is the subject of significant academic and popular debate regarding its validity, reliability, and usefulness in assessing implicit bias.

Integrative complexity is a research psychometric that refers to the degree to which thinking and reasoning involve the recognition and integration of multiple perspectives and possibilities and their interrelated contingencies.

Confidence is the state of being clear-headed: either that a hypothesis or prediction is correct, or that a chosen course of action is the best or most effective. Confidence comes from the Latin word fidere which means "to trust". In contrast, arrogance or hubris is a state of unmerited confidence—belief lacking evidence and/or a reason. Overconfidence or presumptuousness is excessive belief in success without regard for potential failure. Confidence can be a self-fulfilling prophecy, as those without it may fail because they lack it, and those with it may succeed because they have it rather than because of an innate ability or skill. We develop a tractable method for augmenting macroeconomic models with autonomous variation in higher-order beliefs

The overconfidence effect is a well-established bias in which a person's subjective confidence in their judgments is reliably greater than the objective accuracy of those judgments, especially when confidence is relatively high. Overconfidence is one example of a miscalibration of subjective probabilities. Throughout the research literature, overconfidence has been defined in three distinct ways: (1) overestimation of one's actual performance; (2) overplacement of one's performance relative to others; and (3) overprecision in expressing unwarranted certainty in the accuracy of one's beliefs.

<span class="mw-page-title-main">Paul E. Meehl</span> American psychologist (1920–2003)

Paul Everett Meehl was an American clinical psychologist. He was the Hathaway and Regents' Professor of Psychology at the University of Minnesota, and past president of the American Psychological Association. A Review of General Psychology survey, published in 2002, ranked Meehl as the 74th most cited psychologist of the 20th century, in a tie with Eleanor J. Gibson. Throughout his nearly 60-year career, Meehl made seminal contributions to psychology, including empirical studies and theoretical accounts of construct validity, schizophrenia etiology, psychological assessment, behavioral prediction, metascience, and philosophy of science.

The negativity bias, also known as the negativity effect, is a cognitive bias that, even when of equal intensity, things of a more negative nature have a greater effect on one's psychological state and processes than neutral or positive things. In other words, something very positive will generally have less of an impact on a person's behavior and cognition than something equally emotional but negative. The negativity bias has been investigated within many different domains, including the formation of impressions and general evaluations; attention, learning, and memory; and decision-making and risk considerations.

Positive illusions are unrealistically favorable attitudes that people have towards themselves or to people that are close to them. Positive illusions are a form of self-deception or self-enhancement that feel good; maintain self-esteem; or avoid discomfort, at least in the short term. There are three general forms: inflated assessment of one's own abilities, unrealistic optimism about the future, and an illusion of control. The term "positive illusions" originates in a 1988 paper by Taylor and Brown. "Taylor and Brown's (1988) model of mental health maintains that certain positive illusions are highly prevalent in normal thought and predictive of criteria traditionally associated with mental health."

Edward Francis Diener was an American psychologist and author. Diener was a professor of psychology at the University of Utah and the University of Virginia, and Joseph R. Smiley Distinguished Professor Emeritus at the University of Illinois, as well as a senior scientist for the Gallup Organization. He is noted for his research over the past thirty years on happiness, including work on temperament and personality influences on well-being, theories of well-being, income and well-being, cultural influences on well-being, and the measurement of well-being. As shown on Google Scholar as of April 2021, Diener's publications have been cited over 257,000 times.

<span class="mw-page-title-main">Peter McGraw</span>

Peter McGraw is an American professor of marketing and psychology at the University of Colorado Boulder. As a behavioral scientist his research spans the fields of judgment and decision making, emotion, affect, mood, and behavioral economics.

Personality judgment is the process by which people perceive each other's personalities through acquisition of certain information about others, or meeting others in person. The purpose of studying personality judgment is to understand past behavior exhibited by individuals and predict future behavior. Theories concerning personality judgment focus on the accuracy of personality judgments and the effects of personality judgments on various aspects of social interactions. Determining how people judge personality is important because personality judgments often influence individuals' behaviors.

Moral foundations theory is a social psychological theory intended to explain the origins of and variation in human moral reasoning on the basis of innate, modular foundations. It was first proposed by the psychologists Jonathan Haidt, Craig Joseph, and Jesse Graham, building on the work of cultural anthropologist Richard Shweder. More recently, Mohammad Atari, Jesse Graham, and Jonathan Haidt have revised some aspects of the theory and developed new measurement tools. The theory has been developed by a diverse group of collaborators and popularized in Haidt's book The Righteous Mind. The theory proposes that morality is "more than one thing", first arguing for five foundations, and later expanding for six foundations :

Academic bias is the bias or perceived bias of scholars allowing their beliefs to shape their research and the scientific community. It can refer to several types of scholastic prejudice, e.g., logocentrism, phonocentrism, ethnocentrism or the belief that some sciences and disciplines rank higher than others.

The Good Judgment Project (GJP) is an organization dedicated to "harnessing the wisdom of the crowd to forecast world events". It was co-created by Philip E. Tetlock, decision scientist Barbara Mellers, and Don Moore, all professors at the University of Pennsylvania.

Debiasing is the reduction of bias, particularly with respect to judgment and decision making. Biased judgment and decision making is that which systematically deviates from the prescriptions of objective standards such as facts, logic, and rational behavior or prescriptive norms. Biased judgment and decision making exists in consequential domains such as medicine, law, policy, and business, as well as in everyday life. Investors, for example, tend to hold onto falling stocks too long and sell rising stocks too quickly. Employers exhibit considerable discrimination in hiring and employment practices, and some parents continue to believe that vaccinations cause autism despite knowing that this link is based on falsified evidence. At an individual level, people who exhibit less decision bias have more intact social environments, reduced risk of alcohol and drug use, lower childhood delinquency rates, and superior planning and problem solving abilities.

Intergroup relations refers to interactions between individuals in different social groups, and to interactions taking place between the groups themselves collectively. It has long been a subject of research in social psychology, political psychology, and organizational behavior.

References

  1. Tetlock, Phil. "CV" (PDF).
  2. Tetlock, P.E. (2006-08-20). Expert political judgment: How good is it? How can we know?. Princeton University Press. ISBN   978-0-691-12871-9.
  3. 1 2 3 Tetlock, P.E.; Mellers, B.; Rohrbaugh, N.; Chen, E. (2014). "Forecasting tournaments: Tools for increasing transparency and the quality of debate". Current Directions in Psychological Science. 23 (4): 290–295. doi:10.1177/0963721414534257. S2CID   145516680.
  4. 1 2 3 4 Mellers, B.A.; Stone, E.; Murray, T.; Minster, A.; Rohrbaugh, N.; Bishop, M.; Chen, E.; Baker, J.; Hou, Y.; Horowitz, M.; Ungar, L.; Tetlock, P.E. (2015). "Identifying and Cultivating "Superforecasters" as a Method of Improving Probabilistic Predictions". Perspectives on Psychological Science. 10 (3): 267–281. doi:10.1177/1745691615577794. PMID   25987508. S2CID   3118872.
  5. 1 2 Mellers, B.A.; Ungar, L.; Fincher, K.; Horowitz, M.; Atanasov, P.; Swift, S.; Murray, T.; Tetlock, P. (2015). "The Psychology of Intelligence Analysis: Drivers of Prediction Accuracy in World Politics". Journal of Experimental Psychology: Applied. 21 (1): 1–14. CiteSeerX   10.1.1.692.9459 . doi:10.1037/xap0000040. PMID   25581088.
  6. 1 2 Mellers, B.A.; Ungar, L.; Baron, J.; Ramos, J.; Gurcay, B.; Fincher, K.; Scott, S.; Moore, D.; Atanasov, P.; Swift, S.; Murray, T.; Tetlock, P. (2014). "Psychological strategies for winning a geopolitical tournament". Psychological Science. 25 (5): 1106–1115. CiteSeerX   10.1.1.720.2899 . doi:10.1177/0956797614524255. PMID   24659192. S2CID   42143367.
  7. 1 2 Satopaa, V.A.; Baron, J.; Foster, D.P.; Mellers, B.A.; Tetlock, P.E.; Ungar, L.H. (2014). "Combining multiple probability predictions using a simple Logit model". International Journal of Forecasting. 30 (2): 344–356. doi:10.1016/j.ijforecast.2013.09.009.
  8. 1 2 Baron, J.; Ungar, L.; Mellers, B.; Tetlock, P.E. (2014). "Two reasons to make aggregated probabilities more extreme". Decision Analysis. 11 (2): 133–145. doi:10.1287/deca.2014.0293.
  9. 1 2 3 Tetlock, P.E.; Gardner, D. (2015). Superforecasting: The Art and Science of Prediction. New York: Crown.
  10. 1 2 Tetlock, P.E.; Mellers, B.A. (2011). "Intelligent management of intelligence agencies: Beyond accountability ping-pong". American Psychologist. 66 (6): 542–554. CiteSeerX   10.1.1.353.3318 . doi:10.1037/a0024285. PMID   21823782.
  11. Tetlock, P.E. (2009). "Playing tarot on K Street". The National Interest (Sept–Oct): 57–67.
  12. Forecasting Research Institute, Wikidata   Q122208275
  13. Ezra Karger; Josh Rosenberg; Zachary G Jacobs; et al. (8 August 2023), Forecasting Existential Risks: Evidence from a Long-Run Forecasting Tournament (PDF), Wikidata   Q122208144
  14. 1 2 Tetlock, P.E. (1985). "Accountability: The neglected social context of judgment and choice". Research in Organizational Behavior. 7: 297–332.
  15. Tetlock, P.E. (1992). "The impact of accountability on judgment and choice: Toward a social contingency model". Advances in Experimental Social Psychology. 25: 331–376. doi:10.1016/S0065-2601(08)60287-7. ISBN   9780120152254.
  16. Lerner, J.; Tetlock, P.E. (1999). "Accounting for the effects of accountability". Psychological Bulletin. 125 (2): 255–275. doi:10.1037/0033-2909.125.2.255. PMID   10087938. S2CID   18195061.
  17. Tetlock, P.E.; Mitchell, G. (2009). "Implicit bias and accountability systems: What must organizations do to prevent discrimination". Research in Organizational Behavior. 29: 3–38. doi:10.1016/j.riob.2009.10.002.
  18. Mitchell, P.G.; Tetlock, P.E. (2006). "Anti-discrimination law and the perils of mind reading". The Ohio State University Law Review. 67: 1023–1121.
  19. Tetlock, P.E.; Vieider, F.; Patil, S.V.; Grant, A. (2013). "Accountability and ideology: When left looks right and right looks left". Organizational Behavior and Human Decision Processes. 122: 22–35. doi:10.1016/j.obhdp.2013.03.007.
  20. Tetlock, P.E. (2000). "Cognitive biases and organizational correctives: Do both disease and cure depend on the ideological beholder?". Administrative Science Quarterly. 45 (2): 293–326. doi:10.2307/2667073. JSTOR   2667073. S2CID   58924766.
  21. Tetlock, P.E. (2002). "Social-functionalist frameworks for judgment and choice: The intuitive politician, theologian, and prosecutor". Psychological Review. 109 (3): 451–472. doi:10.1037/0033-295x.109.3.451. PMID   12088240.
  22. Tetlock, P.E.; Peterson, R.; Lerner, J. (2009). "Revising the value pluralism model: Incorporating social content and context postulates". Ontario Symposium on Social and Personality Psychology: Values.
  23. Tetlock, P.E.; Kristel, O.; Elson, B.; Green, M.; Lerner, J. (2000). "The psychology of the unthinkable: Taboo trade-offs, forbidden base rates, and heretical counterfactuals". Journal of Personality and Social Psychology. 78 (5): 853–870. CiteSeerX   10.1.1.126.6275 . doi:10.1037/0022-3514.78.5.853. PMID   10821194.
  24. Fiske, A.; Tetlock, P.E. (1997). "Taboo trade-offs: Reactions to transactions that transgress spheres of justice". Political Psychology. 18 (2): 255–297. doi:10.1111/0162-895x.00058.
  25. Tetlock, P.E. (2003). "Thinking about the unthinkable: Coping with secular encroachments on sacred values". Trends in Cognitive Sciences. 7 (7): 320–324. CiteSeerX   10.1.1.455.71 . doi:10.1016/s1364-6613(03)00135-9. PMID   12860191. S2CID   8532142.
  26. Schoemaker, P.; Tetlock, P.E. (2011). "Taboo scenarios: How to think about the unthinkable". California Management Review. 54 (2): 5–24. doi:10.1525/cmr.2012.54.2.5. S2CID   157853775.
  27. McGraw, P.; Schwartz, J.; Tetlock, P.E. (2012). "From the commercial to the communal: Reframing taboo trade-offs in religious and pharmaceutical marketing". Journal of Consumer Research. 39: 157–173. doi:10.1086/662070.
  28. McGraw, P.; Tetlock, P.E. (2005). "Taboo trade-offs, relational framing, and the acceptability of exchanges". Journal of Consumer Psychology. 15 (1): 35–38. CiteSeerX   10.1.1.590.1956 . doi:10.1207/s15327663jcp1501_2. S2CID   14394449.
  29. McGraw, P.; Tetlock, P.E.; Kristel, O. (2003). "The limits of fungibility: Relational schemata and the value of things". Journal of Consumer Research. 30 (2): 219–229. CiteSeerX   10.1.1.169.909 . doi:10.1086/376805. S2CID   6181783.
  30. Fincher, K.; Tetlock, P.E. (2015). "Brutality Under Cover of Ambiguity: Activating, Perpetuating and De-Activating Covert Retributivism". Personality and Social Psychology Bulletin. 41 (5): 629–642. doi:10.1177/0146167215571090. PMID   25758706. S2CID   8228107.
  31. Tetlock, P.E. (2007). "Psychology and politics: The challenges of integrating levels of analysis in social science". Social Psychology: Handbook of Basic Principles.
  32. Tetlock, P.E. (1998). "Social psychology and world politics". Handbook of Social Psychology.
  33. Tetlock, P.E. (1984). "Cognitive style and political belief systems in the British House of Commons". Journal of Personality and Social Psychology. 46 (2): 365–375. doi:10.1037/0022-3514.46.2.365.
  34. Tetlock, P.E. (1986). "A value pluralism model of ideological reasoning". Journal of Personality and Social Psychology. 50 (4): 819–827. doi:10.1037/0022-3514.50.4.819.
  35. Sniderman, P.M.; Tetlock, P.E. (1986). "Symbolic racism: Problems of motive attribution in political analysis". Journal of Social Issues. 42 (2): 129–150. doi:10.1111/j.1540-4560.1986.tb00229.x.
  36. Arkes, H.; Tetlock, P.E. (2004). "Arkes, H., & Tetlock, P.E. (2004) Attributions of implicit prejudice, or "Would Jesse Jackson 'fail' the Implicit Association Test?"". Psychological Inquiry. 15 (4): 257–278. CiteSeerX   10.1.1.372.2454 . doi:10.1207/s15327965pli1504_01. S2CID   9834343.
  37. Oswald, F.; Mitchell, G.; Blanton, H.; Jaccard, J.; Tetlock, P. (2013). "Predicting ethnic and racial discrimination: A meta-analysis of IAT research". Journal of Personality and Social Psychology. 105 (2): 171–192. doi:10.1037/a0032734. PMID   23773046.
  38. Oswald, F.; Mitchell, G.; Blanton, H.; Jaccard, J.; Tetlock, P.E. (2015). "Using the IAT to predict ethnic and racial discrimination: Small effect sizes of unknown societal significance". Journal of Personality and Social Psychology. 108 (4): 562–571. doi:10.1037/pspa0000023. PMID   25844574.
  39. Tetlock, P.E.; Mitchell, P.G.; Anastasopoulos, J. (2013). "Detecting and punishing unconscious bias". The Journal of Legal Studies. 42: 83–110. doi:10.1086/668403. S2CID   51690723.
  40. Duarte, J.; Crawford, J.; Jussim, L.; Haidt, J.; Stern, C.; Tetlock, P.E. (2014). "Ideological diversity will improve social psychological science". Behavioral and Brain Sciences. 38: e130. doi:10.1017/s0140525x14000430. PMID   25036715.
  41. Duarte, J.; Crawford, J.; Jussim, L.; Haidt, J.; Stern, C.; Tetlock, P.E. (2014). "A Reply to the Commentaries". Behavioral and Brain Sciences. 38: e164. doi:10.1017/S0140525X15000035. PMID   26816000. S2CID   206263185.
  42. Tetlock, P.E. (1994). "Political psychology or politicized psychology: Is the road to scientific hell paved with good moral intentions?". Political Psychology. 15 (3): 509–530. doi:10.2307/3791569. JSTOR   3791569.
  43. Tetlock, P.E.; Mitchell, P.G. (1993). "Liberal and conservative approaches to justice: Conflicting psychological portraits". Psychological Perspectives on Justice: 234–256. doi:10.1017/CBO9780511552069.012. ISBN   9780521431996.
  44. Tetlock, P.E.; Armor, D.; Peterson, R. (1994). "Tetlock, P.E., Armor, D., & Peterson, R. (1994). The slavery debate in antebellum America: Cognitive style, value conflict, and the limits of compromise". Journal of Personality and Social Psychology. 66: 115–126. doi:10.1037/0022-3514.66.1.115. S2CID   53075954.
  45. Mitchell, G.; Tetlock, P.E. (2009). "Disentangling reasons and rationalizations: Exploring perceived fairness in hypothetical societies". In John T. Jost; Aaron C. Kay; Hulda Thorisdottir (eds.). Social and Psychological Bases of Ideology and System Justification. Oxford University Press. pp. 126–157. doi:10.1093/acprof:oso/9780195320916.003.006. ISBN   978-0-19-532091-6.
  46. Mitchell, P.G.; Tetlock, P.E.; Newman, D.; Lerner, J. (2003). "Experiments behind the veil: A hypothetical societies approach to the study of social justice". Political Psychology. 24 (3): 519–547. CiteSeerX   10.1.1.189.4635 . doi:10.1111/0162-895x.00339.
  47. Mitchell, P.G.; Tetlock, P.E.; Mellers, B.A.; Ordonez, L. (1993). "Judgments of social justice: Compromises between equality and efficiency". Journal of Personality and Social Psychology. 65 (4): 629–639. CiteSeerX   10.1.1.493.302 . doi:10.1037/0022-3514.65.4.629.
  48. Skitka, L.; Tetlock, P.E. (1993). "Providing public assistance: Cognitive and motivational processes underlying liberal and conservative policy preferences". Journal of Personality and Social Psychology. 65 (6): 1205–1224. CiteSeerX   10.1.1.500.6248 . doi:10.1037/0022-3514.65.6.1205.
  49. Skitka, L.; Tetlock, P.E. (1992). "Allocating scarce resources: A contingency model of distributive justice". Journal of Experimental Social Psychology. 28 (6): 491–522. doi:10.1016/0022-1031(92)90043-j.