Take-the-best heuristic

Last updated

In psychology, the take-the-best heuristic [1] is a heuristic (a simple strategy for decision-making) which decides between two alternatives by choosing based on the first cue that discriminates them, where cues are ordered by cue validity (highest to lowest). In the original formulation, the cues were assumed to have binary values (yes or no) or have an unknown value. The logic of the heuristic is that it bases its choice on the best cue (reason) only and ignores the rest.

Contents

Psychologists Gerd Gigerenzer and Daniel Goldstein discovered that the heuristic did surprisingly well at making accurate inferences in real-world environments, such as inferring which of two cities is larger. The heuristic has since been modified and applied to domains from medicine, artificial intelligence, and political forecasting. [2] [3] It has also been shown that the heuristic can accurately model how experts, such as airport customs officers [4] and professional burglars, make decisions. [5] The heuristic can also predict details of the cognitive process, such as number of cues used and response times, often better than complex models that integrate all available cues; [6] [7] as such, it is an example of the less-is-more effect.

One-reason decision-making

Theories of decision making typically assume that all relevant reasons (features or cues) are searched and integrated into a final decision. Yet under uncertainty (as opposed to risk), the relevant cues are typically not all known, nor are their precise weights and the correlations between cues. In these situations, relying only on the best cue available may be a reasonable alternative that allows for fast, frugal, and accurate decisions. This is the logic of a class of heuristics known as "one-reason decision making," which includes take-the-best. [8] Consider cues with binary values (0, 1), where 1 indicates the cue value that is associated with a higher criterion value. The task is to infer which of two alternatives has the higher criterion value. An example is which of two NBA teams will win the game, based on cues such as home match and who won the last match. The take-the-best heuristic entails three steps to make such an inference: [9]

Search rule: Look through cues in the order of their validity.

Stopping rule: Stop search when the first cue is found where the values of the two alternatives differ.

Decision rule: Predict that the alternative with the higher cue value has the higher value on the outcome variable.

The validity v of a cue is given by v = C/(C+W), where C is the number of correct inferences when a cue discriminates, and W is the number of wrong inferences, all estimated from samples.

Take-the-best for the comparison task

Consider the task to infer which object, A or B, has a higher value on a numerical criterion. As an example imagine someone having to judge whether the German city of Cologne has a larger population than the other German city of Stuttgart. This judgment or inference has to be based on information provided by binary cues, like "Is the city a state capital?". From a formal point of view, the task is a categorization: A pair (A, B) is to be categorized as XA > XB or XB > XA (where X denotes the criterion), based on cue information.

Cues are binary; this means they assume two values and can be modeled, for instance, as having the values 0 and 1 (for "yes" and "no"). They are ranked according to their cue validity, defined as the proportion of correct comparisons among the pairs A and B, for which it has different values, i.e., for which it discriminates between A and B. Take-the-best analyses each cue, one after the other, according to the ranking by validity and stopping the first time a cue discriminates between the items and concluding that the item with the larger value has also a larger value on the criterion.

The matrix of all objects of the reference class, from which A and B have been taken, and of the cue values which describe these objects constitutes a so-called environment. Gigerenzer and Goldstein, who introduced take-the-best (see Gerd Gigerenzer and Daniel Goldstein, D. G. (1996) [10] ) considered, as a walk-through example, precisely pairs of German cities. yet only those with more than 100.000 inhabitants. The comparison task for a given pair (A,B) of German cities in the reference class, consisted in establishing which one has a larger population, based on nine cues. Cues were binary-valued, such as whether the city is a state capital or whether it has a soccer team in the national league.

The cue values could modeled by 1s (for "yes") and 0s (for "no") so that each city could be identified with its "cue profile", i.e., e vector of 1s and 0s, ordered according to the ranking of cues.

The question was: How can one infer which of two objects, for example, city A with cue profile (100101010) and city B with cue profile (100010101), scores higher on the established criterion, i.e., population size? The take-the-best heuristic simply compares the profiles lexicographically, just as numbers written in base two are compared: the first cue value is 1 for both, which means that the first cue does not discriminate between A and B. The second cue value is 0 for both, again with no discrimination. The same happens for the third cue value, while the fourth cue value is 1 for A and 0 for B, implying that A is judged as having a higher value on the criterion. In other words, XA > XB if and only if (100101010) > (100010101) .

Mathematically this means that the cues found for the comparison allow a quasi-order isomorphism between the objects compared on the criterion, in this case cities with their populations, and their corresponding binary vectors. Here "quasi" means that the isomorphism is, in general, not perfect, because the set of cues is not perfect.

What is surprising is that this simple heuristic has a great performance compared with other strategies. One obvious measure for establishing the performance of an inference mechanism is determined by the percentage of correct judgements. Furthermore, what matters most is not just the performance of the heuristic when fitting known data, but when generalizing from a known training set to new items.

Czerlinski, Goldstein and Gigerenzer compared several strategies with take-the-best: a simple tallying, or unit weight model (also called "Dawes' rule" in that literature), a weighted linear model on the cues weighted by their validities (also called "Franklin's rule" in that literature), linear regression, and Minimalist. Their results show the robustness of take-the-best in generalization.

Heuristic performance on the German city data set, generated with ggplot2 based on data in. See the steps to reproduce on CRAN. Models fit predict cities.png
Heuristic performance on the German city data set, generated with ggplot2 based on data in. See the steps to reproduce on CRAN.
Heuristic performance across 20 data sets from an illustration inside reference ndeg FIGURA-01.jpg
Heuristic performance across 20 data sets from an illustration inside reference n°

For example, consider the task of selecting the bigger city of two cities when

The percent correct was roughly 74% for regression, take-the-best, unit weight linear. More specifically, the scores were 74.3%, 74.2%, and 74.1%, so regression won by a small margin.

However, the paper also considered generalization (also known as out-of-sample prediction).

In this case, when 10,000 different random splits were used, regression had on average 71.9% correct, Take-the-best had 72.2% correct, and unit with linear had 71.4% correct. The take-the-best heuristic was more accurate than regression in this case. [13]

See also

Related Research Articles

<span class="mw-page-title-main">Cognitive bias</span> Systematic pattern of deviation from norm or rationality in judgment

A cognitive bias is a systematic pattern of deviation from norm or rationality in judgment. Individuals create their own "subjective reality" from their perception of the input. An individual's construction of reality, not the objective input, may dictate their behavior in the world. Thus, cognitive biases may sometimes lead to perceptual distortion, inaccurate judgment, illogical interpretation, and irrationality.

A heuristic, or heuristic technique, is any approach to problem solving or self-discovery that employs a practical method that is not guaranteed to be optimal, perfect, or rational, but is nevertheless sufficient for reaching an immediate, short-term goal or approximation. Where finding an optimal solution is impossible or impractical, heuristic methods can be used to speed up the process of finding a satisfactory solution. Heuristics can be mental shortcuts that ease the cognitive load of making a decision.

Bounded rationality is the idea that rationality is limited when individuals make decisions, and under these limitations, rational individuals will select a decision that is satisfactory rather than optimal.

The recognition heuristic, originally termed the recognition principle, has been used as a model in the psychology of judgment and decision making and as a heuristic in artificial intelligence. The goal is to make inferences about a criterion that is not directly accessible to the decision maker, based on recognition retrieved from memory. This is possible if recognition of alternatives has relevance to the criterion. For two alternatives, the heuristic is defined as:

If one of two objects is recognized and the other is not, then infer that the recognized object has the higher value with respect to the criterion.

<span class="mw-page-title-main">Gerd Gigerenzer</span> German cognitive psychologist

Gerd Gigerenzer is a German psychologist who has studied the use of bounded rationality and heuristics in decision making. Gigerenzer is director emeritus of the Center for Adaptive Behavior and Cognition (ABC) at the Max Planck Institute for Human Development and director of the Harding Center for Risk Literacy, both in Berlin.

Daniel G. Goldstein is an American cognitive psychologist known for the specification and testing of heuristics and models of bounded rationality in the field of judgment and decision making. He is an honorary research fellow at London Business School and works with Microsoft Research as a principal researcher.

The gaze heuristic is a heuristic used in directing correct motion to achieve a goal using one main variable. An example of the gaze heuristic is catching a ball. The gaze heuristic is one example of psychologist Gerd Gigerenzer's one good reason heuristic, where human animals and non-human animals are able to process large amounts of information quickly and react, regardless of whether the information is consciously processed.

The psychology of reasoning is the study of how people reason, often broadly defined as the process of drawing conclusions to inform how people solve problems and make decisions. It overlaps with psychology, philosophy, linguistics, cognitive science, artificial intelligence, logic, and probability theory.

Heuristics is the process by which humans use mental shortcuts to arrive at decisions. Heuristics are simple strategies that humans, animals, organizations, and even machines use to quickly form judgments, make decisions, and find solutions to complex problems. Often this involves focusing on the most relevant aspects of a problem or situation to formulate a solution. While heuristic processes are used to find the answers and solutions that are most likely to work or be correct, they are not always right or the most accurate. Judgments and decisions based on heuristics are simply good enough to satisfy a pressing need in situations of uncertainty, where information is incomplete. In that sense they can differ from answers given by logic and probability.

The heuristic-systematic model of information processing (HSM) is a widely recognized model by Shelly Chaiken that attempts to explain how people receive and process persuasive messages. The model states that individuals can process messages in one of two ways: heuristically or systematically. Whereas systematic processing entails careful and deliberative processing of a message, heuristic processing entails the use of simplifying decision rules or ‘heuristics’ to quickly assess the message content. The guiding belief with this model is that individuals are more apt to minimize their use of cognitive resources, thus affecting the intake and processing of messages. HSM predicts that processing type will influence the extent to which a person is persuaded or exhibits lasting attitude change. HSM is quite similar to the elaboration likelihood model, or ELM. Both models were predominantly developed in the early to mid-1980s and share many of the same concepts and ideas.

Heuristics are simple decision making strategies used to achieve a specific goal quickly and efficiently, and are commonly implemented in sports. Many sports require the ability to make fast decisions under time pressure, and the proper use of heuristics is essential for many of these decisions.

Social heuristics are simple decision making strategies that guide people's behavior and decisions in the social environment when time, information, or cognitive resources are scarce. Social environments tend to be characterised by complexity and uncertainty, and in order to simplify the decision-making process, people may use heuristics, which are decision making strategies that involve ignoring some information or relying on simple rules of thumb.

Ecological rationality is a particular account of practical rationality, which in turn specifies the norms of rational action – what one ought to do in order to act rationally. The presently dominant account of practical rationality in the social and behavioral sciences such as economics and psychology, rational choice theory, maintains that practical rationality consists in making decisions in accordance with some fixed rules, irrespective of context. Ecological rationality, in contrast, claims that the rationality of a decision depends on the circumstances in which it takes place, so as to achieve one's goals in this particular context. What is considered rational under the rational choice account thus might not always be considered rational under the ecological rationality account. Overall, rational choice theory puts a premium on internal logical consistency whereas ecological rationality targets external performance in the world. The term ecologically rational is only etymologically similar to the biological science of ecology.

In behavioural sciences, social rationality is a type of decision strategy used in social contexts, in which a set of simple rules is applied in complex and uncertain situations.

The less-is-more effect refers to the finding that heuristic decision strategies can yield more accurate judgments than alternative strategies that use more pieces of information. Understanding these effects is part of the study of ecological rationality.

<span class="mw-page-title-main">Laura Martignon</span> Colombian and Italian mathematician; lives in Germany

Laura Martignon is a Colombian and Italian professor and scientist. From 2003 until 2020 she served as a Professor of Mathematics and Mathematical Education at the Ludwigsburg University of Education. Until 2017 she was an Adjunct Scientist of the Max Planck Institute for Human Development in Berlin, where she previously worked as Senior Researcher. She also worked for ten years as a Mathematics Professor at the University of Brasilia and spent a period of one and a half years, as visiting scholar, at the Hebrew University of Jerusalem.

In the study of decision-making, a fast-and-frugal tree is a simple graphical structure that categorizes objects by asking one question at a time. These decision trees are used in a range of fields: psychology, artificial intelligence, and management science. Unlike other decision or classification trees, such as Leo Breiman's CART, fast-and-frugal trees are intentionally simple, both in their construction as well as their execution, and operate speedily with little information. For this reason, fast-and-frugal-trees are potentially attractive when designing resource-constrained tasks.

The priority heuristic is a simple, lexicographic decision strategy that correctly predicts classic violations of expected utility theory such as the Allais paradox, the four-fold pattern, the certainty effect, the possibility effect, or intransitivities.

<span class="mw-page-title-main">Ralph Hertwig</span> German psychologist

Ralph Hertwig is a German psychologist whose work focuses on the psychology of human judgment and decision making. Hertwig is Director of the Center for Adaptive Rationality at the Max Planck Institute for Human Development in Berlin, Germany. He grew up with his brothers Steffen Hertwig and Michael Hertwig in Talheim, Heilbronn.

Robin Miles Hogarth is a British-American psychologist and emeritus professor in the Department of Economics and Business at Universitat Pompeu Fabra in Barcelona, Spain. He has served as president of both the Society for Judgment and Decision Making and the European Association for Decision Making. His previous positions include ICREA Research Professor at Universitat Pompeu Fabra and Wallace W. Booth Professor of Behavioral Science at the University of Chicago.

References

  1. Gigerenzer, G. & Goldstein, D. G. (1996). "Reasoning the fast and frugal way: Models of bounded rationality". Psychological Review, 103, 650–669.
  2. Graefe, Andreas; Armstrong, J. Scott (2012). "Predicting elections from the most important issue: A test of the take‐the‐best heuristic". Journal of Behavioral Decision Making. 25 (1): 41–48. doi:10.1002/bdm.710.
  3. Czerlinski, J., Goldstein, D. G., & Gigerenzer, G. (1999). "How good are simple heuristics?" In Gigerenzer, G., Todd, P. M. & the ABC Group, Simple Heuristics That Make Us Smart. New York: Oxford University Press.
  4. Pachur, T. & Marinello, G. (2013). Expert intuitions: How to model the decision strategies of airport customs officers? Acta Psychologica, 144, 97–103.
  5. Garcia-Retamero, R., & Dhami, M. K. (2009). Take-the-best in expert-novice decision strategies for residential burglary. Psychonomic Bulletin & Review, 16, 163–169
  6. Bergert F. B., & Nosofsky, R. M. (2007). A response-time approach to comparing generalized rational and take-the-best models of decision making. Journal of Experimental Psychology: Learning, Memory and Cognition, 331, 107–129
  7. Bröder, A. (2012). The quest for take-the-best. In P. M. Todd, G. Gigerenzer, & the ABC Research Group, Ecological rationality: Intelligence in the world (pp. 216–240). New York: Oxford University Press
  8. Gigerenzer, G., & Gaissmaier, W. (2011). Heuristic decision making. Annual Review of Psychology, 62. 451–482
  9. Gigerenzer, G., & Goldstein, D. G. (1996). Reasoning the fast and frugal way: Models of bounded rationality. Psychological Review, 103, 650–669.
  10. Gigerenzer & Goldstein, 1996 – APA Psynet – Reasoning the fast and frugal way: Models of bounded rationality
  11. Czerlinski, J., Goldstein, D. G., & Gigerenzer, G. (1999). "How good are simple heuristics?" In Gigerenzer, G., Todd, P. M. & the ABC Group, Simple Heuristics That Make Us Smart. New York: Oxford University Press.
  12. MH. Martignon & Hoffrage (2002) – Fast, frugal, and fit: Simple heuristics for paired comparison
  13. Czerlinski, J., Goldstein, D. G., & Gigerenzer, G. (1999). "How good are simple heuristics?" In Gigerenzer, G., Todd, P. M. & the ABC Group, Simple Heuristics That Make Us Smart. New York: Oxford University Press.