Take-the-best heuristic

In psychology, the take-the-best heuristic ^[1] is a heuristic (a simple strategy for decision-making) which decides between two alternatives by choosing based on the first cue that discriminates them, where cues are ordered by cue validity (highest to lowest). In the original formulation, the cues were assumed to have binary values (yes or no) or have an unknown value. The logic of the heuristic is that it bases its choice on the best cue (reason) only and ignores the rest.

Psychologists Gerd Gigerenzer and Daniel Goldstein discovered that the heuristic did surprisingly well at making accurate inferences in real-world environments, such as inferring which of two cities is larger. The heuristic has since been modified and applied to domains from medicine, artificial intelligence, and political forecasting. ^{[2] [3]} The heuristic has been used to accurately model how experts, such as airport customs officers ^[4] and professional burglars, make decisions; ^[5] the model often makes better predictions of human behavior than more complex models that assume experts integrate all available cues. ^{[6] [7]}

One-reason decision-making

Theories of decision making typically assume that all relevant reasons (features or cues) are searched and integrated into a final decision. Yet under uncertainty (as opposed to risk), the relevant cues are typically not all known, nor are their precise weights and the correlations between cues. In these situations, relying only on the best cue available may be a reasonable alternative that allows for fast, frugal, and accurate decisions. This is the logic of a class of heuristics known as "one-reason decision making," which includes take-the-best. ^[8] Consider cues with binary values (0, 1), where 1 indicates the cue value that is associated with a higher criterion value. The task is to infer which of two alternatives has the higher criterion value. An example is which of two NBA teams will win the game, based on cues such as home match and who won the last match. The take-the-best heuristic entails three steps to make such an inference: ^[9]

Search rule: Look through cues in the order of their validity.

Stopping rule: Stop search when the first cue is found where the values of the two alternatives differ.

Decision rule: Predict that the alternative with the higher cue value has the higher value on the outcome variable.

The validity v of a cue is given by v = C/(C+W), where C is the number of correct inferences when a cue discriminates, and W is the number of wrong inferences, all estimated from samples.

Take-the-best for the comparison task

Consider the task to infer which object, A or B, has a higher value on a numerical criterion. As an example imagine someone having to judge whether the German city of Cologne has a larger population than the other German city of Stuttgart. This judgment or inference has to be based on information provided by binary cues, like "Is the city a state capital?". From a formal point of view, the task is a categorization: A pair (A, B) is to be categorized as X_A > X_B or X_B > X_A (where X denotes the criterion), based on cue information.

Cues are binary; this means they assume two values and can be modeled, for instance, as having the values 0 and 1 (for "yes" and "no"). They are ranked according to their cue validity, defined as the proportion of correct comparisons among the pairs A and B, for which it has different values, i.e., for which it discriminates between A and B. Take-the-best analyses each cue, one after the other, according to the ranking by validity and stopping the first time a cue discriminates between the items and concluding that the item with the larger value has also a larger value on the criterion.

The matrix of all objects of the reference class, from which A and B have been taken, and of the cue values which describe these objects constitutes a so-called environment. Gigerenzer and Goldstein, who introduced take-the-best (see Gerd Gigerenzer and Daniel Goldstein, D. G. (1996) ^[10] ) considered, as a walk-through example, precisely pairs of German cities. yet only those with more than 100,000 inhabitants. The comparison task for a given pair (A,B) of German cities in the reference class, consisted in establishing which one has a larger population, based on nine cues. Cues were binary-valued, such as whether the city is a state capital or whether it has a soccer team in the national league.

The cue values could be modeled by 1s (for "yes") and 0s (for "no") so that each city could be identified with its "cue profile", i.e., a vector of 1s and 0s, ordered according to the ranking of cues.

The question was: How can one infer which of two objects, for example, city A with cue profile (100101010) and city B with cue profile (100010101), scores higher on the established criterion, i.e., population size? The take-the-best heuristic simply compares the profiles lexicographically, just as numbers written in base two are compared: the first cue value is 1 for both, which means that the first cue does not discriminate between A and B. The second cue value is 0 for both, again with no discrimination. The same happens for the third cue value, while the fourth cue value is 1 for A and 0 for B, implying that A is judged as having a higher value on the criterion. In other words, X_A > X_B if and only if (100101010) > (100010101) .

Mathematically this means that the cues found for the comparison allow a quasi-order isomorphism between the objects compared on the criterion, in this case cities with their populations, and their corresponding binary vectors. Here "quasi" means that the isomorphism is, in general, not perfect, because the set of cues is not perfect.

What is surprising is that this simple heuristic has a great performance compared with other strategies. One obvious measure for establishing the performance of an inference mechanism is determined by the percentage of correct judgements. Furthermore, what matters most is not just the performance of the heuristic when fitting known data, but when generalizing from a known training set to new items.

Czerlinski, Goldstein and Gigerenzer compared several strategies with take-the-best: a simple tallying, or unit weight model (also called "Dawes' rule" in that literature), a weighted linear model on the cues weighted by their validities (also called "Franklin's rule" in that literature), linear regression, and Minimalist. Their results show the robustness of take-the-best in generalization.

Heuristic performance on the German city data set, generated with ggplot2 based on data in. See the steps to reproduce on CRAN.

Heuristic performance across 20 data sets from an illustration inside reference n°

For example, consider the task of selecting the bigger city of two cities when

• Models are fit to a data set of 83 German cities
• Models select the bigger of a pair of cities for all 83*82/2 pairs of cities.

The percent correct was roughly 74% for regression, take-the-best, unit weight linear. More specifically, the scores were 74.3%, 74.2%, and 74.1%, so regression won by a small margin.

However, the paper also considered generalization (also known as out-of-sample prediction).

• Models are fit to a data set of a randomly-selected half of 83 German cities
• Models select the bigger of a pair of cities drawn from the other half of cities.

In this case, when 10,000 different random splits were used, regression had on average 71.9% correct, Take-the-best had 72.2% correct, and unit with linear had 71.4% correct. The take-the-best heuristic was more accurate than regression in this case. ^[13]

See also

• Greedy algorithm
• Recognition heuristic

References

1. Gigerenzer, G. & Goldstein, D. G. (1996). "Reasoning the fast and frugal way: Models of bounded rationality". Psychological Review, 103, 650–669.
2. Graefe, Andreas; Armstrong, J. Scott (2012). "Predicting elections from the most important issue: A test of the take‐the‐best heuristic". Journal of Behavioral Decision Making. 25 (1): 41–48. doi:10.1002/bdm.710.
3. Czerlinski, J., Goldstein, D. G., & Gigerenzer, G. (1999). "How good are simple heuristics?" In Gigerenzer, G., Todd, P. M. & the ABC Group, Simple Heuristics That Make Us Smart. New York: Oxford University Press.
4. Pachur, T. & Marinello, G. (2013). Expert intuitions: How to model the decision strategies of airport customs officers? Acta Psychologica, 144, 97–103.
5. Garcia-Retamero, R., & Dhami, M. K. (2009). Take-the-best in expert-novice decision strategies for residential burglary. Psychonomic Bulletin & Review, 16, 163–169
6. Bergert F. B., & Nosofsky, R. M. (2007). A response-time approach to comparing generalized rational and take-the-best models of decision making. Journal of Experimental Psychology: Learning, Memory and Cognition, 331, 107–129
7. Bröder, A. (2012). The quest for take-the-best. In P. M. Todd, G. Gigerenzer, & the ABC Research Group, Ecological rationality: Intelligence in the world (pp. 216–240). New York: Oxford University Press
8. Gigerenzer, G., & Gaissmaier, W. (2011). Heuristic decision making. Annual Review of Psychology, 62. 451–482
9. Gigerenzer, G., & Goldstein, D. G. (1996). Reasoning the fast and frugal way: Models of bounded rationality. Psychological Review, 103, 650–669.
10. Gigerenzer & Goldstein, 1996 – APA Psynet – Reasoning the fast and frugal way: Models of bounded rationality
11. Czerlinski, J., Goldstein, D. G., & Gigerenzer, G. (1999). "How good are simple heuristics?" In Gigerenzer, G., Todd, P. M. & the ABC Group, Simple Heuristics That Make Us Smart. New York: Oxford University Press.
12. MH. Martignon & Hoffrage (2002) – Fast, frugal, and fit: Simple heuristics for paired comparison
13. Czerlinski, J., Goldstein, D. G., & Gigerenzer, G. (1999). "How good are simple heuristics?" In Gigerenzer, G., Todd, P. M. & the ABC Group, Simple Heuristics That Make Us Smart. New York: Oxford University Press.