Outcome primacy

Last updated

'Outcome primacy' is a psychological phenomenon that describes lasting effects on a subject's behavior based on the outcome of first experiences with a given task or decision. [1] It was found that this outcome primacy can account for much of the underweighting of rare events in experience based decisions, [2] where participants apparently underestimate small probabilities (in contrast to prospect theory where people tend to overestimate low probabilities, when lotteries are described).

Contents

Modelling

Behaviour in this task can be modelled using a standard, model-free reinforcement learning algorithm. In this model, the values of the different actions are learned over time and are used to determine the next action according to a predefined action-selection rule. It was shown that a substantial effect of first experience on behaviour is consistent with the reinforcement learning model if one assumes that the outcome of first experience resets the values of the experienced actions, but not if symmetric initial conditions are assumed. Moreover, the predictive power of the resetting model outperforms previously published [3] models regarding the aggregate choice behaviour.

Relation to other form of primacy

These findings suggest that first experience has a disproportionately large effect on subsequent actions, similar to primacy effects in other fields of cognitive psychology, such as in the application of the serial position effect. The mechanism of resetting of the initial conditions that underlies outcome primacy may thus also account for other forms of primacy.

Related Research Articles

A heuristic, or heuristic technique, is any approach to problem solving or self-discovery that employs a practical method that is not guaranteed to be optimal, perfect, or rational, but is nevertheless sufficient for reaching an immediate, short-term goal or approximation. Where finding an optimal solution is impossible or impractical, heuristic methods can be used to speed up the process of finding a satisfactory solution. Heuristics can be mental shortcuts that ease the cognitive load of making a decision.

<span class="mw-page-title-main">Prospect theory</span> Theory of behavioral economics and behavioral finance

Prospect theory is a theory of behavioral economics, judgment and decision making that was developed by Daniel Kahneman and Amos Tversky in 1979. The theory was cited in the decision to award Kahneman the 2002 Nobel Memorial Prize in Economics.

Social learning is a theory of learning process social behavior which proposes that new behaviors can be acquired by observing and imitating others. It states that learning is a cognitive process that takes place in a social context and can occur purely through observation or direct instruction, even in the absence of motor reproduction or direct reinforcement. In addition to the observation of behavior, learning also occurs through the observation of rewards and punishments, a process known as vicarious reinforcement. When a particular behavior is rewarded regularly, it will most likely persist; conversely, if a particular behavior is constantly punished, it will most likely desist. The theory expands on traditional behavioral theories, in which behavior is governed solely by reinforcements, by placing emphasis on the important roles of various internal processes in the learning individual.

Hindsight bias, also known as the knew-it-all-along phenomenon or creeping determinism, is the common tendency for people to perceive past events as having been more predictable than they were.

<span class="mw-page-title-main">Loss aversion</span> Overall description of loss aversion theory

Loss aversion is a psychological and economic concept which refers to how outcomes are interpreted as gains and losses where losses are subject to more sensitivity in people's responses compared to equivalent gains acquired. Kahneman and Tversky (1992) have suggested that losses can be twice as powerful, psychologically, as gains. When defined in terms of the utility function shape as in the cumulative prospect theory (CPT), losses have a steeper utility than gains, thus being more "painful" than the satisfaction from a comparable gain as shown in Figure 1. Loss aversion was first proposed by Amos Tversky and Daniel Kahneman as an important framework for prospect theory – an analysis of decision under risk.

The conjunction fallacy is an inference that a conjoint set of two or more specific conclusions is likelier than any single member of that same set, in violation of the laws of probability. It is a type of formal fallacy.

The recognition heuristic, originally termed the recognition principle, has been used as a model in the psychology of judgment and decision making and as a heuristic in artificial intelligence. The goal is to make inferences about a criterion that is not directly accessible to the decision maker, based on recognition retrieved from memory. This is possible if recognition of alternatives has relevance to the criterion. For two alternatives, the heuristic is defined as:

If one of two objects is recognized and the other is not, then infer that the recognized object has the higher value with respect to the criterion.

<span class="mw-page-title-main">Gerd Gigerenzer</span> German cognitive psychologist

Gerd Gigerenzer is a German psychologist who has studied the use of bounded rationality and heuristics in decision making. Gigerenzer is director emeritus of the Center for Adaptive Behavior and Cognition (ABC) at the Max Planck Institute for Human Development and director of the Harding Center for Risk Literacy, both in Berlin.

Serial-position effect is the tendency of a person to recall the first and last items in a series best, and the middle items worst. The term was coined by Hermann Ebbinghaus through studies he performed on himself, and refers to the finding that recall accuracy varies as a function of an item's position within a study list. When asked to recall a list of items in any order, people tend to begin recall with the end of the list, recalling those items best. Among earlier list items, the first few items are recalled more frequently than the middle items.

Daniel G. Goldstein is an American cognitive psychologist known for the specification and testing of heuristics and models of bounded rationality in the field of judgment and decision making. He is an honorary research fellow at London Business School and works with Microsoft Research as a principal researcher.

Decision field theory (DFT) is a dynamic-cognitive approach to human decision making. It is a cognitive model that describes how people actually make decisions rather than a rational or normative theory that prescribes what people should or ought to do. It is also a dynamic model of decision making rather than a static model, because it describes how a person's preferences evolve across time until a decision is reached rather than assuming a fixed state of preference. The preference evolution process is mathematically represented as a stochastic process called a diffusion process. It is used to predict how humans make decisions under uncertainty, how decisions change under time pressure, and how choice context changes preferences. This model can be used to predict not only the choices that are made but also decision or response times.

In psychology, a fluency heuristic is a mental heuristic in which, if one object is processed more fluently, faster, or more smoothly than another, the mind infers that this object has the higher value with respect to the question being considered. In other words, the more skillfully or elegantly an idea is communicated, the more likely it is to be considered seriously, whether or not it is logical.

Heuristics is the process by which humans use mental shortcuts to arrive at decisions. Heuristics are simple strategies that humans, animals, organizations, and even machines use to quickly form judgments, make decisions, and find solutions to complex problems. Often this involves focusing on the most relevant aspects of a problem or situation to formulate a solution. While heuristic processes are used to find the answers and solutions that are most likely to work or be correct, they are not always right or the most accurate. Judgments and decisions based on heuristics are simply good enough to satisfy a pressing need in situations of uncertainty, where information is incomplete. In that sense they can differ from answers given by logic and probability.

In psychology, economics and philosophy, preference is a technical term usually used in relation to choosing between alternatives. For example, someone prefers A over B if they would rather choose A than B. Preferences are central to decision theory because of this relation to behavior. Some methods such as Ordinal Priority Approach use preference relation for decision-making. As connative states, they are closely related to desires. The difference between the two is that desires are directed at one object while preferences concern a comparison between two alternatives, of which one is preferred to the other.

The rhyme-as-reason effect, or Eaton–Rosen phenomenon, is a cognitive bias whereupon a saying or aphorism is judged as more accurate or truthful when it is rewritten to rhyme.

Heuristics are simple decision making strategies used to achieve a specific goal quickly and efficiently, and are commonly implemented in sports. Many sports require the ability to make fast decisions under time pressure, and the proper use of heuristics is essential for many of these decisions.

Social heuristics are simple decision making strategies that guide people's behavior and decisions in the social environment when time, information, or cognitive resources are scarce. Social environments tend to be characterised by complexity and uncertainty, and in order to simplify the decision-making process, people may use heuristics, which are decision making strategies that involve ignoring some information or relying on simple rules of thumb.

The description-experience gap is a phenomenon in experimental behavioral studies of decision making. The gap refers to the observed differences in people's behavior depending on whether their decisions are made towards clearly outlined and described outcomes and probabilities or whether they simply experience the alternatives without having any prior knowledge of the consequences of their choices.

The priority heuristic is a simple, lexicographic decision strategy that correctly predicts classic violations of expected utility theory such as the Allais paradox, the four-fold pattern, the certainty effect, the possibility effect, or intransitivities.

<span class="mw-page-title-main">Ralph Hertwig</span> German psychologist

Ralph Hertwig is a German psychologist whose work focuses on the psychology of human judgment and decision making. Hertwig is Director of the Center for Adaptive Rationality at the Max Planck Institute for Human Development in Berlin, Germany. He grew up with his brothers Steffen Hertwig and Michael Hertwig in Talheim, Heilbronn.

References

  1. Shteingart, Hanan; Tal Neiman; Yonatan Loewenstein (2013). "The Role of First Impression in Operant Learning" (PDF). Journal of Experimental Psychology: General. 142 (2): 476–488. doi:10.1037/a0029550. PMID   22924882. Archived from the original (PDF) on 2013-10-06. Retrieved 2013-09-14.
  2. Hertwig Barron; Weber Erev (2004). "Decisions from experience and the effect of rare events in risky choice" (PDF). Psychological Science. 15 (8): 534–539. doi:10.1111/j.0956-7976.2004.00715.x. hdl: 11858/00-001M-0000-002E-57CE-F . PMID   15270998. S2CID   12977034.
  3. Erev, Ido; Ert, Eyal; Roth, Alvin E.; Haruvy, Ernan; Herzog, Stefan M.; Hau, Robin; Hertwig, Ralph; Stewart, Terrence; West, Robert; Lebiere, Christian (2010). "A choice prediction competition: Choices from experience and from description" (PDF). Journal of Behavioral Decision Making. 23 (1): 15–47. doi:10.1002/bdm.683. hdl: 11858/00-001M-0000-002E-579F-8 . ISSN   0894-3257.