Motivating operation

Last updated

Motivating operation (MO) is a behavioristic concept introduced by Jack Michael in 1982. It is used to explain variations in the effects in the consequences of behavior. Most importantly, a MO affects how strongly the person is reinforced or punished by the consequences of their behavior. For example, food deprivation is a motivating operation; if a person is hungry, food is strongly reinforcing, but if a person is satiated, food is less reinforcing. [1] In 2003 Laraway suggested subdividing MOs into those that increase the reinforcing or punishing effects of a stimulus, which are termed establishing operations, and MOs that decrease the reinforcing or punishing effects of a stimulus, which are termed abolishing operations.

Contents

Theory

The concept of motivating operation deals with the observation that behavior depends not only on the stimuli present in the current situation and the organism's past experience with those stimuli, but also on the organism's recent past history of deprivation, satiation, pain, or other such influences. Such a past history can have two effects: it can change the value of a consequence by making it more or less reinforcing, and/or it can change the probability of behaviors that have produced that consequence. For example, food deprivation changes the value of food, making it more reinforcing, and it also evokes learned behaviors that have obtained food. Likewise, food satiation reduces both the reinforcing effect of food and the probability of food-getting behaviors.

Note that a motivating operation differs from a discriminative stimulus (Sd). A discriminative stimulus signals the availability of reinforcement, while a motivating operation changes the effectiveness of a reinforcer. [2]

Nine main unconditioned (i.e. not learned) motivating operations, have been identified in humans. Deprivation of food, water, sleep, activity, or oxygen; becoming too warm or too cold; and increase of a painful stimulus all function as establishing operations for related behaviors, and increase the effect of positive or negative reinforcement related to them. Conversely, being satiated with food, water, sleep, activity, oxygen and sex; getting cooler after being too warm or warmer after too cold; and decrease of a painful stimulus all function as abolishing operations for related behavior and reinforcement. [3]

There are also conditioned motivating operations that result from the learning history of the organism. Three kinds of conditioned operations have been identified: a surrogate, reflexive, and transitive. A surrogate MO has the same effect as the MO it was paired with when it was learned; a reflexive MO acts as a reinforcement when it is removed; a transitive MO make something else effective as reinforcement. [3] There is some debate as to whether an organism can be deprived or satiated from conditioned reinforcers.

Theoretical note

The concept of motivational operations has been applied to Maslow's hierarchy of needs [4] by describing the lower two levels as involving unconditioned MOs and the upper three levels as involving conditioned MOs.

Related Research Articles

Operant conditioning is a type of associative learning process through which the strength of a behavior is modified by reinforcement or punishment. It is also a procedure that is used to bring about such learning.

Classical conditioning refers to a learning procedure in which a biologically potent stimulus is paired with a previously neutral stimulus. It also refers to the learning process that results from this pairing, through which the neutral stimulus comes to elicit a response that is usually similar to the one elicited by the potent stimulus.

Reinforcement consequence that will strengthen an organisms future behavior whenever that behavior is preceded by a specific antecedent stimulus

In behavioral psychology, reinforcement is a consequence applied that will strengthen an organism's future behavior whenever that behavior is preceded by a specific antecedent stimulus. This strengthening effect may be measured as a higher frequency of behavior, longer duration, greater magnitude, or shorter latency. There are two types of reinforcement, known as positive reinforcement and negative reinforcement; positive is where by a reward is offered on expression of the wanted behaviour and negative is taking away an undesirable element in the persons environment whenever the desired behaviour is achieved. Rewarding stimuli, which are associated with "wanting" and "liking" and appetitive behavior, function as positive reinforcers; the converse statement is also true: positive reinforcers provide a desirable stimulus. Reinforcement does not require an individual to consciously perceive an effect elicited by the stimulus. Thus, reinforcement occurs only if there is an observable strengthening in behavior. However, there is also negative reinforcement, which is characterized by taking away an undesirable stimulus. Changing someone's job might serve as a negative reinforcer to someone who suffers from back problems, i.e. Changing from a labourers job to an office position for instance.

Motivation is the experience of desire or aversion. As such, motivation has both an objective aspect and an internal or subjective aspect.

The experimental analysis of behavior is school of thought in psychology founded on B. F. Skinner's philosophy of radical behaviorism and defines the basic principles used in applied behavior analysis. A central principle was the inductive reasoning data-driven examination of functional relations, as opposed to the kinds of hypothetico-deductive learning theory that had grown up in the comparative psychology of the 1920–1950 period. Skinner's approach was characterized by observation of measurable behavior which could be predicted and controlled. It owed its early success to the effectiveness of Skinner's procedures of operant conditioning, both in the laboratory and in behavior therapy.

Behaviorism is a systematic approach to understanding the behavior of humans and other animals. It assumes that behavior is either a reflex evoked by the pairing of certain antecedent stimuli in the environment, or a consequence of that individual's history, including especially reinforcement and punishment contingencies, together with the individual's current motivational state and controlling stimuli. Although behaviorists generally accept the important role of heredity in determining behavior, they focus primarily on environmental events.

Motivational salience is a cognitive process and a form of attention that motivates or propels an individual's behavior towards or away from a particular object, perceived event or outcome. Motivational salience regulates the intensity of behaviors that facilitate the attainment of a particular goal, the amount of time and energy that an individual is willing to expend to attain a particular goal, and the amount of risk that an individual is willing to accept while working to attain a particular goal.

Animal training teaching animals specific responses to specific conditions or stimuli

Animal training is the act of teaching animals specific responses to specific conditions or stimuli. Training may be for purposes such as companionship, detection, protection, and entertainment. The type of training an animal receives will vary depending on the training method used, and the purpose for training the animal. For example, a seeing eye dog will be trained to achieve a different goal than a wild animal in a circus.

Shaping is a conditioning paradigm used primarily in the experimental analysis of behavior. The method used is differential reinforcement of successive approximations. It was introduced by B. F. Skinner with pigeons and extended to dogs, dolphins, humans and other species. In shaping, the form of an existing response is gradually changed across successive trials towards a desired target behavior by reinforcing exact segments of behavior. Skinner's explanation of shaping was this:

We first give the bird food when it turns slightly in the direction of the spot from any part of the cage. This increases the frequency of such behavior. We then withhold reinforcement until a slight movement is made toward the spot. This again alters the general distribution of behavior without producing a new unit. We continue by reinforcing positions successively closer to the spot, then by reinforcing only when the head is moved slightly forward, and finally only when the beak actually makes contact with the spot. ... The original probability of the response in its final form is very low; in some cases it may even be zero. In this way we can build complicated operants which would never appear in the repertoire of the organism otherwise. By reinforcing a series of successive approximations, we bring a rare response to a very high probability in a short time. ... The total act of turning toward the spot from any point in the box, walking toward it, raising the head, and striking the spot may seem to be a functionally coherent unit of behavior; but it is constructed by a continual process of differential reinforcement from undifferentiated behavior, just as the sculptor shapes his figure from a lump of clay.

Extinction is a behavioral phenomenon observed in both operantly conditioned and classically conditioned behavior, which manifests itself by fading of non-reinforced conditioned response over time. When operant behavior that has been previously reinforced no longer produces reinforcing consequences the behavior gradually stops occurring. In classical conditioning, when a conditioned stimulus is presented alone, so that it no longer predicts the coming of the unconditioned stimulus, conditioned responding gradually stops. For example, after Pavlov's dog was conditioned to salivate at the sound of a metronome, it eventually stopped salivating to the metronome after the metronome had been sounded repeatedly but no food came. Many anxiety disorders such as post traumatic stress disorder are believed to reflect, at least in part, a failure to extinguish conditioned fear.

In classical conditioning, the delay reduction hypothesis states that certain discriminative stimuli (DS) are more effective signals for conditioned reinforcers (CR) if they signal a decrease in time to a positive reinforcer or an increase in time to an aversive stimulus or punishment. This is often applied in chain link schedules, with the final link being the aversive stimulus or positive (unconditioned) reinforcer.

In operant conditioning, punishment is any change in a human or animal's surroundings which, occurring after a given behavior or response, reduces the likelihood of that behavior occurring again in the future. As with reinforcement, it is the behavior, not the human/animal, that is punished. Whether a change is or is not punishing is determined by its effect on the rate that the behavior occurs, not by any "hostile" or aversive features of the change. For example, a painful stimulus which would act as a punisher for most people may actually reinforce some behaviors of masochistic individuals.

Behavioral momentum is a theory in quantitative analysis of behavior and is a behavioral metaphor based on physical momentum. It describes the general relation between resistance to change and the rate of reinforcement obtained in a given situation.

In behavioral psychology, stimulus control is a phenomenon in operant conditioning that occurs when an organism behaves in one way in the presence of a given stimulus and another way in its absence. A stimulus that modifies behavior in this manner is either a discriminative stimulus (Sd) or stimulus delta (S-delta). Stimulus-based control of behavior occurs when the presence or absence of an Sd or S-delta controls the performance of a particular behavior. For example, the presence of a stop sign (S-delta) at a traffic intersection alerts the driver to stop driving and increases the probability that "braking" behavior will occur. Such behavior is said to be emitted because it does not force the behavior to occur since stimulus control is a direct result of historical reinforcement contingencies, as opposed to reflexive behavior that is said to be elicited through respondent conditioning.

Conditioned place preference a form of conditioning used to measure the motivational effects of objects or experiences

Conditioned place preference (CPP) is a form of Pavlovian conditioning used to measure the motivational effects of objects or experiences. By measuring the amount of time an animal spends in an area that has been associated with a stimulus, researchers can infer the animal's liking for the stimulus. This paradigm can also be used to measure conditioned place aversion with an identical procedure involving aversive stimuli instead. Both procedures usually involve mice or rats as subjects. This procedure can be used to measure extinction and reinstatement of the conditioned stimulus. Certain drugs are used in this paradigm to measure their reinforcing properties. Two different methods are used to choose the compartments to be conditioned, and these are biased vs. unbiased. The biased method allows the animal to explore the apparatus, and the compartment they least prefer is the one that the drug is administered in and the one they most prefer is the one where the vehicle is injected. This method allows the animal to choose the compartment they get the drug and vehicle in. In comparison, the unbiased method does not allow the animal to choose what compartment they get the drug and vehicle in and instead the researcher chooses the compartments.

James “Jim” A. Dinsmoor was an influential experimental psychologist who published work in the field of the experimental analysis of behavior. He was born October 4, 1921, in Woburn, Massachusetts to Daniel and Jean Dinsmoor. He graduated with his bachelor's degree from Dartmouth College in 1943. Subsequently, he attended Columbia University in New York City, where he received his Master's and Ph.D. degrees under the mentorship of William N. Schoenfeld and Fred S. Keller. There, he was introduced to the work of B.F. Skinner, whose behavior analytic research inspired Dinsmoor to pursue a lifetime of research in conditioned responding.

In learning theory, drive reduction theory is a type of motivational theory. Drive Reduction Theory, developed by Clark Hull in 1943, was a major theory for motivation in the Behaviorist tradition. Drive itself was defined as motivation that arose due to a psychological or physiological need; it has a variety of characteristics that include the intensifying or fueling of responses to a situation. As amount of drive is directly proportional to the intensity of the behavior that will result from it. It works as an internal stimulus that motivates the individual to move to sate the drive. Additionally, it has been described as an internal and instinctual process that moves individuals to take actions that would allow them to attain their desired goal or end-state. It can also be understood to be the result of a lack of something physiological, as opposed to psychological needs, which are inherent in humans.

An antecedent is a stimulus that cues an organism to perform a learned behavior. When an organism perceives an antecedent stimulus, it behaves in a way that maximizes reinforcing consequences and minimizes punishing consequences. This might be part of complex, interpersonal communication.

The three-term contingency in operant conditioning—or contingency management—describes the relationship between a behavior, its consequence, and the environmental context. The three-term contingency was first defined by B. F. Skinner in the early 1950s. It is often used within ABA to alter the frequency of socially significant human behavior.

Association in psychology refers to a mental connection between concepts, events, or mental states that usually stems from specific experiences. Associations are seen throughout several schools of thought in psychology including behaviorism, associationism, psychoanalysis, social psychology, and structuralism. The idea stems from Plato and Aristotle, especially with regard to the succession of memories, and it was carried on by philosophers such as John Locke, David Hume, David Hartley, and James Mill. It finds its place in modern psychology in such areas as memory, learning, and the study of neural pathways.

References

  1. Laraway, S., Snycerski, S., Michael, J., & Poling. (2003). Motivating operations and terms to describe them: some further refinements. Journal of Applied Behavior Analysis. 36. 407-414.
  2. Michael, J. (1982) Distinguishing between discriminative and motivational functions of stimuli. Journal of the Experimental Analysis of Behavior. 37. 149-155.
  3. 1 2 Cooper, John O (2007). Applied Behavior Analysis. Upper Saddle River, NJ, USA: Pearson Education. ISBN   0-13-129327-3.
  4. Maslow, A. (1943). A theory of human motivation. Psychological Review, Vol 50(4). 370-396. doi: 10.1037/40054346.