Group of neural structures responsible for motivation and desire
Examples of primary rewards.[1] Clockwise from top left: water, food, parental care, and sex.
The reward system (the mesocorticolimbic circuit) is a group of neural structures responsible for incentive salience (i.e., "wanting"; desire or craving for a reward and motivation), associative learning (primarily positive reinforcement and classical conditioning), and positively-valencedemotions, particularly ones involving pleasure as a core component (e.g., joy, euphoria and ecstasy).[2][3] Reward is the attractive and motivational property of a stimulus that induces appetitive behavior, also known as approach behavior, and consummatory behavior.[2] A rewarding stimulus has been described as "any stimulus, object, event, activity, or situation that has the potential to make us approach and consume it is by definition a reward".[2] In operant conditioning, rewarding stimuli function as positive reinforcers;[1] however, the converse statement also holds true: positive reinforcers are rewarding.[1][4]The reward system motivates animals to approach stimuli or engage in behaviour that increases fitness (sex, energy-dense foods, etc.). Survival for most animal species depends upon maximizing contact with beneficial stimuli and minimizing contact with harmful stimuli. Reward cognition serves to increase the likelihood of survival and reproduction by causing associative learning, eliciting approach and consummatory behavior, and triggering positively-valenced emotions.[1] Thus, reward is a mechanism that evolved to help increase the adaptive fitness of animals.[5] In drug addiction, certain substances over-activate the reward circuit, leading to compulsive substance-seeking behavior resulting from synaptic plasticity in the circuit.[6]
Primary rewards are a class of rewarding stimuli which facilitate the survival of one's self and offspring, and they include homeostatic (e.g., palatable food) and reproductive (e.g., sexual contact and parental investment) rewards.[2][7] Intrinsic rewards are unconditioned rewards that are attractive and motivate behavior because they are inherently pleasurable.[2] Extrinsic rewards (e.g., money or seeing one's favorite sports team winning a game) are conditioned rewards that are attractive and motivate behavior but are not inherently pleasurable.[2][8] Extrinsic rewards derive their motivational value as a result of a learned association (i.e., conditioning) with intrinsic rewards.[2] Extrinsic rewards may also elicit pleasure (e.g., euphoria from winning a lot of money in a lottery) after being classically conditioned with intrinsic rewards.[2]
Terms that are commonly used to describe behavior related to the "wanting" or desire component of reward include appetitive behavior, approach behavior, preparatory behavior, instrumental behavior, anticipatory behavior, and seeking.[9] Terms that are commonly used to describe behavior related to the "liking" or pleasure component of reward include consummatory behavior and taking behavior.[9]
The three primary functions of rewards are their capacity to:
Most of the dopamine pathways (i.e., neurons that use the neurotransmitterdopamine to communicate with other neurons) that project out of the ventral tegmental area are part of the reward system;[10] in these pathways, dopamine acts on D1-like receptors or D2-like receptors to either stimulate (D1-like) or inhibit (D2-like) the production of cAMP.[22] The GABAergicmedium spiny neurons of the striatum are components of the reward system as well.[10] The glutamatergic projection nuclei in the subthalamic nucleus, prefrontal cortex, hippocampus, thalamus, and amygdala connect to other parts of the reward system via glutamate pathways.[10] The medial forebrain bundle, which is a set of many neural pathways that mediate brain stimulation reward (i.e., reward derived from direct electrochemical stimulation of the lateral hypothalamus), is also a component of the reward system.[23]
Two theories exist with regard to the activity of the nucleus accumbens and the generation liking and wanting. The inhibition (or hyperpolarization) hypothesis proposes that the nucleus accumbens exerts tonic inhibitory effects on downstream structures such as the ventral pallidum, hypothalamus or ventral tegmental area, and that in inhibiting MSNs in the nucleus accumbens (NAcc), these structures are excited, "releasing" reward related behavior. While GABA receptoragonists are capable of eliciting both "liking" and "wanting" reactions in the nucleus accumbens, glutaminergic inputs from the basolateral amygdala, ventral hippocampus, and medial prefrontal cortex can drive incentive salience. Furthermore, while most studies find that NAcc neurons reduce firing in response to reward, a number of studies find the opposite response. This had led to the proposal of the disinhibition (or depolarization) hypothesis, that proposes that excitation or NAcc neurons, or at least certain subsets, drives reward related behavior.[3][24][25]
After nearly 50 years of research on brain-stimulation reward, experts have certified that dozens of sites in the brain will maintain intracranial self-stimulation. Regions include the lateral hypothalamus and medial forebrain bundles, which are especially effective. Stimulation there activates fibers that form the ascending pathways; the ascending pathways include the mesolimbic dopamine pathway, which projects from the ventral tegmental area to the nucleus accumbens. There are several explanations as to why the mesolimbic dopamine pathway is central to circuits mediating reward. First, there is a marked increase in dopamine release from the mesolimbic pathway when animals engage in intracranial self-stimulation.[5] Second, experiments consistently indicate that brain-stimulation reward stimulates the reinforcement of pathways that are normally activated by natural rewards, and drug reward or intracranial self-stimulation can exert more powerful activation of central reward mechanisms because they activate the reward center directly rather than through the peripheral nerves.[5][26][27] Third, when animals are administered addictive drugs or engage in naturally rewarding behaviors, such as feeding or sexual activity, there is a marked release of dopamine within the nucleus accumbens.[5] However, dopamine is not the only reward compound in the brain.
Key pathway
Diagram showing some of the key components of the mesocorticolimbic ("reward") circuit
Ventral tegmental area
The ventral tegmental area (VTA) is important in responding to stimuli and cues that indicate a reward is present. Rewarding stimuli (and all addictive drugs) act on the circuit by triggering the VTA to release dopamine signals to the nucleus accumbens, either directly or indirectly.[citation needed] The VTA has two important pathways: The mesolimbic pathway projecting to limbic (striatal) regions and underpinning the motivational behaviors and processes, and the mesocortical pathway projecting to the prefrontal cortex, underpinning cognitive functions, such as learning external cues, etc.[28]
The striatum is broadly involved in acquiring and eliciting learned behaviors in response to a rewarding cue. The VTA projects to the striatum, and activates the GABA-ergic Medium Spiny Neurons via D1 and D2 receptors within the ventral (Nucleus Accumbens) and dorsal striatum.[30]
The Ventral Striatum (the Nucleus Accumbens) is broadly involved in acquiring behavior when fed into by the VTA, and eliciting behavior when fed into by the PFC. The NAc shell projects to the pallidum and the VTA, regulating limbic and autonomic functions. This modulates the reinforcing properties of stimuli, and short term aspects of reward. The NAc Core projects to the substantia nigra and is involved in the development of reward-seeking behaviors and its expression. It is involved in spatial learning, conditional response, and impulsive choice; the long term elements of reward.[28]
The Dorsal Striatum is involved in learning, the Dorsal Medial Striatum in goal directed learning, and the Dorsal Lateral Striatum in stimulus-response learning foundational to Pavlovian response.[31] On repeated activation by a stimuli, the Nucleus Accumbens can activate the Dorsal Striatum via an intrastriatal loop. The transition of signals from the NAc to the DS allows reward associated cues to activate the DS without the reward itself being present. This can activate cravings and reward-seeking behaviors (and is responsible for triggering relapse during abstinence in addiction).[32]
Prefrontal Cortex
The VTA dopaminergic neurons project to the PFC, activating glutaminergic neurons that project to multiple other regions, including the Dorsal Striatum and NAc, ultimately allowing the PFC to mediate salience and conditional behaviors in response to stimuli.[32]
Notably, abstinence from addicting drugs activates the PFC, glutamatergic projection to the NAc, which leads to strong cravings, and modulates reinstatement of addiction behaviors resulting from abstinence. The PFC also interacts with the VTA through the mesocortical pathway, and helps associate environmental cues with the reward.[32]
Hippocampus
The Hippocampus has multiple functions, including in the creation and storage of memories . In the reward circuit, it serves to contextual memories and associated cues. It ultimately underpins the reinstatement of reward-seeking behaviors via cues, and contextual triggers.[33]
Amygdala
The AMY receives input from the VTA, and outputs to the NAc. The amygdala is important in creating powerful emotional flashbulb memories, and likely underpins the creation of strong cue-associated memories.[34] It also is important in mediating the anxiety effects of withdrawal, and increased drug intake in addiction.[35]
Pleasure centers
Pleasure is a component of reward, but not all rewards are pleasurable (e.g., money does not elicit pleasure unless this response is conditioned).[2] Stimuli that are naturally pleasurable, and therefore attractive, are known as intrinsic rewards, whereas stimuli that are attractive and motivate approach behavior, but are not inherently pleasurable, are termed extrinsic rewards.[2] Extrinsic rewards (e.g., money) are rewarding as a result of a learned association with an intrinsic reward.[2] In other words, extrinsic rewards function as motivational magnets that elicit "wanting", but not "liking" reactions once they have been acquired.[2]
The reward system contains pleasure centersor hedonic hotspots – i.e., brain structures that mediate pleasure or "liking" reactions from intrinsic rewards. As of October2017,[update] hedonic hotspots have been identified in subcompartments within the nucleus accumbens shell, ventral pallidum, parabrachial nucleus, orbitofrontal cortex (OFC), and insular cortex.[3][14][36] The hotspot within the nucleus accumbens shell is located in the rostrodorsal quadrant of the medial shell, while the hedonic coldspot is located in a more posterior region. The posterior ventral pallidum also contains a hedonic hotspot, while the anterior ventral pallidum contains a hedonic coldspot. In rats, microinjections of opioids, endocannabinoids, and orexin are capable of enhancing liking reactions in these hotspots.[3] The hedonic hotspots located in the anterior OFC and posterior insula have been demonstrated to respond to orexin and opioids in rats, as has the overlapping hedonic coldspot in the anterior insula and posterior OFC.[36] On the other hand, the parabrachial nucleus hotspot has only been demonstrated to respond to benzodiazepine receptor agonists.[3]
Hedonic hotspots are functionally linked, in that activation of one hotspot results in the recruitment of the others, as indexed by the induced expression of c-Fos, an immediate early gene. Furthermore, inhibition of one hotspot results in the blunting of the effects of activating another hotspot.[3][36] Therefore, the simultaneous activation of every hedonic hotspot within the reward system is believed to be necessary for generating the sensation of an intense euphoria.[37]
Tuning of appetitive and defensive reactions in the nucleus accumbens shell (above). AMPA blockade requires D1 function in order to produce motivated behaviors, regardless of valence, and D2 function to produce defensive behaviors. GABA agonism, on the other hand, does not requires dopamine receptor function (below). The expansion of the anatomical regions that produce defensive behaviors under stress, and appetitive behaviors in the home environment produced by AMPA antagonism. This flexibility is less evident with GABA agonism.
Incentive salience is the "wanting" or "desire" attribute, which includes a motivational component, that is assigned to a rewarding stimulus by the nucleus accumbens shell (NAcc shell).[2][38][39] The degree of dopamine neurotransmission into the NAcc shell from the mesolimbic pathway is highly correlated with the magnitude of incentive salience for rewarding stimuli.[38]
Activation of the dorsorostral region of the nucleus accumbens correlates with increases in wanting without concurrent increases in liking.[40] However, dopaminergic neurotransmission into the nucleus accumbens shell is responsible not only for appetitive motivational salience (i.e., incentive salience) towards rewarding stimuli, but also for aversive motivational salience, which directs behavior away from undesirable stimuli.[9][41][42] In the dorsal striatum, activation of D1 expressing MSNs produces appetitive incentive salience, while activation of D2 expressing MSNs produces aversion. In the NAcc, such a dichotomy is not as clear cut, and activation of both D1 and D2 MSNs is sufficient to enhance motivation,[43][44] likely via disinhibiting the VTA through inhibiting the ventral pallidum.[45][46]
Robinson and Berridge's 1993 incentive-sensitization theory proposed that reward contains separable psychological components: wanting (incentive) and liking (pleasure). To explain increasing contact with a certain stimulus such as chocolate, there are two independent factors at work – our desire to have the chocolate (wanting) and the pleasure effect of the chocolate (liking). According to Robinson and Berridge, wanting and liking are two aspects of the same process, so rewards are usually wanted and liked to the same degree. However, wanting and liking also change independently under certain circumstances. For example, rats that do not eat after receiving dopamine (experiencing a loss of desire for food) act as though they still like food. In another example, activated self-stimulation electrodes in the lateral hypothalamus of rats increase appetite, but also cause more adverse reactions to tastes such as sugar and salt; apparently, the stimulation increases wanting but not liking. Such results demonstrate that the reward system of rats includes independent processes of wanting and liking. The wanting component is thought to be controlled by dopaminergic pathways, whereas the liking component is thought to be controlled by opiate-GABA-endocannabinoids systems.[5]
Anti-reward system
Koobs & Le Moal proposed that there exists a separate circuit responsible for the attenuation of reward-pursuing behavior, which they termed the anti-reward circuit. This component acts as brakes on the reward circuit, thus preventing the over pursuit of food, sex, etc. This circuit involves multiple parts of the amygdala (the bed nucleus of the stria terminalis, the central nucleus), the Nucleus Accumbens, and signal molecules including norepinephrine, corticotropin-releasing factor, and dynorphin.[47] This circuit is also hypothesized to mediate the unpleasant components of stress, and is thus thought to be involved in addiction and withdrawal. While the reward circuit mediates the initial positive reinforcement involved in the development of addiction, it is the anti-reward circuit that later dominates via negative reinforcement that motivates the pursuit of the rewarding stimuli.[48]
Rewarding stimuli can drive learning in both the form of classical conditioning (Pavlovian conditioning) and operant conditioning (instrumental conditioning). In classical conditioning, a reward can act as an unconditioned stimulus that, when associated with the conditioned stimulus, causes the conditioned stimulus to elicit both musculoskeletal (in the form of simple approach and avoidance behaviors) and vegetative responses. In operant conditioning, a reward may act as a reinforcer in that it increases or supports actions that lead to itself.[1] Learned behaviors may or may not be sensitive to the value of the outcomes they lead to; behaviors that are sensitive to the contingency of an outcome on the performance of an action as well as the outcome value are goal-directed, while elicited actions that are insensitive to contingency or value are called habits.[49] This distinction is thought to reflect two forms of learning, model free and model based. Model free learning involves the simple caching and updating of values. In contrast, model based learning involves the storage and construction of an internal model of events that allows inference and flexible prediction. Although pavlovian conditioning is generally assumed to be model-free, the incentive salience assigned to a conditioned stimulus is flexible with regard to changes in internal motivational states.[50]
Distinct neural systems are responsible for learning associations between stimuli and outcomes, actions and outcomes, and stimuli and responses. Although classical conditioning is not limited to the reward system, the enhancement of instrumental performance by stimuli (i.e., Pavlovian-instrumental transfer) requires the nucleus accumbens. Habitual and goal directed instrumental learning are dependent upon the lateral striatum and the medial striatum, respectively.[49]
During instrumental learning, opposing changes in the ratio of AMPA to NMDA receptors and phosphorylated ERK occurs in the D1-type and D2-type MSNs that constitute the direct and indirect pathways, respectively.[51][52] These changes in synaptic plasticity and the accompanying learning is dependent upon activation of striatal D1 and NMDA receptors. The intracellular cascade activated by D1 receptors involves the recruitment of protein kinase A, and through resulting phosphorylation of DARPP-32, the inhibition of phosphatases that deactivate ERK. NMDA receptors activate ERK through a different but interrelated Ras-Raf-MEK-ERK pathway. Alone NMDA mediated activation of ERK is self-limited, as NMDA activation also inhibits PKA mediated inhibition of ERK deactivating phosphatases. However, when D1 and NMDA cascades are co-activated, they work synergistically, and the resultant activation of ERK regulates synaptic plasticity in the form of spine restructuring, transport of AMPA receptors, regulation of CREB, and increasing cellular excitability via inhibiting Kv4.2.[53][54][55]
The lateral hypothalamus and medial forebrain bundle has been the most-frequently-studied brain-stimulation reward site, particularly in studies of the effects of drugs on brain stimulation reward.[66] The neurotransmitter system that has been most-clearly identified with the habit-forming actions of drugs-of-abuse is the mesolimbic dopamine system, with its efferent targets in the nucleus accumbens and its local GABAergic afferents. The reward-relevant actions of amphetamine and cocaine are in the dopaminergic synapses of the nucleus accumbens and perhaps the medial prefrontal cortex. Rats also learn to lever-press for cocaine injections into the medial prefrontal cortex, which works by increasing dopamine turnover in the nucleus accumbens.[67][68] Nicotine infused directly into the nucleus accumbens also enhances local dopamine release, presumably by a presynaptic action on the dopaminergic terminals of this region. Nicotinic receptors localize to dopaminergic cell bodies and local nicotine injections increase dopaminergic cell firing that is critical for nicotinic reward.[69][70] Some additional habit-forming drugs are also likely to decrease the output of medium spiny neurons as a consequence, despite activating dopaminergic projections. For opiates, the lowest-threshold site for reward effects involves actions on GABAergic neurons in the ventral tegmental area, a secondary site of opiate-rewarding actions on medium spiny output neurons of the nucleus accumbens. Thus the following form the core of currently characterised drug-reward circuitry; GABAergic afferents to the mesolimbic dopamine neurons (primary substrate of opiate reward), the mesolimbic dopamine neurons themselves (primary substrate of psychomotor stimulant reward), and GABAergic efferents to the mesolimbic dopamine neurons (a secondary site of opiate reward).[66]
Dysfunctional motivational salience appears in a number of psychiatric symptoms and disorders. Anhedonia, traditionally defined as a reduced capacity to feel pleasure, has been re-examined as reflecting blunted incentive salience, as most anhedonic populations exhibit intact "liking".[71][72] On the other end of the spectrum, heightened incentive salience that is narrowed for specific stimuli is characteristic of behavioral and drug addictions. In the case of fear or paranoia, dysfunction may lie in elevated aversive salience.[73] In modern literature, anhedonia is associated with the proposed two forms of pleasure, "anticipatory" and "consummatory".
Neuroimaging studies across diagnoses associated with anhedonia have reported reduced activity in the OFC and ventral striatum.[74] One meta analysis reported anhedonia was associated with reduced neural response to reward anticipation in the caudate nucleus, putamen, nucleus accumbens and medial prefrontal cortex (mPFC).[75]
Mood disorders
Certain types of depression are associated with reduced motivation, as assessed by willingness to expend effort for reward. These abnormalities have been tentatively linked to reduced activity in areas of the striatum, and while dopaminergic abnormalities are hypothesized to play a role, most studies probing dopamine function in depression have reported inconsistent results.[76][77] Although postmortem and neuroimaging studies have found abnormalities in numerous regions of the reward system, few findings are consistently replicated. Some studies have reported reduced NAcc, hippocampus, medial prefrontal cortex (mPFC), and orbitofrontal cortex (OFC) activity, as well as elevated basolateral amygdala and subgenual cingulate cortex (sgACC) activity during tasks related to reward or positive stimuli. These neuroimaging abnormalities are complemented by little post mortem research, but what little research has been done suggests reduced excitatory synapses in the mPFC.[78] Reduced activity in the mPFC during reward related tasks appears to be localized to more dorsal regions(i.e. the pregenual cingulate cortex), while the more ventral sgACC is hyperactive in depression.[79]
Attempts to investigate underlying neural circuitry in animal models has also yielded conflicting results. Two paradigms are commonly used to simulate depression, chronic social defeat (CSDS), and chronic mild stress (CMS), although many exist. CSDS produces reduced preference for sucrose, reduced social interactions, and increased immobility in the forced swim test. CMS similarly reduces sucrose preference, and behavioral despair as assessed by tail suspension and forced swim tests. Animals susceptible to CSDS exhibit increased phasic VTA firing, and inhibition of VTA-NAcc projections attenuates behavioral deficits induced by CSDS.[80] However, inhibition of VTA-mPFC projections exacerbates social withdrawal. On the other hand, CMS associated reductions in sucrose preference and immobility were attenuated and exacerbated by VTA excitation and inhibition, respectively.[81][82] Although these differences may be attributable to different stimulation protocols or poor translational paradigms, variable results may also lie in the heterogenous functionality of reward related regions.[83]
Optogenetic stimulation of the mPFC as a whole produces antidepressant effects. This effect appears localized to the rodent homologue of the pgACC (the prelimbic cortex), as stimulation of the rodent homologue of the sgACC (the infralimbic cortex) produces no behavioral effects. Furthermore, deep brain stimulation in the infralimbic cortex, which is thought to have an inhibitory effect, also produces an antidepressant effect. This finding is congruent with the observation that pharmacological inhibition of the infralimbic cortex attenuates depressive behaviors.[83]
Schizophrenia
Schizophrenia is associated with deficits in motivation, commonly grouped under other negative symptoms such as reduced spontaneous speech. The experience of "liking" is frequently reported to be intact,[84] both behaviorally and neurally, although results may be specific to certain stimuli, such as monetary rewards.[85] Furthermore, implicit learning and simple reward-related tasks are also intact in schizophrenia.[86] Rather, deficits in the reward system are apparent during reward-related tasks that are cognitively complex. These deficits are associated with both abnormal striatal and OFC activity, as well as abnormalities in regions associated with cognitive functions such as the dorsolateral prefrontal cortex (DLPFC).[87]
Attention deficit hyperactivity disorder
In those with ADHD, core aspects of the reward system are underactive, making it challenging to derive reward from regular activities. Those with the disorder experience a boost of motivation after a high-stimulation behaviour triggers a release of dopamine. In the aftermath of that boost and reward, the return to baseline levels results in an immediate drop in motivation.[88]
Impairments of dopaminergic and serotonergic function are said to be key factors in ADHD.[89] These impairments can lead to executive dysfunction such as dysregulation of reward processing and motivational dysfunction, including anhedonia.[90]
History
Skinner box
The first clue to the presence of a reward system in the brain came with an accidental discovery by James Olds and Peter Milner in 1954. They discovered that rats would perform behaviors such as pressing a bar, to administer a brief burst of electrical stimulation to specific sites in their brains. This phenomenon is called intracranial self-stimulation or brain stimulation reward. Typically, rats will press a lever hundreds or thousands of times per hour to obtain this brain stimulation, stopping only when they are exhausted. While trying to teach rats how to solve problems and run mazes, stimulation of certain regions of the brain where the stimulation was found seemed to give pleasure to the animals. They tried the same thing with humans and the results were similar. The explanation to why animals engage in a behavior that has no value to the survival of either themselves or their species is that the brain stimulation is activating the system underlying reward.[91]
In a fundamental discovery made in 1954, researchers James Olds and Peter Milner found that low-voltage electrical stimulation of certain regions of the brain of the rat acted as a reward in teaching the animals to run mazes and solve problems.[92][failed verification][93] It seemed that stimulation of those parts of the brain gave the animals pleasure,[92] and in later work humans reported pleasurable sensations from such stimulation.[citation needed] When rats were tested in Skinner boxes where they could stimulate the reward system by pressing a lever, the rats pressed for hours.[93] Research in the next two decades established that dopamine is one of the main chemicals aiding neural signaling in these regions, and dopamine was suggested to be the brain's "pleasure chemical".[94]
Ivan Pavlov was a psychologist who used the reward system to study classical conditioning. Pavlov used the reward system by rewarding dogs with food after they had heard a bell or another stimulus. Pavlov was rewarding the dogs so that the dogs associated food, the reward, with the bell, the stimulus.[95] Edward L. Thorndike used the reward system to study operant conditioning. He began by putting cats in a puzzle box and placing food outside of the box so that the cat wanted to escape. The cats worked to get out of the puzzle box to get to the food. Although the cats ate the food after they escaped the box, Thorndike learned that the cats attempted to escape the box without the reward of food. Thorndike used the rewards of food and freedom to stimulate the reward system of the cats. Thorndike used this to see how the cats learned to escape the box.[96] More recently, Ivan De Araujo and colleagues used nutrients inside the gut to stimulate the reward system via the vagus nerve.[97]
Other species
Animals quickly learn to press a bar to obtain an injection of opiates directly into the midbrain tegmentum or the nucleus accumbens. The same animals do not work to obtain the opiates if the dopaminergic neurons of the mesolimbic pathway are inactivated. In this perspective, animals, like humans, engage in behaviors that increase dopamine release.
Kent Berridge, a researcher in affective neuroscience, found that sweet (liked) and bitter (disliked) tastes produced distinct orofacial expressions, and these expressions were similarly displayed by human newborns, orangutans, and rats. This was evidence that pleasure (specifically, liking) has objective features and was essentially the same across various animal species. Most neuroscience studies have shown that the more dopamine released by the reward, the more effective the reward is. This is called the hedonic impact, which can be changed by the effort for the reward and the reward itself. Berridge discovered that blocking dopamine systems did not seem to change the positive reaction to something sweet (as measured by facial expression). In other words, the hedonic impact did not change based on the amount of sugar. This discounted the conventional assumption that dopamine mediates pleasure. Even with more-intense dopamine alterations, the data seemed to remain constant.[98] However, a clinical study from January 2019 that assessed the effect of a dopamine precursor (levodopa), antagonist (risperidone), and a placebo on reward responses to music– including the degree of pleasure experienced during musical chills, as measured by changes in electrodermal activity as well as subjective ratings– found that the manipulation of dopamine neurotransmission bidirectionally regulates pleasure cognition (specifically, the hedonic impact of music) in human subjects.[99][100] This research demonstrated that increased dopamine neurotransmission acts as a sine qua non condition for pleasurable hedonic reactions to music in humans.[99][100]
Berridge developed the incentive salience hypothesis to address the wanting aspect of rewards. It explains the compulsive use of drugs by drug addicts even when the drug no longer produces euphoria, and the cravings experienced even after the individual has finished going through withdrawal. Some addicts respond to certain stimuli involving neural changes caused by drugs. This sensitization in the brain is similar to the effect of dopamine because wanting and liking reactions occur. Human and animal brains and behaviors experience similar changes regarding reward systems because these systems are so prominent.[98]
The striatum or corpus striatum is a cluster of interconnected nuclei that make up the largest structure of the subcortical basal ganglia. The striatum is a critical component of the motor and reward systems; receives glutamatergic and dopaminergic inputs from different sources; and serves as the primary input to the rest of the basal ganglia.
Dopamine is a neuromodulatory molecule that plays several important roles in cells. It is an organic chemical of the catecholamine and phenethylamine families. Dopamine constitutes about 80% of the catecholamine content in the brain. It is an amine synthesized by removing a carboxyl group from a molecule of its precursor chemical, L-DOPA, which is synthesized in the brain and kidneys. Dopamine is also synthesized in plants and most animals. In the brain, dopamine functions as a neurotransmitter—a chemical released by neurons to send signals to other nerve cells. Neurotransmitters are synthesized in specific regions of the brain, but affect many regions systemically. The brain includes several distinct dopamine pathways, one of which plays a major role in the motivational component of reward-motivated behavior. The anticipation of most types of rewards increases the level of dopamine in the brain, and many addictive drugs increase dopamine release or block its reuptake into neurons following release. Other brain dopamine pathways are involved in motor control and in controlling the release of various hormones. These pathways and cell groups form a dopamine system which is neuromodulatory.
The mesolimbic pathway, sometimes referred to as the reward pathway, is a dopaminergic pathway in the brain. The pathway connects the ventral tegmental area in the midbrain to the ventral striatum of the basal ganglia in the forebrain. The ventral striatum includes the nucleus accumbens and the olfactory tubercle.
The nucleus accumbens is a region in the basal forebrain rostral to the preoptic area of the hypothalamus. The nucleus accumbens and the olfactory tubercle collectively form the ventral striatum. The ventral striatum and dorsal striatum collectively form the striatum, which is the main component of the basal ganglia. The dopaminergic neurons of the mesolimbic pathway project onto the GABAergic medium spiny neurons of the nucleus accumbens and olfactory tubercle. Each cerebral hemisphere has its own nucleus accumbens, which can be divided into two structures: the nucleus accumbens core and the nucleus accumbens shell. These substructures have different morphology and functions.
Dopaminergic pathways in the human brain are involved in both physiological and behavioral processes including movement, cognition, executive functions, reward, motivation, and neuroendocrine control. Each pathway is a set of projection neurons, consisting of individual dopaminergic neurons.
The ventral tegmental area (VTA), also known as the ventral tegmental area of Tsai, or simply ventral tegmentum, is a group of neurons located close to the midline on the floor of the midbrain. The VTA is the origin of the dopaminergic cell bodies of the mesocorticolimbic dopamine system and other dopamine pathways; it is widely implicated in the drug and natural reward circuitry of the brain. The VTA plays an important role in a number of processes, including reward cognition and orgasm, among others, as well as several psychiatric disorders. Neurons in the VTA project to numerous areas of the brain, ranging from the prefrontal cortex to the caudal brainstem and several regions in between.
Motivational salience is a cognitive process and a form of attention that motivates or propels an individual's behavior towards or away from a particular object, perceived event or outcome. Motivational salience regulates the intensity of behaviors that facilitate the attainment of a particular goal, the amount of time and energy that an individual is willing to expend to attain a particular goal, and the amount of risk that an individual is willing to accept while working to attain a particular goal.
Neuropharmacology is the study of how drugs affect function in the nervous system, and the neural mechanisms through which they influence behavior. There are two main branches of neuropharmacology: behavioral and molecular. Behavioral neuropharmacology focuses on the study of how drugs affect human behavior (neuropsychopharmacology), including the study of how drug dependence and addiction affect the human brain. Molecular neuropharmacology involves the study of neurons and their neurochemical interactions, with the overall goal of developing drugs that have beneficial effects on neurological function. Both of these fields are closely connected, since both are concerned with the interactions of neurotransmitters, neuropeptides, neurohormones, neuromodulators, enzymes, second messengers, co-transporters, ion channels, and receptor proteins in the central and peripheral nervous systems. Studying these interactions, researchers are developing drugs to treat many different neurological disorders, including pain, neurodegenerative diseases such as Parkinson's disease and Alzheimer's disease, psychological disorders, addiction, and many others.
Salience is the property by which some thing stands out. Salient events are an attentional mechanism by which organisms learn and survive; those organisms can focus their limited perceptual and cognitive resources on the pertinent subset of the sensory data available to them.
The medial forebrain bundle (MFB) is a neural pathway containing fibers from the basal olfactory regions, the periamygdaloid region and the septal nuclei, as well as fibers from brainstem regions, including the ventral tegmental area and nigrostriatal pathway.
Medium spiny neurons (MSNs), also known as spiny projection neurons (SPNs), are a special type of inhibitory GABAergic neuron representing approximately 90% of neurons within the human striatum, a basal ganglia structure. Medium spiny neurons have two primary phenotypes : D1-type MSNs of the direct pathway and D2-type MSNs of the indirect pathway. Most striatal MSNs contain only D1-type or D2-type dopamine receptors, but a subpopulation of MSNs exhibit both phenotypes.
Brain stimulation reward (BSR) is a pleasurable phenomenon elicited via direct stimulation of specific brain regions, originally discovered by James Olds and Peter Milner. BSR can serve as a robust operant reinforcer. Targeted stimulation activates the reward system circuitry and establishes response habits similar to those established by natural rewards, such as food and sex. Experiments on BSR soon demonstrated that stimulation of the lateral hypothalamus, along with other regions of the brain associated with natural reward, was both rewarding as well as motivation-inducing. Electrical brain stimulation and intracranial drug injections produce robust reward sensation due to a relatively direct activation of the reward circuitry. This activation is considered to be more direct than rewards produced by natural stimuli, as those signals generally travel through the more indirect peripheral nerves. BSR has been found in all vertebrates tested, including humans, and it has provided a useful tool for understanding how natural rewards are processed by specific brain regions and circuits, as well the neurotransmission associated with the reward system.
Protein fosB, also known as FosB and G0/G1 switch regulatory protein 3 (G0S3), is a protein that in humans is encoded by the FBJ murine osteosarcoma viral oncogene homolog B (FOSB) gene.
Behavioral addiction, process addiction, or non-substance-related disorder is a form of addiction that involves a compulsion to engage in a rewarding non-substance-related behavior – sometimes called a natural reward – despite any negative consequences to the person's physical, mental, social or financial well-being. In the brain's reward system, a gene transcription factor known as ΔFosB has been identified as a necessary common factor involved in both behavioral and drug addictions, which are associated with the same set of neural adaptations.
The ventral pallidum (VP) is a structure within the basal ganglia of the brain. It is an output nucleus whose fibres project to thalamic nuclei, such as the ventral anterior nucleus, the ventral lateral nucleus, and the medial dorsal nucleus. The VP is a core component of the reward system which forms part of the limbic loop of the basal ganglia, a pathway involved in the regulation of motivational salience, behavior, and emotions. It is involved in addiction.
Addiction is a neuropsychological disorder characterized by a persistent and intense urge to use a drug or engage in a behavior that produces natural reward, despite substantial harm and other negative consequences. Repetitive drug use often alters brain function in ways that perpetuate craving, and weakens self-control. This phenomenon – drugs reshaping brain function – has led to an understanding of addiction as a brain disorder with a complex variety of psychosocial as well as neurobiological factors that are implicated in addiction's development.
Cocaine addiction is the compulsive use of cocaine despite adverse consequences. It arises through epigenetic modification and transcriptional regulation of genes in the nucleus accumbens.
Addiction is a state characterized by compulsive engagement in rewarding stimuli, despite adverse consequences. The process of developing an addiction occurs through instrumental learning, which is otherwise known as operant conditioning.
The rostromedial tegmental nucleus (RMTg), also known as the tail of the ventral tegmental area (tVTA), is a GABAergic nucleus which functions as a "master brake" for the midbrain dopamine system. This region was discovered by the researchers, M. Barrot, J.Kaufling and T. Jhou. It is poorly differentiated from the rest of the ventral tegmental area (VTA) and possesses robust functional and structural links to the dopamine pathways. Notably, both acute and chronic exposure to psychostimulants have been shown to induce FosB and ΔFosB expression in the RMTg; no other drug type has been shown to induce these proteins in the RMTg.
Ilana B. Witten is an American neuroscientist and professor of psychology and neuroscience at Princeton University. Witten studies the mesolimbic pathway, with a focus on the striatal neural circuit mechanisms driving reward learning and decision making.
References
1 2 3 4 5 6 7 8 9 Schultz W (2015). "Neuronal reward and decision signals: from theories to data". Physiological Reviews. 95 (3): 853–951. doi:10.1152/physrev.00023.2014. PMC4491543. PMID26109341. Rewards in operant conditioning are positive reinforcers.... Operant behavior gives a good definition for rewards. Anything that makes an individual come back for more is a positive reinforcer and therefore a reward. Although it provides a good definition, positive reinforcement is only one of several reward functions.... Rewards are attractive. They are motivating and make us exert an effort.... Rewards induce approach behavior, also called appetitive or preparatory behavior, sexual behavior, and consummatory behavior.... Thus any stimulus, object, event, activity, or situation that has the potential to make us approach and consume it is by definition a reward.... Rewarding stimuli, objects, events, situations, and activities consist of several major components. First, rewards have basic sensory components (visual, auditory, somatosensory, gustatory, and olfactory)... Second, rewards are salient and thus elicit attention, which are manifested as orienting responses. The salience of rewards derives from three principal factors, namely, their physical intensity and impact (physical salience), their novelty and surprise (novelty/surprise salience), and their general motivational impact shared with punishers (motivational salience). A separate form not included in this scheme, incentive salience, primarily addresses dopamine function in addiction and refers only to approach behavior (as opposed to learning)... Third, rewards have a value component that determines the positively motivating effects of rewards and is not contained in, nor explained by, the sensory and attentional components. This component reflects behavioral preferences and thus is subjective and only partially determined by physical parameters. Only this component constitutes what we understand as a reward. It mediates the specific behavioral reinforcing, approach generating, and emotional effects of rewards that are crucial for the organism's survival and reproduction, whereas all other components are only supportive of these functions.... Rewards can also be intrinsic to behavior. They contrast with extrinsic rewards that provide motivation for behavior and constitute the essence of operant behavior in laboratory tests. Intrinsic rewards are activities that are pleasurable on their own and are undertaken for their own sake, without being the means for getting extrinsic rewards.... Intrinsic rewards are genuine rewards in their own right, as they induce learning, approach, and pleasure, like perfectioning, playing, and enjoying the piano. Although they can serve to condition higher order rewards, they are not conditioned, higher order rewards, as attaining their reward properties does not require pairing with an unconditioned reward.... These emotions are also called liking (for pleasure) and wanting (for desire) in addiction research and strongly support the learning and approach generating functions of reward.
1 2 3 4 5 6 7 8 Berridge KC, Kringelbach ML (May 2015). "Pleasure systems in the brain". Neuron. 86 (3): 646–664. doi:10.1016/j.neuron.2015.02.018. PMC4425246. PMID25950633. In the prefrontal cortex, recent evidence indicates that the [orbitofrontal cortex] OFC and insula cortex may each contain their own additional hot spots (D.C. Castro et al., Soc. Neurosci., abstract). In specific subregions of each area, either opioid-stimulating or orexin-stimulating microinjections appear to enhance the number of liking reactions elicited by sweetness, similar to the [nucleus accumbens] NAc and [ventral pallidum] VP hot spots. Successful confirmation of hedonic hot spots in the OFC or insula would be important and possibly relevant to the orbitofrontal mid-anterior site mentioned earlier that especially tracks the subjective pleasure of foods in humans (Georgiadis et al., 2012; Kringelbach, 2005; Kringelbach et al., 2003; Small et al., 2001; Veldhuizen et al., 2010). Finally, in the brainstem, a hindbrain site near the parabrachial nucleus of dorsal pons also appears able to contribute to hedonic gains of function (Söderpalm and Berridge, 2000). A brainstem mechanism for pleasure may seem more surprising than forebrain hot spots to anyone who views the brainstem as merely reflexive, but the pontine parabrachial nucleus contributes to taste, pain, and many visceral sensations from the body and has also been suggested to play an important role in motivation (Wu et al., 2012) and in human emotion (especially related to the somatic marker hypothesis) (Damasio, 2010).
1 2 3 4 5 6 7 Yager LM, Garcia AF, Wunsch AM, Ferguson SM (August 2015). "The ins and outs of the striatum: Role in drug addiction". Neuroscience. 301: 529–541. doi:10.1016/j.neuroscience.2015.06.033. PMC4523218. PMID26116518. [The striatum] receives dopaminergic inputs from the ventral tegmental area (VTA) and the substantia nigra (SNr) and glutamatergic inputs from several areas, including the cortex, hippocampus, amygdala, and thalamus (Swanson, 1982; Phillipson and Griffiths, 1985; Finch, 1996; Groenewegen et al., 1999; Britt et al., 2012). These glutamatergic inputs make contact on the heads of dendritic spines of the striatal GABAergic medium spiny projection neurons (MSNs) whereas dopaminergic inputs synapse onto the spine neck, allowing for an important and complex interaction between these two inputs in modulation of MSN activity... It should also be noted that there is a small population of neurons in the [nucleus accumbens] NAc that coexpress both D1 and D2 receptors, though this is largely restricted to the NAc shell (Bertran- Gonzalez et al., 2008).... Neurons in the NAc core and NAc shell subdivisions also differ functionally. The NAc core is involved in the processing of conditioned stimuli whereas the NAc shell is more important in the processing of unconditioned stimuli; Classically, these two striatal MSN populations are thought to have opposing effects on basal ganglia output. Activation of the dMSNs causes a net excitation of the thalamus resulting in a positive cortical feedback loop; thereby acting as a 'go' signal to initiate behavior. Activation of the iMSNs, however, causes a net inhibition of thalamic activity resulting in a negative cortical feedback loop and therefore serves as a 'brake' to inhibit behavior... there is also mounting evidence that iMSNs play a role in motivation and addiction (Lobo and Nestler, 2011; Grueter et al., 2013). For example, optogenetic activation of NAc core and shell iMSNs suppressed the development of a cocaine CPP whereas selective ablation of NAc core and shell iMSNs... enhanced the development and the persistence of an amphetamine CPP (Durieux et al., 2009; Lobo et al., 2010). These findings suggest that iMSNs can bidirectionally modulate drug reward.... Together these data suggest that iMSNs normally act to restrain drug-taking behavior and recruitment of these neurons may in fact be protective against the development of compulsive drug use.
↑ Taylor SB, Lewis CR, Olive MF (2013). "The neurocircuitry of illicit psychostimulant addiction: acute and chronic effects in humans". Subst Abuse Rehabil. 4: 29–43. doi:10.2147/SAR.S39684. PMC3931688. PMID24648786. Regions of the basal ganglia, which include the dorsal and ventral striatum, internal and external segments of the globus pallidus, subthalamic nucleus, and dopaminergic cell bodies in the substantia nigra, are highly implicated not only in fine motor control but also in [prefrontal cortex] PFC function.43 Of these regions, the [nucleus accumbens] NAc (described above) and the [dorsal striatum] DS (described below) are most frequently examined with respect to addiction. Thus, only a brief description of the modulatory role of the basal ganglia in addiction-relevant circuits will be mentioned here. The overall output of the basal ganglia is predominantly via the thalamus, which then projects back to the PFC to form cortico-striatal-thalamo-cortical (CSTC) loops. Three CSTC loops are proposed to modulate executive function, action selection, and behavioral inhibition. In the dorsolateral prefrontal circuit, the basal ganglia primarily modulate the identification and selection of goals, including rewards.44 The [orbitofrontal cortex] OFC circuit modulates decision-making and impulsivity, and the anterior cingulate circuit modulates the assessment of consequences.44 These circuits are modulated by dopaminergic inputs from the [ventral tegmental area] VTA to ultimately guide behaviors relevant to addiction, including the persistence and narrowing of the behavioral repertoire toward drug seeking, and continued drug use despite negative consequences.43–45
1 2 Malenka RC, Nestler EJ, Hyman SE (2009). Sydor A, Brown RY (eds.). Molecular Neuropharmacology: A Foundation for Clinical Neuroscience (2nded.). New York: McGraw-Hill Medical. pp.365–366, 376. ISBN978-0-07-148127-4. The neural substrates that underlie the perception of reward and the phenomenon of positive reinforcement are a set of interconnected forebrain structures called brain reward pathways; these include the nucleus accumbens (NAc; the major component of the ventral striatum), the basal forebrain (components of which have been termed the extended amygdala, as discussed later in this chapter), hippocampus, hypothalamus, and frontal regions of cerebral cortex. These structures receive rich dopaminergic innervation from the ventral tegmental area (VTA) of the midbrain. Addictive drugs are rewarding and reinforcing because they act in brain reward pathways to enhance either dopamine release or the effects of dopamine in the NAc or related structures, or because they produce effects similar to dopamine.... A macrostructure postulated to integrate many of the functions of this circuit is described by some investigators as the extended amygdala. The extended amygdala is said to comprise several basal forebrain structures that share similar morphology, immunocytochemical features, and connectivity and that are well suited to mediating aspects of reward function; these include the bed nucleus of the stria terminalis, the central medial amygdala, the shell of the NAc, and the sublenticular substantia innominata.
↑ Ogawa, SK; Watabe-Uchida, M (2018). "Organization of dopamine and serotonin system: Anatomical and functional mapping of monosynaptic inputs using rabies virus". Pharmacology Biochemistry and Behavior. 174: 9–22. doi:10.1016/j.pbb.2017.05.001. PMID28476484. S2CID5089422.
↑ You ZB, Chen YQ, Wise RA (2001). "Dopamine and glutamate release in the nucleus accumbens and ventral tegmental area of rat following lateral hypothalamic self-stimulation". Neuroscience. 107 (4): 629–639. doi:10.1016/s0306-4522(01)00379-7. PMID11720786. S2CID33615497.
1 2 Kokane, S. S., & Perrotti, L. I. (2020). Sex Differences and the Role of Estradiol in Mesolimbic Reward Circuits and Vulnerability to Cocaine and Opiate Addiction. Frontiers in Behavioral Neuroscience, 14.
↑ Becker, J. B., & Chartoff, E. (2019). Sex differences in neural mechanisms mediating reward and addiction. Neuropsychopharmacology, 44(1), 166-183.
↑ Stoof, J. C., & Kebabian, J. W. (1984). Two dopamine receptors: biochemistry, physiology and pharmacology. Life sciences, 35(23), 2281-2296.
↑ Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2005). Blockade of NMDA receptors in the dorsomedial striatum prevents action–outcome learning in instrumental conditioning. European Journal of Neuroscience, 22(2), 505-512.
1 2 3 Koob, G. F., & Volkow, N. D. (2016). Neurobiology of addiction: a neurocircuitry analysis. The Lancet Psychiatry, 3(8), 760-773.
↑ Kutlu, M. G., & Gould, T. J. (2016). Effects of drugs of abuse on hippocampal plasticity and hippocampus-dependent learning and memory: contributions to development and maintenance of addiction. Learning & memory, 23(10), 515-533.
↑ McGaugh, J. L. (July 2004). "The amygdala modulates the consolidation of memories of emotionally arousing experiences". Annual Review of Neuroscience. 27 (1): 1–28.
↑ Koob G. F., Le Moal M. (2008). Addiction and the brain antireward system. Annu. Rev. Psychol. 59 29–53. 10.1146/annurev.psych.59.103006.093548 [PubMed] [CrossRef] [Google Scholar] Koob G. F., Sanna P. P., Bloom F. E. (1998). Neuroscience of addiction. Neuron 21 467–476.
↑ Kringelbach ML, Berridge KC (2012). "The Joyful Mind"(PDF). Scientific American. 307 (2): 44–45. Bibcode:2012SciAm.307b..40K. doi:10.1038/scientificamerican0812-40. PMID22844850. Archived from the original(PDF) on 29 March 2017. Retrieved 17 January 2017. So it makes sense that the real pleasure centers in the brain – those directly responsible for generating pleasurable sensations – turn out to lie within some of the structures previously identified as part of the reward circuit. One of these so-called hedonic hotspots lies in a subregion of the nucleus accumbens called the medial shell. A second is found within the ventral pallidum, a deep-seated structure near the base of the forebrain that receives most of its signals from the nucleus accumbens.... On the other hand, intense euphoria is harder to come by than everyday pleasures. The reason may be that strong enhancement of pleasure – like the chemically induced pleasure bump we produced in lab animals – seems to require activation of the entire network at once. Defection of any single component dampens the high. Whether the pleasure circuit – and in particular, the ventral pallidum – works the same way in humans is unclear.
1 2 Berridge KC (April 2012). "From prediction error to incentive salience: mesolimbic computation of reward motivation". Eur. J. Neurosci. 35 (7): 1124–1143. doi:10.1111/j.1460-9568.2012.07990.x. PMC3325516. PMID22487042. Here I discuss how mesocorticolimbic mechanisms generate the motivation component of incentive salience. Incentive salience takes Pavlovian learning and memory as one input and as an equally important input takes neurobiological state factors (e.g. drug states, appetite states, satiety states) that can vary independently of learning. Neurobiological state changes can produce unlearned fluctuations or even reversals in the ability of a previously learned reward cue to trigger motivation. Such fluctuations in cue-triggered motivation can dramatically depart from all previously learned values about the associated reward outcome.... Associative learning and prediction are important contributors to motivation for rewards. Learning gives incentive value to arbitrary cues such as a Pavlovian conditioned stimulus (CS) that is associated with a reward (unconditioned stimulus or UCS). Learned cues for reward are often potent triggers of desires. For example, learned cues can trigger normal appetites in everyone, and can sometimes trigger compulsive urges and relapse in addicts. Cue-triggered 'wanting' for the UCS A brief CS encounter (or brief UCS encounter) often primes a pulse of elevated motivation to obtain and consume more reward UCS. This is a signature feature of incentive salience. Cue as attractive motivational magnets When a Pavlovian CS+ is attributed with incentive salience it not only triggers 'wanting' for its UCS, but often the cue itself becomes highly attractive – even to an irrational degree. This cue attraction is another signature feature of incentive salience... Two recognizable features of incentive salience are often visible that can be used in neuroscience experiments: (i) UCS-directed 'wanting' – CS-triggered pulses of intensified 'wanting' for the UCS reward; and (ii) CS-directed 'wanting' – motivated attraction to the Pavlovian cue, which makes the arbitrary CS stimulus into a motivational magnet.
↑ Malenka RC, Nestler EJ, Hyman SE (2009). Sydor A, Brown RY (eds.). Molecular Neuropharmacology: A Foundation for Clinical Neuroscience (2nded.). New York: McGraw-Hill Medical. pp.147–148, 367, 376. ISBN978-0-07-148127-4. VTA DA neurons play a critical role in motivation, reward-related behavior (Chapter 15), attention, and multiple forms of memory. This organization of the DA system, wide projection from a limited number of cell bodies, permits coordinated responses to potent new rewards. Thus, acting in diverse terminal fields, dopamine confers motivational salience ("wanting") on the reward itself or associated cues (nucleus accumbens shell region), updates the value placed on different goals in light of this new experience (orbital prefrontal cortex), helps consolidate multiple forms of memory (amygdala and hippocampus), and encodes new motor programs that will facilitate obtaining this reward in the future (nucleus accumbens core region and dorsal striatum). In this example, dopamine modulates the processing of sensorimotor information in diverse neural circuits to maximize the ability of the organism to obtain future rewards.... The brain reward circuitry that is targeted by addictive drugs normally mediates the pleasure and strengthening of behaviors associated with natural reinforcers, such as food, water, and sexual contact. Dopamine neurons in the VTA are activated by food and water, and dopamine release in the NAc is stimulated by the presence of natural reinforcers, such as food, water, or a sexual partner.... The NAc and VTA are central components of the circuitry underlying reward and memory of reward. As previously mentioned, the activity of dopaminergic neurons in the VTA appears to be linked to reward prediction. The NAc is involved in learning associated with reinforcement and the modulation of motoric responses to stimuli that satisfy internal homeostatic needs. The shell of the NAc appears to be particularly important to initial drug actions within reward circuitry; addictive drugs appear to have a greater effect on dopamine release in the shell than in the core of the NAc.
↑ Berridge KC, Kringelbach ML (1 June 2013). "Neuroscience of affect: brain mechanisms of pleasure and displeasure". Current Opinion in Neurobiology. 23 (3): 294–303. doi:10.1016/j.conb.2013.01.017. PMC3644539. PMID23375169. For instance, mesolimbic dopamine, probably the most popular brain neurotransmitter candidate for pleasure two decades ago, turns out not to cause pleasure or liking at all. Rather dopamine more selectively mediates a motivational process of incentive salience, which is a mechanism for wanting rewards but not for liking them.... Rather opioid stimulation has the special capacity to enhance liking only if the stimulation occurs within an anatomical hotspot
↑ Koob G. F., Le Moal M. (2008). Addiction and the brain antireward system. Annu. Rev. Psychol. 59 29–53. 10.1146/annurev.psych.59.103006.093548 [PubMed] [CrossRef] [Google Scholar] Koob G. F., Sanna P. P., Bloom F. E. (1998). Neuroscience of addiction. Neuron 21 467–476
↑ Meyer, J. S., & Quenzer, L. F. (2013). Psychopharmacology: Drugs, the brain, and behavior. Sinauer Associates.
↑ Balleine, BW; Morris, RW; Leung, BK (2 December 2015). "Thalamocortical integration of instrumental learning and performance and their disintegration in addiction". Brain Research. 1628 (Pt A): 104–16. doi:10.1016/j.brainres.2014.12.023. PMID25514336. S2CID11776683. Importantly, we found evidence of increased activity in the direct pathway; both intracellular changes in the expression of the plasticity marker pERK and AMPA/NMDA ratios evoked by stimulating cortical afferents were increased in the D1-direct pathway neurons. In contrast, D2 neurons showed an opposing change in plasticity; stimulation of cortical afferents reduced AMPA/NMDA ratios on those neurons (Shan et al., 2014).
↑ Nakanishi, S; Hikida, T; Yawata, S (12 December 2014). "Distinct dopaminergic control of the direct and indirect pathways in reward-based and avoidance learning behaviors". Neuroscience. 282: 49–59. doi:10.1016/j.neuroscience.2014.04.026. PMID24769227. S2CID21652525.
1 2 Ruffle JK (November 2014). "Molecular neurobiology of addiction: what's all the (Δ)FosB about?". Am. J. Drug Alcohol Abuse. 40 (6): 428–437. doi:10.3109/00952990.2014.933840. PMID25083822. S2CID19157711. The strong correlation between chronic drug exposure and ΔFosB provides novel opportunities for targeted therapies in addiction (118), and suggests methods to analyze their efficacy (119). Over the past two decades, research has progressed from identifying ΔFosB induction to investigating its subsequent action (38). It is likely that ΔFosB research will now progress into a new era – the use of ΔFosB as a biomarker.... Conclusions ΔFosB is an essential transcription factor implicated in the molecular and behavioral pathways of addiction following repeated drug exposure. The formation of ΔFosB in multiple brain regions, and the molecular pathway leading to the formation of AP-1 complexes is well understood. The establishment of a functional purpose for ΔFosB has allowed further determination as to some of the key aspects of its molecular cascades, involving effectors such as GluR2 (87,88), Cdk5 (93) and NFkB (100). Moreover, many of these molecular changes identified are now directly linked to the structural, physiological and behavioral changes observed following chronic drug exposure (60,95,97,102). New frontiers of research investigating the molecular roles of ΔFosB have been opened by epigenetic studies, and recent advances have illustrated the role of ΔFosB acting on DNA and histones, truly as a molecular switch (34). As a consequence of our improved understanding of ΔFosB in addiction, it is possible to evaluate the addictive potential of current medications (119), as well as use it as a biomarker for assessing the efficacy of therapeutic interventions (121,122,124). Some of these proposed interventions have limitations (125) or are in their infancy (75). However, it is hoped that some of these preliminary findings may lead to innovative treatments, which are much needed in addiction.
1 2 Olsen CM (December 2011). "Natural rewards, neuroplasticity, and non-drug addictions". Neuropharmacology. 61 (7): 1109–1122. doi:10.1016/j.neuropharm.2011.03.010. PMC3139704. PMID21459101. Functional neuroimaging studies in humans have shown that gambling (Breiter et al, 2001), shopping (Knutson et al, 2007), orgasm (Komisaruk et al, 2004), playing video games (Koepp et al, 1998; Hoeft et al, 2008) and the sight of appetizing food (Wang et al, 2004a) activate many of the same brain regions (i.e., the mesocorticolimbic system and extended amygdala) as drugs of abuse (Volkow et al, 2004).... Cross-sensitization is also bidirectional, as a history of amphetamine administration facilitates sexual behavior and enhances the associated increase in NAc DA... As described for food reward, sexual experience can also lead to activation of plasticity-related signaling cascades. The transcription factor delta FosB is increased in the NAc, PFC, dorsal striatum, and VTA following repeated sexual behavior (Wallace et al., 2008; Pitchers et al., 2010b). This natural increase in delta FosB or viral overexpression of delta FosB within the NAc modulates sexual performance, and NAc blockade of delta FosB attenuates this behavior (Hedges et al, 2009; Pitchers et al., 2010b). Further, viral overexpression of delta FosB enhances the conditioned place preference for an environment paired with sexual experience (Hedges et al., 2009).... In some people, there is a transition from "normal" to compulsive engagement in natural rewards (such as food or sex), a condition that some have termed behavioral or non-drug addictions (Holden, 2001; Grant et al., 2006a).... In humans, the role of dopamine signaling in incentive-sensitization processes has recently been highlighted by the observation of a dopamine dysregulation syndrome in some patients taking dopaminergic drugs. This syndrome is characterized by a medication-induced increase in (or compulsive) engagement in non-drug rewards such as gambling, shopping, or sex (Evans et al, 2006; Aiken, 2007; Lader, 2008)." Table 1: Summary of plasticity observed following exposure to drug or natural reinforcers"
1 2 Biliński P, Wojtyła A, Kapka-Skrzypczak L, Chwedorowicz R, Cyranka M, Studziński T (2012). "Epigenetic regulation in drug addiction". Ann. Agric. Environ. Med. 19 (3): 491–496. PMID23020045. For these reasons, ΔFosB is considered a primary and causative transcription factor in creating new neural connections in the reward centre, prefrontal cortex, and other regions of the limbic system. This is reflected in the increased, stable and long-lasting level of sensitivity to cocaine and other drugs, and tendency to relapse even after long periods of abstinence. These newly constructed networks function very efficiently via new pathways as soon as drugs of abuse are further taken... In this way, the induction of CDK5 gene expression occurs together with suppression of the G9A gene coding for dimethyltransferase acting on the histone H3. A feedback mechanism can be observed in the regulation of these 2 crucial factors that determine the adaptive epigenetic response to cocaine. This depends on ΔFosB inhibiting G9a gene expression, i.e. H3K9me2 synthesis which in turn inhibits transcription factors for ΔFosB. For this reason, the observed hyper-expression of G9a, which ensures high levels of the dimethylated form of histone H3, eliminates the neuronal structural and plasticity effects caused by cocaine by means of this feedback which blocks ΔFosB transcription
↑ Pitchers KK, Vialou V, Nestler EJ, Laviolette SR, Lehman MN, Coolen LM (February 2013). "Natural and drug rewards act on common neural plasticity mechanisms with ΔFosB as a key mediator". The Journal of Neuroscience. 33 (8): 3434–3442. doi:10.1523/JNEUROSCI.4881-12.2013. PMC3865508. PMID23426671. Drugs of abuse induce neuroplasticity in the natural reward pathway, specifically the nucleus accumbens (NAc), thereby causing development and expression of addictive behavior.... Together, these findings demonstrate that drugs of abuse and natural reward behaviors act on common molecular and cellular mechanisms of plasticity that control vulnerability to drug addiction, and that this increased vulnerability is mediated by ΔFosB and its downstream transcriptional targets.... Sexual behavior is highly rewarding (Tenk et al., 2009), and sexual experience causes sensitized drug-related behaviors, including cross-sensitization to amphetamine (Amph)-induced locomotor activity (Bradley and Meisel, 2001; Pitchers et al., 2010a) and enhanced Amph reward (Pitchers et al., 2010a). Moreover, sexual experience induces neural plasticity in the NAc similar to that induced by psychostimulant exposure, including increased dendritic spine density (Meisel and Mullins, 2006; Pitchers et al., 2010a), altered glutamate receptor trafficking, and decreased synaptic strength in prefrontal cortex-responding NAc shell neurons (Pitchers et al., 2012). Finally, periods of abstinence from sexual experience were found to be critical for enhanced Amph reward, NAc spinogenesis (Pitchers et al., 2010a), and glutamate receptor trafficking (Pitchers et al., 2012). These findings suggest that natural and drug reward experiences share common mechanisms of neural plasticity
↑ Beloate LN, Weems PW, Casey GR, Webb IC, Coolen LM (February 2016). "Nucleus accumbens NMDA receptor activation regulates amphetamine cross-sensitization and deltaFosB expression following sexual experience in male rats". Neuropharmacology. 101: 154–164. doi:10.1016/j.neuropharm.2015.09.023. PMID26391065. S2CID25317397.
↑ Robison AJ, Nestler EJ (November 2011). "Transcriptional and epigenetic mechanisms of addiction". Nat. Rev. Neurosci. 12 (11): 623–637. doi:10.1038/nrn3111. PMC3272277. PMID21989194. ΔFosB serves as one of the master control proteins governing this structural plasticity.... ΔFosB also represses G9a expression, leading to reduced repressive histone methylation at the cdk5 gene. The net result is gene activation and increased CDK5 expression.... In contrast, ΔFosB binds to the c-fos gene and recruits several co-repressors, including HDAC1 (histone deacetylase 1) and SIRT 1 (sirtuin 1).... The net result is c-fos gene repression. Figure 4: Epigenetic basis of drug regulation of gene expression
↑ Goeders N.E., Smith J.E. (1993). "Intracranial cocaine self-administration into the medial prefrontal cortex increases dopamine turnover in the nucleus accumbens". J. Pharmacol. Exp. Ther. 265 (2): 592–600. PMID8496810.
↑ Westfall, Thomas C.; Grant, Heather; Perry, Holly (January 1983). "Release of dopamine and 5-hydroxytryptamine from rat striatal slices following activation of nicotinic cholinergic receptors". General Pharmacology: The Vascular System. 14 (3): 321–325. doi:10.1016/0306-3623(83)90037-x. PMID6135645.
↑ Preda, Adrian (2014). "Brain Imaging Correlates of Anhedonia". In Ritsner, Michael (ed.). Anhedonia: a comprehensive handbook. Dordrecht: Springer Netherlands. ISBN978-94-017-8590-7.
↑ Treadway, Michael, T. (2016). "The Neurobiology of Motivational Deficits in Depression— An Update on Candidate Pathomechanisms". In Simpson, Eleanor H.; Balsam, Peter D. (eds.). Behavioral Neuroscience of Motivation (Current Topics in Behavioral Neurosciences) (1sted.). Switzerland: Springer International Publishing. p.343. ISBN978-3-319-26933-7. In a relatively recent literature, studies of motivation and reinforcement in depression have been largely consistent in detecting differences as compared to healthy controls (Whitton et al. 2015). In several studies using the effort expenditure for reward task (EEfRT), patients with MDD expended less effort for rewards when compared with controls (Treadway et al. 2012; Yang et al. 2014){{cite book}}: CS1 maint: multiple names: authors list (link)
↑ Bucci, P; Galderisi, S (May 2017). "Categorizing and assessing negative symptoms". Current Opinion in Psychiatry. 30 (3): 201–208. doi:10.1097/YCO.0000000000000322. PMID28212174. S2CID9923114. They also provide a separate assessment of the consummatory anhedonia (reduced experience of pleasure derived from ongoing enjoyable activities) and anticipatory anhedonia (reduced ability to anticipate future pleasure). In fact, the former one seems to be relatively intact in schizophrenia, whereas the latter one seems to be impaired [32 – 34]. However, discrepant data have also been reported [35].
↑ Young, Anticevic & Barch 2018, p.215a,"Several recent reviews (e.g., Cohen and Minor, 2010) have found that individuals with schizophrenia show relatively intact self-reported emotional responses to affect-eliciting stimuli as well as other indicators of intact response...A more mixed picture arises from functional neuroimaging studies examining brain responses to other types of pleasurable stimuli in schizophrenia (Paradiso et al., 2003)"
↑ Young, Anticevic & Barch 2018, p.215b,"As such it is surprising that behavioral studies have suggested that reinforcement learning is intact in schizophrenia when learning is relatively implicit (though, see Siegert et al., 2008 for evidence of impaired Serial Reaction Time task learning), but more impaired when explicit representations of stimulus-reward contingencies are needed (see Gold et al., 2008). This pattern has given rise to the theory that the striatally mediated gradual reinforcement learning system may be intact in schizophrenia, while more rapid, on-line, cortically mediated learning systems are impaired."
↑ Young, Anticevic & Barch 2018, p.216, "We have recently shown that individuals with schizophrenia can show improved cognitive control performance when information about rewards are externally presented but not when they must be internally maintained (Mann et al., 2013), with some evidence for impairments in DLPFC and striatal activation during internal maintenance of reward information being associated with individuals' differences in motivation (Chung and Barch, 2016)."
1 2 Ferreri L, Mas-Herrero E, Zatorre RJ, Ripollés P, Gomez-Andres A, Alicart H, Olivé G, Marco-Pallarés J, Antonijoan RM, Valle M, Riba J, Rodriguez-Fornells A (January 2019). "Dopamine modulates the reward experiences elicited by music". Proceedings of the National Academy of Sciences of the United States of America. 116 (9): 3793–3798. Bibcode:2019PNAS..116.3793F. doi:10.1073/pnas.1811878116. PMC6397525. PMID30670642. Listening to pleasurable music is often accompanied by measurable bodily reactions such as goose bumps or shivers down the spine, commonly called 'chills' or 'frissons.'... Overall, our results straightforwardly revealed that pharmacological interventions bidirectionally modulated the reward responses elicited by music. In particular, we found that risperidone impaired participants' ability to experience musical pleasure, whereas levodopa enhanced it.... Here, in contrast, studying responses to abstract rewards in human subjects, we show that manipulation of dopaminergic transmission affects both the pleasure (i.e., amount of time reporting chills and emotional arousal measured by EDA) and the motivational components of musical reward (money willing to spend). These findings suggest that dopaminergic signaling is a sine qua non condition not only for motivational responses, as has been shown with primary and secondary rewards, but also for hedonic reactions to music. This result supports recent findings showing that dopamine also mediates the perceived pleasantness attained by other types of abstract rewards and challenges previous findings in animal models on primary rewards, such as food.
1 2 Goupil L, Aucouturier JJ (February 2019). "Musical pleasure and musical emotions". Proceedings of the National Academy of Sciences of the United States of America. 116 (9): 3364–3366. Bibcode:2019PNAS..116.3364G. doi:10.1073/pnas.1900369116. PMC6397567. PMID30770455. In a pharmacological study published in PNAS, Ferreri et al. (1) present evidence that enhancing or inhibiting dopamine signaling using levodopa or risperidone modulates the pleasure experienced while listening to music.... In a final salvo to establish not only the correlational but also the causal implication of dopamine in musical pleasure, the authors have turned to directly manipulating dopaminergic signaling in the striatum, first by applying excitatory and inhibitory transcranial magnetic stimulation over their participants' left dorsolateral prefrontal cortex, a region known to modulate striatal function (5), and finally, in the current study, by administrating pharmaceutical agents able to alter dopamine synaptic availability (1), both of which influenced perceived pleasure, physiological measures of arousal, and the monetary value assigned to music in the predicted direction.... While the question of the musical expression of emotion has a long history of investigation, including in PNAS (6), and the 1990s psychophysiological strand of research had already established that musical pleasure could activate the autonomic nervous system (7), the authors' demonstration of the implication of the reward system in musical emotions was taken as inaugural proof that these were veridical emotions whose study has full legitimacy to inform the neurobiology of our everyday cognitive, social, and affective functions (8). Incidentally, this line of work, culminating in the article by Ferreri et al. (1), has plausibly done more to attract research funding for the field of music sciences than any other in this community. The evidence of Ferreri et al. (1) provides the latest support for a compelling neurobiological model in which musical pleasure arises from the interaction of ancient reward/valuation systems (striatal–limbic–paralimbic) with more phylogenetically advanced perception/predictions systems (temporofrontal).
Young, Jared W.; Anticevic, Alan; Barch, Deanna M. (2018). "Cognitive and Motivational Neuroscience of Psychotic Disorders". In Charney, Dennis S.; Sklar, Pamela; Buxbaum, Joseph D.; Nestler, Eric J. (eds.). Charney & Nestler's Neurobiology of Mental Illness (5thed.). New York: Oxford University Press. ISBN9780190681425.
External links
Wikimedia Commons has media related to Reward system.
This page is based on this Wikipedia article Text is available under the CC BY-SA 4.0 license; additional terms may apply. Images, videos and audio are available under their respective licenses.
