Wolfram Schultz

Last updated
Wolfram Schultz

FRS
Alma mater University of Heidelberg (MD)
University of Fribourg (PhD)
Known forresearch that demonstrates that dopamine neurons signal errors in reward prediction
AwardsBrain Prize, Golden Brain Award, Gruber Prize in Neuroscience, & Karl Spencer Lashley Award
Scientific career
Institutions University of Cambridge
Website www.wolframschultz.org

Wolfram Schultz, FRS is a German professor of Neuroscience at the University of Cambridge known for his research that dopamine neurons signal errors in reward prediction. [1] [2] [3]

Contents

Life and career

Schultz received his medical degree from the University of Heidelberg in 1972 and his PhD in Physiology from the University of Fribourg, Switzerland. [3] [4] He then completed three postdoctoral research fellowships: with the German neurophysiologist Otto Cruetzfeld at the Max-Planck Institute for Biophysical Chemistry in Gottingen, Germany, Australian neurophysiologist John C. Eccles at State University of New York at Buffalo in the United States, and the neuropsychopharmacist Urban Ungerstedt at the Karolinska Institute in Stockholm. [3] Schultz moved to the University of Cambridge in 2001, where he is currently Wellcome Principal Research Fellow and Professor of Neuroscience. [5] [6]

Research

During the 1980s and 1990s, Schultz was experimenting with macaque monkeys when he found that dopamine neurons in their basal ganglia increased in activity after they were given a reward. [6] This led to the discovery for which he is best known: dopamine neurons signal errors in reward prediction (the difference between the reward an animal expects and the reward it actually receives). [6]

Honours and awards

He won the Golden Brain Award in 2002, The Brain Prize in 2017, the Gruber Prize in Neuroscience in 2018, the Karl Spencer Lashley Award in 2019, and has an h-index of 101. [4] [7]

He is a Fellow of the Royal Society and past president of the European Brain and Behaviour Society. [3]

Selected publications

Related Research Articles

<span class="mw-page-title-main">Neurotransmitter</span> Chemical substance that enables neurotransmission

A neurotransmitter is a signaling molecule secreted by a neuron to affect another cell across a synapse. The cell receiving the signal, or target cell, may be another neuron, but could also be a gland or muscle cell.

<span class="mw-page-title-main">Striatum</span> Nucleus in the basal ganglia of the brain

The striatum or corpus striatum is a nucleus in the subcortical basal ganglia of the forebrain. The striatum is a critical component of the motor and reward systems; receives glutamatergic and dopaminergic inputs from different sources; and serves as the primary input to the rest of the basal ganglia.

<span class="mw-page-title-main">Dopamine</span> Organic chemical that functions both as a hormone and a neurotransmitter

Dopamine is a neuromodulatory molecule that plays several important roles in cells. It is an organic chemical of the catecholamine and phenethylamine families. Dopamine constitutes about 80% of the catecholamine content in the brain. It is an amine synthesized by removing a carboxyl group from a molecule of its precursor chemical, L-DOPA, which is synthesized in the brain and kidneys. Dopamine is also synthesized in plants and most animals. In the brain, dopamine functions as a neurotransmitter—a chemical released by neurons to send signals to other nerve cells. Neurotransmitters are synthesized in specific regions of the brain, but affect many regions systemically. The brain includes several distinct dopamine pathways, one of which plays a major role in the motivational component of reward-motivated behavior. The anticipation of most types of rewards increases the level of dopamine in the brain, and many addictive drugs increase dopamine release or block its reuptake into neurons following release. Other brain dopamine pathways are involved in motor control and in controlling the release of various hormones. These pathways and cell groups form a dopamine system which is neuromodulatory.

The mesolimbic pathway, sometimes referred to as the reward pathway, is a dopaminergic pathway in the brain. The pathway connects the ventral tegmental area in the midbrain to the ventral striatum of the basal ganglia in the forebrain. The ventral striatum includes the nucleus accumbens and the olfactory tubercle.

<span class="mw-page-title-main">Nucleus accumbens</span> Region of the basal forebrain

The nucleus accumbens is a region in the basal forebrain rostral to the preoptic area of the hypothalamus. The nucleus accumbens and the olfactory tubercle collectively form the ventral striatum. The ventral striatum and dorsal striatum collectively form the striatum, which is the main component of the basal ganglia. The dopaminergic neurons of the mesolimbic pathway project onto the GABAergic medium spiny neurons of the nucleus accumbens and olfactory tubercle. Each cerebral hemisphere has its own nucleus accumbens, which can be divided into two structures: the nucleus accumbens core and the nucleus accumbens shell. These substructures have different morphology and functions.

<span class="mw-page-title-main">Dopaminergic pathways</span> Projection neurons in the brain that synthesize and release dopamine

Dopaminergic pathways in the human brain are involved in both physiological and behavioral processes including movement, cognition, executive functions, reward, motivation, and neuroendocrine control. Each pathway is a set of projection neurons, consisting of individual dopaminergic neurons.

<span class="mw-page-title-main">Ventral tegmental area</span> Group of neurons on the floor of the midbrain

The ventral tegmental area (VTA), also known as the ventral tegmental area of Tsai, or simply ventral tegmentum, is a group of neurons located close to the midline on the floor of the midbrain. The VTA is the origin of the dopaminergic cell bodies of the mesocorticolimbic dopamine system and other dopamine pathways; it is widely implicated in the drug and natural reward circuitry of the brain. The VTA plays an important role in a number of processes, including reward cognition and orgasm, among others, as well as several psychiatric disorders. Neurons in the VTA project to numerous areas of the brain, ranging from the prefrontal cortex to the caudal brainstem and several regions in between.

Motivational salience is a cognitive process and a form of attention that motivates or propels an individual's behavior towards or away from a particular object, perceived event or outcome. Motivational salience regulates the intensity of behaviors that facilitate the attainment of a particular goal, the amount of time and energy that an individual is willing to expend to attain a particular goal, and the amount of risk that an individual is willing to accept while working to attain a particular goal.

Temporal difference (TD) learning refers to a class of model-free reinforcement learning methods which learn by bootstrapping from the current estimate of the value function. These methods sample from the environment, like Monte Carlo methods, and perform updates based on current estimates, like dynamic programming methods.

<span class="mw-page-title-main">Habenula</span> Small bilateral neuronal structure in the brain of vertebrates

The habenula is a small bilateral neuronal structure in the brain of vertebrates, that has also been called a microstructure since it is no bigger than a pea. The naming as little rein describes its elongated shape in the epithalamus, where it borders the third ventricle, and lies in front of the pineal gland.

<span class="mw-page-title-main">Peter Dayan</span> Researcher in computational neuroscience

Peter Dayan is a British neuroscientist and computer scientist who is director at the Max Planck Institute for Biological Cybernetics in Tübingen, Germany, along with Ivan De Araujo. He is co-author of Theoretical Neuroscience, an influential textbook on computational neuroscience. He is known for applying Bayesian methods from machine learning and artificial intelligence to understand neural function and is particularly recognized for relating neurotransmitter levels to prediction errors and Bayesian uncertainties. He has pioneered the field of reinforcement learning (RL) where he helped develop the Q-learning algorithm, and made contributions to unsupervised learning, including the wake-sleep algorithm for neural networks and the Helmholtz machine.

<span class="mw-page-title-main">Reward system</span> Group of neural structures responsible for motivation and desire

The reward system is a group of neural structures responsible for incentive salience, associative learning, and positively-valenced emotions, particularly ones involving pleasure as a core component. Reward is the attractive and motivational property of a stimulus that induces appetitive behavior, also known as approach behavior, and consummatory behavior. A rewarding stimulus has been described as "any stimulus, object, event, activity, or situation that has the potential to make us approach and consume it is by definition a reward". In operant conditioning, rewarding stimuli function as positive reinforcers; however, the converse statement also holds true: positive reinforcers are rewarding.

Pendleton Read Montague, Jr. is an American neuroscientist and popular science author. He is the director of the Human Neuroimaging Lab and Computational Psychiatry Unit at the Fralin Biomedical Research Institute at VTC in Roanoke, Virginia, where he also holds the title of the inaugural Virginia Tech Carilion Vernon Mountcastle Research Professor. Montague is also a professor in the department of physics at Virginia Tech in Blacksburg, Virginia and professor of Psychiatry and Behavioral Medicine at Virginia Tech Carilion School of Medicine.

The Gruber Prize in Neuroscience, established in 2004, is one of three international awards worth US$500,000 made by the Gruber Foundation, a non-profit organization based in Yale University in New Haven, Connecticut.

<span class="mw-page-title-main">Ann Graybiel</span> American neuroscientist

Ann Martin Graybiel is an Institute Professor and a faculty member in the Department of Brain and Cognitive Sciences at the Massachusetts Institute of Technology. She is also an investigator at the McGovern Institute for Brain Research. She is an expert on the basal ganglia and the neurophysiology of habit formation, implicit learning, and her work is relevant to Parkinson's disease, Huntington's disease, obsessive–compulsive disorder, substance abuse and other disorders that affect the basal ganglia.

Paul W. Glimcher is an American neuroeconomist, neuroscientist, psychologist, economist, scholar, and entrepreneur. He is one of the foremost researchers focused on the study of human behavior and decision-making, and is known for his central role in founding and developing the field of neuroeconomics which takes an interdisciplinary approach to understanding how humans make decisions. Glimcher also founded the Institute for the Study of Decision Making at New York University (NYU). Today he serves as Chair of the Department of Neuroscience and Director of the Neurosciences Institute at NYU's Grossman School of Medicine.

In neuroscience, predictive coding is a theory of brain function which postulates that the brain is constantly generating and updating a "mental model" of the environment. According to the theory, such a mental model is used to predict input signals from the senses that are then compared with the actual input signals from those senses. With the rising popularity of representation learning, the theory is being actively pursued and applied in machine learning and related fields.

<span class="mw-page-title-main">Okihide Hikosaka</span> Neuroscience Professor

Okihide Hikosaka is a neuroscience research professor who specializes in the mechanisms of motivation, learning, skill, decision-making, attention, and oculomotor control. His research into neuronal mechanisms of voluntary behavior and basal ganglia function created breakthroughs in the understanding of the neurochemistry behind information-seeking behavior and the efficacy of grouping motor sequence learning actions in order to remember more than individual actions.

Ilana B. Witten is an American neuroscientist and professor of psychology and neuroscience at Princeton University. Witten studies the mesolimbic pathway, with a focus on the striatal neural circuit mechanisms driving reward learning and decision making.

Anthony J. Dickinson, is a British psychologist, currently Emeritus Professor of Comparative Psychology in the Department of Psychology at the University of Cambridge. He is the author of the highly cited monograph Contemporary Animal Learning Theory and was elected a Fellow of the Royal Society in 2003 for "internationally recognised contributions to our understanding of learning, memory, motivation and planning".

References

  1. "Wolfram Schultz". royalsociety.org. Retrieved 2023-10-23.
  2. "Wolfram Schultz". www.wolframschultz.org. Retrieved 2023-10-23.
  3. 1 2 3 4 "Wolfram Schultz | Gruber Foundation". gruber.yale.edu. Retrieved 2023-10-23.
  4. 1 2 "Wolfram Schultz | The Lundbeck Foundation". lundbeckfonden.com. Retrieved 2023-10-23.
  5. "Prof Wolfram Schultz FRS". University of Cambridge. Retrieved 16 November 2023.
  6. 1 2 3 "Wolfram Schultz". Gruber Foundation. Yale University. Retrieved 16 November 2023.
  7. "Wolfram Schultz". scholar.google.co.uk. Retrieved 2023-10-23.