Andrew Barto

Last updated
Andrew G. Barto
Andrew G. Barto.jpg
Bornc. 1948 (age 7475)
Nationality American
Alma mater University of Michigan
Awards IEEE Neural Networks Society Pioneer Award, IJCAI Award for Research Excellence
Scientific career
Fields Computer science
Institutions University of Massachusetts Amherst
Doctoral students Richard S. Sutton, Satinder Singh

Andrew G. Barto (born c. 1948) is an American computer scientist, currently Professor Emeritus of computer science at University of Massachusetts Amherst. Barto is best known for his foundational contributions to the field of modern computational reinforcement learning. [1]

Contents

Early life and education

Barto received his B.S. with distinction in mathematics from the University of Michigan in 1970, after having initially majored in naval architecture and engineering. After reading work by Michael Arbib and McCulloch and Pitts he became interested in using computers and mathematics to model the brain, and five years later was awarded a Ph.D. in computer science for a thesis on cellular automata. [2]

Career

In 1977, Barto joined the College of Information and Computer Sciences at the University of Massachusetts Amherst as a postdoctoral research associate, was promoted to associate professor in 1982, and full professor in 1991. He was department chair from 2007 to 2011 and a core faculty member of the Neuroscience and Behavior program. [3]

During this time at UMass, Barto co-directed the Autonomous Learning Laboratory (initially the Adaptive Network Laboratory), which generated several key ideas in reinforcement learning. Richard Sutton, with whom he co-authored the influential book Reinforcement Learning: An Introduction (MIT Press 1998; 2nd edition 2018), was his first PhD student. Barto graduated 27 PhD students, thirteen of which went on to become professors. [3]

Barto published over one hundred papers or chapters in journals, books, and conference and workshop proceedings. He is co-author with Richard Sutton of the book Reinforcement Learning: An Introduction, MIT Press 1998 (2nd edition 2018), and co-editor with Jennie Si, Warren Powell, and Don Wunch II of the Handbook of Learning and Approximate Dynamic Programming, Wiley-IEEE Press, 2004. [4]

Awards and honors

Barto is a Fellow of the American Association for the Advancement of Science, a Fellow and Senior Member of the IEEE, [5] and a member of the American Association for Artificial Intelligence and the Society for Neuroscience.

Barto was awarded the UMass Neurosciences Lifetime Achievement Award, 2019, the IEEE Neural Network Society Pioneer Award in 2004, [6] and the IJCAI Award for Research Excellence, 2017. His citation for the latter read:

Professor Barto is recognized for his groundbreaking and impactful research in both the theory and application of reinforcement learning. [1]

Related Research Articles

<span class="mw-page-title-main">Marvin Minsky</span> American cognitive scientist (1927–2016)

Marvin Lee Minsky was an American cognitive and computer scientist concerned largely with research of artificial intelligence (AI), co-founder of the Massachusetts Institute of Technology's AI laboratory, and author of several texts concerning AI and philosophy.

<span class="mw-page-title-main">Reinforcement learning</span> Field of machine learning

Reinforcement learning (RL) is an area of machine learning concerned with how intelligent agents ought to take actions in an environment in order to maximize the notion of cumulative reward. Reinforcement learning is one of three basic machine learning paradigms, alongside supervised learning and unsupervised learning.

<span class="mw-page-title-main">Steve Furber</span> British computer scientist

Stephen Byram Furber is a British computer scientist, mathematician and hardware engineer, currently the ICL Professor of Computer Engineering in the Department of Computer Science at the University of Manchester, UK. After completing his education at the University of Cambridge, he spent the 1980s at Acorn Computers, where he was a principal designer of the BBC Micro and the ARM 32-bit RISC microprocessor. As of 2018, over 100 billion copies of the ARM processor have been manufactured, powering much of the world's mobile computing and embedded systems.

Terrence Joseph Sejnowski is the Francis Crick Professor at the Salk Institute for Biological Studies where he directs the Computational Neurobiology Laboratory and is the director of the Crick-Jacobs center for theoretical and computational biology. He has performed pioneering research in neural networks and computational neuroscience.

<span class="mw-page-title-main">Temporal difference learning</span> Computer programming concept

Temporal difference (TD) learning refers to a class of model-free reinforcement learning methods which learn by bootstrapping from the current estimate of the value function. These methods sample from the environment, like Monte Carlo methods, and perform updates based on current estimates, like dynamic programming methods.

Michael Anthony Arbib is an American computational neuroscientist. He is an Adjunct Professor of Psychology at the University of California at San Diego and professor emeritus at the University of Southern California; before his 2016 retirement he was the Fletcher Jones Professor of computer science, as well as a professor of biological sciences, biomedical engineering, electrical engineering, neuroscience and psychology.

Michael Irwin Jordan is an American scientist, professor at the University of California, Berkeley and researcher in machine learning, statistics, and artificial intelligence.

<span class="mw-page-title-main">Stephen Grossberg</span> American scientist (born 1939)

Stephen Grossberg is a cognitive scientist, theoretical and computational psychologist, neuroscientist, mathematician, biomedical engineer, and neuromorphic technologist. He is the Wang Professor of Cognitive and Neural Systems and a Professor Emeritus of Mathematics & Statistics, Psychological & Brain Sciences, and Biomedical Engineering at Boston University.

<span class="mw-page-title-main">Peter Dayan</span>

Peter Dayan is a British neuroscientist and computer scientist who is director at the Max Planck Institute for Biological Cybernetics in Tübingen, Germany. He is co-author of Theoretical Neuroscience, an influential textbook on computational neuroscience. He is known for applying Bayesian methods from machine learning and artificial intelligence to understand neural function and is particularly recognized for relating neurotransmitter levels to prediction errors and Bayesian uncertainties. He has pioneered the field of reinforcement learning (RL) where he helped develop the Q-learning algorithm, and made contributions to unsupervised learning, including the wake-sleep algorithm for neural networks and the Helmholtz machine.

<span class="mw-page-title-main">Jacek M. Zurada</span>

Jacek M. Zurada serves as a Professor of Electrical and Computer Engineering Department at the University of Louisville, Kentucky. His M.S. and Ph.D degrees are from Politechnika Gdaṅska ranked as #1 among Polish universities of technology. He has held visiting appointments at Swiss Federal Institute of Technology, Zurich, Princeton, Northeastern, Auburn, and at overseas universities in Australia, Chile, China, France, Germany, Hong Kong, Italy, Japan, Poland, Singapore, Spain, and South Africa. He is a Life Fellow of IEEE and a Fellow of International Neural Networks Society and Doctor Honoris Causa of Czestochowa Institute of Technology, Poland.

<span class="mw-page-title-main">Erol Gelenbe</span>

Sami Erol Gelenbe, a Turkish and French computer scientist, electronic engineer and applied mathematician, pioneered the field of Computer System and Network Performance in Europe. Active in European Union research projects, he is Professor in the Institute of Theoretical and Applied Informatics of the Polish Academy of Sciences (2017-), Associate Researcher in the I3S Laboratory and Abraham de Moivre Laboratory. Previous Chaired professorships include the University of Liège (1974-1979), University Paris-Saclay (1979-1986), University Paris Descartes (1986-2005), ECE Chair at Duke University (1993-1998), University Chair Professor and Director of EECS, University of Central Florida (1998-2003), and Dennis Gabor Professor and Head of Intelligent Systems and Networks, Imperial College (2003-2019).

<span class="mw-page-title-main">Richard S. Sutton</span> Canadian computer scientist

Richard S. Sutton is a Canadian computer scientist. He is a distinguished research scientist at DeepMind and a professor of computing science at the University of Alberta. Sutton is considered one of the founders of modern computational reinforcement learning, having several significant contributions to the field, including temporal difference learning and policy gradient methods.

<span class="mw-page-title-main">Daniela L. Rus</span> American computer scientist

Daniela L. Rus is a roboticist and computer scientist, Director of the MIT Computer Science and Artificial Intelligence Laboratory (CSAIL), and the Andrew and Erna Viterbi Professor in the Department of Electrical Engineering and Computer Science (EECS) at the Massachusetts Institute of Technology.

<span class="mw-page-title-main">University of Massachusetts Amherst College of Information and Computer Sciences</span>

The Manning College of Information and Computer Sciences is a college at the University of Massachusetts Amherst. Computer Science at University of Massachusetts Amherst began as a department in 1964. In 2012, the Department of Computer Science became a school, and in 2015 it became the College of Information and Computer Sciences.

Klaus-Robert Müller is a German computer scientist and physicist, most noted for his work in machine learning and brain–computer interfaces.

Stefan Schaal is a German-American computer scientist specializing in robotics, machine learning, autonomous systems, and computational neuroscience.

Prashant Shenoy is an Indian-American Computer Scientist. He is a Distinguished Professor of Computer Science in the College of Information and Computer Sciences at the University of Massachusetts Amherst. He is known for his contributions to distributed computing, computer networks, cloud computing, and computational sustainability.

Victor R. Lesser is Distinguished Professor Emeritus in the School of Computer Science at the University of Massachusetts at Amherst and the Director of Multi-Agent Systems Laboratory. He is widely considered as the founding father of multi-agent systems. He received the IJCAI Award for Research Excellence in 2009.

Donald C. Wunsch II is Mary K. Finley Distinguished Professor of computer engineering at the Missouri University of Science and Technology, and a Fellow of the Institute of Electrical and Electronics Engineers He is known for his work on " hardware implementations, reinforcement and unsupervised learning".

Barna Saha is an Indian-American theoretical computer scientist whose research interests include algorithmic applications of the probabilistic method, probabilistic databases, fine-grained complexity, and the analysis of big data. She is an associate professor and Jacobs Faculty Scholar in the Department of Computer Science & Engineering at the University of California, San Diego.

References

  1. 1 2 "IJCAI 2017 Awards". 19 August 2017. Retrieved September 6, 2022.
  2. "Virtual History Interview". International Neural Network Society. 7 January 2022. Retrieved September 6, 2022.
  3. 1 2 "Andrew G. Barto". University of Massachusetts Amherst. 17 February 2008. Retrieved October 18, 2020.
  4. UMass Amherst: Department of Computer Science Archived September 2, 2006, at the Wayback Machine
  5. "Barto elected IEEE fellow". University of Massachusetts Amherst. November 22, 2005. Retrieved December 3, 2019.
  6. ""IEEE Computational Intelligence Society Past Recipients"". 6 September 2022. Retrieved September 6, 2022.