Neurorobotics

Last updated

Neurorobotics is the combined study of neuroscience, robotics, and artificial intelligence. It is the science and technology of embodied autonomous neural systems. Neural systems include brain-inspired algorithms (e.g. connectionist networks), computational models of biological neural networks (e.g. artificial spiking neural networks, large-scale simulations of neural microcircuits) and actual biological systems (e.g. in vivo and in vitro neural nets). Such neural systems can be embodied in machines with mechanic or any other forms of physical actuation. This includes robots, prosthetic or wearable systems but also, at smaller scale, micro-machines and, at the larger scales, furniture and infrastructures.

Contents

Neurorobotics is that branch of neuroscience with robotics, which deals with the study and application of science and technology of embodied autonomous neural systems like brain-inspired algorithms. It is based on the idea that the brain is embodied and the body is embedded in the environment. Therefore, most neurorobots are required to function in the real world, as opposed to a simulated environment. [1]

Beyond brain-inspired algorithms for robots neurorobotics may also involve the design of brain-controlled robot systems. [2] [3] [4]

Major classes of models

Neurorobots can be divided into various major classes based on the robot's purpose. Each class is designed to implement a specific mechanism of interest for study. Common types of neurorobots are those used to study motor control, memory, action selection, and perception.

Locomotion and motor control

Neurorobots are often used to study motor feedback and control systems, and have proved their merit in developing controllers for robots. Locomotion is modeled by a number of neurologically inspired theories on the action of motor systems. Locomotion control has been mimicked using models or central pattern generators, clumps of neurons capable of driving repetitive behavior, to make four-legged walking robots. [5] Other groups have expanded the idea of combining rudimentary control systems into a hierarchical set of simple autonomous systems. These systems can formulate complex movements from a combination of these rudimentary subsets. [6] This theory of motor action is based on the organization of cortical columns, which progressively integrate from simple sensory input into a complex afferent signals, or from complex motor programs to simple controls for each muscle fiber in efferent signals, forming a similar hierarchical structure.

Another method for motor control uses learned error correction and predictive controls to form a sort of simulated muscle memory. In this model, awkward, random, and error-prone movements are corrected for using error feedback to produce smooth and accurate movements over time. The controller learns to create the correct control signal by predicting the error. Using these ideas, robots have been designed which can learn to produce adaptive arm movements [7] or to avoid obstacles in a course.

Learning and memory systems

Robots designed to test theories of animal memory systems. Many studies examine the memory system of rats, particularly the rat hippocampus, dealing with place cells, which fire for a specific location that has been learned. [8] [9] Systems modeled after the rat hippocampus are generally able to learn mental maps of the environment, including recognizing landmarks and associating behaviors with them, allowing them to predict the upcoming obstacles and landmarks. [9]

Another study has produced a robot based on the proposed learning paradigm of barn owls for orientation and localization based on primarily auditory, but also visual stimuli. The hypothesized method involves synaptic plasticity and neuromodulation, [10] a mostly chemical effect in which reward neurotransmitters such as dopamine or serotonin affect the firing sensitivity of a neuron to be sharper. [11] The robot used in the study adequately matched the behavior of barn owls. [12] Furthermore, the close interaction between motor output and auditory feedback proved to be vital in the learning process, supporting active sensing theories that are involved in many of the learning models. [10]

Neurorobots in these studies are presented with simple mazes or patterns to learn. Some of the problems presented to the neurorobot include recognition of symbols, colors, or other patterns and execute simple actions based on the pattern. In the case of the barn owl simulation, the robot had to determine its location and direction to navigate in its environment.

Action selection and value systems

Action selection studies deal with negative or positive weighting to an action and its outcome. Neurorobots can and have been used to study simple ethical interactions, such as the classical thought experiment where there are more people than a life raft can hold, and someone must leave the boat to save the rest. However, more neurorobots used in the study of action selection contend with much simpler persuasions such as self-preservation or perpetuation of the population of robots in the study. These neurorobots are modeled after the neuromodulation of synapses to encourage circuits with positive results. [11] [13]

In biological systems, neurotransmitters such as dopamine or acetylcholine positively reinforce neural signals that are beneficial. One study of such interaction involved the robot Darwin VII, which used visual, auditory, and a simulated taste input to "eat" conductive metal blocks. The arbitrarily chosen good blocks had a striped pattern on them while the bad blocks had a circular shape on them. The taste sense was simulated by conductivity of the blocks. The robot had positive and negative feedbacks to the taste based on its level of conductivity. The researchers observed the robot to see how it learned its action selection behaviors based on the inputs it had. [14] Other studies have used herds of small robots which feed on batteries strewn about the room, and communicate its findings to other robots. [15]

Sensory perception

Neurorobots have also been used to study sensory perception, particularly vision. These are primarily systems that result from embedding neural models of sensory pathways in automatas. This approach gives exposure to the sensory signals that occur during behavior and also enables a more realistic assessment of the degree of robustness of the neural model. It is well known that changes in the sensory signals produced by motor activity provide useful perceptual cues that are used extensively by organisms. For example, researchers have used the depth information that emerges during replication of human head and eye movements to establish robust representations of the visual scene. [16] [17]

Biological robots

Biological robots are not officially neurorobots in that they are not neurologically inspired AI systems, but actual neuron tissue wired to a robot. This employs the use of cultured neural networks to study brain development or neural interactions. These typically consist of a neural culture raised on a multielectrode array (MEA), which is capable of both recording the neural activity and stimulating the tissue. In some cases, the MEA is connected to a computer which presents a simulated environment to the brain tissue and translates brain activity into actions in the simulation, as well as providing sensory feedback [18] The ability to record neural activity gives researchers a window into a brain, which they can use to learn about a number of the same issues neurorobots are used for.

An area of concern with the biological robots is ethics. Many questions are raised about how to treat such experiments. The central question concerns consciousness and whether or not the rat brain experiences it. There are many theories about how to define consciousness. [19] [20]

Implications for neuroscience

Neuroscientists benefit from neurorobotics because it provides a blank slate to test various possible methods of brain function in a controlled and testable environment. While robots are more simplified versions of the systems they emulate, they are more specific, allowing more direct testing of the issue at hand. [10] [21] They also have the benefit of being accessible at all times, while it is more difficult to monitor large portions of a brain while the human or animal is active, especially individual neurons. [22]

The development of neuroscience has produced neural treatments. These include pharmaceuticals and neural rehabilitation. [23] Progress is dependent on an intricate understanding of the brain and how exactly it functions. It is difficult to study the brain, especially in humans, due to the danger associated with cranial surgeries. Neurorobots can improved the range of tests and experiments that can be performed in the study of neural processes.

See also

Related Research Articles

<span class="mw-page-title-main">Brain</span> Organ central to the nervous system

The brain is an organ that serves as the center of the nervous system in all vertebrate and most invertebrate animals. It consists of nervous tissue and is typically located in the head (cephalization), usually near organs for special senses such as vision, hearing and olfaction. Being the most specialized organ, it is responsible for receiving information from the sensory nervous system, processing those information and the coordination of motor control.

<span class="mw-page-title-main">Neuroscience</span> Scientific study of the nervous system

Neuroscience is the scientific study of the nervous system, its functions and disorders. It is a multidisciplinary science that combines physiology, anatomy, molecular biology, developmental biology, cytology, psychology, physics, computer science, chemistry, medicine, statistics, and mathematical modeling to understand the fundamental and emergent properties of neurons, glia and neural circuits. The understanding of the biological basis of learning, memory, behavior, perception, and consciousness has been described by Eric Kandel as the "epic challenge" of the biological sciences.

<span class="mw-page-title-main">Mind uploading</span> Hypothetical process of digitally emulating a brain

Mind uploading is a speculative process of whole brain emulation in which a brain scan is used to completely emulate the mental state of the individual in a digital computer. The computer would then run a simulation of the brain's information processing, such that it would respond in essentially the same way as the original brain and experience having a sentient conscious mind.

Computational neuroscience is a branch of neuroscience which employs mathematics, computer science, theoretical analysis and abstractions of the brain to understand the principles that govern the development, structure, physiology and cognitive abilities of the nervous system.

Neuromorphic computing is an approach to computing that is inspired by the structure and function of the human brain. A neuromorphic computer/chip is any device that uses physical artificial neurons to do computations. In recent times, the term neuromorphic has been used to describe analog, digital, mixed-mode analog/digital VLSI, and software systems that implement models of neural systems. The implementation of neuromorphic computing on the hardware level can be realized by oxide-based memristors, spintronic memories, threshold switches, transistors, among others. Training software-based neuromorphic systems of spiking neural networks can be achieved using error backpropagation, e.g., using Python based frameworks such as snnTorch, or using canonical learning rules from the biological learning literature, e.g., using BindsNet.

Neural engineering is a discipline within biomedical engineering that uses engineering techniques to understand, repair, replace, or enhance neural systems. Neural engineers are uniquely qualified to solve design problems at the interface of living neural tissue and non-living constructs.

<span class="mw-page-title-main">Stephen Grossberg</span> American scientist (born 1939)

Stephen Grossberg is a cognitive scientist, theoretical and computational psychologist, neuroscientist, mathematician, biomedical engineer, and neuromorphic technologist. He is the Wang Professor of Cognitive and Neural Systems and a Professor Emeritus of Mathematics & Statistics, Psychological & Brain Sciences, and Biomedical Engineering at Boston University.

Central pattern generators (CPGs) are self-organizing biological neural circuits that produce rhythmic outputs in the absence of rhythmic input. They are the source of the tightly-coupled patterns of neural activity that drive rhythmic and stereotyped motor behaviors like walking, swimming, breathing, or chewing. The ability to function without input from higher brain areas still requires modulatory inputs, and their outputs are not fixed. Flexibility in response to sensory input is a fundamental quality of CPG-driven behavior. To be classified as a rhythmic generator, a CPG requires:

  1. "two or more processes that interact such that each process sequentially increases and decreases, and
  2. that, as a result of this interaction, the system repeatedly returns to its starting condition."

Motor control is the regulation of movements in organisms that possess a nervous system. Motor control includes conscious voluntary movements, subconscious muscle memory and involuntary reflexes, as well as instinctual taxis.

Neuroinformatics is the emergent field that combines informatics and neuroscience. Neuroinformatics is related with neuroscience data and information processing by artificial neural networks. There are three main directions where neuroinformatics has to be applied:

A hybrot is a cybernetic organism in the form of a robot controlled by a computer consisting of both electronic and biological elements. The biological elements are typically rat neurons connected to a computer chip.

A cultured neuronal network is a cell culture of neurons that is used as a model to study the central nervous system, especially the brain. Often, cultured neuronal networks are connected to an input/output device such as a multi-electrode array (MEA), thus allowing two-way communication between the researcher and the network. This model has proved to be an invaluable tool to scientists studying the underlying principles behind neuronal learning, memory, plasticity, connectivity, and information processing.

In the field of computational neuroscience, Brain simulation is the concept of creating a functioning computer model of a brain or part of a brain. Brain simulation projects intend to contribute to a complete understanding of the brain, and eventually also assist the process of treating and diagnosing brain diseases. Simulations utilize mathematical models of biological neurons, such as the hodgkin-huxley model, to simulate the behavior of neurons, or other cells within the brain.

AnimatLab is an open-source neuromechanical simulation tool that allows authors to easily build and test biomechanical models and the neural networks that control them to produce behaviors. Users can construct neural models of varied level of details, 3D mechanical models of triangle meshes, and use muscles, motors, receptive fields, stretch sensors and other transducers to interface the two systems. Experiments can be run in which various stimuli are applied and data is recorded, making it a useful tool for computational neuroscience. The software can also be used to model biomimetic robotic systems.

In neuroscience, predictive coding is a theory of brain function which postulates that the brain is constantly generating and updating a "mental model" of the environment. According to the theory, such a mental model is used to predict input signals from the senses that are then compared with the actual input signals from those senses. Predictive coding is member of a wider set of theories that follow the Bayesian brain hypothesis.

<span class="mw-page-title-main">Reza Shadmehr</span> Iranian-American professor (born 1963)

Reza Shadmehr is an Iranian-American professor of Biomedical Engineering and Neuroscience at the Johns Hopkins School of Medicine. He is known for his contributions to the fields of motor control, motor learning, and computational neuroscience.

<span class="mw-page-title-main">Aude Billard</span> Swiss physicist

Aude G. Billard is a Swiss physicist in the fields of machine learning and human-robot interactions. As a full professor at the School of Engineering at Swiss Federal Institute of Technology in Lausanne (EPFL), Billard’s research focuses on applying machine learning to support robot learning through human guidance. Billard’s work on human-robot interactions has been recognized numerous times by the Institute of Electrical and Electronics Engineers (IEEE) and she currently holds a leadership position on the executive committee of the IEEE Robotics and Automation Society (RAS) as the vice president of publication activities.

<span class="mw-page-title-main">Auke Ijspeert</span> Swiss-Dutch roboticist and neuroscientist

Auke Jan Ijspeert is a Swiss-Dutch roboticist and neuroscientist. He is a professor of biorobotics in the Institute of Bioengineering at EPFL, École Polytechnique Fédérale de Lausanne, and the head of the Biorobotics Laboratory at the School of Engineering.

<span class="mw-page-title-main">Synthetic nervous system</span> Computational neuroscience model

Synthetic Nervous System (SNS) is a computational neuroscience model that may be developed with the Functional Subnetwork Approach (FSA) to create biologically plausible models of circuits in a nervous system. The FSA enables the direct analytical tuning of dynamical networks that perform specific operations within the nervous system without the need for global optimization methods like genetic algorithms and reinforcement learning. The primary use case for a SNS is system control, where the system is most often a simulated biomechanical model or a physical robotic platform. An SNS is a form of a neural network much like artificial neural networks (ANNs), convolutional neural networks (CNN), and recurrent neural networks (RNN). The building blocks for each of these neural networks is a series of nodes and connections denoted as neurons and synapses. More conventional artificial neural networks rely on training phases where they use large data sets to form correlations and thus “learn” to identify a given object or pattern. When done properly this training results in systems that can produce a desired result, sometimes with impressive accuracy. However, the systems themselves are typically “black boxes” meaning there is no readily distinguishable mapping between structure and function of the network. This makes it difficult to alter the function, without simply starting over, or extract biological meaning except in specialized cases. The SNS method differentiates itself by using details of both structure and function of biological nervous systems. The neurons and synapse connections are intentionally designed rather than iteratively changed as part of a learning algorithm.

<span class="mw-page-title-main">Juyang Weng</span> Chinese-American computer engineer and neuroscientist

Juyang (John) Weng is a Chinese-American computer engineer, neuroscientist, author, and academic. He is a former professor at the Department of Computer Science and Engineering at Michigan State University and the President of Brain-Mind Institute and GENISAMA.

References

  1. ↑ Chiel HJ, Beer RD (December 1997). "The brain has a body: adaptive behavior emerges from interactions of nervous system, body and environment". Trends in Neurosciences. 20 (12): 553–7. doi:10.1016/s0166-2236(97)01149-1. PMID   9416664. S2CID   5634365.
  2. ↑ Vannucci L, Ambrosano A, Cauli N, Albanese U, Falotico E, Ulbrich S, et al. (1 November 2015). "A visual tracking model implemented on the iCub robot as a use case for a novel neurorobotic toolkit integrating brain and physics simulation". 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids). pp. 1179–1184. doi:10.1109/HUMANOIDS.2015.7363512. ISBN   978-1-4799-6885-5. S2CID   206713899.
  3. ↑ Röhrbein F, Laschi C, Walter F, Bohte S, Falotico E, Tolu S, Ulbrich S (September 2015). Brain-Supported Learning Algorithms for Robots (PDF). Proceedings of the EuroAsianPacific Joint Conference on Cognitive Science/4th European Conference on Cognitive Science/11th International Conference on Cognitive Science. Torino, Italy. Retrieved 9 April 2017.
  4. ↑ Arrowsmith E (2 October 2012). "A Basic Neurorobotics Platform Using the Neurosky Mindwave". Ern Arrowsmith. Retrieved 9 April 2017– via wordpress.com.
  5. ↑ Ijspeert AJ, Crespi A, Ryczko D, Cabelguen JM (March 2007). "From swimming to walking with a salamander robot driven by a spinal cord model" (PDF). Science. 315 (5817). New York, N.Y.: 1416–20. Bibcode:2007Sci...315.1416I. doi:10.1126/science.1138353. PMID   17347441. S2CID   3193002.
  6. ↑ Giszter SF, Moxon KA, Rybak IA, Chapin JK (November 2001). "Neurobiological and neurorobotic approaches to control architectures for a humanoid motor system". Robotics and Autonomous Systems. 37 (2–3): 219–235. doi:10.1016/S0921-8890(01)00159-2.
  7. ↑ Eskiizmirliler S, Forestier N, Tondu B, Darlot C (May 2002). "A model of the cerebellar pathways applied to the control of a single-joint robot arm actuated by McKibben artificial muscles". Biological Cybernetics. 86 (5): 379–394. doi:10.1007/s00422-001-0302-1. PMID   11984652. S2CID   8051621.
  8. ↑ O'Keefe J, Nadel L (1978). The hippocampus as a cognitive map. Oxford: Clarendon Press. ISBN   978-0-19-857206-0.
  9. 1 2 Matarić MJ (March 1998). "Behavior-based robotics as a tool for synthesis of artificial behavior and analysis of natural behavior". Trends in Cognitive Sciences. 2 (3): 82–6. doi:10.1016/s1364-6613(98)01141-3. PMID   21227083. S2CID   17860567.
  10. 1 2 3 Rucci M, Bullock D, Santini F (January 2007). "Integrating robotics and neuroscience: brains for robots, bodies for brains". Advanced Robotics. 21 (10): 1115–1129. doi:10.1163/156855307781389428. S2CID   18575829.
  11. 1 2 Cox BR, Krichmar JL (September 2009). "Neuromodulation as a robot controller". IEEE Robotics & Automation Magazine. 16 (3): 72–80. doi:10.1109/mra.2009.933628. S2CID   16807722.
  12. ↑ Rucci M, Edelman GM, Wray J (February 1999). "Adaptation of orienting behavior: From the barn owl to a robotic system". IEEE Transactions on Robotics and Automation. 15 (1): 96–110. doi:10.1109/70.744606. S2CID   8061163.
  13. ↑ Hasselmo ME, Hay J, Ilyn M, Gorchetchnikov A (2002). "Neuromodulation, theta rhythm and rat spatial navigation". Neural Networks. 15 (4–6): 689–707. doi:10.1016/s0893-6080(02)00057-6. PMID   12371520.
  14. ↑ Krichmar JL, Edelman GM (August 2002). "Machine psychology: autonomous behavior, perceptual categorization and conditioning in a brain-based device". Cerebral Cortex. 12 (8). New York, N.Y.: 818–30. doi: 10.1093/cercor/12.8.818 . PMID   12122030.
  15. ↑ Doya K, Uchibe E (June 2005). "The cyber rodent project: Exploration of adaptive mechanisms for self-preservation and self-reproduction". Adaptive Behavior. 13 (2): 149–160. doi:10.1177/105971230501300206. S2CID   35959217.
  16. ↑ Santini F, Rucci M (February 2007). "Active estimation of distance in a robotic system that replicates human eye movement". Robotics and Autonomous Systems. 55 (2): 107–121. doi:10.1016/j.robot.2006.07.001.
  17. ↑ Kuang X, Gibson M, Shi BE, Rucci M (July 2012). "Active vision during coordinated head/eye movements in a humanoid robot". IEEE Transactions on Robotics. 28 (6): 1423–1430. doi:10.1109/TRO.2012.2204513. S2CID   17969004.
  18. ↑ Demarse TB, Wagenaar DA, Blau AW, Potter SM (2001). "The Neurally Controlled Animat: Biological Brains Acting with Simulated Bodies". Autonomous Robots. 11 (3): 305–310. doi:10.1023/a:1012407611130. PMC   2440704 . PMID   18584059.
  19. ↑ Warwick K (September 2010). "Implications and consequences of robots with biological brains". Ethics and Information Technology. 12 (3): 223–234. doi:10.1007/s10676-010-9218-6. S2CID   1263639.
  20. ↑ Bentzen MM (2014). "Brains on Wheels: Theoretical and Ethical Issues in Bio-Robotics.". Sociable Robots and the Future of Social Relations. IOS Press. pp. 245–251. doi:10.3233/978-1-61499-480-0-245. S2CID   67790806.
  21. ↑ Niu CM, Jalaleddini K, Sohn WJ, Rocamora J, Sanger TD, Valero-Cuevas FJ (April 2017). "Neuromorphic meets neuromechanics, part I: the methodology and implementation". Journal of Neural Engineering. 14 (2): 025001. Bibcode:2017JNEng..14b5001N. doi:10.1088/1741-2552/aa593c. PMC   5540665 . PMID   28084217.
  22. ↑ Jalaleddini K, Minos Niu C, Chakravarthi Raja S, Joon Sohn W, Loeb GE, Sanger TD, Valero-Cuevas FJ (April 2017). "Neuromorphic meets neuromechanics, part II: the role of fusimotor drive". Journal of Neural Engineering. 14 (2): 025002. Bibcode:2017JNEng..14b5002J. doi:10.1088/1741-2552/aa59bd. PMC   5394229 . PMID   28094764.
  23. ↑ Bach-y-Rita P (July 1999). "Theoretical aspects of sensory substitution and of neurotransmission-related reorganization in spinal cord injury". Spinal Cord. 37 (7): 465–74. doi: 10.1038/sj.sc.3100873 . PMID   10438112. S2CID   8419555.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.