Multi-agent system

Last updated

Simple reflex agent IntelligentAgent-SimpleReflex.png
Simple reflex agent
Learning agent IntelligentAgent-Learning.png
Learning agent

A multi-agent system (MAS or "self-organized system") is a computerized system composed of multiple interacting intelligent agents. [1] Multi-agent systems can solve problems that are difficult or impossible for an individual agent or a monolithic system to solve. [2] Intelligence may include methodic, functional, procedural approaches, algorithmic search or reinforcement learning. [3]

Contents

Despite considerable overlap, a multi-agent system is not always the same as an agent-based model (ABM). The goal of an ABM is to search for explanatory insight into the collective behavior of agents (which do not necessarily need to be "intelligent") obeying simple rules, typically in natural systems, rather than in solving specific practical or engineering problems. The terminology of ABM tends to be used more often in the science, and MAS in engineering and technology. [4] Applications where multi-agent systems research may deliver an appropriate approach include online trading, [5] disaster response, [6] [7] target surveillance [8] and social structure modelling. [9]

Concept

Multi-agent systems consist of agents and their environment. Typically multi-agent systems research refers to software agents. However, the agents in a multi-agent system could equally well be robots, humans or human teams. A multi-agent system may contain combined human-agent teams.

Agents can be divided into types spanning simple to complex. Categories include:

Agent environments can be divided into:

Agent environments can also be organized according to properties such as accessibility (whether it is possible to gather complete information about the environment), determinism (whether an action causes a definite effect), dynamics (how many entities influence the environment in the moment), discreteness (whether the number of possible actions in the environment is finite), episodicity (whether agent actions in certain time periods influence other periods), [11] and dimensionality (whether spatial characteristics are important factors of the environment and the agent considers space in its decision making). [12] Agent actions are typically mediated via an appropriate middleware. This middleware offers a first-class design abstraction for multi-agent systems, providing means to govern resource access and agent coordination. [13]

Characteristics

The agents in a multi-agent system have several important characteristics: [14]

Self-organisation and self-direction

Multi-agent systems can manifest self-organisation as well as self-direction and other control paradigms and related complex behaviors even when the individual strategies of all their agents are simple.[ citation needed ] When agents can share knowledge using any agreed language, within the constraints of the system's communication protocol, the approach may lead to a common improvement. Example languages are Knowledge Query Manipulation Language (KQML) or Agent Communication Language (ACL).

System paradigms

Many MAS are implemented in computer simulations, stepping the system through discrete "time steps". The MAS components communicate typically using a weighted request matrix, e.g.

 Speed-VERY_IMPORTANT: min=45 mph,   Path length-MEDIUM_IMPORTANCE: max=60 expectedMax=40,   Max-Weight-UNIMPORTANT   Contract Priority-REGULAR 

and a weighted response matrix, e.g.

 Speed-min:50 but only if weather sunny,   Path length:25 for sunny / 46 for rainy  Contract Priority-REGULAR  note – ambulance will override this priority and you'll have to wait

A challenge-response-contract scheme is common in MAS systems, where

also considering other components, evolving "contracts" and the restriction sets of the component algorithms.

Another paradigm commonly used with MAS is the "pheromone", where components leave information for other nearby components. These pheromones may evaporate/concentrate with time, that is their values may decrease (or increase).

Properties

MAS tend to find the best solution for their problems without intervention. There is high similarity here to physical phenomena, such as energy minimizing, where physical objects tend to reach the lowest energy possible within the physically constrained world. For example: many of the cars entering a metropolis in the morning will be available for leaving that same metropolis in the evening.

The systems also tend to prevent propagation of faults, self-recover and be fault tolerant, mainly due to the redundancy of components.

Research

The study of multi-agent systems is "concerned with the development and analysis of sophisticated AI problem-solving and control architectures for both single-agent and multiple-agent systems." [16] Research topics include:

Frameworks

Frameworks have emerged that implement common standards (such as the FIPA and OMG MASIF standards). [23] These frameworks e.g. JADE, save time and aid in the standardization of MAS development. [24]

Currently though, no standard is actively maintained from FIPA or OMG. Efforts for further development of software agents in industrial context are carried out in IEEE IES technical committee on Industrial Agents. [25]

Applications

MAS have not only been applied in academic research, but also in industry. [26] MAS are applied in the real world to graphical applications such as computer games. Agent systems have been used in films. [27] It is widely advocated for use in networking and mobile technologies, to achieve automatic and dynamic load balancing, high scalability and self-healing networks. They are being used for coordinated defence systems.

Other applications [28] include transportation, [29] logistics, [30] graphics, manufacturing, power system, [31] smartgrids, [32] and the GIS.

Also, Multi-agent Systems Artificial Intelligence (MAAI) are used for simulating societies, the purpose thereof being helpful in the fields of climate, energy, epidemiology, conflict management, child abuse, .... [33] Some organisations working on using multi-agent system models include Center for Modelling Social Systems, Centre for Research in Social Simulation, Centre for Policy Modelling, Society for Modelling and Simulation International. [33]

Vehicular traffic with controlled autonomous vehicles can be modelling as a multi-agent system involving crowd dynamics. [34] Hallerbach et al. discussed the application of agent-based approaches for the development and validation of automated driving systems via a digital twin of the vehicle-under-test and microscopic traffic simulation based on independent agents. [35] Waymo has created a multi-agent simulation environment Carcraft to test algorithms for self-driving cars. [36] [37] It simulates traffic interactions between human drivers, pedestrians and automated vehicles. People's behavior is imitated by artificial agents based on data of real human behavior.

See also

Related Research Articles

Distributed Artificial Intelligence (DAI) also called Decentralized Artificial Intelligence is a subfield of artificial intelligence research dedicated to the development of distributed solutions for problems. DAI is closely related to and a predecessor of the field of multi-agent systems.

<span class="mw-page-title-main">Boids</span> Artificial life program

Boids is an artificial life program, developed by Craig Reynolds in 1986, which simulates the flocking behaviour of birds, and related group motion. His paper on this topic was published in 1987 in the proceedings of the ACM SIGGRAPH conference. The name "boid" corresponds to a shortened version of "bird-oid object", which refers to a bird-like object. Reynolds' boid model is one example of a larger general concept, for which many other variations have been developed since. The closely related work of Ichiro Aoki is noteworthy because it was published in 1982 — five years before Reynolds' boids paper.

In computer science, a software agent is a computer program that acts for a user or another program in a relationship of agency.

<span class="mw-page-title-main">Simultaneous localization and mapping</span> Computational navigational technique used by robots and autonomous vehicles

Simultaneous localization and mapping (SLAM) is the computational problem of constructing or updating a map of an unknown environment while simultaneously keeping track of an agent's location within it. While this initially appears to be a chicken or the egg problem, there are several algorithms known to solve it in, at least approximately, tractable time for certain environments. Popular approximate solution methods include the particle filter, extended Kalman filter, covariance intersection, and GraphSLAM. SLAM algorithms are based on concepts in computational geometry and computer vision, and are used in robot navigation, robotic mapping and odometry for virtual reality or augmented reality.

An agent-based model (ABM) is a computational model for simulating the actions and interactions of autonomous agents in order to understand the behavior of a system and what governs its outcomes. It combines elements of game theory, complex systems, emergence, computational sociology, multi-agent systems, and evolutionary programming. Monte Carlo methods are used to understand the stochasticity of these models. Particularly within ecology, ABMs are also called individual-based models (IBMs). A review of recent literature on individual-based models, agent-based models, and multiagent systems shows that ABMs are used in many scientific domains including biology, ecology and social science. Agent-based modeling is related to, but distinct from, the concept of multi-agent systems or multi-agent simulation in that the goal of ABM is to search for explanatory insight into the collective behavior of agents obeying simple rules, typically in natural systems, rather than in designing agents or solving specific practical or engineering problems.

<span class="mw-page-title-main">Swarm robotics</span> Coordination of multiple robots as a system

Swarm robotics is an approach to the coordination of multiple robots as a system which consist of large numbers of mostly simple physical robots. ″In a robot swarm, the collective behavior of the robots results from local interactions between the robots and between the robots and the environment in which they act.″ It is supposed that a desired collective behavior emerges from the interactions between the robots and interactions of robots with the environment. This approach emerged on the field of artificial swarm intelligence, as well as the biological studies of insects, ants and other fields in nature, where swarm behaviour occurs.

A blackboard system is an artificial intelligence approach based on the blackboard architectural model, where a common knowledge base, the "blackboard", is iteratively updated by a diverse group of specialist knowledge sources, starting with a problem specification and ending with a solution. Each knowledge source updates the blackboard with a partial solution when its internal constraints match the blackboard state. In this way, the specialists work together to solve the problem. The blackboard model was originally designed as a way to handle complex, ill-defined problems, where the solution is the sum of its parts.

The belief–desire–intention software model (BDI) is a software model developed for programming intelligent agents. Superficially characterized by the implementation of an agent's beliefs, desires and intentions, it actually uses these concepts to solve a particular problem in agent programming. In essence, it provides a mechanism for separating the activity of selecting a plan from the execution of currently active plans. Consequently, BDI agents are able to balance the time spent on deliberating about plans and executing those plans. A third activity, creating the plans in the first place (planning), is not within the scope of the model, and is left to the system designer and programmer.

<span class="mw-page-title-main">Intelligent agent</span> Software agent which acts autonomously

In intelligence and artificial intelligence, an intelligent agent (IA) is an agent acting in an intelligent manner; It perceives its environment, takes actions autonomously in order to achieve goals, and may improve its performance with learning or acquiring knowledge. An intelligent agent may be simple or complex: A thermostat or other control system is considered an example of an intelligent agent, as is a human being, as is any system that meets the definition, such as a firm, a state, or a biome.

Ekaterini Panagiotou Sycara is a Greek computer scientist. She is an Edward Fredkin Research Professor of Robotics in the Robotics Institute, School of Computer Science at Carnegie Mellon University internationally known for her research in artificial intelligence, particularly in the fields of negotiation, autonomous agents and multi-agent systems. She directs the Advanced Agent-Robotics Technology Lab at Robotics Institute, Carnegie Mellon University. She also serves as academic advisor for PhD students at both Robotics Institute and Tepper School of Business.

<span class="mw-page-title-main">Ronald C. Arkin</span> American roboticist and roboethicist

Ronald Craig Arkin is an American roboticist and roboethicist, and a Regents' Professor in the School of Interactive Computing, College of Computing at the Georgia Institute of Technology. He is known for the motor schema technique in robot navigation and for his book Behavior-Based Robotics.

<span class="mw-page-title-main">Velocity obstacle</span> Term in robotics and motion planning

In robotics and motion planning, a velocity obstacle, commonly abbreviated VO, is the set of all velocities of a robot that will result in a collision with another robot at some moment in time, assuming that the other robot maintains its current velocity. If the robot chooses a velocity inside the velocity obstacle then the two robots will eventually collide, if it chooses a velocity outside the velocity obstacle, such a collision is guaranteed not to occur.

Agent-oriented programming (AOP) is a programming paradigm where the construction of the software is centered on the concept of software agents. In contrast to object-oriented programming which has objects at its core, AOP has externally specified agents at its core. They can be thought of as abstractions of objects. Exchanged messages are interpreted by receiving "agents", in a way specific to its class of agents.

<span class="mw-page-title-main">Juan Pavón</span> Spanish computer scientist (b.1962)

Juan Pavón is a Spanish computer scientist, full professor of the Complutense University of Madrid (UCM). He is a pioneer researcher in the field of Software Agents, co-creator of the FIPA MESSAGE and INGENIAS methodologies, and founder and director of the research group GRASIA: GRoup of Agent-based, Social and Interdisciplinary Applications at UCM. He is known for his work in the field of Artificial Intelligence, specifically in agent-oriented software engineering. He has been often cited by mainstream media, as a reference in Artificial Intelligence.

Cloud robotics is a field of robotics that attempts to invoke cloud technologies such as cloud computing, cloud storage, and other Internet technologies centered on the benefits of converged infrastructure and shared services for robotics. When connected to the cloud, robots can benefit from the powerful computation, storage, and communication resources of modern data center in the cloud, which can process and share information from various robots or agent. Humans can also delegate tasks to robots remotely through networks. Cloud computing technologies enable robot systems to be endowed with powerful capability whilst reducing costs through cloud technologies. Thus, it is possible to build lightweight, low-cost, smarter robots with an intelligent "brain" in the cloud. The "brain" consists of data center, knowledge base, task planners, deep learning, information processing, environment models, communication support, etc.

Agent mining is an interdisciplinary area that synergizes multiagent systems with data mining and machine learning.

<span class="mw-page-title-main">Michael Wooldridge (computer scientist)</span> British computer scientist

Michael John Wooldridge is a professor of computer science at the University of Oxford. His main research interests is in multi-agent systems, and in particular, in the computational theory aspects of rational action in systems composed of multiple self-interested agents. His work is characterised by the use of techniques from computational logic, game theory, and social choice theory.

<span class="mw-page-title-main">GAMA Platform</span> Simulation platform

GAMA is a simulation platform with a complete modelling and simulation integrated development environment (IDE) for building spatially explicit agent-based simulations.

<span class="mw-page-title-main">Aude Billard</span> Swiss physicist

Aude G. Billard is a Swiss physicist in the fields of machine learning and human-robot interactions. As a full professor at the School of Engineering at Swiss Federal Institute of Technology in Lausanne (EPFL), Billard’s research focuses on applying machine learning to support robot learning through human guidance. Billard’s work on human-robot interactions has been recognized numerous times by the Institute of Electrical and Electronics Engineers (IEEE) and she currently holds a leadership position on the executive committee of the IEEE Robotics and Automation Society (RAS) as the vice president of publication activities.

<span class="mw-page-title-main">Lyle Norman Long</span> Academic and computational scientist

Lyle Norman Long is an academic, and computational scientist. He is a Professor Emeritus of Computational Science, Mathematics, and Engineering at The Pennsylvania State University, and is most known for developing algorithms and software for mathematical models, including neural networks, and robotics. His research has been focused in the fields of computational science, computational neuroscience, cognitive robotics, parallel computing, and software engineering.

References

  1. Yoav Shoham, Kevin Leyton-Brown. Multiagent Systems: Algorithmic, Game-Theoretic, and Logical Foundations. Cambridge University Press, 2009. http://www.masfoundations.org/
  2. Hu, J.; Turgut, A.; Lennox, B.; Arvin, F., "Robust Formation Coordination of Robot Swarms with Nonlinear Dynamics and Unknown Disturbances: Design and Experiments" IEEE Transactions on Circuits and Systems II: Express Briefs, 2021.
  3. Stefano V. Albrecht, Filippos Christianos, Lukas Schäfer. Multi-Agent Reinforcement Learning: Foundations and Modern Approaches. MIT Press, 2024. https://www.marl-book.com/
  4. Niazi, Muaz; Hussain, Amir (2011). "Agent-based Computing from Multi-agent Systems to Agent-Based Models: A Visual Survey" (PDF). Scientometrics. 89 (2): 479–499. arXiv: 1708.05872 . doi:10.1007/s11192-011-0468-9. S2CID   17934527.
  5. Rogers, Alex; David, E.; Schiff, J.; Jennings, N.R. (2007). "The Effects of Proxy Bidding and Minimum Bid Increments within eBay Auctions". ACM Transactions on the Web. 1 (2): 9–es. CiteSeerX   10.1.1.65.4539 . doi:10.1145/1255438.1255441. S2CID   207163424. Archived from the original on April 2, 2010. Retrieved March 18, 2008.
  6. Schurr, Nathan; Marecki, Janusz; Tambe, Milind; Scerri, Paul; Kasinadhuni, Nikhil; Lewis, J.P. (2005). "The Future of Disaster Response: Humans Working with Multiagent Teams using DEFACTO". Archived (PDF) from the original on June 3, 2013. Retrieved January 8, 2024.
  7. Genc, Zulkuf; et al. (2013). "Agent-Based Information Infrastructure for Disaster Management" (PDF). Intelligent Systems for Crisis Management. Lecture Notes in Geoinformation and Cartography. pp. 349–355. doi:10.1007/978-3-642-33218-0_26. ISBN   978-3-642-33217-3.
  8. Hu, Junyan; Bhowmick, Parijat; Lanzon, Alexander (2020). "Distributed Adaptive Time-Varying Group Formation Tracking for Multiagent Systems With Multiple Leaders on Directed Graphs". IEEE Transactions on Control of Network Systems. 7: 140–150. doi: 10.1109/TCNS.2019.2913619 . S2CID   149609966.
  9. Sun, Ron; Naveh, Isaac (June 30, 2004). "Simulating Organizational Decision-Making Using a Cognitively Realistic Agent Model". Journal of Artificial Societies and Social Simulation.
  10. 1 2 Kubera, Yoann; Mathieu, Philippe; Picault, Sébastien (2010), "Everything can be Agent!" (PDF), Proceedings of the Ninth International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS'2010): 1547–1548
  11. Russell, Stuart J.; Norvig, Peter (2003), Artificial Intelligence: A Modern Approach (2nd ed.), Upper Saddle River, New Jersey: Prentice Hall, ISBN   0-13-790395-2
  12. Salamon, Tomas (2011). Design of Agent-Based Models. Repin: Bruckner Publishing. p. 22. ISBN   978-80-904661-1-1.
  13. Weyns, Danny; Omicini, Amdrea; Odell, James (2007). "Environment as a first-class abstraction in multiagent systems". Autonomous Agents and Multi-Agent Systems. 14 (1): 5–30. CiteSeerX   10.1.1.154.4480 . doi:10.1007/s10458-006-0012-0. S2CID   13347050.
  14. Wooldridge, Michael (2002). An Introduction to MultiAgent Systems. John Wiley & Sons. p. 366. ISBN   978-0-471-49691-5.
  15. Panait, Liviu; Luke, Sean (2005). "Cooperative Multi-Agent Learning: The State of the Art" (PDF). Autonomous Agents and Multi-Agent Systems. 11 (3): 387–434. CiteSeerX   10.1.1.307.6671 . doi:10.1007/s10458-005-2631-2. S2CID   19706.
  16. "The Multi-Agent Systems Lab". University of Massachusetts Amherst . Retrieved October 16, 2009.
  17. Albrecht, Stefano; Stone, Peter (2017), "Multiagent Learning: Foundations and Recent Trends. Tutorial", IJCAI-17 conference (PDF)
  18. Cucker, Felipe; Steve Smale (2007). "The Mathematics of Emergence" (PDF). Japanese Journal of Mathematics. 2: 197–227. doi:10.1007/s11537-007-0647-x. S2CID   2637067 . Retrieved June 9, 2008.
  19. Shen, Jackie (Jianhong) (2008). "Cucker–Smale Flocking under Hierarchical Leadership". SIAM J. Appl. Math. 68 (3): 694–719. arXiv: q-bio/0610048 . doi:10.1137/060673254. S2CID   14655317 . Retrieved June 9, 2008.
  20. Ahmed, S.; Karsiti, M.N. (2007), "A testbed for control schemes using multi agent nonholonomic robots", 2007 IEEE International Conference on Electro/Information Technology, p. 459, doi:10.1109/EIT.2007.4374547, ISBN   978-1-4244-0940-2, S2CID   2734931
  21. Yang, Lidong; Li, Zhang (2021). "Motion control in magnetic microrobotics: From individual and multiple robots to swarms". Annual Review of Control, Robotics, and Autonomous Systems. 4: 509–534. doi:10.1146/annurev-control-032720-104318. S2CID   228892228.
  22. Pinan Basualdo, Franco; Misra, Sarthak (2023). "Collaborative Magnetic Agents for 3D Microrobotic Grasping". Advanced Intelligent Systems. 5 (12). doi: 10.1002/aisy.202300365 . S2CID   262167298.
  23. "OMG Document – orbos/97-10-05 (Update of Revised MAF Submission)". www.omg.org. Retrieved February 19, 2019.
  24. Ahmed, Salman; Karsiti, Mohd N.; Agustiawan, Herman (2007). "A development framework for collaborative robots using feedback control". ResearchGate . Retrieved January 8, 2024.
  25. "IEEE IES Technical Committee on Industrial Agents (TC-IA)". tcia.ieee-ies.org. Retrieved February 19, 2019.
  26. Leitão, Paulo; Karnouskos, Stamatis (March 26, 2015). Industrial agents : emerging applications of software agents in industry. Leitão, Paulo,, Karnouskos, Stamatis. Amsterdam, Netherlands. ISBN   978-0128003411. OCLC   905853947.{{cite book}}: CS1 maint: location missing publisher (link)
  27. "Film showcase". MASSIVE . Retrieved April 28, 2012.
  28. Leitao, Paulo; Karnouskos, Stamatis; Ribeiro, Luis; Lee, Jay; Strasser, Thomas; Colombo, Armando W. (2016). "Smart Agents in Industrial Cyber–Physical Systems". Proceedings of the IEEE. 104 (5): 1086–1101. doi:10.1109/JPROC.2016.2521931. hdl: 10198/15438 . ISSN   0018-9219. S2CID   579475.
  29. Xiao-Feng Xie, S. Smith, G. Barlow. Schedule-driven coordination for real-time traffic network control. International Conference on Automated Planning and Scheduling (ICAPS), São Paulo, Brazil, 2012: 323–331.
  30. Máhr, T. S.; Srour, J.; De Weerdt, M.; Zuidwijk, R. (2010). "Can agents measure up? A comparative study of an agent-based and on-line optimization approach for a drayage problem with uncertainty". Transportation Research Part C: Emerging Technologies. 18: 99–119. CiteSeerX   10.1.1.153.770 . doi:10.1016/j.trc.2009.04.018.
  31. Kazemi, Hamidreza; Liasi, Sahand; Sheikh-El-Eslami, Mohammadkazem (November 2018). "Generation Expansion Planning Considering Investment Dynamic of Market Participants Using Multi-agent System". ResearchGate. doi:10.1109/SGC.2018.8777904 . Retrieved January 8, 2024.
  32. Singh, Vijay; Samuel, Paulson (June 6, 2017). "Distributed Multi -Agent System Based Load Frequency Control for Multi- Area Power System in Smart Grid". IEEE Transactions on Industrial Electronics. 64 (6): 5151–5160. doi:10.1109/TIE.2017.2668983 . Retrieved January 8, 2024.
  33. 1 2 "AI can predict your future behaviour with powerful new simulations". New Scientist.
  34. Gong, Xiaoqian; Herty, Michael; Piccoli, Benedetto; Visconti, Giuseppe (May 3, 2023). "Crowd Dynamics: Modeling and Control of Multiagent Systems". Annual Review of Control, Robotics, and Autonomous Systems. 6 (1): 261–282. doi: 10.1146/annurev-control-060822-123629 . ISSN   2573-5144.
  35. Hallerbach, S.; Xia, Y.; Eberle, U.; Koester, F. (2018). "Simulation-Based Identification of Critical Scenarios for Cooperative and Automated Vehicles". SAE International Journal of Connected and Automated Vehicles. 1 (2). SAE International: 93. doi:10.4271/2018-01-1066.
  36. Madrigal, Story by Alexis C. "Inside Waymo's Secret World for Training Self-Driving Cars". The Atlantic. Retrieved August 14, 2020.
  37. Connors, J.; Graham, S.; Mailloux, L. (2018). "Cyber Synthetic Modeling for Vehicle-to-Vehicle Applications". In International Conference on Cyber Warfare and Security. Academic Conferences International Limited: 594-XI.

Further reading