Agent-based computational economics

Last updated

Agent-based computational economics (ACE) is the area of computational economics that studies economic processes, including whole economies, as dynamic systems of interacting agents. As such, it falls in the paradigm of complex adaptive systems. [1] In corresponding agent-based models, the "agents" are "computational objects modeled as interacting according to rules" over space and time, not real people. The rules are formulated to model behavior and social interactions based on incentives and information. [2] Such rules could also be the result of optimization, realized through use of AI methods (such as Q-learning and other reinforcement learning techniques). [3]

Contents

The theoretical assumption of mathematical optimization by agents in equilibrium is replaced by the less restrictive postulate of agents with bounded rationality adapting to market forces. [4] ACE models apply numerical methods of analysis to computer-based simulations of complex dynamic problems for which more conventional methods, such as theorem formulation, may not find ready use. [5] Starting from initial conditions specified by the modeler, the computational economy evolves over time as its constituent agents repeatedly interact with each other, including learning from interactions. In these respects, ACE has been characterized as a bottom-up culture-dish approach to the study of economic systems. [6]

ACE has a similarity to, and overlap with, game theory as an agent-based method for modeling social interactions. [7] But practitioners have also noted differences from standard methods, for example in ACE events modeled being driven solely by initial conditions, whether or not equilibria exist or are computationally tractable, and in the modeling facilitation of agent autonomy and learning. [8]

The method has benefited from continuing improvements in modeling techniques of computer science and increased computer capabilities. The ultimate scientific objective of the method is to "test theoretical findings against real-world data in ways that permit empirically supported theories to cumulate over time, with each researcher’s work building appropriately on the work that has gone before." [9] The subject has been applied to research areas like asset pricing, [10] energy systems, [11] competition and collaboration, [12] transaction costs, [13] market structure and industrial organization and dynamics, [14] welfare economics, [15] and mechanism design, [16] information and uncertainty, [17] macroeconomics, [18] and Marxist economics. [19] [20]

Overview

The "agents" in ACE models can represent individuals (e.g. people), social groupings (e.g. firms), biological entities (e.g. growing crops), and/or physical systems (e.g. transport systems). The ACE modeler provides the initial configuration of a computational economic system comprising multiple interacting agents. The modeler then steps back to observe the development of the system over time without further intervention. In particular, system events should be driven by agent interactions without external imposition of equilibrium conditions. [21] Issues include those common to experimental economics in general [22] and development of a common framework for empirical validation [23] and resolving open questions in agent-based modeling. [24]

ACE is an officially designated special interest group (SIG) of the Society for Computational Economics. [25] Researchers at the Santa Fe Institute have contributed to the development of ACE.

Example: finance

One area where ACE methodology has frequently been applied is asset pricing. W. Brian Arthur, Eric Baum, William Brock, Cars Hommes, and Blake LeBaron, among others, have developed computational models in which many agents choose from a set of possible forecasting strategies in order to predict stock prices, which affects their asset demands and thus affects stock prices. These models assume that agents are more likely to choose forecasting strategies which have recently been successful. The success of any strategy will depend on market conditions and also on the set of strategies that are currently being used. These models frequently find that large booms and busts in asset prices may occur as agents switch across forecasting strategies. [10] [26] [27] More recently, Brock, Hommes, and Wagener (2009) have used a model of this type to argue that the introduction of new hedging instruments may destabilize the market, [28] and some papers have suggested that ACE might be a useful methodology for understanding the 2008 financial crisis. [29] [30] [31] See also discussion under Financial economics § Financial markets and § Departures from rationality.

See also

Related Research Articles

<span class="mw-page-title-main">Political economy</span> Study of the development of social production

Political economy is a branch of political science and economics studying economic systems and their governance by political systems. Widely studied phenomena within the discipline are systems such as labour markets and financial markets, as well as phenomena such as growth, distribution, inequality, and trade, and how these are shaped by institutions, laws, and government policy. Originating in the 18th century, it is the precursor to the modern discipline of economics. Political economy in its modern form is considered an interdisciplinary field, drawing on theory from both political science and modern economics.

<span class="mw-page-title-main">Industrial organization</span> Field that examines the structure of firms and markets

In economics, industrial organization is a field that builds on the theory of the firm by examining the structure of firms and markets. Industrial organization adds real-world complications to the perfectly competitive model, complications such as transaction costs, limited information, and barriers to entry of new firms that may be associated with imperfect competition. It analyzes determinants of firm and market organization and behavior on a continuum between competition and monopoly, including from government actions.

<span class="mw-page-title-main">Public choice</span> Economic theory applied to political science

Public choice, or public choice theory, is "the use of economic tools to deal with traditional problems of political science." It includes the study of political behavior. In political science, it is the subset of positive political theory that studies self-interested agents and their interactions, which can be represented in a number of ways—using standard constrained utility maximization, game theory, or decision theory. It is the origin and intellectual foundation of contemporary work in political economy.

Monetary economics is the branch of economics that studies the different theories of money: it provides a framework for analyzing money and considers its functions, and it considers how money can gain acceptance purely because of its convenience as a public good. The discipline has historically prefigured, and remains integrally linked to, macroeconomics. This branch also examines the effects of monetary systems, including regulation of money and associated financial institutions and international aspects.

<span class="mw-page-title-main">Experimental economics</span> Method used to study economic questions

Experimental economics is the application of experimental methods to study economic questions. Data collected in experiments are used to estimate effect size, test the validity of economic theories, and illuminate market mechanisms. Economic experiments usually use cash to motivate subjects, in order to mimic real-world incentives. Experiments are used to help understand how and why markets and other exchange systems function as they do. Experimental economics have also expanded to understand institutions and the law.

A macroeconomic model is an analytical tool designed to describe the operation of the problems of economy of a country or a region. These models are usually designed to examine the comparative statics and dynamics of aggregate quantities such as the total amount of goods and services produced, total income earned, the level of employment of productive resources, and the level of prices.

<span class="mw-page-title-main">Computational economics</span> Interdisciplinary research discipline

Computational economics is an interdisciplinary research discipline that combines methods in computational science and economics to solve complex economic problems. This subject encompasses computational modeling of economic systems. Some of these areas are unique, while others established areas of economics by allowing robust data analytics and solutions of problems that would be arduous to research without computers and associated numerical methods.

<span class="mw-page-title-main">Philosophy and economics</span> Branch of philosophy

Philosophy and economics studies topics such as public economics, behavioural economics, rationality, justice, history of economic thought, rational choice, the appraisal of economic outcomes, institutions and processes, the status of highly idealized economic models, the ontology of economic phenomena and the possibilities of acquiring knowledge of them.

<span class="mw-page-title-main">Economic methodology</span> Subfield of economics

Economic methodology is the study of methods, especially the scientific method, in relation to economics, including principles underlying economic reasoning. In contemporary English, 'methodology' may reference theoretical or systematic aspects of a method. Philosophy and economics also takes up methodology at the intersection of the two subjects.

Economics education or economic education is a field within economics that focuses on two main themes:

<span class="mw-page-title-main">Cultural economics</span> Branch of economics

Cultural economics is the branch of economics that studies the relation of culture to economic outcomes. Here, 'culture' is defined by shared beliefs and preferences of respective groups. Programmatic issues include whether and how much culture matters as to economic outcomes and what its relation is to institutions. As a growing field in behavioral economics, the role of culture in economic behavior is increasingly being demonstrated to cause significant differentials in decision-making and the management and valuation of assets.

Microfoundations are an effort to understand macroeconomic phenomena in terms of economic agents' behaviors and their interactions. Research in microfoundations explores the link between macroeconomic and microeconomic principles in order to explore the aggregate relationships in macroeconomic models.

Leigh Tesfatsion is a computational economist who taught at Iowa State University. She received her doctorate at the University of Minnesota, and taught at the University of Southern California before moving to Iowa State. She is known for promoting agent-based models as an alternative to rational expectations general equilibrium models for studying markets, finance, and macroeconomic phenomena. Her works are widely cited in the literature on the subject.

Kenneth Lewis Judd is a computational economist at Stanford University, where he is the Paul H. Bauer Senior Fellow at the Hoover Institution. He received his PhD in economics from the University of Wisconsin in 1980. He is perhaps best known as the author of Numerical Methods in Economics, and he is also among the editors of the Handbook of Computational Economics and of the Journal of Economic Dynamics and Control.

John Duffy is an American economist. He is a professor of economics at the University of California, Irvine.

<span class="mw-page-title-main">Adaptive Modeler</span> Financial software application

Altreva Adaptive Modeler is a software application for creating agent-based financial market simulation models for the purpose of forecasting prices of real world market traded stocks or other securities. The technology it uses is based on the theory of agent-based computational economics (ACE), the computational study of economic processes modeled as dynamic systems of interacting heterogeneous agents.

<span class="mw-page-title-main">Mathematical economics</span> Application of mathematical methods to represent theories and analyze problems in economics

Mathematical economics is the application of mathematical methods to represent theories and analyze problems in economics. Often, these applied methods are beyond simple geometry, and may include differential and integral calculus, difference and differential equations, matrix algebra, mathematical programming, or other computational methods. Proponents of this approach claim that it allows the formulation of theoretical relationships with rigor, generality, and simplicity.

<span class="mw-page-title-main">History of macroeconomic thought</span>

Macroeconomic theory has its origins in the study of business cycles and monetary theory. In general, early theorists believed monetary factors could not affect real factors such as real output. John Maynard Keynes attacked some of these "classical" theories and produced a general theory that described the whole economy in terms of aggregates rather than individual, microeconomic parts. Attempting to explain unemployment and recessions, he noticed the tendency for people and businesses to hoard cash and avoid investment during a recession. He argued that this invalidated the assumptions of classical economists who thought that markets always clear, leaving no surplus of goods and no willing labor left idle.

The methodology of econometrics is the study of the range of differing approaches to undertaking econometric analysis.

In economic theory and econometrics, the term heterogeneity refers to differences across the units being studied. For example, a macroeconomic model in which consumers are assumed to differ from one another is said to have heterogeneous agents.

References

  1. W. Brian Arthur, 1994. "Inductive Reasoning and Bounded Rationality," American Economic Review, 84(2), pp. 406-411 Archived 21 May 2013 at the Wayback Machine .
      Leigh Tesfatsion, 2003. "Agent-based Computational Economics: Modeling Economies as Complex Adaptive Systems," Information Sciences, 149(4), pp. 262-268 Archived 26 April 2012 at the Wayback Machine .
  2. Scott E. Page (2008). "agent-based models," The New Palgrave Dictionary of Economics , 2nd Edition. Abstract.
  3. Richard S. Sutton and Andrew G. Barto, Reinforcement Learning: An Introduction, The MIT Press, Cambridge, MA, 1998 Archived 4 September 2009 at the Wayback Machine
  4. John H. Holland and John H. Miller (1991). "Artificial Adaptive Agents in Economic Theory," American Economic Review, 81(2), pp. 365-370 Archived 5 January 2011 at the Wayback Machine p. 366.
      Thomas C. Schelling (1978 [2006]). Micromotives and Macrobehavior, Norton. Description Archived 2 November 2017 at the Wayback Machine , preview.
      Thomas J. Sargent, 1994. Bounded Rationality in Macroeconomics, Oxford. Description and chapter-preview 1st-page links.
  5. • Kenneth L. Judd, 2006. "Computationally Intensive Analyses in Economics," Handbook of Computational Economics, v. 2, ch. 17, Introduction, p. 883. [Pp. 881- 893. Pre-pub PDF.
       • _____, 1998. Numerical Methods in Economics, MIT Press. Links to description Archived 11 February 2012 at the Wayback Machine and chapter previews.
  6. • Leigh Tesfatsion (2002). "Agent-Based Computational Economics: Growing Economies from the Bottom Up," Artificial Life, 8(1), pp.55-82. Abstract and pre-pub PDF Archived 14 May 2013 at the Wayback Machine .
       • _____ (1997). "How Economists Can Get Alife," in W. B. Arthur, S. Durlauf, and D. Lane, eds., The Economy as an Evolving Complex System, II, pp. 533-564. Addison-Wesley. Pre-pub PDF Archived 15 April 2012 at the Wayback Machine .
  7. Joseph Y. Halpern (2008). "computer science and game theory," The New Palgrave Dictionary of Economics, 2nd Edition. Abstract.
       • Yoav Shoham (2008). "Computer Science and Game Theory," Communications of the ACM, 51(8), pp. 75-79 Archived 26 April 2012 at the Wayback Machine .
      Alvin E. Roth (2002). "The Economist as Engineer: Game Theory, Experimentation, and Computation as Tools for Design Economics," Econometrica, 70(4), pp. 1341–1378.
  8. Tesfatsion, Leigh (2006), "Agent-Based Computational Economics: A Constructive Approach to Economic Theory," ch. 16, Handbook of Computational Economics, v. 2, part 2, ACE study of economic system. Abstract and pre-pub PDF.
  9. • Leigh Tesfatsion (2006). "Agent-Based Computational Economics: A Constructive Approach to Economic Theory," ch. 16, Handbook of Computational Economics, v. 2, [pp. 831-880] sect. 5. Abstract and pre-pub PDF.
      Kenneth L. Judd (2006). "Computationally Intensive Analyses in Economics," Handbook of Computational Economics, v. 2, ch. 17, pp. 881- 893. Pre-pub PDF.
       • Leigh Tesfatsion and Kenneth L. Judd, ed. (2006). Handbook of Computational Economics, v. 2. Description Archived 6 March 2012 at the Wayback Machine & and chapter-preview links.
  10. 1 2 B. Arthur, J. Holland, B. LeBaron, R. Palmer, P. Taylor (1997), 'Asset pricing under endogenous expectations in an artificial stock market,' in The Economy as an Evolving Complex System II, B. Arthur, S. Durlauf, and D. Lane, eds., Addison Wesley.
  11. Harder, Nick; Qussous, Ramiz; Weidlich, Anke (1 October 2023). "Fit for purpose: Modeling wholesale electricity markets realistically with multi-agent deep reinforcement learning". Energy and AI. 14: 100295. doi: 10.1016/j.egyai.2023.100295 . ISSN   2666-5468.
  12. Robert Axelrod (1997). The Complexity of Cooperation: Agent-Based Models of Competition and Collaboration, Princeton. Description, contents, and preview.
  13. Tomas B. Klosa and Bart Nooteboom, 2001. "Agent-based Computational Transaction Cost Economics," Journal of Economic Dynamics and Control 25(3–4), pp. 503–52. Abstract.
  14. • Roberto Leombruni and Matteo Richiardi, ed. (2004), Industry and Labor Dynamics: The Agent-Based Computational Economics Approach. World Scientific Publishing ISBN   981-256-100-5. Description Archived 27 July 2010 at the Wayback Machine and chapter-preview links.
      Joshua M. Epstein (2006). "Growing Adaptive Organizations: An Agent-Based Computational Approach," in Generative Social Science: Studies in Agent-Based Computational Modeling, pp. 309- 344. Description Archived 26 January 2012 at the Wayback Machine and abstract.
  15. Robert Axtell (2005). "The Complexity of Exchange," Economic Journal, 115(504, Features), pp. F193-F210.
  16. The New Palgrave Dictionary of Economics (2008), 2nd Edition:
         Roger B. Myerson "mechanism design." Abstract.
         _____. "revelation principle." Abstract.
         Tuomas Sandholm. "computing in mechanism design." Abstract.
      Noam Nisan and Amir Ronen (2001). "Algorithmic Mechanism Design," Games and Economic Behavior, 35(1-2), pp. 166–196.
      Noam Nisan et al., ed. (2007). Algorithmic Game Theory, Cambridge University Press. Description Archived 5 May 2012 at the Wayback Machine .
  17. Tuomas W. Sandholm and Victor R. Lesser (2001). "Leveled Commitment Contracts and Strategic Breach," Games and Economic Behavior, 35(1-2), pp. 212-270.
  18. David Colander, Peter Howitt, Alan Kirman, Axel Leijonhufvud, and Perry Mehrling, 2008. "Beyond DSGE Models: Toward an Empirically Based Macroeconomics," American Economic Review, 98(2), pp. 236-240. Pre-pub PDF.
      Thomas J. Sargent (1994). Bounded Rationality in Macroeconomics, Oxford. Description and chapter-preview 1st-page links.
       • M. Oeffner (2009). 'Agent-based Keynesian Macroeconomics'. PhD thesis, Faculty of Economics, University of Würzburg.
  19. A. F. Cottrell, P. Cockshott, G. J. Michaelson, I. P. Wright, V. Yakovenko (2009), Classical Econophysics. Routledge, ISBN   978-0-415-47848-9.
  20. Leigh Tesfatsion (2006), "Agent-Based Computational Economics: A Constructive Approach to Economic Theory," ch. 16, Handbook of Computational Economics, v. 2, part 2, ACE study of economic system. Abstract and pre-pub PDF.
  21. Summary of methods Archived 26 May 2007 at the Wayback Machine : Department of Economics, Politics and Public Administration, Aalborg University, Denmark website.
  22. Vernon L. Smith, 2008. "experimental economics," The New Palgrave Dictionary of Economics, 2nd Edition. Abstract.
  23. Bektas, A., Piana, V. & Schuman, R. A meso-level empirical validation approach for agent-based computational economic models drawing on micro-data: a use case with a mobility mode-choice model. SN Bus Econ 1, 80 (2021). https://doi.org/10.1007/s43546-021-00083-4
  24. Giorgio Fagiolo, Alessio Moneta, and Paul Windrum, 2007. "A Critical Guide to Empirical Validation of Agent-Based Models in Economics: Methodologies, Procedures, and Open Problems," Computational Economics, 30, pp. 195–226.
  25. Society for Computational Economics website.
  26. W. Brock and C. Hommes (1997), 'A rational route to randomness.' Econometrica 65 (5), pp. 1059-1095.
  27. C. Hommes (2008), 'Interacting agents in finance,' in The New Palgrave Dictionary of Economics.
  28. Brock, W.; Hommes, C.; Wagener, F. (2009). "More hedging instruments may destabilize markets" (PDF). Journal of Economic Dynamics and Control. 33 (11): 1912–1928. doi:10.1016/j.jedc.2009.05.004.
  29. M. Buchanan (2009), 'Meltdown modelling. Could agent-based computer models prevent another financial crisis?.' Nature, Vol. 460, No. 7256. (5 August 2009), pp. 680-682.
  30. J.D. Farmer, D. Foley (2009), 'The economy needs agent-based modelling.' Nature, Vol. 460, No. 7256. (5 August 2009), pp. 685-686.
  31. M. Holcombe, S. Coakley, M.Kiran, S. Chin, C. Greenough, D.Worth, S.Cincotti, M.Raberto, A. Teglio, C. Deissenberg, S. van der Hoog, H. Dawid, S. Gemkow, P. Harting, M. Neugart. Large-scale Modeling of Economic Systems, Complex Systems, 22(2), 175-191, 2013