Self-organized criticality

Last updated
An image of the 2d Bak-Tang-Wiesenfeld sandpile, the original model of self-organized criticality. Backtang2.png
An image of the 2d Bak-Tang-Wiesenfeld sandpile, the original model of self-organized criticality.

Self-organized criticality (SOC) is a property of dynamical systems that have a critical point as an attractor. Their macroscopic behavior thus displays the spatial or temporal scale-invariance characteristic of the critical point of a phase transition, but without the need to tune control parameters to a precise value, because the system, effectively, tunes itself as it evolves towards criticality.

The concept was put forward by Per Bak, Chao Tang and Kurt Wiesenfeld ("BTW") in a paper [1] published in 1987 in Physical Review Letters , and is considered to be one of the mechanisms by which complexity [2] arises in nature. Its concepts have been applied across fields as diverse as geophysics, [3] [4] [5] physical cosmology, evolutionary biology and ecology, bio-inspired computing and optimization (mathematics), economics, quantum gravity, sociology, solar physics, plasma physics, neurobiology [6] [7] [8] [9] and others.

SOC is typically observed in slowly driven non-equilibrium systems with many degrees of freedom and strongly nonlinear dynamics. Many individual examples have been identified since BTW's original paper, but to date there is no known set of general characteristics that guarantee a system will display SOC.

Overview

Self-organized criticality is one of a number of important discoveries made in statistical physics and related fields over the latter half of the 20th century, discoveries which relate particularly to the study of complexity in nature. For example, the study of cellular automata, from the early discoveries of Stanislaw Ulam and John von Neumann through to John Conway's Game of Life and the extensive work of Stephen Wolfram, made it clear that complexity could be generated as an emergent feature of extended systems with simple local interactions. Over a similar period of time, Benoît Mandelbrot's large body of work on fractals showed that much complexity in nature could be described by certain ubiquitous mathematical laws, while the extensive study of phase transitions carried out in the 1960s and 1970s showed how scale invariant phenomena such as fractals and power laws emerged at the critical point between phases.

The term self-organized criticality was first introduced in Bak, Tang and Wiesenfeld's 1987 paper, which clearly linked together those factors: a simple cellular automaton was shown to produce several characteristic features observed in natural complexity (fractal geometry, pink (1/f) noise and power laws) in a way that could be linked to critical-point phenomena. Crucially, however, the paper emphasized that the complexity observed emerged in a robust manner that did not depend on finely tuned details of the system: variable parameters in the model could be changed widely without affecting the emergence of critical behavior: hence, self-organized criticality. Thus, the key result of BTW's paper was its discovery of a mechanism by which the emergence of complexity from simple local interactions could be spontaneousand therefore plausible as a source of natural complexityrather than something that was only possible in artificial situations in which control parameters are tuned to precise critical values. An alternative view is that SOC appears when the criticality is linked to a value of zero of the control parameters. [10]

Despite the considerable interest and research output generated from the SOC hypothesis, there remains no general agreement with regards to its mechanisms in abstract mathematical form. Bak Tang and Wiesenfeld based their hypothesis on the behavior of their sandpile model. [1]

Models of self-organized criticality

In chronological order of development:

Early theoretical work included the development of a variety of alternative SOC-generating dynamics distinct from the BTW model, attempts to prove model properties analytically (including calculating the critical exponents [12] [13] ), and examination of the conditions necessary for SOC to emerge. One of the important issues for the latter investigation was whether conservation of energy was required in the local dynamical exchanges of models: the answer in general is no, but with (minor) reservations, as some exchange dynamics (such as those of BTW) do require local conservation at least on average [ clarification needed ].

It has been argued that the BTW "sandpile" model should actually generate 1/f2 noise rather than 1/f noise. [14] This claim was based on untested scaling assumptions, and a more rigorous analysis showed that sandpile models generally produce 1/fa spectra, with a<2. [15] Other simulation models were proposed later that could produce true 1/f noise. [16]

In addition to the nonconservative theoretical model mentioned above [ clarification needed ], other theoretical models for SOC have been based upon information theory, [17] mean field theory, [18] the convergence of random variables, [19] and cluster formation. [20] A continuous model of self-organised criticality is proposed by using tropical geometry. [21]

Key theoretical issues yet to be resolved include the calculation of the possible universality classes of SOC behavior and the question of whether it is possible to derive a general rule for determining if an arbitrary algorithm displays SOC.

Self-organized criticality in nature

The relevance of SOC to the dynamics of real sand has been questioned. Sandpile Matemateca 19.jpg
The relevance of SOC to the dynamics of real sand has been questioned.

SOC has become established as a strong candidate for explaining a number of natural phenomena, including:

Despite the numerous applications of SOC to understanding natural phenomena, the universality of SOC theory has been questioned. For example, experiments with real piles of rice revealed their dynamics to be far more sensitive to parameters than originally predicted. [31] [1] Furthermore, it has been argued that 1/f scaling in EEG recordings are inconsistent with critical states, [32] and whether SOC is a fundamental property of neural systems remains an open and controversial topic. [33]

Self-organized criticality and optimization

It has been found that the avalanches from an SOC process make effective patterns in a random search for optimal solutions on graphs. [34] An example of such an optimization problem is graph coloring. The SOC process apparently helps the optimization from getting stuck in a local optimum without the use of any annealing scheme, as suggested by previous work on extremal optimization.

See also

Related Research Articles

<span class="mw-page-title-main">Percolation</span> Filtration of fluids through porous materials

In physics, chemistry, and materials science, percolation refers to the movement and filtering of fluids through porous materials. It is described by Darcy's law. Broader applications have since been developed that cover connectivity of many systems modeled as lattices or graphs, analogous to connectivity of lattice components in the filtration problem that modulates capacity for percolation.

<span class="mw-page-title-main">Edge of chaos</span> Transition space between order and disorder

The edge of chaos is a transition space between order and disorder that is hypothesized to exist within a wide variety of systems. This transition zone is a region of bounded instability that engenders a constant dynamic interplay between order and disorder.

In applied mathematics, highly optimized tolerance (HOT) is a method of generating power law behavior in systems by including a global optimization principle. It was developed by Jean M. Carlson and John Doyle in the early 2000s. For some systems that display a characteristic scale, a global optimization term could potentially be added that would then yield power law behavior. It has been used to generate and describe internet-like graphs, forest fire models and may also apply to biological systems.

Per Bak was a Danish theoretical physicist who coauthored the 1987 academic paper that coined the term "self-organized criticality."

<span class="mw-page-title-main">Tang Chao (physicist)</span> Chinese physicist

Tang Chao is a Chair Professor of Physics and Systems Biology at Peking University.

<span class="mw-page-title-main">Topological order</span> Type of order at absolute zero

In physics, topological order is a kind of order in the zero-temperature phase of matter. Macroscopically, topological order is defined and described by robust ground state degeneracy and quantized non-Abelian geometric phases of degenerate ground states. Microscopically, topological orders correspond to patterns of long-range quantum entanglement. States with different topological orders cannot change into each other without a phase transition.

Extremal optimization (EO) is an optimization heuristic inspired by the Bak–Sneppen model of self-organized criticality from the field of statistical physics. This heuristic was designed initially to address combinatorial optimization problems such as the travelling salesman problem and spin glasses, although the technique has been demonstrated to function in optimization domains.

Kurt Wiesenfeld is an American physicist working primarily on non-linear dynamics. His works primarily concern stochastic resonance, spontaneous synchronization of coupled oscillators, and non-linear laser dynamics. Since 1987, he has been professor of physics at the Georgia Institute of Technology.

<span class="mw-page-title-main">Percolation threshold</span> Threshold of percolation theory models

The percolation threshold is a mathematical concept in percolation theory that describes the formation of long-range connectivity in random systems. Below the threshold a giant connected component does not exist; while above it, there exists a giant component of the order of system size. In engineering and coffee making, percolation represents the flow of fluids through porous media, but in the mathematics and physics worlds it generally refers to simplified lattice models of random systems or networks (graphs), and the nature of the connectivity in them. The percolation threshold is the critical value of the occupation probability p, or more generally a critical surface for a group of parameters p1, p2, ..., such that infinite connectivity (percolation) first occurs.

<span class="mw-page-title-main">Abelian sandpile model</span> Cellular automaton

The Abelian sandpile model (ASM) is the more popular name of the original Bak–Tang–Wiesenfeld model (BTW). The BTW model was the first discovered example of a dynamical system displaying self-organized criticality. It was introduced by Per Bak, Chao Tang and Kurt Wiesenfeld in a 1987 paper.

<span class="mw-page-title-main">Subir Sachdev</span> Indian physicist

Subir Sachdev is Herchel Smith Professor of Physics at Harvard University specializing in condensed matter. He was elected to the U.S. National Academy of Sciences in 2014, received the Lars Onsager Prize from the American Physical Society and the Dirac Medal from the ICTP in 2018, and was elected Foreign Member of the Royal Society ForMemRS in 2023. He was a co-editor of the Annual Review of Condensed Matter Physics 2017–2019, and is Editor-in-Chief of Reports on Progress in Physics 2022-.

Dante R. Chialvo is a professor at Universidad Nacional de San Martin. Together with Per Bak, they put forward concrete models considering the brain as a critical system. Initial contributions focussed on mathematical ideas of how learning could benefit from criticality. Further work provided experimental evidence for this conjecture both at large and small scale. He was named Fulbright Scholar in 2005 and elected as a Fellow of the American Physical Society in 2007 and as Member of the Academia de Ciencias de America Latina in 2022.

In the context of the physical and mathematical theory of percolation, a percolation transition is characterized by a set of universal critical exponents, which describe the fractal properties of the percolating medium at large scales and sufficiently close to the transition. The exponents are universal in the sense that they only depend on the type of percolation model and on the space dimension. They are expected to not depend on microscopic details such as the lattice structure, or whether site or bond percolation is considered. This article deals with the critical exponents of random percolation.

<span class="mw-page-title-main">Active matter</span> Matter behavior at system scale

Active matter is matter composed of large numbers of active "agents", each of which consumes energy in order to move or to exert mechanical forces. Such systems are intrinsically out of thermal equilibrium. Unlike thermal systems relaxing towards equilibrium and systems with boundary conditions imposing steady currents, active matter systems break time reversal symmetry because energy is being continually dissipated by the individual constituents. Most examples of active matter are biological in origin and span all the scales of the living, from bacteria and self-organising bio-polymers such as microtubules and actin, to schools of fish and flocks of birds. However, a great deal of current experimental work is devoted to synthetic systems such as artificial self-propelled particles. Active matter is a relatively new material classification in soft matter: the most extensively studied model, the Vicsek model, dates from 1995.

Maya Paczuski is the head and founder of the Complexity Science Group at the University of Calgary. She is a well-cited physicist whose work spans self-organized criticality, avalanche dynamics, earthquake, and complex networks. She was born in Israel in 1963, but grew up in the United States. Maya Paczuski received a B.S. and M.S. in Electrical Engineering and Computer Science from M.I.T. in 1986 and then went on to study with Mehran Kardar, earning her Ph.D in Condensed matter physics from the same institute.

In neuroscience, the critical brain hypothesis states that certain biological neuronal networks work near phase transitions. Experimental recordings from large groups of neurons have shown bursts of activity, so-called neuronal avalanches, with sizes that follow a power law distribution. These results, and subsequent replication on a number of settings, led to the hypothesis that the collective dynamics of large neuronal networks in the brain operates close to the critical point of a phase transition. According to this hypothesis, the activity of the brain would be continuously transitioning between two phases, one in which activity will rapidly reduce and die, and another where activity will build up and amplify over time. In criticality, the brain capacity for information processing is enhanced, so subcritical, critical and slightly supercritical branching process of thoughts could describe how human and animal minds function.

<span class="mw-page-title-main">Amnon Aharony</span> Physicist at Ben Gurion University in Israel

Amnon Aharony is an Israeli Professor (Emeritus) of Physics in the School of Physics and Astronomy at Tel Aviv University, Israel and in the Physics Department of Ben Gurion University of the Negev, Israel. After years of research on statistical physics, his current research focuses on condensed matter theory, especially in mesoscopic physics and spintronics. He is a member of the Israel Academy of Sciences and Humanities, a Foreign Honorary Member of the American Academy of Arts and Sciences and of several other academies. He also received several prizes, including the Rothschild Prize in Physical Sciences, and the Gunnar Randers Research Prize, awarded every other year by the King of Norway.

<span class="mw-page-title-main">Vitaly Kocharovsky</span> Russian physicist

Vitaly Kocharovsky is a Russian-American physicist, academic and researcher. He is a Professor of Physics and Astronomy at Texas A&M University.

<span class="mw-page-title-main">Vladimir Kocharovsky</span>

Vladimir Kocharovsky is a Russian physicist, academic and researcher. He is a Head of the Astrophysics and Space Plasma Physics Department at the Institute of Applied Physics of the Russian Academy of Sciences and a professor at N.I. Lobachevsky State University of Nizhny Novgorod.

Dov I. Levine is an American-Israeli physicist, known for his research on quasicrystals, soft condensed matter physics, and statistical mechanics out of equilibrium.

References

  1. 1 2 3 Bak P, Tang C, Wiesenfeld K (July 1987). "Self-organized criticality: An explanation of the 1/f noise". Physical Review Letters. 59 (4): 381–384. Bibcode:1987PhRvL..59..381B. doi:10.1103/PhysRevLett.59.381. PMID   10035754. Papercore summary: http://papercore.org/Bak1987.
  2. Bak P, Paczuski M (July 1995). "Complexity, contingency, and criticality". Proceedings of the National Academy of Sciences of the United States of America. 92 (15): 6689–6696. Bibcode:1995PNAS...92.6689B. doi: 10.1073/pnas.92.15.6689 . PMC   41396 . PMID   11607561.
  3. 1 2 3 Smalley Jr RF, Turcotte DL, Solla SA (1985). "A renormalization group approach to the stick-slip behavior of faults". Journal of Geophysical Research. 90 (B2): 1894. Bibcode:1985JGR....90.1894S. doi:10.1029/JB090iB02p01894. S2CID   28835238.
  4. Smyth WD, Nash JD, Moum JN (March 2019). "Self-organized criticality in geophysical turbulence". Scientific Reports. 9 (1): 3747. Bibcode:2019NatSR...9.3747S. doi:10.1038/s41598-019-39869-w. PMC   6403305 . PMID   30842462.
  5. Hatamian, S. T. (February 1996). "Modeling fragmentation in two dimensions". Pure and Applied Geophysics PAGEOPH. 146 (1): 115–129. doi:10.1007/BF00876672. ISSN   0033-4553.
  6. Dmitriev A, Dmitriev V (2021-01-20). "Identification of Self-Organized Critical State on Twitter Based on the Retweets' Time Series Analysis". Complexity. 2021: e6612785. doi: 10.1155/2021/6612785 . ISSN   1076-2787.
  7. Linkenkaer-Hansen K, Nikouline VV, Palva JM, Ilmoniemi RJ (February 2001). "Long-range temporal correlations and scaling behavior in human brain oscillations". The Journal of Neuroscience. 21 (4): 1370–1377. doi:10.1523/JNEUROSCI.21-04-01370.2001. PMC   6762238 . PMID   11160408.
  8. 1 2 Beggs JM, Plenz D (December 2003). "Neuronal avalanches in neocortical circuits". The Journal of Neuroscience. 23 (35): 11167–11177. doi:10.1523/JNEUROSCI.23-35-11167.2003. PMC   6741045 . PMID   14657176.
  9. Chialvo DR (2004). "Critical brain networks". Physica A. 340 (4): 756–765. arXiv: cond-mat/0402538 . Bibcode:2004PhyA..340..756R. doi:10.1016/j.physa.2004.05.064. S2CID   15922916.
  10. Gabrielli A, Caldarelli G, Pietronero L (December 2000). "Invasion percolation with temperature and the nature of self-organized criticality in real systems". Physical Review E. 62 (6 Pt A): 7638–7641. arXiv: cond-mat/9910425 . Bibcode:2000PhRvE..62.7638G. doi:10.1103/PhysRevE.62.7638. PMID   11138032. S2CID   20510811.
  11. 1 2 Turcotte DL, Smalley Jr RF, Solla SA (1985). "Collapse of loaded fractal trees". Nature. 313 (6004): 671–672. Bibcode:1985Natur.313..671T. doi:10.1038/313671a0. S2CID   4317400.
  12. Tang C, Bak P (June 1988). "Critical exponents and scaling relations for self-organized critical phenomena". Physical Review Letters. 60 (23): 2347–2350. Bibcode:1988PhRvL..60.2347T. doi:10.1103/PhysRevLett.60.2347. PMID   10038328.
  13. Tang C, Bak P (1988). "Mean field theory of self-organized critical phenomena". Journal of Statistical Physics (Submitted manuscript). 51 (5–6): 797–802. Bibcode:1988JSP....51..797T. doi:10.1007/BF01014884. S2CID   67842194.
  14. Jensen HJ, Christensen K, Fogedby HC (October 1989). "1/f noise, distribution of lifetimes, and a pile of sand". Physical Review B. 40 (10): 7425–7427. Bibcode:1989PhRvB..40.7425J. doi:10.1103/physrevb.40.7425. PMID   9991162.
  15. Laurson L, Alava MJ, Zapperi S (15 September 2005). "Letter: Power spectra of self-organized critical sand piles". Journal of Statistical Mechanics: Theory and Experiment. 0511. L001.
  16. Maslov S, Tang C, Zhang YC (1999). "1/f noise in Bak-Tang-Wiesenfeld models on narrow stripes". Phys. Rev. Lett. 83 (12): 2449–2452. arXiv: cond-mat/9902074 . Bibcode:1999PhRvL..83.2449M. doi:10.1103/physrevlett.83.2449. S2CID   119392131.
  17. Dewar R (2003). "Information theory explanation of the fluctuation theorem, maximum entropy production and self-organized criticality in non-equilibrium stationary states". Journal of Physics A: Mathematical and General. 36 (3): 631–641. arXiv: cond-mat/0005382 . Bibcode:2003JPhA...36..631D. doi:10.1088/0305-4470/36/3/303. S2CID   44217479.
  18. Vespignani A, Zapperi S (1998). "How self-organized criticality works: a unified mean-field picture". Physical Review E. 57 (6): 6345–6362. arXiv: cond-mat/9709192 . Bibcode:1998PhRvE..57.6345V. doi:10.1103/physreve.57.6345. hdl:2047/d20002173. S2CID   29500701.
  19. Kendal WS (2015). "Self-organized criticality attributed to a central limit-like convergence effect". Physica A. 421: 141–150. Bibcode:2015PhyA..421..141K. doi:10.1016/j.physa.2014.11.035.
  20. Hoffmann H (February 2018). "Impact of network topology on self-organized criticality". Physical Review E. 97 (2–1): 022313. Bibcode:2018PhRvE..97b2313H. doi: 10.1103/PhysRevE.97.022313 . PMID   29548239.
  21. Kalinin N, Guzmán-Sáenz A, Prieto Y, Shkolnikov M, Kalinina V, Lupercio E (August 2018). "Self-organized criticality and pattern emergence through the lens of tropical geometry". Proceedings of the National Academy of Sciences of the United States of America. 115 (35): E8135–E8142. arXiv: 1806.09153 . Bibcode:2018PNAS..115E8135K. doi: 10.1073/pnas.1805847115 . PMC   6126730 . PMID   30111541.
  22. Bak P, Paczuski M, Shubik M (1997-12-01). "Price variations in a stock market with many agents". Physica A: Statistical Mechanics and Its Applications. 246 (3): 430–453. arXiv: cond-mat/9609144 . Bibcode:1997PhyA..246..430B. doi:10.1016/S0378-4371(97)00401-9. ISSN   0378-4371. S2CID   119480691.
  23. Sornette D, Johansen A, Bouchaud JP (January 1996). "Stock Market Crashes, Precursors and Replicas". Journal de Physique I. 6 (1): 167–175. arXiv: cond-mat/9510036 . Bibcode:1996JPhy1...6..167S. doi:10.1051/jp1:1996135. ISSN   1155-4304. S2CID   5492260.
  24. Phillips JC (2014). "Fractals and self-organized criticality in proteins". Physica A. 415: 440–448. Bibcode:2014PhyA..415..440P. doi:10.1016/j.physa.2014.08.034.
  25. Phillips JC (November 2021). "Synchronized attachment and the Darwinian evolution of coronaviruses CoV-1 and CoV-2". Physica A. 581: 126202. arXiv: 2008.12168 . Bibcode:2021PhyA..58126202P. doi:10.1016/j.physa.2021.126202. PMC   8216869 . PMID   34177077.
  26. Malamud BD, Morein G, Turcotte DL (September 1998). "Forest fires: An example of self-organized critical behavior". Science. 281 (5384): 1840–1842. Bibcode:1998Sci...281.1840M. doi:10.1126/science.281.5384.1840. PMID   9743494.
  27. Poil SS, Hardstone R, Mansvelder HD, Linkenkaer-Hansen K (July 2012). "Critical-state dynamics of avalanches and oscillations jointly emerge from balanced excitation/inhibition in neuronal networks". The Journal of Neuroscience. 32 (29): 9817–9823. doi:10.1523/JNEUROSCI.5990-11.2012. PMC   3553543 . PMID   22815496.
  28. Chialvo DR (2010). "Emergent complex neural dynamics". Nature Physics. 6 (10): 744–750. arXiv: 1010.2530 . Bibcode:2010NatPh...6..744C. doi:10.1038/nphys1803. ISSN   1745-2481. S2CID   17584864.
  29. Tagliazucchi E, Balenzuela P, Fraiman D, Chialvo DR (2012). "Criticality in large-scale brain FMRI dynamics unveiled by a novel point process analysis". Frontiers in Physiology. 3: 15. doi: 10.3389/fphys.2012.00015 . PMC   3274757 . PMID   22347863.
  30. Caldarelli G, Petri A (September 1996). "Self-Organization and Annealed Disorder in Fracturing Process" (PDF). Physical Review Letters. 77 (12): 2503–2506. Bibcode:1996PhRvL..77.2503C. doi:10.1103/PhysRevLett.77.2503. PMID   10061970. S2CID   5462487.
  31. Frette V, Christensen K, Malthe-Sørenssen A, Feder J, Jøssang T, Meakin P (1996). "Avalanche dynamics in a pile of rice". Nature . 379 (6560): 49–52. Bibcode:1996Natur.379...49F. doi:10.1038/379049a0. S2CID   4344739.
  32. Bédard C, Kröger H, Destexhe A (September 2006). "Does the 1/f frequency scaling of brain signals reflect self-organized critical states?". Physical Review Letters. 97 (11): 118102. arXiv: q-bio/0608026 . Bibcode:2006PhRvL..97k8102B. doi:10.1103/PhysRevLett.97.118102. PMID   17025932. S2CID   1036124.
  33. Hesse J, Gross T (2014). "Self-organized criticality as a fundamental property of neural systems". Frontiers in Systems Neuroscience. 8: 166. doi: 10.3389/fnsys.2014.00166 . PMC   4171833 . PMID   25294989.
  34. Hoffmann H, Payton DW (February 2018). "Optimization by Self-Organized Criticality". Scientific Reports. 8 (1): 2358. Bibcode:2018NatSR...8.2358H. doi:10.1038/s41598-018-20275-7. PMC   5799203 . PMID   29402956.

Further reading