Self-organization in cybernetics

Last updated

Self-organization, a process where some form of overall order arises out of the local interactions between parts of an initially disordered system, was discovered in cybernetics by William Ross Ashby in 1947. [1] [2] It states that any deterministic dynamic system automatically evolves towards a state of equilibrium that can be described in terms of an attractor in a basin of surrounding states. Once there, the further evolution of the system is constrained to remain in the attractor. This constraint implies a form of mutual dependency or coordination between its constituent components or subsystems. In Ashby's terms, each subsystem has adapted to the environment formed by all other subsystems. [1]

The cybernetician Heinz von Foerster formulated the principle of "order from noise" in 1960. [3] [4] It notes that self-organization is facilitated by random perturbations ("noise") that let the system explore a variety of states in its state space. This increases the chance that the system will arrive into the basin of a "strong" or "deep" attractor, from which it then quickly enters the attractor itself. The biophysicist Henri Atlan developed such a concept by proposing the principle of "complexity from noise" [5] [6] (French : le principe de complexité par le bruit) [7] first in the 1972 book L'organisation biologique et la théorie de l'information [8] and then in the 1979 book Entre le cristal et la fumée. [9] The thermodynamicist Ilya Prigogine formulated a similar principle as "order through fluctuations" [10] or "order out of chaos". [11] It is applied in the method of simulated annealing for problem solving and machine learning. [12]

Wiener regarded the automatic serial identification of a black box and its subsequent reproduction (copying) as sufficient to meet the condition of self-organization. [13] The importance of phase locking or the "attraction of frequencies", as he called it, is discussed in the 2nd edition of his "Cybernetics". [14] Drexler sees self-replication (copying) as a key step in nano and universal assembly. [15] In later work he seeks to lessen this constraint. [16]

By contrast, the four concurrently connected galvanometers of W. Ross Ashby's Homeostat hunt, when perturbed, to converge on one of many possible stable states. [17] Ashby used his state counting measure of variety [18] to describe stable states and produced the "Good Regulator" [19] theorem which requires internal models for self-organized endurance and stability (e.g. Nyquist stability criterion).

Warren McCulloch proposed "Redundancy of Potential Command" [20] as characteristic of the organization of the brain and human nervous system and the necessary condition for self-organization.

Heinz von Foerster proposed Redundancy, R = 1  H/Hmax, where H is entropy. [21] [22] In essence this states that unused potential communication bandwidth is a measure of self-organization.

In the 1970s Stafford Beer considered this condition as necessary for autonomy which identifies self-organization in persisting and living systems. He applied his viable system model to management. It consists of five parts: the monitoring of performance of the survival processes (1), their management by recursive application of regulation (2), homeostatic operational control (3) and development (4) which produce maintenance of identity (5) under environmental perturbation. Focus is prioritized by an alerting "algedonic loop" feedback: a sensitivity to both pain and pleasure produced from under-performance or over-performance relative to a standard capability. [23] [ full citation needed ]

In the 1990s Gordon Pask pointed out von Foerster's H and Hmax were not independent and interacted via countably infinite recursive concurrent spin processes [24] (he favoured the Bohm interpretation) which he called concepts (liberally defined in any medium, "productive and, incidentally reproductive"). His strict definition of concept "a procedure to bring about a relation" [25] permitted his theorem "Like concepts repel, unlike concepts attract" [26] to state a general spin based principle of self-organization. His edict, an exclusion principle, "There are No Doppelgangers" [27] [24] means no two concepts can be the same (all interactions occur with different perspectives making time incommensurable for actors). This means, after sufficient duration as differences assert, all concepts will attract and coalesce as pink noise and entropy increases (and see Big Crunch, self-organized criticality). The theory is applicable to all organizationally closed or homeostatic processes that produce enduring and coherent products (where spins have a fixed average phase relationship and also in the sense of Nicholas Rescher's coherence theory of truth with the proviso that the sets and their members exert repulsive forces at their boundaries) through interactions: evolving, learning and adapting.

Pask's Interactions of Actors "hard carapace" model is reflected in some of the ideas of emergence and coherence. It requires a knot emergence topology that produces radiation during interaction with a unit cell that has a prismatic tensegrity structure. Laughlin's contribution to emergence reflects some of these constraints. [28]

See also

Related Research Articles

Systems theory is the transdisciplinary study of systems, i.e. cohesive groups of interrelated, interdependent components that can be natural or artificial. Every system has causal boundaries, is influenced by its context, defined by its structure, function and role, and expressed through its relations with other systems. A system is "more than the sum of its parts" when it expresses synergy or emergent behavior.

Warren Sturgis McCulloch was an American neurophysiologist and cybernetician, known for his work on the foundation for certain brain theories and his contribution to the cybernetics movement. Along with Walter Pitts, McCulloch created computational models based on mathematical algorithms called threshold logic which split the inquiry into two distinct approaches, one approach focused on biological processes in the brain and the other focused on the application of neural networks to artificial intelligence.

<span class="mw-page-title-main">Heinz von Foerster</span> Austrian-American scientist and cybernetician (1911–2002)

Heinz von Foerster was an Austrian-American scientist combining physics and philosophy, and widely attributed as the originator of second-order cybernetics. He was twice a Guggenheim fellow and also was a fellow of the American Association for the Advancement of Science, 1980. He is well known for his 1960 Doomsday equation formula published in Science predicting future population growth.

<span class="mw-page-title-main">Self-organization</span> Process of creating order by local interactions

Self-organization, also called spontaneous order in the social sciences, is a process where some form of overall order arises from local interactions between parts of an initially disordered system. The process can be spontaneous when sufficient energy is available, not needing control by any external agent. It is often triggered by seemingly random fluctuations, amplified by positive feedback. The resulting organization is wholly decentralized, distributed over all the components of the system. As such, the organization is typically robust and able to survive or self-repair substantial perturbation. Chaos theory discusses self-organization in terms of islands of predictability in a sea of chaotic unpredictability.

<span class="mw-page-title-main">W. Ross Ashby</span> English psychiatrist (1903–1972)

William Ross Ashby was an English psychiatrist and a pioneer in cybernetics, the study of the science of communications and automatic control systems in both machines and living things. His first name was not used: he was known as Ross Ashby.

Second-order cybernetics, also known as the cybernetics of cybernetics, is the recursive application of cybernetics to itself and the reflexive practice of cybernetics according to such a critique. It is cybernetics where "the role of the observer is appreciated and acknowledged rather than disguised, as had become traditional in western science". Second-order cybernetics was developed between the late 1960s and mid 1970s by Heinz von Foerster and others, with key inspiration coming from Margaret Mead. Foerster referred to it as "the control of control and the communication of communication" and differentiated first order cybernetics as "the cybernetics of observed systems" and second-order cybernetics as "the cybernetics of observing systems".

<span class="mw-page-title-main">Gordon Pask</span> British cybernetician and psychologist (1928–1996)

Andrew Gordon Speedie Pask was a British cybernetician, inventor and polymath who made during his lifetime multiple contributions to cybernetics, educational psychology, educational technology, epistemology, chemical computing, architecture, and the performing arts. During his life he gained three doctorate degrees. He was an avid writer, with more than two hundred and fifty publications which included a variety of journal articles, books, periodicals, patents, and technical reports. He also worked as an academic and researcher for a variety of educational settings, research institutes, and private stakeholders including but not limited to the University of Illinois, Concordia University, the Open University, Brunel University and the Architectural Association School of Architecture. He is known for the development of conversation theory.

<span class="mw-page-title-main">Humberto Maturana</span> Chilean biologist and philosopher (1928–2021)

Humberto Maturana Romesín was a Chilean biologist and philosopher. Many consider him a member of a group of second-order cybernetics theoreticians such as Heinz von Foerster, Gordon Pask, Herbert Brün and Ernst von Glasersfeld, but in fact he was a biologist, scientist.

A glossary of terms relating to systems theory.

Principia Cybernetica is an international cooperation of scientists in the field of cybernetics and systems science, especially known for their website, Principia Cybernetica. They have dedicated their organization to what they call "a computer-supported evolutionary-systemic philosophy, in the context of the transdisciplinary academic fields of Systems Science and Cybernetics".

In cybernetics, the term variety denotes the total number of distinguishable elements of a set, most often the set of states, inputs, or outputs of a finite-state machine or transformation, or the binary logarithm of the same quantity. Variety is used in cybernetics as an information theory that is easily related to deterministic finite automata, and less formally as a conceptual tool for thinking about organization, regulation, and stability. It is an early theory of complexity in automata, complex systems, and operations research.

New Cybernetics, as used by cybernetician Gordon Pask, is the meaningful transfer of information between coherences in all media in terms of attractions and repulsions between clockwise and anti-clockwise spins. This is a possibly defining paradigm of the new cybernetics or second-order cybernetics.

<span class="mw-page-title-main">Stuart Umpleby</span>

Stuart Anspach Umpleby is an American cybernetician and professor in the Department of Management and Director of the Research Program in Social and Organizational Learning in the School of Business at the George Washington University.

<span class="mw-page-title-main">Henri Atlan</span> French biophysicist and philosopher (born 1931)

Henri Atlan is a French biophysicist and philosopher.

<span class="mw-page-title-main">American Society for Cybernetics</span> Organization

The American Society for Cybernetics (ASC) is an American non-profit scholastic organization for the advancement of cybernetics as a science, a discipline, a meta-discipline and the promotion of cybernetics as basis for an interdisciplinary discourse. The society does this by developing and applying cybernetics’ concepts which are presented and published via its conferences and peer-reviewed publications. As a meta-discipline, it creates bridges between disciplines, philosophies, sciences, and arts. The ASC is a full member of the International Federation for Systems Research (IFSR).

<span class="mw-page-title-main">Cybernetics</span> Transdisciplinary field concerned with regulatory and purposive systems

Cybernetics is a field of systems theory that studies circular causal systems whose outputs are also inputs, such as feedback systems. It is concerned with the general principles of circular causal processes, including in ecological, technological, biological, cognitive and social systems and also in the context of practical activities such as designing, learning, and managing.

The Biological Computer Laboratory (BCL) was a research institute of the Department of Electrical Engineering at the University of Illinois Urbana-Champaign. It was founded on 1 January 1958, by then Professor of Electrical Engineering Heinz von Foerster. He was head of BCL until his retirement in 1975.

In information theory, Interactions of actors theory is a theory developed by Gordon Pask and Gerard de Zeeuw. It is a generalisation of Pask's earlier conversation theory: The chief distinction being that conversation theory focuses on analysing the specific features that allow a conversation to emerge between two participants, whereas interaction of actor's theory focuses on the broader domain of conversation in which conversations may appear, disappear, and reappear over time.

The Symposium on Principles of Self-Organization was held at Allerton House on 8–9 June 1960. It was a key conference in the development of cybernetics and was in many ways a continuation of the Macy Conferences. it was organised by Heinz von Foerster through the Biological Computer Laboratory based at University of Illinois at Urbana-Champaign. It was sponsored by the Information Systems Branch of the U.S. Office of Naval Research.

References

  1. 1 2 Ashby, W. R. (1947). "Principles of the Self-Organizing Dynamic System". The Journal of General Psychology. 37 (2): 125–8. doi:10.1080/00221309.1947.9918144. PMID   20270223.
  2. Ashby, W. R. (1962). "Principles of the self-organizing system", pp. 255–278 in Principles of Self-Organization. Heinz von Foerster and George W. Zopf, Jr. (eds.) U.S. Office of Naval Research.
  3. Von Foerster, H. (1960). "On self-organizing systems and their environments", pp. 31–50 in Self-organizing systems. M.C. Yovits and S. Cameron (eds.), Pergamon Press, London
  4. Asaro, P. (2007). "Heinz von Foerster and the Bio-Computing Movements of the 1960s" in Albert Müller and Karl H. Müller (eds.) An Unfinished Revolution? Heinz von Foerster and the Biological Computer Laboratory BCL 1958–1976. Vienna, Austria: Edition Echoraum.
  5. See occurrences on Google Books.
  6. François, Charles, ed. (2011) [1997]. International Encyclopedia of Systems and Cybernetics (2nd ed.). Berlin: Walter de Gruyter. p.  107. ISBN   978-3-1109-6801-9.
  7. See occurrences on Google Books.
  8. https://www.google.com/search?&q=%22complexité+par+le+bruit%22%22L'Organisation+biologique+et+la+théorie+de+l'information%22+1972
  9. https://www.google.com/search?&q=%22complexité+par+le+bruit%22%22Entre+le+cristal+et+la+fumée%22+1979
  10. Nicolis, G. and Prigogine, I. (1977). Self-organization in nonequilibrium systems: From dissipative structures to order through fluctuations. Wiley, New York.
  11. Prigogine, I. and Stengers, I. (1984). Order out of chaos: Man's new dialogue with nature. Bantam Books.
  12. Ahmed, Furqan; Tirkkonen, Olav (January 2016). "Simulated annealing variants for self-organized resource allocation in small cell networks". Applied Soft Computing. 38: 762–770. doi:10.1016/j.asoc.2015.10.028. S2CID   10126852.
  13. Wiener, Norbert (1962) "The mathematics of self-organising systems". Recent developments in information and decision processes, Macmillan, N. Y. and Chapter X in Cybernetics, or control and communication in the animal and the machine, The MIT Press.
  14. Cybernetics, or control and communication in the animal and the machine, The MIT Press, Cambridge, Massachusetts and Wiley, NY, 1948. 2nd Edition 1962 "Chapter X "Brain Waves and Self-Organizing Systems"pp 201–202.
  15. Eric K. Drexler "Engines of Creation" 1986
  16. Engines of Creation 2 http://www1.appstate.edu/dept/physics/nanotech/EnginesofCreation2_8803267.pdf
  17. Ashby, William Ross (1952) Design for a Brain, Chapter 5 Chapman & Hall
  18. Ashby, William Ross (1956) An Introduction to Cybernetics, Part Two Chapman & Hall
  19. Conant, Roger C.; Ross Ashby, W. (8 March 2007). "Every good regulator of a system must be a model of that system". International Journal of Systems Science. 1 (2): 89–97. doi:10.1080/00207727008920220.
  20. Embodiments of Mind MIT Press (1965)"
  21. von Foerster, Heinz; Pask, Gordon (1961). "A Predictive Model for Self-Organizing Systems, Part I". Cybernetica. 3: 258–300.
  22. von Foerster, Heinz; Pask, Gordon (1961). "A Predictive Model for Self-Organizing Systems, Part II". Cybernetica. 4: 20–55.
  23. "Brain of the Firm" Alan Lane (1972) see also "Beyond Dispute," Wiley, Stafford Beer 1994 "Redundancy of Potential Command" pp. 157–158.
  24. 1 2 Pask, Gordon (September 1996). "Heinz von Foerster's Self Organization, the Progenitor of Conversation and Interaction Theories". Systems Research. 13 (3): 349–362. doi:10.1002/(sici)1099-1735(199609)13:3<349::aid-sres103>3.3.co;2-7.
  25. Pask, G. (1973). Conversation, Cognition and Learning. A Cybernetic Theory and Methodology. Elsevier
  26. Green, Nick (July 2001). "On Gordon Pask". Kybernetes. 30 (5/6): 673–682. doi:10.1108/03684920110391913.
  27. Pask, Gordon (1993) Interactions of Actors (IA), Theory and Some Applications.
  28. Laughlin, R. B.; Pines, David (4 January 2000). "The Theory of Everything". Proceedings of the National Academy of Sciences of the United States of America. 97 (1): 28–31. doi: 10.1073/pnas.97.1.28 . PMC   26610 . PMID   10618365.