Landauer's principle

Last updated

Landauer's principle is a physical principle pertaining to the lower theoretical limit of energy consumption of computation. It holds that an irreversible change in information stored in a computer, such as merging two computational paths, dissipates a minimum amount of heat to its surroundings. [1]

Contents

The principle was first proposed by Rolf Landauer in 1961.

Statement

Landauer's principle states that the minimum energy needed to erase one bit of information is proportional to the temperature at which the system is operating. More specifically, the energy needed for this computational task is given by

where is the Boltzmann constant. [2] At room temperature, the Landauer limit represents an energy of approximately 0.018 eV (2.9×10−21 J). Modern computers use about a billion times as much energy per operation. [3] [4]

History

Rolf Landauer first proposed the principle in 1961 while working at IBM. [5] He justified and stated important limits to an earlier conjecture by John von Neumann. For this reason, it is sometimes referred to as being simply the Landauer bound or Landauer limit.

In 2008 and 2009, researchers showed that Landauer's principle can be derived from the second law of thermodynamics and the entropy change associated with information gain, developing the thermodynamics of quantum and classical feedback-controlled systems. [6] [7]

In 2011, the principle was generalized to show that while information erasure requires an increase in entropy, this increase could theoretically occur at no energy cost. [8] Instead, the cost can be taken in another conserved quantity, such as angular momentum.

In a 2012 article published in Nature, a team of physicists from the École normale supérieure de Lyon, University of Augsburg and the University of Kaiserslautern described that for the first time they have measured the tiny amount of heat released when an individual bit of data is erased. [9]

In 2014, physical experiments tested Landauer's principle and confirmed its predictions. [10]

In 2016, researchers used a laser probe to measure the amount of energy dissipation that resulted when a nanomagnetic bit flipped from off to on. Flipping the bit required 26 millielectronvolts (4.2 zeptojoules). [11]

A 2018 article published in Nature Physics features a Landauer erasure performed at cryogenic temperatures (T = 1 K) on an array of high-spin (S = 10) quantum molecular magnets. The array is made to act as a spin register where each nanomagnet encodes a single bit of information. [12] The experiment has laid the foundations for the extension of the validity of the Landauer principle to the quantum realm. Owing to the fast dynamics and low "inertia" of the single spins used in the experiment, the researchers also showed how an erasure operation can be carried out at the lowest possible thermodynamic cost—that imposed by the Landauer principle—and at a high speed. [12] [13]

Challenges

The principle is widely accepted as physical law, but in recent years it has been challenged for using circular reasoning and faulty assumptions, notably in Earman and Norton (1998), and subsequently in Shenker (2000) [14] and Norton (2004, [15] 2011 [16] ), and defended by Bennett (2003), [1] Ladyman et al. (2007), [17] and by Jordan and Manikandan (2019). [18] Sagawa and Ueda (2008) and Cao and Feito (2009) have shown that Landauer's principle is a consequence of the second law of Thermodynamics and the entropy reduction associated with information gain. [6] [7]

On the other hand, recent advances in non-equilibrium statistical physics have established that there is no a priori relationship between logical and thermodynamic reversibility. [19] It is possible that a physical process is logically reversible but thermodynamically irreversible. It is also possible that a physical process is logically irreversible but thermodynamically reversible. At best, the benefits of implementing a computation with a logically reversible system are nuanced. [20]

In 2016, researchers at the University of Perugia claimed to have demonstrated a violation of Landauer’s principle. [21] However, according to Laszlo Kish (2016), [22] their results are invalid because they "neglect the dominant source of energy dissipation, namely, the charging energy of the capacitance of the input electrode".

See also

Related Research Articles

<span class="mw-page-title-main">Entropy</span> Property of a thermodynamic system

Entropy is a scientific concept that is most commonly associated with a state of disorder, randomness, or uncertainty. The term and the concept are used in diverse fields, from classical thermodynamics, where it was first recognized, to the microscopic description of nature in statistical physics, and to the principles of information theory. It has found far-ranging applications in chemistry and physics, in biological systems and their relation to life, in cosmology, economics, sociology, weather science, climate change, and information systems including the transmission of information in telecommunication.

The holographic principle is a property of string theories and a supposed property of quantum gravity that states that the description of a volume of space can be thought of as encoded on a lower-dimensional boundary to the region — such as a light-like boundary like a gravitational horizon. First proposed by Gerard 't Hooft, it was given a precise string theoretic interpretation by Leonard Susskind, who combined his ideas with previous ones of 't Hooft and Charles Thorn. Leonard Susskind said, “The three-dimensional world of ordinary experience––the universe filled with galaxies, stars, planets, houses, boulders, and people––is a hologram, an image of reality coded on a distant two-dimensional surface." As pointed out by Raphael Bousso, Thorn observed in 1978 that string theory admits a lower-dimensional description in which gravity emerges from it in what would now be called a holographic way. The prime example of holography is the AdS/CFT correspondence.

In physics, statistical mechanics is a mathematical framework that applies statistical methods and probability theory to large assemblies of microscopic entities. It does not assume or postulate any natural laws, but explains the macroscopic behavior of nature from the behavior of such ensembles.

<span class="mw-page-title-main">Maxwell's demon</span> Thought experiment of 1867

Maxwell's demon is a thought experiment that appears to disprove the second law of thermodynamics. It was proposed by the physicist James Clerk Maxwell in 1867. In his first letter, Maxwell referred to the entity as a "finite being" or a "being who can play a game of skill with the molecules". Lord Kelvin would later call it a "demon".

<span class="mw-page-title-main">Second law of thermodynamics</span> Physical law for entropy and heat

The second law of thermodynamics is a physical law based on universal empirical observation concerning heat and energy interconversions. A simple statement of the law is that heat always flows spontaneously from hotter to colder regions of matter. Another statement is: "Not all heat can be converted into work in a cyclic process."

<span class="mw-page-title-main">T-symmetry</span> Time reversal symmetry in physics

T-symmetry or time reversal symmetry is the theoretical symmetry of physical laws under the transformation of time reversal,

The fluctuation theorem (FT), which originated from statistical mechanics, deals with the relative probability that the entropy of a system which is currently away from thermodynamic equilibrium will increase or decrease over a given amount of time. While the second law of thermodynamics predicts that the entropy of an isolated system should tend to increase until it reaches equilibrium, it became apparent after the discovery of statistical mechanics that the second law is only a statistical one, suggesting that there should always be some nonzero probability that the entropy of an isolated system might spontaneously decrease; the fluctuation theorem precisely quantifies this probability.

<span class="mw-page-title-main">Black hole thermodynamics</span> Area of study

In physics, black hole thermodynamics is the area of study that seeks to reconcile the laws of thermodynamics with the existence of black hole event horizons. As the study of the statistical mechanics of black-body radiation led to the development of the theory of quantum mechanics, the effort to understand the statistical mechanics of black holes has had a deep impact upon the understanding of quantum gravity, leading to the formulation of the holographic principle.

<span class="mw-page-title-main">Laplace's demon</span> Hypothetical all-predicting intellect

In the history of science, Laplace's demon was a notable published articulation of causal determinism on a scientific basis by Pierre-Simon Laplace in 1814. According to determinism, if someone knows the precise location and momentum of every atom in the universe, their past and future values for any given time are entailed; they can be calculated from the laws of classical mechanics.

<span class="mw-page-title-main">Irreversible process</span> Process that cannot be undone

In science, a process that is not reversible is called irreversible. This concept arises frequently in thermodynamics. All complex natural processes are irreversible, although a phase transition at the coexistence temperature is well approximated as reversible.

<span class="mw-page-title-main">Bekenstein bound</span> Upper limit on entropy in physics

In physics, the Bekenstein bound is an upper limit on the thermodynamic entropy S, or Shannon entropy H, that can be contained within a given finite region of space which has a finite amount of energy—or conversely, the maximal amount of information required to perfectly describe a given physical system down to the quantum level. It implies that the information of a physical system, or the information necessary to perfectly describe that system, must be finite if the region of space and the energy are finite. In computer science this implies that non-finite models such as Turing machines are not realizable as finite devices.

Reversible computing is any model of computation where the computational process, to some extent, is time-reversible. In a model of computation that uses deterministic transitions from one state of the abstract machine to another, a necessary condition for reversibility is that the relation of the mapping from states to their successors must be one-to-one. Reversible computing is a form of unconventional computing.

The limits of computation are governed by a number of different factors. In particular, there are several physical and practical limits to the amount of computation or data storage that can be performed with a given amount of mass, volume, or energy.

The mathematical expressions for thermodynamic entropy in the statistical thermodynamics formulation established by Ludwig Boltzmann and J. Willard Gibbs in the 1870s are similar to the information entropy by Claude Shannon and Ralph Hartley, developed in the 1940s.

Joan Vaccaro is a physicist at Griffith University and a former student of David Pegg. Her work in quantum physics includes quantum phase, nonclassical states of light, coherent laser excitation of atomic gases, cold atomic gases, stochastic Schrödinger equations, quantum information theory, quantum references, wave–particle duality, quantum thermodynamics, and the physical nature of time.

<span class="mw-page-title-main">Entropic gravity</span> Theory in modern physics that describes gravity as an entropic force

Entropic gravity, also known as emergent gravity, is a theory in modern physics that describes gravity as an entropic force—a force with macro-scale homogeneity but which is subject to quantum-level disorder—and not a fundamental interaction. The theory, based on string theory, black hole physics, and quantum information theory, describes gravity as an emergent phenomenon that springs from the quantum entanglement of small bits of spacetime information. As such, entropic gravity is said to abide by the second law of thermodynamics under which the entropy of a physical system tends to increase over time.

The Bousso bound captures a fundamental relation between quantum information and the geometry of space and time. It appears to be an imprint of a unified theory that combines quantum mechanics with Einstein's general relativity. The study of black hole thermodynamics and the information paradox led to the idea of the holographic principle: the entropy of matter and radiation in a spatial region cannot exceed the Bekenstein–Hawking entropy of the boundary of the region, which is proportional to the boundary area. However, this "spacelike" entropy bound fails in cosmology; for example, it does not hold true in our universe.

<span class="mw-page-title-main">Quantum thermodynamics</span> Study of the relations between thermodynamics and quantum mechanics

Quantum thermodynamics is the study of the relations between two independent physical theories: thermodynamics and quantum mechanics. The two independent theories address the physical phenomena of light and matter. In 1905, Albert Einstein argued that the requirement of consistency between thermodynamics and electromagnetism leads to the conclusion that light is quantized, obtaining the relation . This paper is the dawn of quantum theory. In a few decades quantum theory became established with an independent set of rules. Currently quantum thermodynamics addresses the emergence of thermodynamic laws from quantum mechanics. It differs from quantum statistical mechanics in the emphasis on dynamical processes out of equilibrium. In addition, there is a quest for the theory to be relevant for a single individual quantum system.

Stochastic thermodynamics is an emergent field of research in statistical mechanics that uses stochastic variables to better understand the non-equilibrium dynamics present in many microscopic systems such as colloidal particles, biopolymers, enzymes, and molecular motors.

<span class="mw-page-title-main">Molecular demon</span>

A molecular demon or biological molecular machine is a biological macromolecule that resembles and seems to have the same properties as Maxwell's demon. These macromolecules gather information in order to recognize their substrate or ligand within a myriad of other molecules floating in the intracellular or extracellular plasm. This molecular recognition represents an information gain which is equivalent to an energy gain or decrease in entropy. When the demon is reset i.e. when the ligand is released, the information is erased, energy is dissipated and entropy increases obeying the second law of thermodynamics. The difference between biological molecular demons and the thought experiment of Maxwell's demon is the latter's apparent violation of the second law.

References

  1. 1 2 Charles H. Bennett (2003), "Notes on Landauer's principle, Reversible Computation and Maxwell's Demon" (PDF), Studies in History and Philosophy of Modern Physics, 34 (3): 501–510, arXiv: physics/0210005 , Bibcode:2003SHPMP..34..501B, doi:10.1016/S1355-2198(03)00039-X, S2CID   9648186 , retrieved 2015-02-18.
  2. Vitelli, M.B.; Plenio, V. (2001). "The physics of forgetting: Landauer's erasure principle and information theory" (PDF). Contemporary Physics. 42 (1): 25–60. arXiv: quant-ph/0103108 . Bibcode:2001ConPh..42...25P. doi:10.1080/00107510010018916. eISSN   1366-5812. hdl:10044/1/435. ISSN   0010-7514. S2CID   9092795.
  3. Thomas J. Thompson. "Nanomagnet memories approach low-power limit". bloomfield knoble. Archived from the original on December 19, 2014. Retrieved May 5, 2013.
  4. Samuel K. Moore (14 March 2012). "Landauer Limit Demonstrated". IEEE Spectrum. Retrieved May 5, 2013.
  5. Rolf Landauer (1961), "Irreversibility and heat generation in the computing process" (PDF), IBM Journal of Research and Development, 5 (3): 183–191, doi:10.1147/rd.53.0183 , retrieved 2015-02-18.
  6. 1 2 Sagawa, Takahiro; Ueda, Masahito (2008-02-26). "Second Law of Thermodynamics with Discrete Quantum Feedback Control". Physical Review Letters. 100 (8): 080403. arXiv: 0710.0956 . Bibcode:2008PhRvL.100h0403S. doi:10.1103/PhysRevLett.100.080403. PMID   18352605. S2CID   41799543.
  7. 1 2 Cao, F. J.; Feito, M. (2009-04-10). "Thermodynamics of feedback controlled systems". Physical Review E. 79 (4): 041118. arXiv: 0805.4824 . Bibcode:2009PhRvE..79d1118C. doi:10.1103/PhysRevE.79.041118. PMID   19518184. S2CID   30188109.
  8. Joan Vaccaro; Stephen Barnett (June 8, 2011), "Information Erasure Without an Energy Cost", Proc. R. Soc. A, 467 (2130): 1770–1778, arXiv: 1004.5330 , Bibcode:2011RSPSA.467.1770V, doi:10.1098/rspa.2010.0577, S2CID   11768197 .
  9. Antoine Bérut; Artak Arakelyan; Artyom Petrosyan; Sergio Ciliberto; Raoul Dillenschneider; Eric Lutz (8 March 2012), "Experimental verification of Landauer's principle linking information and thermodynamics" (PDF), Nature, 483 (7388): 187–190, arXiv: 1503.06537 , Bibcode:2012Natur.483..187B, doi:10.1038/nature10872, PMID   22398556, S2CID   9415026 .
  10. Yonggun Jun; Momčilo Gavrilov; John Bechhoefer (4 November 2014), "High-Precision Test of Landauer's Principle in a Feedback Trap", Physical Review Letters , 113 (19): 190601, arXiv: 1408.5089 , Bibcode:2014PhRvL.113s0601J, doi:10.1103/PhysRevLett.113.190601, PMID   25415891, S2CID   10164946 .
  11. Hong, Jeongmin; Lambson, Brian; Dhuey, Scott; Bokor, Jeffrey (2016-03-01). "Experimental test of Landauer's principle in single-bit operations on nanomagnetic memory bits". Science Advances. 2 (3): e1501492. Bibcode:2016SciA....2E1492H. doi:10.1126/sciadv.1501492. ISSN   2375-2548. PMC   4795654 . PMID   26998519..
  12. 1 2 Rocco Gaudenzi; Enrique Burzuri; Satoru Maegawa; Herre van der Zant; Fernando Luis (19 March 2018), "Quantum Landauer erasure with a molecular nanomagnet", Nature Physics, 14 (6): 565–568, Bibcode:2018NatPh..14..565G, doi:10.1038/s41567-018-0070-7, hdl: 10261/181265 , S2CID   125321195 .
  13. Bennett, Charles H. (September 2003). Notes on Landauer's principle, reversible computation, and Maxwell's Demon. Vol. 34. p. 510. arXiv: physics/0210005 . Bibcode:2003SHPMP..34..501B. doi:10.1016/S1355-2198(03)00039-X. ISBN   9780198570493. S2CID   9648186.{{cite book}}: |journal= ignored (help)
  14. Shenker, Orly R. (June 2000). "Logic and Entropy [preprint]". PhilSci Archive. Archived from the original on 15 November 2023. Retrieved 20 December 2023.
  15. Norton, John D. (June 2005). "Eaters of the lotus: Landauer's principle and the return of Maxwell's demon". Studies in History and Philosophy of Science Part B: Studies in History and Philosophy of Modern Physics. 36 (2): 375–411. Bibcode:2005SHPMP..36..375N. doi:10.1016/j.shpsb.2004.12.002. S2CID   21104635. Archived from the original on 5 June 2023. Retrieved 20 December 2023.
  16. Norton, John D. (August 2011). "Waiting for Landauer" (PDF). Studies in History and Philosophy of Science Part B: Studies in History and Philosophy of Modern Physics. 42 (3): 184–198. Bibcode:2011SHPMP..42..184N. doi:10.1016/j.shpsb.2011.05.002 . Retrieved 20 December 2023.
  17. Ladyman, James; Presnell, Stuart; Short, Anthony J.; Groisman, Berry (March 2007). "The connection between logical and thermodynamic irreversibility". Studies in History and Philosophy of Science Part B: Studies in History and Philosophy of Modern Physics. 38 (1): 58–79. Bibcode:2007SHPMP..38...58L. doi:10.1016/j.shpsb.2006.03.007 . Retrieved 20 December 2023.
  18. Jordan, Andrew; Manikandan, Sreenath (12 December 2019). "Some Like It Hot". Inference: International Review of Science. 5 (1). doi:10.37282/991819.19.82. S2CID   241470079.
  19. Takahiro Sagawa (2014), "Thermodynamic and logical reversibilities revisited", Journal of Statistical Mechanics: Theory and Experiment, 2014 (3): 03025, arXiv: 1311.1886 , Bibcode:2014JSMTE..03..025S, doi:10.1088/1742-5468/2014/03/P03025, S2CID   119247579 .
  20. David H. Wolpert (2019), "Stochastic thermodynamics of computation", Journal of Physics A: Mathematical and Theoretical, 52 (19): 193001, arXiv: 1905.05669 , Bibcode:2019JPhA...52s3001W, doi:10.1088/1751-8121/ab0850, S2CID   126715753 .
  21. "Computing study refutes famous claim that 'information is physical'". m.phys.org.
  22. Laszlo Bela Kish (2016). "Comments on 'Sub-kBT Micro-Electromechanical Irreversible Logic Gate'". Fluctuation and Noise Letters. 14 (4): 1620001–1620194. arXiv: 1606.09493 . Bibcode:2016FNL....1520001K. doi:10.1142/S0219477516200017. S2CID   12110986 . Retrieved 2020-03-08.

Further reading