Microcanonical ensemble

In statistical mechanics, the microcanonical ensemble is a statistical ensemble that represents the possible states of a mechanical system whose total energy is exactly specified. ^[1] The system is assumed to be isolated in the sense that it cannot exchange energy or particles with its environment, so that (by conservation of energy) the energy of the system does not change with time.

The primary macroscopic variables of the microcanonical ensemble are the total number of particles in the system (symbol: N), the system's volume (symbol: V), as well as the total energy in the system (symbol: E). Each of these is assumed to be constant in the ensemble. For this reason, the microcanonical ensemble is sometimes called the NVE ensemble.

In simple terms, the microcanonical ensemble is defined by assigning an equal probability to every microstate whose energy falls within a range centered at E. All other microstates are given a probability of zero. Since the probabilities must add up to 1, the probability P is the inverse of the number of microstates W within the range of energy,

${\displaystyle P=1/W,}$

The range of energy is then reduced in width until it is infinitesimally narrow, still centered at E. In the limit of this process, the microcanonical ensemble is obtained. ^[1]

Applicability

Because of its connection with the elementary assumptions of equilibrium statistical mechanics (particularly the postulate of a priori equal probabilities), the microcanonical ensemble is an important conceptual building block in the theory. ^[2] It is sometimes considered to be the fundamental distribution of equilibrium statistical mechanics. It is also useful in some numerical applications, such as molecular dynamics. ^{[3] [4]} On the other hand, most nontrivial systems are mathematically cumbersome to describe in the microcanonical ensemble, and there are also ambiguities regarding the definitions of entropy and temperature. For these reasons, other ensembles are often preferred for theoretical calculations. ^{[2] [5] [6]}

The applicability of the microcanonical ensemble to real-world systems depends on the importance of energy fluctuations, which may result from interactions between the system and its environment as well as uncontrolled factors in preparing the system. Generally, fluctuations are negligible if a system is macroscopically large, or if it is manufactured with precisely known energy and thereafter maintained in near isolation from its environment. ^[7] In such cases the microcanonical ensemble is applicable. Otherwise, different ensembles are more appropriate – such as the canonical ensemble (fluctuating energy) or the grand canonical ensemble (fluctuating energy and particle number).

Properties

Thermodynamic quantities

The fundamental thermodynamic potential of the microcanonical ensemble is entropy. There are at least three possible definitions, each given in terms of the phase volume function v(E). In classical mechanics v(E) this is the volume of the region of phase space where the energy is less than E. In quantum mechanics v(E) is roughly the number of energy eigenstates with energy less than E; however this must be smoothed so that we can take its derivative (see the Precise expressions section for details on how this is done). The definitions of microcanonical entropy are:

• the Boltzmann entropy ${\displaystyle S_{\text{B}}}$:

  ${\displaystyle S_{\text{B}}=k\log W=k\log \left(\omega {\frac {dv}{dE}}\right)}$

  The Boltzmann entropy depends on a choice of so-called 'energy width' ω, which is an arbitrary quantity with units of energy, typically taken to be small, introduced so that we are taking the logarithm of a dimensionless quantity, as ${\displaystyle {\frac {dv}{dE}}}$ has units of energy.
• the 'volume entropy':

  ${\displaystyle S_{v}=k\log v,}$

• the 'surface entropy':

  ${\displaystyle S_{s}=k\log {\frac {dv}{dE}}=S_{\text{B}}-k\log \omega .}$

  In the surface entropy we are taking the logarithm of a quantity with units of inverse energy, so changing our units of energy will change this quantity by an additive constant. The Boltzmann entropy can be seen as a variant of the surface entropy that avoids this problem.

In the microcanonical ensemble, the temperature is a derived quantity rather than an external control parameter. It is defined as the derivative of the chosen entropy with respect to energy. ^[8] For example, one can define the "temperatures" T_v and T_s as follows:

${\displaystyle 1/T_{v}=dS_{v}/dE,}$

${\displaystyle 1/T_{s}=dS_{s}/dE=dS_{\text{B}}/dE.}$

Like entropy, there are multiple ways to understand temperature in the microcanonical ensemble. More generally, the correspondence between these ensemble-based definitions and their thermodynamic counterparts is not perfect, particularly for finite systems.

The microcanonical pressure and chemical potential are given by: ^[9]

${\displaystyle {\frac {p}{T}}={\frac {\partial S}{\partial V}};\qquad {\frac {\mu }{T}}=-{\frac {\partial S}{\partial N}}}$

Phase transitions

Under their strict definition, phase transitions correspond to nonanalytic behavior in the thermodynamic potential or its derivatives. ^[10] Using this definition, phase transitions in the microcanonical ensemble can occur in systems of any size. This contrasts with the canonical and grand canonical ensembles, for which phase transitions can occur only in the thermodynamic limit – i.e., in systems with infinitely many degrees of freedom. ^{[10] [11]} Roughly speaking, the reservoirs defining the canonical or grand canonical ensembles introduce fluctuations that "smooth out" any nonanalytic behavior in the free energy of finite systems. This smoothing effect is usually negligible in macroscopic systems, which are sufficiently large that the free energy can approximate nonanalytic behavior exceedingly well. However, the technical difference in ensembles may be important in the theoretical analysis of small systems. ^[11]

Information entropy

For a given mechanical system (fixed N, V) and a given range of energy, the uniform distribution of probability P over microstates (as in the microcanonical ensemble) maximizes the ensemble average −⟨log P⟩. ^[1]

Thermodynamic analogies

Early work in statistical mechanics by Ludwig Boltzmann led to his eponymous entropy equation for a system of a given total energy, S = k log W, where W is the number of distinct states accessible by the system at that energy. Boltzmann did not elaborate too deeply on what exactly constitutes the set of distinct states of a system, besides the special case of an ideal gas. This topic was investigated to completion by Josiah Willard Gibbs who developed the generalized statistical mechanics for arbitrary mechanical systems, and defined the microcanonical ensemble described in this article. ^[1] Gibbs investigated carefully the analogies between the microcanonical ensemble and thermodynamics, especially how they break down in the case of systems of few degrees of freedom. He introduced two further definitions of microcanonical entropy that do not depend on ω – the volume and surface entropy described above. (Note that the surface entropy differs from the Boltzmann entropy only by an ω-dependent offset.)

The volume entropy ${\displaystyle S_{v}}$ and associated temperature ${\displaystyle T_{v}}$ are closely analogous to thermodynamic entropy and temperature. It is possible to show exactly that

${\displaystyle dE=T_{v}dS_{v}-\langle P\rangle dV,}$

(⟨P⟩ is the ensemble average pressure) as expected for the first law of thermodynamics. A similar equation can be found for the surface entropy ${\displaystyle S_{s}}$ (or Boltzmann entropy ${\displaystyle S_{\text{B}}}$) and its associated temperature T_s, however the "pressure" in this equation is a complicated quantity unrelated to the average pressure. ^[1]

The microcanonical temperatures ${\displaystyle T_{v}}$ and ${\displaystyle T_{s}}$ are not entirely satisfactory in their analogy to temperature as defined using a canonical ensemble. Outside of the thermodynamic limit, a number of artefacts occur.

• Nontrivial result of combining two systems: Two systems, each described by an independent microcanonical ensemble, can be brought into thermal contact and be allowed to equilibriate into a combined system also described by a microcanonical ensemble. Unfortunately, the energy flow between the two systems cannot be predicted based on the initial Ts. Even when the initial Ts are equal, there may be energy transferred. Moreover, the T of the combination is different from the initial values. This contradicts the intuition that temperature should be an intensive quantity, and that two equal-temperature systems should be unaffected by being brought into thermal contact. ^[1]
• Strange behavior for few-particle systems: Many results such as the microcanonical Equipartition theorem acquire a one- or two-degree of freedom offset when written in terms of T_s. For a small systems this offset is significant, and so if we make S_s the analogue of entropy, several exceptions need to be made for systems with only one or two degrees of freedom. ^[1]
• Spurious negative temperatures: A negative T_s occurs whenever the density of states is decreasing with energy. In some systems the density of states is not monotonic in energy, and so T_s can change sign multiple times as the energy is increased. ^{[12] [13]}

The preferred solution to these problems is avoid use of the microcanonical ensemble. In many realistic cases a system is thermostatted to a heat bath so that the energy is not precisely known. Then, a more accurate description is the canonical ensemble or grand canonical ensemble, both of which have complete correspondence to thermodynamics. ^[14]

Precise expressions for the ensemble

The precise mathematical expression for a statistical ensemble depends on the kind of mechanics under consideration – quantum or classical – since the notion of a "microstate" is considerably different in these two cases. In quantum mechanics, diagonalization provides a discrete set of microstates with specific energies. The classical mechanical case involves instead an integral over canonical phase space, and the size of microstates in phase space can be chosen somewhat arbitrarily.

To construct the microcanonical ensemble, it is necessary in both types of mechanics to first specify a range of energy. In the expressions below the function ${\displaystyle f\left({\tfrac {H-E}{\omega }}\right)}$ (a function of H, peaking at E with width ω) will be used to represent the range of energy in which to include states. An example of this function would be ^[1]

${\displaystyle f(x)={\begin{cases}1,&\mathrm {if} ~|x|<{\tfrac {1}{2}},\\0,&\mathrm {otherwise.} \end{cases}}}$

or, more smoothly,

${\displaystyle f(x)=e^{-\pi x^{2}}.}$

Quantum mechanical

Example of microcanonical ensemble for a quantum system consisting of one particle in a potential well.

Plot of all possible states of this system. The available stationary states displayed as horizontal bars of varying darkness according to |ψ_i(x)|².

An ensemble containing only those states within a narrow interval of energy. As the energy width is taken to zero, a microcanonical ensemble is obtained (provided the interval contains at least one state).

The particle's Hamiltonian is Schrödinger-type, Ĥ = U(x) + p²/2m (the potential U(x) is plotted as a red curve). Each panel shows an energy-position plot with the various stationary states, along with a side plot showing the distribution of states in energy.

Further informationon the representation of ensembles in quantum mechanics: Statistical ensemble (mathematical physics)

A statistical ensemble in quantum mechanics is represented by a density matrix, denoted by ${\displaystyle {\hat {\rho }}}$. The microcanonical ensemble can be written using bra–ket notation, in terms of the system's energy eigenstates and energy eigenvalues. Given a complete basis of energy eigenstates |ψ_i⟩, indexed by i, the microcanonical ensemble is^{[ citation needed ]}

${\displaystyle {\hat {\rho }}={\frac {1}{W}}\sum _{i}f\left({\tfrac {H_{i}-E}{\omega }}\right)|\psi _{i}\rangle \langle \psi _{i}|,}$

where the H_i are the energy eigenvalues determined by ${\displaystyle {\hat {H}}|\psi _{i}\rangle =H_{i}|\psi _{i}\rangle }$ (here Ĥ is the system's total energy operator, i. e., Hamiltonian operator). The value of W is determined by demanding that ${\displaystyle {\hat {\rho }}}$ is a normalized density matrix, and so

${\displaystyle W=\sum _{i}f\left({\tfrac {H_{i}-E}{\omega }}\right).}$

The state volume function (used to calculate entropy) is given by

${\displaystyle v(E)=\sum _{H_{i}<E}1.}$

The microcanonical ensemble is defined by taking the limit of the density matrix as the energy width goes to zero, however a problematic situation occurs once the energy width becomes smaller than the spacing between energy levels. For very small energy width, the ensemble does not exist at all for most values of E, since no states fall within the range. When the ensemble does exist, it typically only contains one (or two) states, since in a complex system the energy levels are only ever equal by accident (see random matrix theory for more discussion on this point). Moreover, the state-volume function also increases only in discrete increments, and so its derivative is only ever infinite or zero, making it difficult to define the density of states. This problem can be solved by not taking the energy range completely to zero and smoothing the state-volume function, however this makes the definition of the ensemble more complicated, since it becomes then necessary to specify the energy range in addition to other variables (together, an NVEω ensemble).

Classical mechanical

Example of microcanonical ensemble for a classical system consisting of one particle in a potential well.

Plot of all possible states of this system. The available physical states are evenly distributed in phase space, but with an uneven distribution in energy; the side-plot displays dv/dE.

An ensemble restricted to only those states within a narrow interval of energy. This ensemble appears as a thin shell in phase space. As the energy width is taken to zero, a microcanonical ensemble is obtained.

Each panel shows phase space (upper graph) and energy-position space (lower graph). The particle's Hamiltonian is H = U(x) + p²/2m, with the potential U(x) shown as a red curve. The side plot shows the distribution of states in energy.

Further informationon the representation of ensembles in classical mechanics: Statistical ensemble (mathematical physics)

In classical mechanics, an ensemble is represented by a joint probability density function ρ(p₁, ... p_n, q₁, ... q_n) defined over the system's phase space. ^[1] The phase space has n generalized coordinates called q₁, ... q_n, and n associated canonical momenta called p₁, ... p_n.

The probability density function for the microcanonical ensemble is:

${\displaystyle \rho ={\frac {1}{h^{n}C}}{\frac {1}{W}}f\left({\tfrac {H-E}{\omega }}\right),}$

where

• H is the total energy (Hamiltonian) of the system, a function of the phase (p₁, … q_n),
• h is an arbitrary but predetermined constant with the units of energy×time, setting the extent of one microstate and providing correct dimensions to ρ. ^{[note 1]}
• C is an overcounting correction factor, often used for particle systems where identical particles are able to change place with each other. ^{[note 2]}

Again, the value of W is determined by demanding that ρ is a normalized probability density function:

${\displaystyle W=\int \ldots \int {\frac {1}{h^{n}C}}f\left({\tfrac {H-E}{\omega }}\right)\,dp_{1}\ldots dq_{n}}$

This integral is taken over the entire phase space. The state volume function (used to calculate entropy) is defined by

${\displaystyle v(E)=\int \ldots \int _{H<E}{\frac {1}{h^{n}C}}\,dp_{1}\ldots dq_{n}.}$

As the energy width ω is taken to zero, the value of W decreases in proportion to ω as W = ω (dv/dE).

Based on the above definition, the microcanonical ensemble can be visualized as an infinitesimally thin shell in phase space, centered on a constant-energy surface. Although the microcanonical ensemble is confined to this surface, it is not necessarily uniformly distributed over that surface: if the gradient of energy in phase space varies, then the microcanonical ensemble is "thicker" (more concentrated) in some parts of the surface than others. This feature is an unavoidable consequence of requiring that the microcanonical ensemble is a steady-state ensemble.

Examples

Ideal gas

The fundamental quantity in the microcanonical ensemble is ${\displaystyle W(E,V,N)}$, which is equal to the phase space volume compatible with given ${\displaystyle (E,V,N)}$. From ${\displaystyle W}$, all thermodynamic quantities can be calculated. For an ideal gas, the energy is independent of the particle positions, which therefore contribute a factor of ${\displaystyle V^{N}}$ to ${\displaystyle W}$. The momenta, by contrast, are constrained to a ${\displaystyle 3N}$-dimensional (hyper-)spherical shell of radius ${\displaystyle {\sqrt {2mE}}}$; their contribution is equal to the surface volume of this shell. The resulting expression for ${\displaystyle W}$ is: ^[15]

${\displaystyle W={\frac {V^{N}}{N!}}{\frac {2\pi ^{3N/2}}{\Gamma (3N/2)}}\left(2mE\right)^{(3N-1)/2}}$

where ${\displaystyle \Gamma (.)}$ is the gamma function, and the factor ${\displaystyle N!}$ has been included to account for the indistinguishability of particles (see Gibbs paradox). In the large ${\displaystyle N}$ limit, the Boltzmann entropy ${\displaystyle S=k_{\mathrm {B} }\log W}$ is

${\displaystyle S=k_{\rm {B}}N\log \left[{\frac {V}{N}}\left({\frac {4\pi m}{3}}{\frac {E}{N}}\right)^{3/2}\right]+{\frac {5}{2}}k_{\rm {B}}N+O\left(\log N\right)}$

This is also known as the Sackur–Tetrode equation.

The temperature is given by

${\displaystyle {\frac {1}{T}}\equiv {\frac {\partial S}{\partial E}}={\frac {3}{2}}{\frac {Nk_{\mathrm {B} }}{E}}}$

which agrees with analogous result from the kinetic theory of gases. Calculating the pressure gives the ideal gas law:

${\displaystyle {\frac {p}{T}}\equiv {\frac {\partial S}{\partial V}}={\frac {Nk_{\mathrm {B} }}{V}}\quad \rightarrow \quad pV=Nk_{\mathrm {B} }T}$

Finally, the chemical potential ${\displaystyle \mu }$ is

${\displaystyle \mu \equiv -T{\frac {\partial S}{\partial N}}=k_{\rm {B}}T\log \left[{\frac {V}{N}}\,\left({\frac {4\pi mE}{3N}}\right)^{3/2}\right]}$

Ideal gas in a uniform gravitational field

The microcanonical phase volume can also be calculated explicitly for an ideal gas in a uniform gravitational field. ^[16]

The results are stated below for a 3-dimensional ideal gas of ${\displaystyle N}$ particles, each with mass ${\displaystyle m}$, confined in a thermally isolated container that is infinitely long in the z-direction and has constant cross-sectional area ${\displaystyle A}$. The gravitational field is assumed to act in the minus z direction with strength ${\displaystyle g}$. The phase volume ${\displaystyle W(E,N)}$ is

${\displaystyle W(E,N)={\frac {(2\pi )^{3N/2}A^{N}m^{N/2}}{g^{N}\Gamma (5N/2)}}E^{{\frac {5N}{2}}-1}}$

where ${\displaystyle E}$ is the total energy, kinetic plus gravitational.

The gas density ${\displaystyle \rho (z)}$ as a function of height ${\displaystyle z}$ can be obtained by integrating over the phase volume coordinates. The result is:

${\displaystyle \rho (z)=\left({\frac {5N}{2}}-1\right){\frac {mg}{E}}\left(1-{\frac {mgz}{E}}\right)^{{\frac {5N}{2}}-2}}$

Similarly, the distribution of the velocity magnitude ${\displaystyle |{\vec {v}}|}$ (averaged over all heights) is

${\displaystyle f(|{\vec {v}}|)={\frac {\Gamma (5N/2)}{\Gamma (3/2)\Gamma (5N/2-3/2)}}\times {\frac {m^{3/2}|{\vec {v}}|^{2}}{2^{1/2}E^{3/2}}}\times \left(1-{\frac {m|{\vec {v}}|^{2}}{2E}}\right)^{\frac {5(N-1)}{2}}}$

The analogues of these equations in the canonical ensemble are the barometric formula and the Maxwell–Boltzmann distribution, respectively. In the limit ${\displaystyle N\rightarrow \infty }$, the microcanonical and canonical expressions coincide; however, they differ for finite ${\displaystyle N}$. In particular, in the microcanonical ensemble, the positions and velocities are not statistically independent. As a result, the kinetic temperature, defined as the average kinetic energy in a given volume ${\displaystyle A\,dz}$, is nonuniform throughout the container:

${\displaystyle T_{\mathrm {kinetic} }={\frac {3E}{5N-2}}\left(1-{\frac {mgz}{E}}\right)}$

By contrast, the temperature is uniform in the canonical ensemble, for any ${\displaystyle N}$. ^[17]

See also

• Isolated system
• Ergodic hypothesis
• Loschmidt's paradox
• Canonical ensemble
• Grand canonical ensemble

Notes

1. (Historical note) Gibbs' original ensemble effectively set h = 1 [energy unit]×[time unit], leading to unit-dependence in the values of some thermodynamic quantities like entropy and chemical potential. Since the advent of quantum mechanics, h is often taken to be equal to the Planck constant in order to obtain a semiclassical correspondence with quantum mechanics.
2. In a system of N identical particles, C = N! (factorial of N). This factor corrects the overcounting in phase space due to identical physical states being found in multiple locations. See the statistical ensemble article for more information on this overcounting.

References

1. Gibbs, Josiah Willard (1902). Elementary Principles in Statistical Mechanics. New York: Charles Scribner's Sons.
2. Balescu, Radu (1975), Equilibrium and Nonequilibrium Statistical Mechanics, John Wiley & Sons, ISBN   978-0-471-04600-4
3. Pearson, Eric M.; Halicioglu, Timur; Tiller, William A. (1985). "Laplace-transform technique for deriving thermodynamic equations from the classical microcanonical ensemble". Physical Review A. 32 (5): 3030–3039. Bibcode:1985PhRvA..32.3030P. doi:10.1103/PhysRevA.32.3030. ISSN   0556-2791. PMID   9896445.
4. Lustig, Rolf (1994). "Statistical thermodynamics in the classical molecular dynamics ensemble. I. Fundamentals". The Journal of Chemical Physics. 100 (4): 3048–3059. Bibcode:1994JChPh.100.3048L. doi: 10.1063/1.466446 . ISSN   0021-9606.
5. Hill, Terrell L. (1986). An Introduction to Statistical Thermodynamics. Dover Publications. ISBN   978-0-486-65242-9.
6. Huang, Kerson (1967). Statistical Mechanics. John Wiley & Sons.
7. Hilbert, Stefan; Hänggi, Peter; Dunkel, Jörn (2014). "Thermodynamic laws in isolated systems". Physical Review E. 90 (6): 062116. arXiv: 1408.5382 . Bibcode:2014PhRvE..90f2116H. doi:10.1103/PhysRevE.90.062116. hdl: 1721.1/92269 . ISSN   1539-3755. PMID   25615053. S2CID   5365820.
8. "The Microcanonical Ensemble". chem.libretexts. Retrieved May 3, 2020.
9. Hill, Terrell L. (1986). An Introduction to Statistical Thermodynamics. Dover Publications. ISBN   978-0-486-65242-9.
10. Nigel Goldenfeld; Lectures on Phase Transitions and the Renormalization Group, Frontiers in Physics 85, Westview Press (June, 1992) ISBN   0-201-55409-7
11. Dunkel, Jörn; Hilbert, Stefan (2006). "Phase transitions in small systems: Microcanonical vs. canonical ensembles". Physica A: Statistical Mechanics and Its Applications. 370 (2): 390–406. arXiv: cond-mat/0511501 . Bibcode:2006PhyA..370..390D. doi:10.1016/j.physa.2006.05.018. ISSN   0378-4371. S2CID   13900006.
12. Jörn Dunkel; Stefan Hilbert (2013). "Inconsistent thermostatistics and negative absolute temperatures". Nature Physics. 10 (1): 67–72. arXiv: 1304.2066 . Bibcode:2014NatPh..10...67D. doi:10.1038/nphys2815. S2CID   16757018.
13. See further references at https://sites.google.com/site/entropysurfaceorvolume/
14. Tolman, R. C. (1938). The Principles of Statistical Mechanics. Oxford University Press.
15. Kardar, Mehran (2007). Statistical Physics of Particles. Cambridge University Press. pp. 105–109. ISBN   978-0-521-87342-0.
16. Roman, F L; White, J A; Velasco, S (1995). "Microcanonical single-particle distributions for an ideal gas in a gravitational field". European Journal of Physics. 16 (2): 83–90. Bibcode:1995EJPh...16...83R. doi:10.1088/0143-0807/16/2/008. ISSN   0143-0807. S2CID   250840083.
17. Velasco, S; Román, F L; White, J A (1996). "On a paradox concerning the temperature distribution of an ideal gas in a gravitational field". European Journal of Physics. 17 (1): 43–44. doi:10.1088/0143-0807/17/1/008. ISSN   0143-0807. S2CID   250885860.