View source for Fluctuation theorem

{{Short description|Theorem in statistical mathematics}}
{{About-distinguish|entropy fluctuations|fluctuation-dissipation theorem}}
{{Technical|date=September 2010}}

The '''fluctuation theorem''' ('''FT'''), which originated from [[statistical mechanics]], deals with the relative probability that the [[Entropy (statistical thermodynamics)|entropy]] of a system which is currently away from [[thermodynamic equilibrium]] (i.e., maximum entropy) will increase or decrease over a given amount of time. While the [[second law of thermodynamics]] predicts that the entropy of an [[isolated system]] should tend to increase until it reaches equilibrium, it became apparent after the discovery of statistical mechanics that the second law is only a statistical one, suggesting that there should always be some nonzero probability that the entropy of an isolated system might spontaneously ''decrease''; the fluctuation theorem precisely quantifies this probability.

== Statement ==

{{Rewrite section|1=Entropy production is not formally defined here, which could lead to confusion. In the standard treatment of the Evans-Searles Theorem in the literature, “entropy production” is typically not normalized by the Boltzmann constant (unlike in other areas of thermodynamics literature). As a result, it does not appear in the exponential. However, if we choose not to explicitly introduce entropy production, readers might assume it is normalized by the Boltzmann constant, in which case we would need to include a factor of its reciprocal in the exponential. --[[User:Maximilian Janisch|Maximilian Janisch]] ([[User talk:Maximilian Janisch|talk]]) 23:07, 1 January 2025 (UTC)|date=January 2025}}

Roughly, the fluctuation theorem relates to the probability distribution of the time-averaged irreversible [[entropy production]], denoted <math>\overline{\Sigma}_t</math>. The theorem states that, in systems away from equilibrium over a finite time ''t'', the ratio between the probability that <math>\overline{\Sigma}_t</math> takes on a value ''A'' and the probability that it takes the opposite value, &minus;''A'', will be exponential in ''At''.
In other words, for a finite non-equilibrium system in a finite time, the FT gives a precise mathematical expression for the probability that entropy will flow in a direction ''opposite'' to that dictated by the [[second law of thermodynamics]].

Mathematically, the FT is expressed as:
: <math> \frac{\Pr(\overline{\Sigma}_{t}=A)}{\Pr(\overline{\Sigma}_{t}=-A)}=e^{At}.</math>

This means that as the time or system size increases (since <math>\Sigma</math> is [[extensive variable|extensive]]), the probability of observing an entropy production opposite to that dictated by the second law of thermodynamics decreases exponentially. The FT is one of the few expressions in non-equilibrium statistical mechanics that is valid far from equilibrium.

Note that the FT does not state that the second law of thermodynamics is wrong or invalid. The second law of thermodynamics is a statement about macroscopic systems. The FT is more general. It can be applied to both microscopic and macroscopic systems. When applied to macroscopic systems, the FT is equivalent to the second law of thermodynamics.

== History ==
The FT was first proposed and tested using computer simulations, by [[Denis Evans]], [[E.G.D. Cohen]] and Gary Morriss in 1993.<ref name="PhysREvLett1993">{{cite journal |title= Denis J. Evans, E. G. D. Cohen, and G. P. Morriss, Phys. Rev. Lett. 71, 2401, ''Probability of second law violations in shearing steady states''|year=1993 |url=https://journals.aps.org/prl/abstract/10.1103/PhysRevLett.71.2401 |publisher=American Physical Society |doi=10.1103/PhysRevLett.71.2401 |pmid=10054671 |last1=Evans |first1=D. J. |last2=Cohen |first2=E. G. |last3=Morriss |first3=G. P. |journal=Physical Review Letters |volume=71 |issue=15 |pages=2401–2404 |bibcode=1993PhRvL..71.2401E }}</ref> The first derivation was given by Evans and [[Debra Searles]] in 1994. Since then, much mathematical and computational work has been done to show that the FT applies to a variety of [[statistical ensemble]]s. The first laboratory experiment that verified the validity of the FT was carried out in 2002. In this experiment, a plastic bead was pulled through a solution by a laser. Fluctuations in the velocity were recorded that were opposite to what the second law of thermodynamics would dictate for macroscopic systems.<ref name="WangSevick2002">{{cite journal|last1=Wang|first1=G. M.|last2=Sevick|first2=E. M.|last3=Mittag|first3=Emil|last4=Searles|first4=Debra J.|last5=Evans|first5=Denis J.|title=Experimental Demonstration of Violations of the Second Law of Thermodynamics for Small Systems and Short Time Scales|journal=Physical Review Letters|volume=89|issue=5|year=2002|issn=0031-9007|doi=10.1103/PhysRevLett.89.050601|bibcode = 2002PhRvL..89e0601W|pmid=12144431|page=050601|url=http://espace.library.uq.edu.au/view/UQ:282878/UQ282878_OA.pdf|hdl=10440/854|hdl-access=free}}</ref><ref name="CarberryReid2004">{{cite journal|last1=Carberry|first1=D. M.|last2=Reid|first2=J. C.|last3=Wang|first3=G. M.|last4=Sevick|first4=E. M.|last5=Searles|first5=Debra J.|last6=Evans|first6=Denis J.|title=Fluctuations and Irreversibility: An Experimental Demonstration of a Second-Law-Like Theorem Using a Colloidal Particle Held in an Optical Trap|journal=Physical Review Letters|volume=92|issue=14|year=2004|issn=0031-9007|doi=10.1103/PhysRevLett.92.140601|bibcode = 2004PhRvL..92n0601C|pmid=15089524|page=140601|url=http://espace.library.uq.edu.au/view/UQ:282816/UQ282816_OA.pdf|hdl=10072/5775|hdl-access=free}}</ref><ref>{{Cite web|title = Second law of thermodynamics "broken"|url = https://www.newscientist.com/article/dn2572-second-law-of-thermodynamics-broken|website = New Scientist|access-date = 2016-02-09|language = en-US|first = Matthew|last = Chalmers}}</ref><ref>{{Cite journal|title = Second law broken|url = http://www.nature.com/news/1998/020722/full/news020722-2.html|journal = Nature News|date = 2002-07-23|doi = 10.1038/news020722-2|language = en|first = Ed|last = Gerstner}}</ref> In 2020, observations at high spatial and spectral resolution of the solar photosphere have shown that solar turbulent convection satisfies the symmetries predicted by the fluctuation relation at a local level.<ref name="Viavattene2020">{{cite journal|last1=Viavattene|first1=G. |last2=Consolini|first2=G. |last3=Giovannelli|first3=L.|last4=Berrilli|first4=F. |last5=Del Moro|first5=D. |last6=Giannattasio|first6=F. |last7=Penza|first7=V. |last8=Calchetti|first8=D.|title=Testing the Steady-State Fluctuation Relation in the Solar Photospheric Convection|journal=Entropy|volume=22|issue=7|year=2020|page=716 |issn=1099-4300|doi=10.3390/e22070716 |pmid=33286488 |pmc=7517254 |bibcode=2020Entrp..22..716V |doi-access=free}}</ref>

== Second law inequality ==
A simple consequence of the fluctuation theorem given above is that if we carry out an arbitrarily large ensemble of experiments from some initial time t=0, and perform an ensemble average of time averages of the entropy production, then an exact consequence of the FT is that the ensemble average cannot be negative for any value of the averaging time t:
: <math> \left\langle {\overline \Sigma  _t } \right\rangle  \ge 0,\quad \forall t. </math>

This inequality is called the second law inequality.<ref>{{Cite journal|title = Fluctuations Relations for Nonequilibrium Systems|journal = Australian Journal of Chemistry|date = 2004-01-01|pages = 1119–1123|volume = 57|issue = 12|doi = 10.1071/ch04115|first1 = D. J.|last1 = Searles|first2 = D. J.|last2 = Evans}}</ref> This inequality can be proved for systems with time dependent fields of arbitrary magnitude and arbitrary time dependence.

It is important to understand what the second law inequality does not imply.  It does not imply that the ensemble averaged entropy production is non-negative at all times.  This is untrue, as consideration of the entropy production in a viscoelastic fluid subject to a sinusoidal time dependent shear rate shows (e.g., rogue waves).{{clarify|date=June 2009}}{{dubious|date=February 2015}}  In this example the ensemble average of the time integral of the entropy production over one cycle is however nonnegative – as expected from the second law inequality.

== Nonequilibrium partition identity ==

Another remarkably simple and elegant consequence of the fluctuation theorem is the so-called "[[nonequilibrium partition identity]]" (NPI):<ref>{{cite journal|last=Carberry|first=D. M.|author2=Williams, S. R. |author3=Wang, G. M. |author4=Sevick, E. M. |author5=Evans, Denis J. |title=The Kawasaki identity and the Fluctuation Theorem|journal=The Journal of Chemical Physics|date=1 January 2004|volume=121|issue=17|pages=8179–82|doi=10.1063/1.1802211|pmid=15511135|bibcode = 2004JChPh.121.8179C |url=http://espace.library.uq.edu.au/view/UQ:298976/UQ298976_OA.pdf|hdl=1885/15803|hdl-access=free}}</ref>
: <math> \left\langle {\exp [ - \overline \Sigma_t \; t ]} \right\rangle  = 1,\quad \text{ for all } t .</math>

Thus in spite of the second law inequality, which might lead you to expect that the average would decay exponentially with time, the exponential probability ratio  given by the FT ''exactly'' cancels the negative exponential in the average above leading to an average which is unity for all time.

== Implications ==

There are many important implications from the fluctuation theorem. One is that small machines (such as nanomachines or even [[mitochondria]] in a cell) will spend part of their time actually running in "reverse". What is meant by "reverse" is that it is possible to observe that these small [[molecular machine]]s are able to generate work by taking heat from the environment. This is possible because there exists a symmetry relation in the work fluctuations associated with the forward and reverse changes a system undergoes as it is driven away from thermal equilibrium by the action of an external perturbation, which is a result predicted by the [[Crooks fluctuation theorem]]. The environment itself continuously drives these molecular machines away from equilibrium and the fluctuations it generates over the system are very relevant because the probability of observing an apparent violation of the second law of thermodynamics becomes significant at this scale.

This is counterintuitive because, from a macroscopic point of view, it would describe complex processes running in reverse. For example, a jet engine running in reverse, taking in ambient heat and exhaust fumes to generate  [[kerosene]] and oxygen. Nevertheless, the size of such a system makes this observation almost impossible to occur. Such a process is possible to be observed microscopically because, as it has been stated above, the probability of observing a "reverse" trajectory depends on system size and is significant for molecular machines if an appropriate measurement instrument is available. This is the case with the development of new biophysical instruments such as the [[optical tweezers]] or the [[atomic force microscope]]. Crooks fluctuation theorem has been verified through RNA folding experiments.<ref>{{cite journal|last=Collin|first=D. |author2=Ritort, F. |author3=Jarzynski C. |author4=Smith, B. |author5=Tinoco Jr, I. |author6=Bustamante C. |title=Verification of Crooks fluctuation theorem and recovery of RNA folding free energies|journal=Nature|date=8 September 2005|volume=437|issue=7056|pages=231–4|doi=10.1038/nature04061|pmid=16148928|arxiv = cond-mat/0512266 |bibcode = 2005Natur.437..231C|pmc=1752236}}</ref>

== Dissipation function ==
Strictly speaking the fluctuation theorem refers to a quantity known as the dissipation function.  In thermostatted nonequilibrium states{{clarify|date=February 2015}} that are close to equilibrium, the long time average of the dissipation function is equal to the average entropy production.  However the FT refers to fluctuations rather than averages.  The dissipation function is defined as
: <math> 
\Omega _t (\Gamma ) = \int_0^t {ds\;\Omega (\Gamma ;s)}  \equiv \ln \left[ {\frac{{f(\Gamma ,0)}}{{f(\Gamma (t),0)}}} \right] + \frac{{\Delta Q(\Gamma ;t)}}{kT}
 </math>
where ''k'' is the Boltzmann constant, <math>f(\Gamma , 0)</math> is the initial (t = 0) distribution of molecular states <math>\Gamma </math>, and  <math> \Gamma (t) </math> is the molecular state arrived at after time t, under the exact time reversible equations of motion. <math> f(\Gamma (t),0) </math> is the INITIAL distribution of those time evolved states.

Note: in order for the FT to be valid we require that  <math>f(\Gamma (t),0) \ne 0,\;\forall \Gamma (0) </math>. This condition is known as the condition of ergodic consistency. It is widely satisfied in common [[statistical ensemble]]s - e.g. the [[canonical ensemble]].

The system may be in contact with a large heat reservoir in order to thermostat the system of interest.  If this is the case <math> \Delta Q(t) </math> is the heat lost to the reservoir over the time (0,t) and T is the absolute equilibrium temperature of the reservoir.<ref>{{cite journal | url=https://journals.aps.org/pre/abstract/10.1103/PhysRevE.70.066113 | doi=10.1103/PhysRevE.70.066113 | title=Independence of the transient fluctuation theorem to thermostatting details | date=2004 | last1=Williams | first1=Stephen R. | last2=Searles | first2=Debra J. | last3=Evans | first3=Denis J. | journal=Physical Review E | volume=70 | issue=6 | page=066113 | pmid=15697440 | bibcode=2004PhRvE..70f6113W }}</ref>  With this definition of the dissipation function the precise statement of the FT simply replaces entropy production with the dissipation function in each of the FT equations above.

Example: If one considers electrical conduction across an electrical resistor in contact with a large heat reservoir at temperature T, then the dissipation function is
: <math> 
\Omega  =  - JF_e V/{kT}\ 
 </math>
the total electric current density J multiplied by the voltage drop across the circuit,  <math>F_e </math>, and the system volume V, divided by the absolute temperature T, of the heat reservoir times the Boltzmann constant.  Thus the dissipation function is easily recognised as the Ohmic work done on the system divided by the temperature of the reservoir.  Close to equilibrium the long time average of this quantity is (to [[leading-order|leading order]] in the voltage drop), equal to the average spontaneous entropy production per unit time.<ref>{{Cite book |last1=Groot |first1=S. R. De |url=https://books.google.com/books?id=mfFyG9jfaMYC |title=Non-Equilibrium Thermodynamics |last2=Mazur |first2=P. |date=2013-01-23 |publisher=Courier Corporation |isbn=978-0-486-15350-6 |pages=348 |quote=Equation (61)}}</ref> However, the fluctuation theorem applies to systems arbitrarily far from equilibrium where the definition of the spontaneous entropy production is problematic.

== Relation to Loschmidt's paradox ==

The [[second law of thermodynamics]], which predicts that the entropy of an isolated system out of equilibrium should tend to increase rather than decrease or stay constant, stands in apparent contradiction with the [[T-symmetry|time-reversible]] equations of motion for classical and quantum systems. The time reversal symmetry of the equations of motion show that if one films a given time dependent physical process, then playing the movie of that process backwards does not violate the laws of mechanics. It is often argued that for every forward trajectory in which entropy increases, there exists a time reversed anti trajectory where entropy decreases, thus if one picks an initial state randomly from the system's [[phase space]] and evolves it forward according to the laws governing the system, decreasing entropy should be just as likely as increasing entropy. It might seem that this is incompatible with the [[second law of thermodynamics]] which predicts that entropy tends to increase. The problem of deriving irreversible thermodynamics from time-symmetric fundamental laws is referred to as [[Loschmidt's paradox]].

The mathematical derivation of the fluctuation theorem and in particular the second law inequality shows that, for a nonequilibrium process, the ensemble averaged value for the dissipation function will be greater than zero.<ref>{{Cite journal |last1=Evans |first1=Denis J. |last2=Searles |first2=Debra J. |date=2002 |title=The Fluctuation Theorem |url=http://www.tandfonline.com/doi/abs/10.1080/00018730210155133 |journal=Advances in Physics |language=en |volume=51 |issue=7 |pages=1529–1585 |doi=10.1080/00018730210155133 |bibcode=2002AdPhy..51.1529E |s2cid=10308868 |issn=0001-8732}}</ref> This result requires causality, i.e. that cause (the initial conditions) precede effect (the value taken on by the dissipation function). This is clearly demonstrated in section 6 of that paper, where it is shown how one could use the same laws of mechanics to extrapolate ''backwards'' from a later state to an earlier state, and in this case the fluctuation theorem would lead us to predict the ensemble average dissipation function to be negative, an anti-second law. This second prediction, which is inconsistent with the real world, is obtained using an anti-causal assumption. That is to say that effect (the value taken on by the dissipation function) precedes the cause (here the later state has been incorrectly used for the initial conditions). The fluctuation theorem shows how the second law is a consequence of the assumption of causality. When we solve a problem we set the initial conditions and then let the laws of mechanics evolve the system forward in time, we don't solve problems by setting the final conditions and letting the laws of mechanics run backwards in time.

== Summary ==

The fluctuation theorem is of fundamental importance to [[non-equilibrium statistical mechanics]].
The FT (together with the [[universal causation]] proposition) gives a generalisation of the [[second law of thermodynamics]] which includes as a special case, the conventional second law. It is then easy to prove the Second Law Inequality and the NonEquilibrium Partition Identity. When combined with the [[central limit theorem]], the FT also implies the [[Green-Kubo relations]] for linear transport coefficients, close to equilibrium. The FT is however, more general than the Green-Kubo Relations because unlike them, the FT applies to fluctuations far from equilibrium. In spite of this fact, scientists have not yet been able to derive the equations for nonlinear response theory from the FT.

The FT does '''not''' imply or require that the distribution of time averaged dissipation be Gaussian.  There are many examples known where the distribution of time averaged dissipation is non-Gaussian and yet the FT (of course) still correctly describes the probability ratios.

Lastly the theoretical constructs used to prove the FT can be applied to ''nonequilibrium transitions'' between two different ''equilibrium'' states. When this is done the so-called [[Jarzynski equality]] or nonequilibrium work relation, can be derived.  This equality shows how equilibrium free energy differences can be computed or measured (in the laboratory<ref>{{cite journal |last1=Rademacher |first1=Markus |last2=Konopik |first2=Michael |last3=Debiossac |first3=Maxime |last4=Grass |first4=David |last5=Lutz |first5=Eric |last6=Kiesel |first6=Nikolai |title=Nonequilibrium Control of Thermal and Mechanical Changes in a Levitated System |journal=Physical Review Letters |date=15 February 2022 |volume=128 |issue=7 |pages=070601 |doi=10.1103/physrevlett.128.070601|pmid=35244419 |arxiv=2103.10898 |bibcode=2022PhRvL.128g0601R |s2cid=232290453 }}</ref>), from nonequilibrium path integrals.  Previously quasi-static (equilibrium) paths were required.

The reason why the fluctuation theorem is so fundamental is that its proof requires so little.  It requires: 
* knowledge of the mathematical form of the initial distribution of molecular states,
* that all time evolved final states at time ''t'', must be present with nonzero probability in the distribution of initial states (''t''&nbsp;=&nbsp;0) – the so-called condition of ''ergodic consistency'' and
* an assumption of time reversal symmetry.

In regard to the latter "assumption", while the equations of motion of quantum dynamics may be time-reversible, quantum processes are nondeterministic by nature. What state a wave function collapses into cannot be predicted mathematically, and further the unpredictability of a quantum system comes not from the myopia of an observer's perception, but on the intrinsically nondeterministic nature of the system itself.

In [[physics]], the [[Newton's laws of motion|laws of motion]] of [[classical mechanics]] exhibit time reversibility, as long as the operator π reverses the [[conjugate momentum|conjugate momenta]] of all the particles of the system, i.e. <math>\mathbf{p} \rightarrow  \mathbf{-p} </math> ([[T-symmetry]]).

In [[quantum mechanics|quantum mechanical]] systems, however, the [[weak nuclear force]] is not invariant under T-symmetry alone; if weak interactions are present reversible dynamics are still possible, but only if the operator π also reverses the signs of all the [[charge (physics)|charges]] and the [[parity (physics)|parity]] of the spatial co-ordinates ([[C-symmetry]] and [[P-symmetry]]). This reversibility of several linked properties is known as [[CPT symmetry]].

[[Thermodynamic process]]es can be [[Reversible process (thermodynamics)|reversible]] or [[irreversible process|irreversible]], depending on the change in [[entropy]] during the process.

== See also ==
* [[Linear response function]]
* [[Green's function (many-body theory)]]
* [[Loschmidt's paradox]]
* [[Le Chatelier's principle]] – a nineteenth century principle that defied a mathematical proof until the advent of the Fluctuation Theorem.
* [[Crooks fluctuation theorem]] – an example of transient fluctuation theorem relating the dissipated work in non equilibrium transformations to free energy differences.
* [[Jarzynski equality]] – another nonequilibrium equality closely related to the fluctuation theorem and to the second law of thermodynamics
* [[Green–Kubo relations]] – there is a deep connection between the fluctuation theorem and the Green–Kubo relations for linear transport coefficients – like shear [[viscosity]] or [[thermal conductivity]]
* [[Ludwig Boltzmann]]
* [[Thermodynamics]]
* [[Brownian motor]]

== Notes ==
{{reflist}}

== References ==
* {{cite journal | author=Denis J. Evans, E.G.D. Cohen & G.P. Morriss| title=Probability of second law violations in shearing steady states | journal=[[Physical Review Letters]] | year=1993 | volume=71 | pages=2401&ndash;2404| doi=10.1103/PhysRevLett.71.2401 | pmid=10054671 | issue=15 | bibcode=1993PhRvL..71.2401E| url=https://unsworks.unsw.edu.au/bitstreams/afc89775-141a-4615-b510-d41787576a5c/download }}
* {{cite journal | author=Denis J. Evans & Debra J. Searles| title=Equilibrium microstates which generate second law violating steady states | journal=[[Physical Review]] | year=1994 | volume=E 50 | pages=1645&ndash;1648 | doi = 10.1103/PhysRevE.50.1645 | issue=2 | pmid=9962139 |bibcode = 1994PhRvE..50.1645E | url=http://espace.library.uq.edu.au/view/UQ:282872/UQ282872_OA.pdf }}
* {{cite journal | author=Denis J. Evans & Debra J. Searles| title= The Fluctuation Theorem | journal=[[Advances in Physics]] | year=2002 | volume=51 | pages=1529&ndash;1585| doi= 10.1080/00018730210155133 | issue=7|bibcode = 2002AdPhy..51.1529E | s2cid= 10308868 }}
* {{cite journal | author=N. Garnier & S. Ciliberto| title=Nonequilibrium fluctuations in a resistor | journal=[[Physical Review E]] | year=2005 | volume=71 | pages=060101R;2404| doi=10.1103/PhysRevE.71.060101 | issue=6| pmid=16089709 |arxiv = cond-mat/0407574 |bibcode = 2005PhRvE..71f0101G | s2cid=34280491 }}
* {{cite journal|title=Fluctuation-Dissipation: Response Theory in Statistical Physics|first1= Umberto Marini Bettolo|last1=Marconi|first2= Andrea|last2=Puglisi|first3= Lamberto|last3=Rondoni|first4=Angelo|last4=Vulpiani|arxiv=0803.0719|year=2008|doi=10.1016/j.physrep.2008.02.002|volume=461|issue= 4–6|journal=Physics Reports|pages=111–195|bibcode=2008PhR...461..111M|s2cid= 118575899}}

[[Category:Statistical mechanics theorems]]
[[Category:Physical paradoxes]]
[[Category:Non-equilibrium thermodynamics]]