Gaussian ensemble

From testwiki
Jump to navigation Jump to search

Template:Short description

In random matrix theory, the Gaussian ensembles are specific probability distributions over self-adjoint matrices whose entries are independently sampled from the gaussian distribution. They are among the most-commonly studied matrix ensembles, fundamental to both mathematics and physics. The three main examples are the Gaussian orthogonal (GOE), unitary (GUE), and symplectic (GSE) ensembles. These are classified by the Dyson index β, which takes values 1, 2, and 4 respectively, counting the number of real components per matrix element (1 for real elements, 2 for complex elements, 4 for quaternions). The index can be extended to take any real positive value.

The gaussian ensembles are also called the Wigner ensembles,[1] or the Hermite ensembles.[2]

Definitions

Conventions

There are many conventions for defining the Gaussian ensembles. In this article, we specify exactly one of them.

In all definitions, the Gaussian ensemble have zero expectation.

  • β: a positive real number. Called the Dyson index. The cases of β=1,2,4 are special.
  • N: the side-length of a matrix. Always a positive integer.
  • WN: a matrix sampled from a Gaussian ensemble with size N×N. The letter W stands for "Wigner".
  • M∗: the adjoint of a matrix. We assume WN=WN∗ (self-adjoint) when WN is sampled from a gaussian ensemble.
  • λ1,…,λN: the eigenvalues of the matrix, which are all real, since the matrices are always assumed to be self-adjoint.
  • σd2: the variance of on-diagonal matrix entries. We assume that for each N, all on-diagonal matrix entries have the same variance. It is always defined as 𝔼[|WN,|2].
  • σod2: the variance of off-diagonal matrix entries. We assume that for each N, all off-diagonal matrix entries have the same variance. It is always defined as 𝔼[|WN,ij|2] where i≠j.
    • For a complex number, |a+bi|2=a2+b2.
    • For a quaternion, |a+bi+cj+dk|2=a2+b2+c2+d2.
  • Z: the partition function.
Summary of convention in the page
Name GOE(N) GUE(N) GSE(N) GβE(N)
Full name Gaussian orthogonal ensemble Gaussian unitary ensemble Gaussian symplectic ensemble Gaussian beta ensemble
β 1 2 4 β
σd2 2 1 1/2 2/β
σod2 1 1 1 1
matrix density 1Ze−14TrWN2 1Ze−12TrWN2 1Ze−TrWN2 1Ze−14βTrWN2
Z 214N(N+3)π14N(N+1) 212Nπ12N2 2−N(N−1)π12N(2N−1) 212N(2πβ)12N+14βN(N−1)

When referring to the main reference works, it is necessary to translate the formulas from them, since each convention leads to different constant scaling factors for the formulas.

Conventions in reference works
Name σd2 σod2
Wikipedia (this page) 2/β 1
Template:Harv (β = 2 only) 1/2 1/2
Template:Harv 1/β 1/2
Template:Harv 2/β 1
Template:Harv for β = 1, 2, 4 1/β 1/2
Template:Harv for β ≠ 1, 2, 4 1 β/2
Template:Harv (β = 2 only) 1 1
Template:Harv (β = 2 only) 1/N 1/N
Template:Harv 1 β/2
Template:Harv 2σ2βN σ2N

There are equivalent definitions for the GβE(N) ensembles, given below.

By sampling

For all β=1,2,4 cases, the GβE(N) ensemble is defined by how it is sampled:

  • Sample a gaussian matrix XN, such that all its entries are IID sampled from the corresponding standard normal distribution.
    • If β=1, then XN,ij∼𝒩(0,1).
    • If β=2, then XN,ij∼𝒩(0,1/2)+i𝒩(0,1/2).
    • If β=4, then XN,ij∼𝒩(0,1/4)+i𝒩(0,1/4)+j𝒩(0,1/4)+k𝒩(0,1/4).
  • Let WN=12(X+X∗).

By density

For all β=1,2,4 cases, the GβE(N) ensemble is defined with density function ρ(WN)=1Ze−β4∑i=1NWN,ii2−β2∑1≤i<j≤N|WN,ij|2=1Ze−β4TrWN2where the partition function is Z=212N(2πβ)12N+14βN(N−1).

The Gaussian orthogonal ensemble GOE(N) is defined as the probability distribution over N×N symmetric matrices with density functionρ(WN)=1Ze−14∑i=1NWN,ii2−12∑1≤i<j≤NWN,ij2=1Ze−14TrWN2where the partition function is Z=214N(N+3)π14N(N+1).

Explicitly, since there are only 12N(N+1) degrees of freedom, the parameterization is as follows:ρ(WN)∏1≤i≤j≤NdWN,ijwhere we pick the upper diagonal entries {Wij}1≤i≤j≤N as the degrees of freedom.

The Gaussian unitary ensemble GUE(N) is defined as the probability distribution over N×N Hermitian matrices with density functionρ(WN)=1Ze−12∑i=1NWN,ii2−∑1≤i<j≤N|WN,ij|2=1Ze−12TrWN2.where the partition function is Z=212Nπ12N2.

Explicitly, since there are only N2 degrees of freedom, the parameterization is as follows: ρ(WN)∏i=1NdWN,ii∏1≤i<j≤Nd(ReWN,ij)d(ImWN,ij)where we pick the upper diagonal entries {WN,ii}1≤i≤N∪{ReWN,ij,ImWN,ij}1≤i<j≤N as the degrees of freedom.

The Gaussian symplectic ensemble GSE(N) is defined as the probability distribution over N×N self‑adjoint quaternionic matrices with density functionρ(WN)=1Ze−∑i=1NWN,ii2−2∑1≤i<j≤N|WN,ij|2=1Ze−TrWN2.where the partition function is Z=2−N(N−1)π12N(2N−1).

Explicitly, since there are only N(2N−1) degrees of freedom, the parameterization is as follows:ρ(WN)∏i=1NdWN,ii∏1≤i<j≤N∏a=03dWN,ij(a)where we write WN,ij=WN,ij(0)+iWN,ij(1)+jWN,ij(2)+kWN,ij(3) and pick the upper diagonal entries {WN,ii}1≤i≤N∪{WN,ij(a)}1≤i<j≤N,0≤a≤3 as the degrees of freedom.

By invariance

For all β=1,2,4 cases, the GβE(N) ensemble is uniquely characterized (up to affine transform) by its symmetries, or invariance under appropriate transformations.[3]

For GOE, consider a probability distribution over N×N symmetric matrices satisfying the following properties:

For GUE, consider a probability distribution over N×N Hermitian matrices satisfying the following properties:

  • Invariance under unitary transformation: For any fixed (not random) N×N unitary matrix U, let M be a random sample from the distribution. Then UMU∗ has the same distribution as M.
  • Independence: The entries {Mij}1≤i≤j≤N are independently distributed.

For GSE, consider a probability distribution over N×N self-adjoint quaternionic matrices satisfying the following properties:

  • Invariance under symplectic transformation: For any fixed (not random) N×N symplectic matrix S, let M be a random sample from the distribution. Then SMS∗ has the same distribution as M.
  • Independence: The entries {Mij}1≤i≤j≤N are independently distributed.

In all 3 cases, these conditions force the distribution to have the form ρ(M)=1Ze−aTr⁡(M2)+bTr⁡(M), where a>0 and b,Z∈ℝ. Thus, with the further specification of 1N𝔼[Tr⁡(M)]=0,1N2𝔼[Tr⁡(M2)]=1+2/β−1N, we recover the GOE, GUE, GSE.[4] Notably, if mere invariance is demanded, then any spectral distribution can be produced by multiplying with a function of form f(Tr⁡(X),Tr⁡(X2),Tr⁡(X3),…).[5]

More succinctly stated, each of GOE, GUE, GSE is uniquely specified by invariance, independence, the mean, and the variance.

By spectral distribution

For all β=1,2,4 cases, the GβE(N) ensemble is defined as the ensemble obtained by ADA∗, where

  • D=diag⁡(λ1,…,λN) is a diagonal real matrix with its entries sampled according to the spectral density, defined below;
  • A is an orthogonal/unitary/symplectic matrix sampled uniformly, that is, from the normalized Haar measure of the orthogonal/unitary/symplectic group.

In this way, the GβE(N) ensemble may be defined after the spectral density is defined first, so that any method to motivate the spectral density then motivates the GβE(N) ensemble, and vice versa.

By maximal entropy

For all β=1,2,4 cases, the GβE(N) ensemble is uniquely characterized as the absolutely continuous probability distribution ρ over N×N real/complex/quaternionic symmetric/orthogonal/symplectic matrices that maximizes entropy 𝔼M∼ρ[−ln⁡ρ(M)], under the constraint of 1N2𝔼M∼ρ[Tr⁡(M2)]=1+2/β−1N.[6]

Spectral density

For eigenvalues λ1,…,λN the joint density of GβE(N) isρβ,N(λ1,…,λN)=1Zβ,Ne−β4∑i=1Nλi2∏1≤i<j≤N|λi−λj|β=1Zβ,Ne−β4‖λ‖22|ΔN(λ)|βwhere ΔN is the Vandermonde determinant, and the partition function Zβ,N is explicitly evaluated as a Selberg integral:[7]Zβ,N=∫ℝNe−β4∑i=1Nλi2∏1≤i<j≤N|λi−λj|βdλ=(2π)N2(2β)12N+14βN(N−1)∏j=1NΓ(1+jβ2)Γ(1+β2)where Γ is the Euler Gamma function. The expression is particularly simple when β=2, where we have a superfactorial:Z2,N=(2π)N2∏j=1Nj!

Determinantal point process

Histogram of the empirical spectral density of 1NWN for 20,…,25, obtained by averaging over 105 samples of the matrix, compared with the theoretical prediction of Nρ(Nx).

Define functions ψn(x):=e−14x2n!2πHen(x), where He is the probabilist's Hermite polynomial. These are the wavefunction states of the quantum harmonic oscillator.

The spectrum of GUE(N) is a determinantal point process with kernel KN(x,x′):=∑n=0N−1ψn(x)ψn(x′), and by the Christoffel–Darboux formula,KN(x,x′)=e−14(x2+x′2)(N−1)!2πHeN(x)HeN−1(x′)−HeN−1(x)HeN(x′)x−x′Using the confluent form of Christoffel–Darboux and the three-term recurrence of Hermite polynomials, the spectral density of GUE(N) for finite values of N:[8]ρ(x)=1NKN(x,x)=1N2πe−12x2∑n=0N−11n!Hen(x)2=e−x2/22πN!(HeN(x)2−HeN+1(x)HeN−1(x))The spectral distribution of β=1,4 can also be written as a quaternionic determinantal point process involving skew-orthogonal polynomials.[9][10]

Tridiagonalization

For all β=1,2,4 cases, given a sampled matrix WN from the GβE(N) ensemble, we can perform a Householder transformation tridiagonalization on it to obtain a tridiagonal matrix Tβ,N, which has the same distribution as1β[aN2bN−10⋯0bN−1aN−12bN−2⋱⋮0bN−2⋱⋱0⋮⋱⋱a22b10⋯0b1a12]where each a1,…,aN∼𝒩(0,1) is gaussian-distributed, and each bi∼χiβ is chi-distributed, and all a1,…,aN,b1,…,bN−1 are independent. The β=1 case was first noted in 1984,[11] and the general case was noted in 2002.[12] Like how the Laplace differential operator can be discretized to the Laplacian matrix, this tridiagonal form of the gaussian ensemble allows a reinterpretation of the gaussian ensembles as an ensemble over not matrices, but over differential operators, specifically, a "stochastic Airy operator". This leads more generally to the study of random matrices as stochastic operators.[2]

Computationally, this allows efficient sampling of eigenvalues, from O(N3) on the full matrix, to just O(N2) on the tridiagonal matrix. If one only requires a histogram of the eigenvalues with m bins, the time can be further decreased to O(Nm), by using the Sturm sequences.[13] Theoretically, this definition allows extension to all β>0 cases, leading to the gaussian beta ensembles,[14][12] and "anti-symmetric" gaussian beta ensembles.[15]

Relatedly, let XN be a N×N matrix, with all entries IID sampled from the corresponding standard normal distribution – for example, if β=2, then XN,ij∼𝒩(0,1/2)+i𝒩(0,1/2). Then applying repeated Housholder transform on only the left side of a results in RN=H1…HNXN, where each Hi is a Householder matrix, and RN is an upper triangular matrix with independent entries, such that each βRN,ii∼χN+1−i for 1≤i≤N, and each RN,ij∼𝒩(0,1/β)⊗β for 1≤i<j≤N.[16]

Global law

Spectral density of GOE/GUE/GSE for N=20,21,…,25. Each distribution is normalized to converge to the semicircle with radius 2.

The Wigner semicircle law states that the empirical eigenvalue distribution of 1NWN converges in distribution to the Wigner semicircle distribution with radius 2.[17][18] That is, the distribution on [−2,+2] with probability density function ρsc(x)=4−x22π

The requirement that the matrix ensemble to be a gaussian ensemble is too strong for the Wigner semicircle law. Indeed, the theorem applies generally for much more generic matrix ensembles.

As Coulomb gas

The joint density ρβ,N can be written as a Gibbs measure:ρβ,N=1Zβ,NCGe−βENwith the energy function (also called the Hamiltonian) EN=14∑i=1Nλi2−∑1≤i<j≤Nln⁡|λi−λj|. This can be interpreted physically as a Boltzmann distribution of a physical system consisting of N identical unit electric charges constrained to move on the real line, repelling each other via the two-dimensional Coulomb potential −ln⁡|x−y|, while being attracted to the origin via a quadratic potential 14x2. This is the Coulomb gas model for the eigenvalues.

In the macroscopic limit, one rescales λi=N1/2xi and defines the empirical measure μN=N−1∑i=1Nδxi, obtaining EN≈12N2(ℰ[μ]+12ln⁡N), where the mean-field functional ℰ[μ]=12∫ℝx2μ(dx)−∬ℝ2ln⁡|x−y|μ(dx)μ(dy)yields the leading order N2 term in ln⁡Zβ,N, termed the Coulomb gas free energy. The Coulomb gas free energy is minimized by the Wigner semicircle law dμsc(x)=(2π)−14−x21{|x|≤2}dx, which gives the limiting eigenvalue density.[19]

Alternatively, suppose that there exists a ρb, such that the quadratic electric potential can be recreated (up to an additive constant) via∫−2N2N−ln⁡|x−y|ρb(y)dy=14x2+C,x∈[−2N,2N].Then, imposing a fixed background negative electric charge of density |ρb(y)| exactly cancels out the electric repulsion between the freely moving positive charges. Such a function does exist: ρb(y)=−4N−y22Nπ, which can be found by solving an integral equation. This indicates that the Wigner semicircle distribution is the equilibrium distribution.[20][21][22]

Gaussian fluctuations about μsc obtained by expanding EN to second order produce the sine kernel in the bulk and the Airy kernel at the soft edge after proper rescaling.

Extreme value

The largest eigenvalue for GβE(N) follows the Tracy–Widom distribution after proper translation and scaling.[23] It can be efficiently sampled by the shift-invert Lanczos algorithm on the 10n1/3×10n1/3 upper left corner of the tridiagonal matrix form.[24]

Level spacings

From ordered eigenvalues λ1<…<λn<λn+1<…<λN, define normalized spacings sn=λn+1−λn⟨s⟩ with mean spacing ⟨s⟩. This normalizes the spacings by:∫0∞pβ(s)ds=1,∫0∞spβ(s)ds=1,β=1,2,4.With this, the approximate spacing distributions are pβ(s)={π2sexp⁡(−π4s2)β=132π2s2exp⁡(−4πs2)β=221836π3s4exp⁡(−649πs2)β=4

Moments

For GOE(N), its moment generating function is 𝔼[eTr⁡(VWN)]=e14‖V+VT‖F2, where ‖⋅‖F is the Frobenius norm.

Rotationally symmetric ensemble

The GUE(N) ensemble can be understood as a particularly representative member of the general family of rotationally symmetric ensembles over Hermitian matrices. The general theory of rotationally symmetric ensembles has allowed researchers to prove some universality results.[25]

Physics

The Wigner surmise

Template:Main The Gaussian ensemble was first motivated in theoretical physics. In the 1940s, Eugene Wigner studied the irregular spacings of slow-neutron resonances in heavy nuclei. Working with the few dozen levels then available, he noticed a pronounced repulsion between neighbouring lines.

In 1951, he modelled the Hamiltonian of a compound-nucleus in a minimal way.[26] He noted that by symmetry considerations, it must be a real symmetric operator, so he modelled it as a random sample from the GOE(N). He solved the 2×2 case and found the two-level spacing law P(s)=π2se−πs2/4, which matched well with the data. He disseminated his guess ("the Wigner surmise") during a conference on Neutron Physics by Time-of-Flight in 1956:[27][28][29]Template:BlockquoteFreeman Dyson stated the project as a statistical theory of nuclear energy levels, to be contrasted with precise calculations based on an analytic model of the nucleus. He argued that a statistical theory is necessary, because the energy levels then measured were on the order of millions, and for such a high order, precise calculations was simply impossible. The idea was different from the then-understood form of statistical mechanics, for instead of having a system with precisely stated dynamical laws, with too many particles interacting under it, thus the particles need to be treated statistically, he would model the dynamical laws themselves as unknown, and thus treated statistically.[30]

Threefold Way

In 1962, Dyson proposed the "Threefold Way" to motivate the three ensembles, by showing that in 3 fields (group representation, quantum mechanics, random matrix theory), there is a 3-fold disjunction, which he traced back to the Frobenius theorem stating that there are only 3 real division algebras: the real, the complex, and the quaternionic.[31] A random matrix representing a Hamiltonian H can be classified by an anti-unitary operator T that describes time-reversal symmetry. The classification depends on whether T exists present and, if so, the value of T2. Each symmetry class produces a constraint on the possible form of H, and the corresponding gaussian ensemble can then be motivated as a maximal entropy distribution, as described previously.

Dyson's Threefold Way
Symmetry Matrix basis where H is... Group representation Ensemble
T2=+1 (e.g., integer spin, no strong spin–orbit interaction) real symmetric real GOE
No T (e.g., presence of a magnetic field, magnetic impurities, chiral gauge potential) complex Hermitian complex GUE
T2=−1 (e.g., half-integer spin with spin-orbit interaction) quaternionic self-adjoint (symplectic) pseudoreal GSE

If T2=+1, the Hamiltonian H must be real symmetric. This typically occurs in systems with no magnetic field and either spinless particles or integer spin particles with negligible spin–orbit interaction. This occurs in level spacing distribution in nuclear compound states, the original motivation for Wigner.

If T does not exist, then H is only required to be Hermitian. Time-reversal symmetry can be broken by a homogeneous magnetic field, random magnetic fluxes, or spin-selective lasers. In these cases, the off-diagonal matrix elements acquire independent complex phases.

  • Chaotic microwave cavities with a ferrite: Adding a strong axial magnetic field causes the level statistics to transition continuously from GOE to GUE, which was a confirmation of the BGS conjecture.[32]
  • Quantum Hall effect: The physics of quantum Hall edge states and Landau levels is modelled by the GUE due to the strong perpendicular magnetic field breaking time-reversal symmetry.
  • Anderson localization in 3-D: Applying an Aharonov–Bohm flux can drive a system's statistics from GOE to GUE at a disorder-induced metal-insulator transition.[33]

If T2=−1, then this is a consequence of Kramers' theorem for systems with half-integer spin and significant spin–orbit interaction. The resulting Hamiltonians are naturally described by quaternion-Hermitian matrices. It has been observed in Kramers doublet[34] and many quantum chaotic systems. It is also possible to construct such a system without spin.[35]

References

Template:Reflist

Template:Matrix classes Template:Random matrix theory