Trace inequality

Template:Short description In mathematics, there are many kinds of inequalities involving matrices and linear operators on Hilbert spaces. This article covers some important operator inequalities connected with traces of matrices.

Basic definitions

Let ${𝐇}_n$ denote the space of Hermitian $n\times n$ matrices, ${𝐇}_n^{+}$ denote the set consisting of positive semi-definite $n\times n$ Hermitian matrices and ${𝐇}_n^{++}$ denote the set of positive definite Hermitian matrices. For operators on an infinite dimensional Hilbert space we require that they be trace class and self-adjoint, in which case similar definitions apply, but we discuss only matrices, for simplicity.

For any real-valued function $f$ on an interval $I\subseteq ℝ,$ one may define a matrix function $f(A)$ for any operator $A\in {𝐇}_n$ with eigenvalues $\lambda$ in $I$ by defining it on the eigenvalues and corresponding projectors $P$ as $$f(A)\equiv \sum _{j}f({\lambda }_j)P_j,$$ given the spectral decomposition $A=\sum _j{\lambda }_j{P}_j.$

Operator monotone

A function $f:I\to ℝ$ defined on an interval $I\subseteq ℝ$ is said to be operator monotone if for all $n,$ and all $A,B\in {𝐇}_n$ with eigenvalues in $I,$ the following holds, $$A\ge B⟹f(A)\ge f(B),$$ where the inequality $A\ge B$ means that the operator $A-B\ge 0$ is positive semi-definite. One may check that $f(A)=A^2$ is, in fact, not operator monotone!

Operator convex

A function $f:I\to ℝ$ is said to be operator convex if for all $n$ and all $A,B\in {𝐇}_n$ with eigenvalues in $I,$ and $0<\lambda <1$, the following holds $$f(\lambda A+(1-\lambda )B)\le \lambda f(A)+(1-\lambda )f(B).$$ Note that the operator $\lambda A+(1-\lambda )B$ has eigenvalues in $I,$ since $A$ and $B$ have eigenvalues in $I.$

A function $f$ is Template:Visible anchor if $-f$ is operator convex;=, that is, the inequality above for $f$ is reversed.

Template:AnchorJoint convexity

A function $g:I\times J\to ℝ,$ defined on intervals $I,J\subseteq ℝ$ is said to be Template:Visible anchor if for all $n$ and all $A_1,A_2\in {𝐇}_n$ with eigenvalues in $I$ and all $B_1,B_2\in {𝐇}_n$ with eigenvalues in $J,$ and any $0\le \lambda \le 1$ the following holds $$g(\lambda A_1+(1-\lambda )A_2,\lambda B_1+(1-\lambda )B_2)\le \lambda g(A_1,B_1)+(1-\lambda )g(A_2,B_2).$$

A function $g$ is Template:Visible anchor if −$g$ is jointly convex, i.e. the inequality above for $g$ is reversed.

Trace function

Given a function $f:ℝ\to ℝ,$ the associated trace function on ${𝐇}_n$ is given by $$A\mapsto \mathrm{Tr}f(A)=\sum _{j}f({\lambda }_j),$$ where $A$ has eigenvalues $\lambda$ and $\mathrm{Tr}$ stands for a trace of the operator.

Convexity and monotonicity of the trace function

Let $f:ℝ\to ℝ$ be continuous, and let Template:Mvar be any integer. Then, if $t\mapsto f(t)$ is monotone increasing, so is $A\mapsto \mathrm{Tr}f(A)$ on H_n.

Likewise, if $t\mapsto f(t)$ is convex, so is $A\mapsto \mathrm{Tr}f(A)$ on H_n, and it is strictly convex if Template:Mvar is strictly convex.

See proof and discussion in, for example.

Löwner–Heinz theorem

For $-1\le p\le 0$, the function $f(t)=-t^p$ is operator monotone and operator concave.

For $0\le p\le 1$, the function $f(t)=t^p$ is operator monotone and operator concave.

For $1\le p\le 2$, the function $f(t)=t^p$ is operator convex. Furthermore,

$f(t)=\log (t)$ is operator concave and operator monotone, while

$f(t)=t\log (t)$ is operator convex.

The original proof of this theorem is due to K. Löwner who gave a necessary and sufficient condition for Template:Mvar to be operator monotone. An elementary proof of the theorem is discussed in and a more general version of it in.

Template:AnchorKlein's inequality

For all Hermitian Template:Mvar×Template:Mvar matrices Template:Mvar and Template:Mvar and all differentiable convex functions $f:ℝ\to ℝ$ with derivative Template:Math, or for all positive-definite Hermitian Template:Mvar×Template:Mvar matrices Template:Mvar and Template:Mvar, and all differentiable convex functions Template:Mvar:(0,∞) → $ℝ$, the following inequality holds,

$\mathrm{Tr}[f(A)-f(B)-(A-B)f^{\prime }(B)]\ge 0.$

In either case, if Template:Mvar is strictly convex, equality holds if and only if Template:Mvar = Template:Mvar. A popular choice in applications is Template:Math, see below.

Proof

Let $C=A-B$ so that, for $t\in (0,1)$,

$B+tC=(1-t)B+tA$,

varies from $B$ to $A$.

Define

$F(t)=\mathrm{Tr}[f(B+tC)]$.

By convexity and monotonicity of trace functions, $F(t)$ is convex, and so for all $t\in (0,1)$,

$F(0)+t(F(1)-F(0))\ge F(t)$,

which is,

$F(1)-F(0)\ge \frac{F(t)-F(0)}{t}$,

and, in fact, the right hand side is monotone decreasing in $t$.

Taking the limit $t\to 0$ yields,

$F(1)-F(0)\ge F^{\prime }(0)$,

which with rearrangement and substitution is Klein's inequality:

$\mathrm{t}\mathrm{r}[f(A)-f(B)-(A-B)f^{\prime }(B)]\ge 0$

Note that if $f(t)$ is strictly convex and $C\ne 0$, then $F(t)$ is strictly convex. The final assertion follows from this and the fact that $\frac{F(t)-F(0)}{t}$ is monotone decreasing in $t$.

Golden–Thompson inequality

In 1965, S. Golden and C.J. Thompson independently discovered that

For any matrices $A,B\in {𝐇}_n$,

$\mathrm{Tr}{e}^{A+B}\le \mathrm{Tr}{e}^A{e}^B.$

This inequality can be generalized for three operators: for non-negative operators $A,B,C\in {𝐇}_n^{+}$,

$\mathrm{Tr}{e}^{\ln A-\ln B+\ln C}\le \underset{0}{\overset{\mathrm{\infty }}{\int }}\mathrm{Tr}A(B+t{)}^{-1}C(B+t{)}^{-1}\mathrm{d}t.$

Peierls–Bogoliubov inequality

Let $R,F\in {𝐇}_n$ be such that Tr e^R = 1. Defining Template:Math, we have

$\mathrm{Tr}{e}^F{e}^R\ge \mathrm{Tr}{e}^{F+R}\ge e^g.$

The proof of this inequality follows from the above combined with Klein's inequality. Take Template:Math.

Gibbs variational principle

Let $H$ be a self-adjoint operator such that $e^{-H}$ is trace class. Then for any $\gamma \ge 0$ with $\mathrm{Tr}\gamma =1,$

$\mathrm{Tr}\gamma H+\mathrm{Tr}\gamma \ln \gamma \ge -\ln \mathrm{Tr}{e}^{-H},$

with equality if and only if $\gamma =\exp (-H)/\mathrm{Tr}\exp (-H).$

Lieb's concavity theorem

The following theorem was proved by E. H. Lieb in. It proves and generalizes a conjecture of E. P. Wigner, M. M. Yanase, and Freeman Dyson. Six years later other proofs were given by T. Ando and B. Simon, and several more have been given since then.

For all $m\times n$ matrices $K$, and all $q$ and $r$ such that $0\le q\le 1$ and $0\le r\le 1$, with $q+r\le 1$ the real valued map on ${𝐇}_m^{+}\times {𝐇}_n^{+}$ given by

$F(A,B,K)=\mathrm{Tr}(K^{*}{A}^{q}K{B}^r)$

• is jointly concave in $(A,B)$
• is convex in $K$.

Here $K^{*}$ stands for the adjoint operator of $K.$

Lieb's theorem

For a fixed Hermitian matrix $L\in {𝐇}_n$, the function

$f(A)=\mathrm{Tr}\exp \{L+\ln A\}$

is concave on ${𝐇}_n^{++}$.

The theorem and proof are due to E. H. Lieb, Thm 6, where he obtains this theorem as a corollary of Lieb's concavity Theorem. The most direct proof is due to H. Epstein; see M.B. Ruskai papers, for a review of this argument.

Ando's convexity theorem

T. Ando's proof of Lieb's concavity theorem led to the following significant complement to it:

For all $m\times n$ matrices $K$, and all $1\le q\le 2$ and $0\le r\le 1$ with $q-r\ge 1$, the real valued map on ${𝐇}_m^{++}\times {𝐇}_n^{++}$ given by

$(A,B)\mapsto \mathrm{Tr}(K^{*}{A}^{q}K{B}^{-r})$

is convex.

Template:AnchorJoint convexity of relative entropy

For two operators $A,B\in {𝐇}_n^{++}$ define the following map

$R(A\parallel B):=\mathrm{Tr}(A\log A)-\mathrm{Tr}(A\log B).$

For density matrices $\rho$ and $\sigma$, the map $R(\rho \parallel \sigma )=S(\rho \parallel \sigma )$ is the Umegaki's quantum relative entropy.

Note that the non-negativity of $R(A\parallel B)$ follows from Klein's inequality with $f(t)=t\log t$.

Statement

The map $R(A\parallel B):{𝐇}_n^{++}\times {𝐇}_n^{++}\to 𝐑$ is jointly convex.

Proof

For all $0<p<1$, $(A,B)\mapsto \mathrm{Tr}(B^{1-p}{A}^p)$ is jointly concave, by Lieb's concavity theorem, and thus

$(A,B)\mapsto \frac{1}{p-1}(\mathrm{Tr}(B^{1-p}{A}^p)-\mathrm{Tr}A)$

is convex. But

$\underset{p\to 1}{\lim }\frac{1}{p-1}(\mathrm{Tr}(B^{1-p}{A}^p)-\mathrm{Tr}A)=R(A\parallel B),$

and convexity is preserved in the limit.

The proof is due to G. Lindblad.

Jensen's operator and trace inequalities

The operator version of Jensen's inequality is due to C. Davis.

A continuous, real function $f$ on an interval $I$ satisfies Jensen's Operator Inequality if the following holds

$f\left(\sum _k{A}_k^{*}{X}_k{A}_k\right)\le \sum _k{A}_k^{*}f(X_k)A_k,$

for operators $\{A_k{\}}_k$ with $\sum _k{A}_k^{*}{A}_k=1$ and for self-adjoint operators $\{X_k{\}}_k$ with spectrum on $I$.

See, for the proof of the following two theorems.

Jensen's trace inequality

Let Template:Mvar be a continuous function defined on an interval Template:Mvar and let Template:Mvar and Template:Mvar be natural numbers. If Template:Mvar is convex, we then have the inequality

$\mathrm{Tr}\left(f\right(\sum _{k=1}^n{A}_k^{*}{X}_k{A}_k\left)\right)\le \mathrm{Tr}(\sum _{k=1}^n{A}_k^{*}f(X_k)A_k),$

for all (Template:Mvar₁, ... , Template:Mvar_n) self-adjoint Template:Mvar × Template:Mvar matrices with spectra contained in Template:Mvar and all (Template:Mvar₁, ... , Template:Mvar_n) of Template:Mvar × Template:Mvar matrices with

$\sum _{k=1}^n{A}_k^{*}{A}_k=1.$

Conversely, if the above inequality is satisfied for some Template:Mvar and Template:Mvar, where Template:Mvar > 1, then Template:Mvar is convex.

Jensen's operator inequality

For a continuous function $f$ defined on an interval $I$ the following conditions are equivalent:

• $f$ is operator convex.
• For each natural number $n$ we have the inequality

$f\left(\sum _{k=1}^n{A}_k^{*}{X}_k{A}_k\right)\le \sum _{k=1}^n{A}_k^{*}f(X_k)A_k,$

for all $(X_1,\dots ,X_n)$ bounded, self-adjoint operators on an arbitrary Hilbert space $\mathscr{H}$ with spectra contained in $I$ and all $(A_1,\dots ,A_n)$ on $\mathscr{H}$ with $\sum _{k=1}^n{A}_k^{*}{A}_k=1.$

• $f(V^{*}XV)\le V^{*}f(X)V$ for each isometry $V$ on an infinite-dimensional Hilbert space $\mathscr{H}$ and

every self-adjoint operator $X$ with spectrum in $I$.

• $Pf(PXP+\lambda (1-P))P\le Pf(X)P$ for each projection $P$ on an infinite-dimensional Hilbert space $\mathscr{H}$, every self-adjoint operator $X$ with spectrum in $I$ and every $\lambda$ in $I$.

Araki–Lieb–Thirring inequality

E. H. Lieb and W. E. Thirring proved the following inequality in 1976: For any $A\ge 0,$ $B\ge 0$ and $r\ge 1,$ $$\mathrm{Tr}((BAB{)}^r)\le \mathrm{Tr}(B^r{A}^r{B}^r).$$

In 1990 H. Araki generalized the above inequality to the following one: For any $A\ge 0,$ $B\ge 0$ and $q\ge 0,$ $$\mathrm{Tr}((BAB{)}^{rq})\le \mathrm{Tr}((B^r{A}^r{B}^r{)}^q),$$ for $r\ge 1,$ and $$\mathrm{Tr}((B^r{A}^r{B}^r{)}^q)\le \mathrm{Tr}((BAB{)}^{rq}),$$ for $0\le r\le 1.$

There are several other inequalities close to the Lieb–Thirring inequality, such as the following: for any $A\ge 0,$ $B\ge 0$ and $\alpha \in [0,1],$ $$\mathrm{Tr}(B{A}^{\alpha }BB{A}^{1-\alpha }B)\le \mathrm{Tr}(B^{2}A{B}^2),$$ and even more generally: for any $A\ge 0,$ $B\ge 0,$ $r\ge 1/2$ and $c\ge 0,$ $$\mathrm{Tr}((BA{B}^{2c}AB{)}^r)\le \mathrm{Tr}((B^{c+1}{A}^2{B}^{c+1}{)}^r).$$ The above inequality generalizes the previous one, as can be seen by exchanging $A$ by $B^2$ and $B$ by $A^{(1-\alpha )/2}$ with $\alpha =2c/(2c+2)$ and using the cyclicity of the trace, leading to $$\mathrm{Tr}((B{A}^{\alpha }BB{A}^{1-\alpha }B{)}^r)\le \mathrm{Tr}((B^{2}A{B}^2{)}^r).$$

Additionally, building upon the Lieb-Thirring inequality the following inequality was derived: For any $A,B\in {𝐇}_n,T\in {ℂ}^{n\times n}$ and all $1\le p,q\le \mathrm{\infty }$ with $1/p+1/q=1$, it holds that $$|\mathrm{Tr}(TA{T}^{*}B)|\le \mathrm{Tr}(T^{*}T|A{|}^p{)}^{\frac{1}{p}}\mathrm{Tr}(T{T}^{*}|B{|}^q{)}^{\frac{1}{q}}.$$

Effros's theorem and its extension

E. Effros in proved the following theorem.

If $f(x)$ is an operator convex function, and $L$ and $R$ are commuting bounded linear operators, i.e. the commutator $[L,R]=LR-RL=0$, the perspective

$g(L,R):=f(L{R}^{-1})R$

is jointly convex, i.e. if $L=\lambda L_1+(1-\lambda )L_2$ and $R=\lambda R_1+(1-\lambda )R_2$ with $[L_i,R_i]=0$ (i=1,2), $0\le \lambda \le 1$,

$g(L,R)\le \lambda g(L_1,R_1)+(1-\lambda )g(L_2,R_2).$

Ebadian et al. later extended the inequality to the case where $L$ and $R$ do not commute .

Von Neumann's trace inequality and related results

Template:Visible anchor, named after its originator John von Neumann, states that for any $n\times n$ complex matrices $A$ and $B$ with singular values ${\alpha }_1\ge {\alpha }_2\ge \cdots \ge {\alpha }_n$ and ${\beta }_1\ge {\beta }_2\ge \cdots \ge {\beta }_n$ respectively, $$|\mathrm{Tr}(AB)|\le \sum _{i=1}^n{\alpha }_i{\beta }_i,$$ with equality if and only if $A$ and $B^{†}$ share singular vectors.

A simple corollary to this is the following result: For Hermitian $n\times n$ positive semi-definite complex matrices $A$ and $B$ where now the eigenvalues are sorted decreasingly ($a_1\ge a_2\ge \cdots \ge a_n$ and $b_1\ge b_2\ge \cdots \ge b_n,$ respectively), $$\sum _{i=1}^n{a}_i{b}_{n-i+1}\le \mathrm{Tr}(AB)\le \sum _{i=1}^n{a}_i{b}_i.$$

See also

• Template:Annotated link
• Template:Annotated link
• Template:Annotated link
• Template:Annotated link

References

• Scholarpedia primary source.