Complex inverse Wishart distribution

The complex inverse Wishart distribution is a matrix probability distribution defined on complex-valued positive-definite matrices and is the complex analog of the real inverse Wishart distribution. The complex Wishart distribution was extensively investigated by Goodman while the derivation of the inverse is shown by Shaman and others. It has greatest application in least squares optimization theory applied to complex valued data samples in digital radio communications systems, often related to Fourier Domain complex filtering.

Letting ${𝐒}_{p\times p}=\sum _{j=1}^{\nu }{G}_j{G}_j^H$ be the sample covariance of independent complex p-vectors $G_j$ whose Hermitian covariance has complex Wishart distribution $𝐒\sim 𝒞𝒲(\mathrm{\Sigma },\nu ,p)$ with mean value $\mathrm{\Sigma }\text{ and }\nu$ degrees of freedom, then the pdf of $𝐗={𝐒}^{\mathbf{-}\mathrm{𝟏}}$ follows the complex inverse Wishart distribution.

Density

If ${𝐒}_{p\times p}$ is a sample from the complex Wishart distribution $𝒞𝒲(\mathrm{\Sigma },\nu ,p)$ such that, in the simplest case, $\nu \ge p\text{ and }\left|𝐒\right|>0$ then $𝐗={𝐒}^{-1}$ is sampled from the inverse complex Wishart distribution ${𝒞𝒲}^{-1}(\mathrm{\Psi },\nu ,p)\text{ where }\mathrm{\Psi }={\mathrm{\Sigma }}^{-1}$.

The density function of $𝐗$ is

$f_{𝐱}(𝐱)=\frac{{\left|\mathrm{\Psi }\right|}^{\nu }}{𝒞{\mathrm{\Gamma }}_p(\nu )}{\left|𝐱\right|}^{-(\nu +p)}{e}^{-\mathrm{tr}(\mathrm{\Psi }{𝐱}^{-1})}$

where $𝒞{\mathrm{\Gamma }}_p(\nu )$ is the complex multivariate Gamma function

$𝒞{\mathrm{\Gamma }}_p(\nu )={\pi }^{\frac{1}{2}p(p-1)}\prod _{j=1}^p\mathrm{\Gamma }(\nu -j+1)$

Moments

The variances and covariances of the elements of the inverse complex Wishart distribution are shown in Shaman's paper above while Maiwald and Kraus determine the 1-st through 4-th moments.

Shaman finds the first moment to be

$𝐄[𝒞{𝐖}^{\mathbf{-}\mathrm{𝟏}}]=\frac{1}{n-p}{\mathrm{\Psi }}^{\mathbf{-}\mathrm{𝟏}},n>p$

and, in the simplest case $\mathrm{\Psi }={𝐈}_{p\times p}$, given $d=\frac{1}{n-p}$, then

$𝐄[vec(𝒞W_3^{-1})]=\left[\begin{array}{ccccccccc}d& 0& 0& 0& d& 0& 0& 0& d\end{array}\right]$

The vectorised covariance is

$𝐂𝐨𝐯[vec(𝒞W_p^{-1})]=b({𝐈}_p\otimes I_p)+c𝐯𝐞𝐜{𝐈}_{𝐩}{\left(𝐯𝐞𝐜{𝐈}_{𝐩}\right)}^T+(a-b-c)𝐉$

where $𝐉$ is a $p^2\times p^2$ identity matrix with ones in diagonal positions $1+(p+1)j,j=0,1,\dots p-1$ and $a,b,c$ are real constants such that for $n>p+1$

$a=\frac{1}{(n-p{)}^2(n-p-1)}$, marginal diagonal variances

$b=\frac{1}{(n-p+1)(n-p)(n-p-1)}$, off-diagonal variances.

$c=\frac{1}{(n-p+1)(n-p{)}^2(n-p-1)}$, intra-diagonal covariances

For $\mathrm{\Psi }={𝐈}_3$, we get the sparse matrix:

$𝐂𝐨𝐯[vec(𝒞W_3^{-1})]=\left[\begin{array}{ccccccccc}a& \cdot & \cdot & \cdot & c& \cdot & \cdot & \cdot & c\\ \cdot & b& \cdot & \cdot & \cdot & \cdot & \cdot & \cdot & \cdot \\ \cdot & \cdot & b& \cdot & \cdot & \cdot & \cdot & \cdot & \cdot \\ \cdot & \cdot & \cdot & b& \cdot & \cdot & \cdot & \cdot & \cdot \\ c& \cdot & \cdot & \cdot & a& \cdot & \cdot & \cdot & c\\ \cdot & \cdot & \cdot & \cdot & \cdot & b& \cdot & \cdot & \cdot \\ \cdot & \cdot & \cdot & \cdot & \cdot & \cdot & b& \cdot & \cdot \\ \cdot & \cdot & \cdot & \cdot & \cdot & \cdot & \cdot & b& \cdot \\ c& \cdot & \cdot & \cdot & c& \cdot & \cdot & \cdot & a\end{array}\right]$

Eigenvalue distributions

The joint distribution of the real eigenvalues of the inverse complex (and real) Wishart are found in Edelman's paper who refers back to an earlier paper by James. In the non-singular case, the eigenvalues of the inverse Wishart are simply the inverted values for the Wishart. Edelman also characterises the marginal distributions of the smallest and largest eigenvalues of complex and real Wishart matrices.