Adaptive estimator

Template:One source In statistics, an adaptive estimator is an estimator in a parametric or semiparametric model with nuisance parameters such that the presence of these nuisance parameters does not affect efficiency of estimation.

Definition

Formally, let parameter θ in a parametric model consists of two parts: the parameter of interest Template:Nowrap, and the nuisance parameter Template:Nowrap. Thus Template:Nowrap. Then we will say that ${\hat{\nu }}_n$ is an adaptive estimator of ν in the presence of η if this estimator is regular, and efficient for each of the submodels

${𝒫}_{\nu }({\eta }_0)=\{P_{\theta }:\nu \in N,\eta ={\eta }_0\}.$

Adaptive estimator estimates the parameter of interest equally well regardless whether the value of the nuisance parameter is known or not.

The necessary condition for a regular parametric model to have an adaptive estimator is that

$I_{\nu \eta }(\theta )=\mathrm{E}[z_{\nu }{z_{\eta }}^{\prime }]=0\text{for all }\theta ,$

where z_ν and z_η are components of the score function corresponding to parameters ν and η respectively, and thus I_νη is the top-right k×m block of the Fisher information matrix I(θ).

Example

Suppose $𝒫$ is the normal location-scale family:

$𝒫=\{f_{\theta }(x)=\frac{1}{\sqrt{2\pi }\sigma }{e}^{-\frac{1}{2{\sigma }^2}(x-\mu {)}^2}|\mu \in ℝ,\sigma >0\}.$

Then the usual estimator $\hat{\mu }=\overline{x}$ is adaptive: we can estimate the mean equally well whether we know the variance or not.

Basic references

• Template:Cite book

Other useful references

• I. V. Blagouchine and E. Moreau: "Unbiased Adaptive Estimations of the Fourth-Order Cumulant for Real Random Zero-Mean Signal", IEEE Transactions on Signal Processing, vol. 57, no. 9, pp. 3330–3346, September 2009.