Processing math: 100%

MathJax

Wednesday, January 21, 2015

An example of Stein's paradox

Charles Stein showed in 1958, that a nonlinear, biased estimator of a multivariate mean has a lower MSE compared to the ML estimator.

Given a sample of N measurements of XN(μ,σIp) with unknown parameter vector μ of length p.

The James-Stein estimator is given by

ˆμJS=(1(p2)σ2Nˉx2)ˉx
where ˉx is the sample mean.

This estimator dominates the MLE everywhere in terms of MSE.  For all μRp,

EμˆμJSμ2<EμˆμMLEμ2
This makes the MLE inadmissible for p3!

No comments: