Empirical Bayes improvement of Kalman filter type of estimators
We consider the problem of estimating the means of random variables , . Assuming some structure on the process, e.g., a state space model, one may use a summary statistics for the contribution of the rest of the observations to the estimation of . The most important example for this is the Kalman filter. We introduce a non-linear improvement of the standard weighted average of the given summary statistics and itself, using empirical Bayes methods. The improvement is obtained under mild assumptions. It is strict when the process that governs the states is not a linear Gaussian state-space model. We consider both the sequential and the retrospective estimation problems.