CIRJE-F-190 "Improved Empirical Bayes Ridge Regression Estimators under Multicollinearity"
Author Name Kubokawa, Tatsuya and M. S. Srivastava
Date January 2003
Full Paper PDF file@
Remarks Subsequently published in Communications in Statistics --- Theory and Methods, 2004, vol.33, pp.1943-1973.
Abstract

In this paper we consider the problem of estimating the regression parameters in a multiple linear regression model when the multicollinearity is present.Under the assumption of normality, we present three empirical Bayes estimators. One of them shrinks the least squares (LS) estimator towards the principal component. The second one is a hierarchical empirical Bayes estimator shrinking the LS estimator twice.The third one is obtained by choosing di erent priors for the two sets of regression parameters that arise in the case of multicollinearity;this estimator is termed decomposed empirical Bayes estimator. These proposed estimators are not only proved to be uniformly better than the LS estimator, that is,minimax in terms of risk under the Strawderman's loss function,but also shown to be useful in the multicollinearity cases through simulation and empirical studies.