Weakly Informative Prior for Point Estimation of Covariance Matrices in Hierarchical Models

Autor/inn/en	Chung, Yeojin; Gelman, Andrew; Rabe-Hesketh, Sophia; Liu, Jingchen; Dorie, Vincent
Titel	Weakly Informative Prior for Point Estimation of Covariance Matrices in Hierarchical Models
Quelle	40 (2015) 2, S.136-157 (22 Seiten)Infoseite zur Zeitschrift PDF als Volltext (1); PDF als Volltext kostenfreie Datei (2) Verfügbarkeit
Zusatzinformation	Weitere Informationen
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
DOI	10.3102/1076998615570945
Schlagwörter	Regression (Statistics); Hierarchical Linear Modeling; Bayesian Statistics; Statistical Inference; Computation; Matrices; Statistical Analysis; Maximum Likelihood Statistics; Educational Research + Suchen Sie Ihr Suchwort? Regression; Regressionsanalyse; Inferential statistics; Schließende Statistik; Matrizenrechnung; Statistische Analyse; Bildungsforschung; Pädagogische Forschung
Abstract	When fitting hierarchical regression models, maximum likelihood (ML) estimation has computational (and, for some users, philosophical) advantages compared to full Bayesian inference, but when the number of groups is small, estimates of the covariance matrix [sigma] of group-level varying coefficients are often degenerate. One can do better, even from a purely point estimation perspective, by using a prior distribution or penalty function. In this article, we use Bayes modal estimation to obtain positive definite covariance matrix estimates. We recommend a class of Wishart (not inverse-Wishart) priors for [sigma] with a default choice of hyperparameters, that is, the degrees of freedom are set equal to the number of varying coefficients plus 2, and the scale matrix is the identity matrix multiplied by a value that is large relative to the scale of the problem. This prior is equivalent to independent gamma priors for the eigenvalues of [sigma] with shape parameter 1.5 and rate parameter close to 0. It is also equivalent to independent gamma priors for the variances with the same hyperparameters multiplied by a function of the correlation coefficients. With this default prior, the posterior mode for [sigma] is always strictly positive definite. Furthermore, the resulting uncertainty for the fixed coefficients is less underestimated than under classical ML or restricted maximum likelihood estimation. We also suggest an extension of our method that can be used when stronger prior information is available for some of the variances or correlations. [This paper was published in "Journal of Educational and Behavioral Statistics" (EJ1057844).] (As Provided).
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01