Miscellanea |
Cholesky Decompositions and Estimation of A Covariance Matrix: Orthogonality of Variance–Correlation Parameters
Division of Statistics, Northern Illinois University, DeKalb, Illinois 60115-2854, U.S.A. pourahm{at}math.niu.edu
Received for publication 1 July 2005. Revision received 1 April 2007.
Chen & Dunson ([3]) have proposed a modified Cholesky decomposition of the form
= D L L'D for a covariance matrix where D is a diagonal matrix with entries proportional to the square roots of the diagonal entries of
and L is a unit lower-triangular matrix solely determining its correlation matrix. This total separation of variance and correlation is definitely a major advantage over the more traditional modified Cholesky decomposition of the form LD2L', (Pourahmadi, [13]). We show that, though the variance and correlation parameters of the former decomposition are separate, they are not asymptotically orthogonal and that the estimation of the new parameters could be more demanding computationally. We also provide statistical interpretation for the entries of L and D as certain moving average parameters and innovation variances and indicate how the existing likelihood procedures can be employed to estimate the new parameters.
Key Words: Maximum likelihood estimation Moving average coefficient Positive-definiteness constraint Unconstrained parameterization Variance–correlation separation
References
-
Barnard J., McCulloch R., Meng X. Modeling covariance matrices in terms of standard deviations and correlations, with applications to shrinkage. Statist. Sinica (2000) 10:1281–312.
Boik R. J. Spectral models for covariance matrices. Biometrika (2002) 89:159–82.
Chen Z., Dunson D. Random effects selection in linear mixed models. Biometrics (2003) 59:762–9.[CrossRef][Web of Science][Medline]
Cox D. R., Reid N. Parameter orthogonality and approximate conditional inference (with Discussion). J. R. Statist. Soc. B (1987) 49:1–39.
Dai M., Guo W. Multivariate spectral analysis using Cholesky decomposition. Biometrika (2004) 91:629–43.
Daniels M. J., Zhao Y. D. Modelling the random effects covariance matrix in longitudinal data. Statist. Med. (2003) 22:1631–47.[CrossRef]
Holan S., Spinka C. Joint mean-covariance models for unbalanced repeated measures: Unconstrained parameterization. Statist. Prob. Lett. (2007) 77:319–28.[CrossRef]
Lindstrom M. J., Bates D. M. Newton-Raphson and EM algorithm for linear mixed-effects models for repeated measures data. J. Am. Statist. Assoc. (1988) 83:1014–22.[CrossRef][Web of Science]
Mason R. L., Tracy N. D., Young J. C. Decomposition of T2 for multivariate control chart interpretation. J. Qual. Technol. (1995) 27:99–108.
Mason R. L., Young J. C. Multivariate Statistical Process Control with Industrial Applications (2002) Philadelphia: SIAM.
Pan J. X., Mackenzie G. Model selection for joint mean-covariance structures in longitudinal studies. Biometrika (2003) 90:1239–44.
Pinhiero J., Bates D. M. Unconstrained parametrizations for variance-covariance matrices. Statist. Comp. (1996) 6:289–96.[CrossRef]
Pourahmadi M. Joint mean-covariance models with applications to longitudinal data: Unconstrained parameterisation. Biometrika (1999) 86:677–90.
Pourahmadi M. Maximum likelihood estimation of generalised linear models for multivariate normal covariance matrix. Biometrika (2000) 87:425–35.
Pourahmadi M. Foundations of Time Series Analysis and Prediction Theory (2001) New York: Wiley.
Roverato A. Cholesky decomposition of a hyper inverse Wishart matrix. Biometrika (2000) 87:99–112.
Smith M, Kohn R. Parsimonious covariance matrix estimation for longitudinal data. J. Am. Statist. Assoc. (2002) 97:1141–53.[CrossRef][Web of Science]
Vrontos I. D., Dellaportas P., Politis D. N. A full-factor multivariate GARCH model. Economet. J. (2003) 6:312–34.[CrossRef]
Ye H., Pan J. Modelling covariance structures in generalised estimating equations for longitudinal data. Biometrika (2006) 93:911–26.
| ||||||||||||||||||||||||||||||||||||||||||||||||