© 1983 by Biometrika Trust
Information gain and a general measure of correlation
Department of Statistics, University of Leeds
Given a parametric model of dependence between two random quantities, X and Y, the notion of information gain can be used to define a measure of correlation. This definition of correlation generalizes both the usual product-moment correlation coeffi cient for the bivariate normal model and the multiple correlation coefficient in the standard linear regression model. The use of this information-based correlation in a descriptive statistical analysis is examined and several examples are given.
Key Words: Conditional correlation Joint correlation Kullback Leibler information gain Likelihood ratio test Akaike's information criterion Robustness
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
G. Molenberghs, T. Burzykowski, A. Alonso, and M. Buyse A perspective on surrogate endpoints in controlled clinical trials Statistical Methods in Medical Research, June 1, 2004; 13(3): 177 - 206. [Abstract] [PDF] |
||||
![]() |
G. Falah, M. Hoy, and R. Sarker Co-existence in Selected Mixed Arab-Jewish Cities in Israel: By Choice or by Default? Urban Stud, April 1, 2000; 37(4): 775 - 796. [Abstract] [PDF] |
||||

