© 1983 by Biometrika Trust
Predictive inference, sufficiency, entropy and an asymptotic likelihood principle
Scientific Systems Inc., Cambridge, Massachusetts, U.S.A.
The objective of inferring stochastic models from a set of data is to obtain the best description, by using a probability model, of the statistical behaviour of future samples of the process. A conceptual repeated sampling experiment is considered for evaluating a predictive distribution used to describe such future observations and leads to an asymptotic likelihood principle. Considerations of likelihood and sufficiency lead to the use of entropy or the KullbackLeibler information as the natural measure of approximation to the actual distribution by a predictive distribution in repeated samples. This gives a small-sample justification for the use of entropy for evaluating parameter estimation as well as model order and structure determination procedures.
Key Words: Akaike's criterion Entropy Foundations of statistics Kullback-Leibler information Likelihood Predictive distribution Predictive inference Probability density estimation Repeated sampling Small sample Sufficiency
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
D. W. Orme-Johnson, C. N. Alexander, and J. L. Davies The Effects of the Maharishi Technology of the Unified Field: Reply to a Methodological Critique Journal of Conflict Resolution, December 1, 1990; 34(4): 756 - 768. [Abstract] |
||||
