© 2000 by Biometrika Trust
Markov chain Monte Carlo in approximate Dirichlet and beta two-parameter process hierarchical models
A1 Department of Biostatistics and Epidemiology, Cleveland Clinic Foundation, Cleveland, OH 44195, USA E-mail: ishwaran@bio.ri.ccf.org A2 Department of Mathematics and Statistics, University of Ottawa, Ottawa, Ontario K1N 6N5, Canada E-mail: zarepour@expresso.mathstat.uottawa.ca
We present some easy-to-construct random probability measures which approximate the Dirichlet process and an extension which we will call the beta two-parameter process. The nature of these constructions makes it simple to implement Markov chain Monte Carlo algorithms for fitting nonparametric hierarchical models. For the Dirichlet process, we consider a truncation approximation as well as a weak limit approximation based on a mixture of Dirichlet processes. The same type of truncation approximation can also be applied to the beta two-parameter process. Both methods lead to posteriors which can be fitted using Markov chain Monte Carlo algorithms that take advantage of blocked coordinate updates. These algorithms promote rapid mixing of the Markov chain and can be readily applied to normal mean mixture models and to density estimation problems. We prefer the truncation approximations, since a simple device for monitoring the adequacy of the approximation can be easily computed from the output of the Gibbs sampler. Furthermore, for the Dirichlet process, the truncation approximation offers an exponentially higher degree of accuracy over the weak limit approximation for the same computational effort. We also find that a certain beta two-parameter process may be suitable for finite mixture modelling because the distinct number of sampled values from this process tends to match closely the number of components of the underlying mixture distribution.
Key Words: almost sure truncation; generalised Dirichlet distribution; mixture of Dirichlet processes; nonparametric hierarchical model; normal mean mixture; random probability measure; weak convergence in distribution
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  D. B. Dunson and J.-H. Park Kernel stick-breaking processes Biometrika, June 1, 2008; 95(2): 307 - 323. [Abstract] [PDF]
|
|
|
|
 |
|
 C. Navarrete, F. A Quintana, and P. Muller Some issues in nonparametric Bayesian modeling using species sampling models Statistical Modeling, April 1, 2008; 8(1): 3 - 21. [Abstract] [PDF]
|
|
|
|
|
|
O. Papaspiliopoulos and G. O. Roberts Retrospective Markov chain Monte Carlo methods for Dirichlet process hierarchical models Biometrika, March 1, 2008; 95(1): 169 - 186. [Abstract] [PDF]
|
|