Biometrika Advance Access originally published online on November 19, 2007
Biometrika 2007 94(4):893-904; doi:10.1093/biomet/asm064
Articles |
The Role of Pseudo Data for Robust Smoothing with Application to Wavelet Regression
Department of Statistics, Seoul National University, Seoul 151-747, Korea heeseok{at}stats.snu.ac.kr
Geophysical Statistics Project, National Center for Atmospheric Research, Boulder, Colorado 80307, U.S.A. nychka{at}ucar.edu
Department of Statistics, The Chinese University of Hong Kong, Shatin, Hong Kong, China tlee{at}sta.cuhk.edu.hk
Received for publication 1 November 2005. Revision received 1 March 2007.
We propose a robust curve and surface estimator based on M-type estimators and penalty-based smoothing. This approach also includes an application to wavelet regression. The concept of pseudo data, a transformation of the robust additive model to the one with bounded errors, is used to derive some theoretical properties and also motivate a computational algorithm. The resulting algorithm, termed the es-algorithm, is computationally fast and provides a simple way of choosing the amount of smoothing. Moreover, it is easily described, straightforwardly implemented and can be extended to other wavelet regression settings such as irregularly spaced data and image denoising. Results from a simulation study and real data examples demonstrate the promising empirical properties of the proposed approach.
Key Words: ES-algorithm M-estimation Penalized least-squares Pseudo data Robust smoothing Wavelets
References
-
Adams R. Sobolev Spaces (1975) New York: Academic Press.
Alliney S., Ruzinsky S. A. An algorithm for the minimization of mixed l1 and l2 norms with application to Bayesian estimation. IEEE Trans. Sig. Proces. (1994) 42:618–27.[CrossRef]
Angelini C., De Canditiis D., Leblanc F. Wavelet regression estimation in non parametric mixed effect models. J. Mult. Anal. (2003) 85:267–91.[CrossRef]
Antoniadis A. Smoothing noisy data with tapered Coiflets series. Scand. J. Statist. (1996) 23:313–30.
Antoniadis A., Fan J. Regularization of wavelet approximations. J. Am. Statist. Assoc. (2001) 96:939–62.[CrossRef][Web of Science]
Aubin J.-P. Applied Functional Analysis (2000) 2nd ed. New York: Wiley.
Averkamp R., Houdré C. Wavelets thresholding for non-necessarily Gaussian noise: Idealism. Ann. Statist. (2003) 31:110–51.[CrossRef]
Cantoni E., Ronchetti E. Resistant selection of the smoothing parameter for smoothing splines. Statist. Comp. (2001) 11:141–6.[CrossRef]
Cox D. D. Asymptotics for M-type smoothing splines. Ann. Statist. (1983) 11:530–51.[CrossRef]
Donoho D. L., Johnstone I. M. Ideal spatial adaptation by wavelet shrinkage. Biometrika (1994) 81:425–55.
Donoho D. L., Johnstone I. M., Hoch J. C., Stern A. S. Maximum entropy and the nearly black object (with Discussion). J. R. Statist. Soc. B (1992) 54:41–81.
Eilers P. H. C., Marx B. D. Flexible smoothing with B-splines and penalties (with Discussion). Statist. Sci. (1996) 11:89–121.[CrossRef]
Hall P., Jones M. C. Adaptive M-estimation in nonparametric regression. Ann. Statist. (1990) 18:1712–28.[CrossRef]
Härdle W., Gasser T. Robust non-parametric function fitting. J. R. Statist. Soc. B (1984) 46:42–51.
Huber P. J. Robust regression: asymptotics, conjectures and Monte Carlo. Ann. Statist. (1973) 1:799–821.[CrossRef]
Huber P. J. Robust smoothing. In: Robustness in Statistics—Launer R. L., Wilkinson G. N., eds. (1979) New York: Academic Press. 38–48.
Huber P. J. Robust Statistics (1981) New York: Wiley.
Johnstone I. M., Silverman B. W. Empirical Bayes selection of wavelet thresholds. Ann. Statist. (2005) 33:1700–52.[CrossRef]
Kovac A., Silverman B. W. Extending the scope of wavelet regression methods by coefficient-dependent thresholding. J. Am. Statist. Assoc. (2000) 95:172–83.[CrossRef][Web of Science]
Messer K. A comparison of a spline estimate to its equivalent kernel estimate. Ann. Statist. (1991) 19:817–29.[CrossRef]
Nason G. P. WaveThresh3 Software (1998) Bristol, UK: Department of Mathematics, University of Bristol.
Nychka D. W. Splines as local smoothers. Ann. Statist. (1995) 23:1175–97.[CrossRef]
Sardy S., Tseng P., Bruce A. Robust wavelet denoising. IEEE Trans. Sig. Proces. (2001) 49:1146–52.[CrossRef]
Silverman B. W. Some aspects of the spline smoothing approach to non-parametric regression curve fitting (with Discussion). J. R. Statist. Soc. B (1985) 47:1–52.
Simonoff J. S. Smoothing Methods in Statistics (1996) New York: Springer.
| ||||||||||||||||||||||||||||||||||||||||||||||||||