© 1994 by Biometrika Trust
Articles |
Ideal spatial adaptation by wavelet shrinkage
Department of Statistics, Stanford University, Stanford, California 94305-4065, U.S.A.
Received for publication 1 August 1992.
Revision received 1 June 1993.
 |
Abstract |
|---|
With ideal spatial adaptation, an oracle furnishes information about how best to adapt a spatially variable estimator, whether piecewise constant, piecewise polynomial, variable knot spline, or variable bandwidth kernel, to the unknown function. Estimation with the aid of an oracle offers dramatic advantages over traditional linear estimation by nonadaptive kernels; however, it is a priori unclear whether such performance can be obtained by a procedure relying on the data alone. We describe a new principle for spatially-adaptive estimation: selective wavelet reconstruction. We show that variable-knot spline fits and piecewise-polynomial fits, when equipped with an oracle to select the knots, are not dramatically more powerful than selective wavelet reconstruction with an oracle. We develop a practical spatially adaptive method, Risk Shrink, which works by shrinkage of empirical wavelet coefficients. RiskShrink mimics the performance of an oracle for selective wavelet reconstruction as well as it is possible to do so. A new inequality in multivariate normal decision theory which we call the oracle inequality shows that attained performance differs from ideal performance by at most a factor of approximately 2 log n, where n is the sample size. Moreover no estimator can give a better guarantee than this. Within the class of spatially adaptive procedures, RiskShrink is essentially optimal. Relying only on the data, it comes within a factor log2n of the performance of piecewise polynomial and variableknot spline methods equipped with an oracle. In contrast, it is unknown how or if piecewise polynomial methods could be made to function this well when denied access to an oracle and forced to rely on data alone.
Key Words: Minimax estimation subject to doing well at a point • Orthogonal wavelet bases of compact support • Piecewise-polynomial fitting • Variable-knot spline
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  J. Hannig and T. C. M. Lee Generalized fiducial inference for wavelet regression Biometrika, December 1, 2009; 96(4): 847 - 860. [Abstract] [PDF]
|
|
|
|
|
|
A. C. Davison and D. Mastropietro Saddlepoint approximation for mixture models Biometrika, June 1, 2009; 96(2): 479 - 486. [Abstract] [PDF]
|
|
|
|
 |
|
 Y.-Y. I. Shih, C.-C. V. Chen, B.-C. Shyu, Z.-J. Lin, Y.-C. Chiang, F.-S. Jaw, Y.-Y. Chen, and C. Chang A New Scenario for Negative Functional Magnetic Resonance Imaging Signals: Endogenous Neurotransmission J. Neurosci., March 11, 2009; 29(10): 3036 - 3044. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. Parolai Denoising of Seismograms Using the S Transform Bulletin of the Seismological Society of America, February 1, 2009; 99(1): 226 - 234. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Elad and D. Datsenko Example-Based Regularization Deployed to Super-Resolution Reconstruction of a Single Image The Computer Journal, January 1, 2009; 52(1): 15 - 30. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. S. Morris, B. N. Clark, and H. B. Gutstein Pinnacle: a fast, automatic and accurate method for detecting and quantifying protein spots in 2-dimensional gel electrophoresis data Bioinformatics, February 15, 2008; 24(4): 529 - 536. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H.-S. Oh, D. W. Nychka, and T. C. M. Lee The Role of Pseudo Data for Robust Smoothing with Application to Wavelet Regression Biometrika, December 1, 2007; 94(4): 893 - 904. [Abstract] [PDF]
|
|
|
|
|
|
H. H. Zhang and W. Lu Adaptive Lasso for Cox's proportional hazards model Biometrika, August 1, 2007; 94(3): 691 - 703. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. L. Ringach and B. J. Malone The Operating Point of the Cortex: Neurons as Large Deviation Detectors J. Neurosci., July 18, 2007; 27(29): 7673 - 7683. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 W. Zhao, H. Li, W. Hou, and R. Wu Wavelet-Based Parametric Functional Mapping of Developmental Trajectories With High-Dimensional Data Genetics, July 1, 2007; 176(3): 1879 - 1892. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. R. Segal Microarray gene expression data with linked survival phenotypes: diffuse large-B-cell lymphoma revisited Biostat., April 1, 2006; 7(2): 268 - 285. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. Wu Differential gene expression detection and sample classification using penalized linear regression models Bioinformatics, February 15, 2006; 22(4): 472 - 476. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H. H. Zhang, J. Ahn, X. Lin, and C. Park Gene selection using support vector machines with non-convex penalty Bioinformatics, January 1, 2006; 22(1): 88 - 95. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. R. Dabney Classification of microarrays to nearest centroids Bioinformatics, November 15, 2005; 21(22): 4148 - 4154. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 O. Tischenko, C. Hoeschen, and E. Buhr Reduction of anatomical noise in medical X-ray images Radiat Prot Dosimetry, May 17, 2005; 114(1-3): 69 - 74. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. Hoeschen, O. Tischenko, E. Buhr, and H. Illers Comparison of technical and anatomical noise in digital thorax X-ray images Radiat Prot Dosimetry, May 17, 2005; 114(1-3): 75 - 80. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
Regularized Deconvolution of Local Short-Period Seismograms in the Wavelet Packet Domain Bulletin of the Seismological Society of America, August 1, 2004; 94(4): 1467 - 1475.
|
|
|
|
|
|
De-Noising of Short-Period Seismograms by Wavelet Packet Transform Bulletin of the Seismological Society of America, December 1, 2003; 93(6): 2554 - 2562.
|
|
|
|
 |
|
 P. Lio Investigating the Relationship Between Genome Structure, Composition, and Ecology in Prokaryotes Mol. Biol. Evol., June 1, 2002; 19(6): 789 - 800. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. Tibshirani, T. Hastie, B. Narasimhan, and G. Chu Diagnosis of multiple cancer types by shrunken centroids of gene expression PNAS, May 14, 2002; 99(10): 6567 - 6572. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J.-W. Lin, A. F. Laine, O. Akinboboye, and S. R. Bergmann Use of Wavelet Transforms in Analysis of Time-Activity Data from Cardiac PET J. Nucl. Med., February 1, 2001; 42(2): 194 - 200. [Abstract] [Full Text]
|
|
|
|
|
|
J.-W. Lin, R. R. Sciacca, R.-L. Chou, A. F. Laine, and S. R. Bergmann Quantification of Myocardial Perfusion in Human Subjects Using 82Rb and Wavelet-Based Noise Reduction J. Nucl. Med., February 1, 2001; 42(2): 201 - 208. [Abstract] [Full Text]
|
|