Hostname: page-component-8448b6f56d-mp689 Total loading time: 0 Render date: 2024-04-23T14:10:31.468Z Has data issue: false hasContentIssue false

Nonparametric regression estimation based on spatially inhomogeneous data: minimax global convergence rates and adaptivity

Published online by Cambridge University Press:  06 December 2013

Anestis Antoniadis
Affiliation:
Laboratoire Jean Kuntzmann, Universite Joseph Fourier, 38041 Grenoble Cedex 9, France. Anestis.Antoniadis@imag.fr
Marianna Pensky
Affiliation:
Department of Mathematics, University of Central Florida, Orlando, 32816-1364, USA; Marianna.Pensky@ucf.edu
Theofanis Sapatinas
Affiliation:
Department of Mathematics and Statistics, University of Cyprus, P.O. Box 20537, CY 1678 Nicosia, Cyprus; fanis@ucy.ac.cy
Get access

Abstract

We consider the nonparametric regression estimation problem of recovering an unknown response function f on the basis of spatially inhomogeneous data when the design points follow a known density g with a finite number of well-separated zeros. In particular, we consider two different cases: when g has zeros of a polynomial order and when g has zeros of an exponential order. These two cases correspond to moderate and severe data losses, respectively. We obtain asymptotic (as the sample size increases) minimax lower bounds for the L2-risk when f is assumed to belong to a Besov ball, and construct adaptive wavelet thresholding estimators of f that are asymptotically optimal (in the minimax sense) or near-optimal within a logarithmic factor (in the case of a zero of a polynomial order), over a wide range of Besov balls. The spatially inhomogeneous ill-posed problem that we investigate is inherently more difficult than spatially homogeneous ill-posed problems like, e.g., deconvolution. In particular, due to spatial irregularity, assessment of asymptotic minimax global convergence rates is a much harder task than the derivation of asymptotic minimax local convergence rates studied recently in the literature. Furthermore, the resulting estimators exhibit very different behavior and asymptotic minimax global convergence rates in comparison with the solution of spatially homogeneous ill-posed problems. For example, unlike in the deconvolution problem, the asymptotic minimax global convergence rates are greatly influenced not only by the extent of data loss but also by the degree of spatial homogeneity of f. Specifically, even if 1/g is non-integrable, one can recover f as well as in the case of an equispaced design (in terms of asymptotic minimax global convergence rates) when it is homogeneous enough since the estimator is “borrowing strength” in the areas where f is adequately sampled.

Type
Research Article
Copyright
© EDP Sciences, SMAI 2013

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Amato, U., Antoniadis, A. and Pensky, M., Wavelet kernel penalized estimation for non-equispaced design regression. Statist. Comput. 16 (2006) 3755. Google Scholar
Antoniadis, A. and Pham, D.T., Wavelet regression for random or irregular design. Comput. Statist. Data Anal. 28 (1998) 353369. Google Scholar
Bissantz, N., Dumbgen, L., Holzmann, H. and Munk, A., Nonparametric confidence bands in deconvolution density estimation. J. Royal Statist. Soc. Series B 69 (2007) 483506. Google Scholar
Brown, L.D., Cai, T.T., Low, M.G. and Zhang, C.H., Asymptotic equivalence theory for nonparametric regression with random design. Annal. Statist. 30 (2002) 688707. Google Scholar
Cai, T.T. and Brown, L.D., Wavelet shrinkage for nonequispaced samples. Annal. Statist. 26 (1998) 17831799. Google Scholar
Chesneau, C., Regression in random design: a minimax study. Statist. Probab. Lett. 77 (2007) 4053. Google Scholar
I. Daubechies, Ten Lectures on Wavelets. Philadelphia: SIAM (1992).
R.B. Dingle, Asymptotic Expansions: Their Derivation and Interpretation. London: Academic Press (1973).
Gaïffas, S.,. Convergence rates for pointwise curve estimation with a degenerate design. Math. Meth. Statist. 14 (2005) 127. Google Scholar
Gaïffas, S., Sharp estimation in sup norm with random design. Statist. Probab. Lett. 77 (2006) 782794. Google Scholar
Gaïffas, S., On pointwise adaptive curve estimation based on inhomogeneous data. ESAIM: Probab. Statist. 11 (2007) 344364. Google Scholar
Gaïffas, S., Uniform estimation of a signal based on inhomogeneous data. Statistica Sinica 19 (2009) 427447. Google Scholar
Giné, E. and Nickl, R., Confidence bands in density estimation. Annal. Statist. 38 (2010) 11221170. Google Scholar
Guillou, A. and Klutchnikoff, N., Minimax pointwise estimation of an anisotropic regression function with unknown density of the design. Math. Methods Statist. 20 (2011) 3057. Google Scholar
Hall, P. and Turlach, B.A., Interpolation methods for nonlinear wavelet regression with irregularly spaced design. Annal. Statist. 25 (1997) 19121925. Google Scholar
W. Härdle, G. Kerkyacharian, D. Picard and A. Tsybakov, Wavelets, Approximation, and Statistical Applications, vol. 129 of Lect. Notes Statist. Springer-Verlag, New York (1998).
Hoffmann, M. and Reiss, M., Nonlinear estimation for linear inverse problems with error in the operator. Annal. Statist. 36 (2008) 310336. Google Scholar
I.M. Johnstone, Minimax Bayes, asymptotic minimax and sparse wavelet priors, in Statistical Decision Theory and Related Topics, edited by S.S. Gupta and J.O. Berger. Springer-Verlag, New York (1994) 303–326,
I.M. Johnstone, Function Estimation and Gaussian Sequence Models. Unpublished Monograph (2002). http://statweb.stanford.edu/~imj/
Johnstone, I.M., Kerkyacharian, G., Picard, D. and Raimondo, M., Wavelet deconvolution in a periodic setting. J. Royal Statist. Soc. Series B 66 (2004) 547-573 (with discussion, 627--657). Google Scholar
Kerkyacharian, G. and Picard, D., Regression in random design and warped wavelets. Bernoulli 10 (2004) 1053-1105. Google Scholar
Kohler, M., Nonlinear orthogonal series estimation for random design regression. J. Statist. Plann. Inference 115 (2003) 491-520. Google Scholar
A.P. Korostelev and A.B. Tsybakov, Minimax Theory of Image Reconstruction, vol. 82 of Lect. Notes Statist. Springer-Verlag, New York (1993).
Kovac, A. and Silverman, B.W., Extending the scope of wavelet regression methods by coefficient-dependent thresholding. J. Amer. Statist. Assoc. 95 (2000) 172-183. Google Scholar
Kulik, R. and Raimondo, M., Wavelet regression in random design with heteroscedastic dependent errors. Annal. Statist. 37 (2009) 3396-3430. Google Scholar
Lepski, O.V., A problem of adaptive estimation in Gaussian white noise. Theory Probab. Appl. 35 (1990) 454-466. Google Scholar
Lepski, O.V., Asymptotically minimax adaptive estimation I: Upper bounds. Optimally adaptive estimators. Theory Probab. Appl. 36 (1991) 682-697. Google Scholar
Lepski, O.V., Mammen, E. and Spokoiny, V.G., Optimal spatial adaptation to inhomogeneous smoothness: an approach based on kernel estimates with variable bandwidth selectors Annal. Statist. 25 (1997) 929-947. Google Scholar
Lepski, O. and Spokoiny, V., Optimal pointwise adaptive methods in nonparametric estimation. Annal. Statist. 25 (1997) 2512-2546. Google Scholar
S. Mallat, A Wavelet Tour of Signal Processing. 2nd Edition, Academic Press, San Diego (1999).
Y. Meyer, Wavelets and Operators. Cambridge: Cambridge University Press (1992).
Pensky, M. and Sapatinas, T., Functional deconvolution in a periodic case: uniform case. Annal. Statist. 37 (2009) 73-104. Google Scholar
Pensky, M. and Sapatinas, T., On convergence rates equivalency and sampling strategies in functional deconvolution models. Annal. Statist. 38 (2010) 1793-1844. Google Scholar
Pensky, M. and Vidakovic, B., On non-equally spaced wavelet regression. Annal. Instit. Statist. Math. 53 (2001) 681-690. Google Scholar
Sardy, S., Percival, D.B., Bruce, A.G., Gao, H.-Y. and Stuelzle, W., Wavelet shrinkage for unequally spaced data. Statist. Comput. 9 (1999) 65-75. Google Scholar
Tribouley, K., Adaptive simultaneous confidence intervals in non-parametric estimation. Statist. Probab. Lett. 69 (2004) 37-51. Google Scholar
A.B. Tsybakov, Introduction to Nonparametric Estimation. Springer-Verlag, New York (2009).
G. Wahba, Spline Models for Observational Data. SIAM, Philadelphia (1990).
Zhang, S., Wong, M.-Y. and Zheng, Z., Wavelet threshold estimation of a regression function with random design. J. Multivariate Anal. 80 (2002) 256-284. Google Scholar