Chernoff inequality; Cramér–Rao inequality; Parameter of interest; Stein characterization; Stein’s method; Statistics and Probability
Résumé :
[en] Stein operators are (differential/difference) operators which arise within the so-called Stein’s method for stochastic approximation.We propose a new mechanism for constructing such operators for arbitrary (continuous or discrete) parametric distributions with continuous dependence on the parameter. We provide explicit general expressions for location, scale and skewness families. We also provide a general expression for discrete distributions. We use properties of our operators to provide upper and lower variance bounds (only lower bounds in the discrete case) on functionals h(X) of random variables X following parametric distributions. These bounds are expressed in terms of the first two moments of the derivatives (or differences) of h. We provide general variance bounds for location, scale and skewness families and apply our bounds to specific examples (namely the Gaussian, exponential, gamma and Poisson distributions). The results obtained via our techniques are systematically competitive with, and sometimes improve on, the best bounds available in the literature.
Disciplines :
Mathématiques
Auteur, co-auteur :
LEY, Christophe ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Mathematics (DMATH) ; Département de Mathématique, Université libre de Bruxelles, Brussels, Belgium
Swan, Yvik; Département de Mathématique, Université de Liège, Liège, Belgium
Afendras, G., Papadatos, N. and Papathanasiou, V. (2011). An extended Stein-type covariance identity for the Pearson family with applications to lower variance bounds. Bernoulli 17, 507-529. MR2787602.
Bakry, D., Gentil, I. and Ledoux, M. (2014). Analysis and Geometry of Markov Diffusion Operators. Grundlehren der Mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences] 348. Cham: Springer. MR3155209.
Barbour, A. D. (1990). Stein's method for diffusion approximations. Probability Theory and Related Fields 84, 297-322. MR1035659.
Barbour, A. D. and Chen, L. H. (2014). Steins (magic) method. Preprint. Available at arXiv: 1411. 1179.
Barbour, A. D. and Chen, L. H. Y. (2005). An Introduction to Stein's Method. Lect. Notes Ser. Inst. Math. Sci. Natl. Univ. Singap. 4. Singapore: Singapore Univ. Press.
Barbour, A. D., Holst, L. and Janson, S. (1992). Poisson Approximation. Oxford Studies in Probability 2. New York: The Clarendon Press, Oxford Univ. Press. MR1163825.
Borovkov, A. and Utev, S. (1984). On an inequality and a related characterization of the normal distribution. Theory of Probability and Its Applications 28, 219-228. MR0700206.
Brown, T. C. and Xia, A. (1995). On Stein-Chen factors for Poisson approximation. Statistics and Probability Letters 23, 327-332. MR1342742.
Cacoullos, T. (1982). On upper and lower bounds for the variance of a function of a random variable. The Annals of Probability 10, 799-809. MR0659549.
Cacoullos, T. and Papathanasiou, V. (1995). A generalization of covariance identity and related characterizations. Mathematical Methods of Statistics 4, 106-113. MR1324694.
Cacoullos, T., Papathanasiou, V. and Utev, S. A. (1994). Variational inequalities with examples and an application to the central limit theorem. The Annals of Probability 22, 1607-1618. MR1303658.
Chatterjee, S., Fulman, J. and Röllin, A. (2011). Exponential approximation by exchangeable pairs and spectral graph theory. ALEA Latin American Journal of Probability and Mathematical Statistics 8, 1-27. MR2802856.
Chen, L. H. Y. (1975). Poisson approximation for dependent trials. The Annals of Probability 3, 534-545. MR0428387.
Chen, L. H. Y. (1982). An inequality for the multivariate normal distribution. Journal of Multivariate Analysis 12, 306-315. MR0661566.
Chen, L. H. Y., Goldstein, L. and Shao, Q.-M. (2011). Normal Approximation by Stein's Method. Probability and Its Applications (New York). Heidelberg: Springer. MR2732624.
Chernoff, H. (1980). The identification of an element of a large population in the presence of noise. The Annals of Statistics 8, 1179-1197. MR0594637.
Chernoff, H. (1981). A note on an inequality involving the normal distribution. The Annals of Probability 9, 533-535. MR0614640.
Diaconis, P. and Zabell, S. (1991). Closed form summation for classical distributions: Variations on a theme of de Moivre. Statistical Science 6, 284-302. MR1144242.
Döbler, C. (2012). Stein's method of exchangeable pairs for absolutely continuous, univariate distributions with applications to the Polya urn model. Preprint. Available at arXiv: 1207. 0533.
Döbler, C., Gaunt, R. E., Ley, C., Reinert, G. and Swan, Y. (2015). A Handbook of Stein Operators. In progress.
Goldstein, L. and Reinert, G. (2005). Distributional transformations, orthogonal polynomials, and Stein characterizations. Journal of Theoretical Probability 18, 237-260. MR2132278.
Goldstein, L. and Reinert, G. (2013). Stein's method for the Beta distribution and the Pólya-Eggenberger urn. Journal of Applied Probability 50, 1187-1205. MR3161381.
Götze, F. (1991). On the rate of convergence in the multivariate CLT. The Annals of Probability 19, 724-739. MR1106283.
Götze, F. and Tikhomirov, A. N. (2003). Rate of convergence to the semi-circular law. Probability Theory and Related Fields 127, 228-276. MR2013983.
Holmes, S. (2004). Stein's method for birth and death chains. In Stein's Method: Expository Lectures and Applications. IMS Lecture Notes Monogr. Ser. 46, 42-65. Beachwood, OH: Institute of Mathematical Statistics. MR2118602.
Houdré, C. and Kagan, A. (1995). Variance inequalities for functions of Gaussian variables. Journal of Theoretical Probability 8, 23-30. MR1308667.
Hudson, H. M. (1978). A natural identity for exponential families with applications in multiparameter estimation. The Annals of Statistics 6, 473-484. MR0467991.
Hwang, J. T. (1982). Improving upon standard estimators in discrete exponential families with applications to Poisson and negative binomial cases. The Annals of Statistics 10, 857-867. MR0663437.
Jones, M. C. and Pewsey, A. (2009). Sinh-arcsinh distributions. Biometrika 96, 761-780. MR2564489.
Klaassen, C. A. J. (1985). On an inequality of Chernoff. The Annals of Probability 13, 966-974. MR0799431.
Landsman, Z., Vanduffel, S. and Yao, J. (2015). Some Stein-type inequalities for multivariate elliptical distributions and applications. Statistics and Probability Letters 97, 54-62. MR3299751.
Ledoux, M. (2001). The Concentration of Measure Phenomenon. Mathematical Surveys and Monographs 89. Providence, RI: American Mathematical Society. MR1849347.
Ledoux, M., Nourdin, I. and Peccati, G. (2015). Stein's method, logarithmic Sobolev and transport inequalities. Geometric and Functional Analysis 25, 256-306. MR3320893.
Lehmann, E. L. and Casella, G. (1998). Theory of Point Estimation, 2nd ed. New York: Springer. MR1639875.
Ley, C. and Paindaveine, D. (2010). Multivariate skewing mechanisms: A unified perspective based on the transformation approach. Statistics and Probability Letters 80, 1685-1694. MR2734229.
Ley, C., Reinert, G. and Swan, Y. (2014). Approximate computation of expectations: A canonical Stein operator. Preprint. Available at arXiv: 1408. 2998v2.
Ley, C. and Swan, Y. (2013a). Local Pinsker inequalities via Stein's discrete density approach. IEEE Transactions on Information Theory 59, 5584-4491. MR3096942.
Ley, C. and Swan, Y. (2013b). Stein's density approach and information inequalities. Electronic Communications in Probability 18, 1-14. MR3019670.
Liu, J. S. (1994). Siegel's formula via Stein's identities. Statistics and Probability Letters 21, 247-251. MR1310101.
Luk, H. M. (1994). Stein's method for the gamma distribution and related statistical applications. Ph. D. thesis, Univ. Southern California. MR2693204.
Nourdin, I. and Peccati, G. (2009). Stein's method on Wiener chaos. Probability Theory and Related Fields 145, 75-118. MR2520122.
Nourdin, I. and Peccati, G. (2012). Normal Approximations with Malliavin Calculus: From Stein's Method to Universality. Cambridge Tracts in Mathematics. Cambridge: Cambridge Univ. Press. MR2962301.
Papadatos, N. and Papathanasiou, V. (2001). Unified variance bounds and a Stein-type identity. In Probability and Statistical Models with Applications 87-100. Boca Raton, FL: Chapman & Hall/CRC.
Peköz, E. and Röllin, A. (2011). New rates for exponential approximation and the theorems of Rényi and Yaglom. The Annals of Probability 39, 587-608. MR2789507.
Peköz, E., Röllin, A. and Ross, N. (2013). Degree asymptotics with rates for preferential attachment random graphs. The Annals of Applied Probability 23, 1188-1218. MR3076682.
Picket, A. (2004). Rates of convergence of χ2 approximations via Stein's method. Ph. D. thesis, Lincoln College, Univ. Oxford.
Reinert, G. (2004). Three general approaches to Stein's method. In An Introduction to Stein's Method. Lecture Notes Series, Institute for Mathematical Sciences, National Univ. Singapore 4. Singapore: World Scientific.
Röllin, A. (2012). On the optimality of Stein factors. In Probability Approximations and Beyond 61-72. New York: Springer.
Stein, C. (1970/1971). A bound for the error in the normal approximation to the distribution of a sum of dependent random variables. In Proceedings of the Sixth Berkeley Symposium on Mathematical Statistics and Probability, Vol. II: Probability Theory 583-602. Berkeley, CA: Univ. California, Berkeley. MR0402873.
Stein, C. (1986). Approximate Computation of Expectations. Institute of Mathematical Statistics Lecture Notes-Monograph Series 7. Hayward, CA: Institute of Mathematical Statistics. MR0882007.
Stein, C., Diaconis, P., Holmes, S. and Reinert, G. (2004). Use of exchangeable pairs in the analysis of simulations. In Stein's Method: Expository Lectures and Applications. IMS Lecture Notes Monogr. Ser. 46, 1-26. Beachwood, OH: Institute of Mathematical Statistics. MR2118600.
