Skip to main content Accessibility help
×
Hostname: page-component-848d4c4894-sjtt6 Total loading time: 0 Render date: 2024-07-04T02:52:00.165Z Has data issue: false hasContentIssue false

Seven - The Cressie-Read Family of Divergence Measures and Empirical Maximum Likelihood Functions

from Part III - A Family of Minimum Discrepancy Estimators

Published online by Cambridge University Press:  05 June 2012

George G. Judge
Affiliation:
University of California, Berkeley
Ron C. Mittelhammer
Affiliation:
Washington State University
Get access

Summary

Introduction

Given Chapters 4 and 6, the reader may be expecting another empirical likelihood (EL)-like functional or divergence measure to be introduced in this chapter. However, we do even more. We provide an entire family of likelihood functionals-divergence measures that includes the maximum empirical likelihood (MEL) and maximum empirical exponential likelihood (MEEL) formulations discussed in Chapters 4 and 6.

We remind the reader that in Chapter 4 we started the pursuit of the solution to a stochastic inverse problem that was based on indirect noisy observations. In this context, we noted in Chapter 2 that when the functional form of the likelihood function is known, the maximum likelihood concept provides an appealing basis for estimation and inference. However, if sufficient information about the underlying data sampling process is not available to specify the functional form of the likelihood function, parametric maximum likelihood (ML) methods are fragile and lose their attractive optimal statistical characteristics. In econometrics, information about the underlying data sampling process is usually partial and incomplete. Consequently, estimation and inference over the past two decades has, as demonstrated in Chapter 3, proceeded under semiparametric formulations in the sense that the joint probability distribution of the data is unspecified, apart from a finite set of theoretical moment conditions or conditional moment restrictions.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Baggerly, K. A 1998 Empirical Likelihood as a Goodness of Fit MeasureBiometrika 85 535CrossRefGoogle Scholar
Baggerly, K. A 2001
Boltzmann, L 1872 Weitere Studien uber das Warmegleichgewicht unter GasmolekulenSitzungsberichte der keiserlichen Akademie der Wissenschaften 66 275Google Scholar
Boltzmann, L 2003 Further Studies on the Thermal Equilibrium of Gas MoleculesBrush, S. GHall, N. SKinetic Theory of Gases: An Anthology of Classic Papers with Historical Commentary362LondonImperial College PressCrossRefGoogle Scholar
Brown, BChen, S 1998 Combined Least Squares Empirical LikelihoodAnnals of Institute of Statistical Mathematics 60 697CrossRefGoogle Scholar
Corcoran, S. A 2000 Empirical Exponential Family Likelihood Using Several Moment ConditionsStatistica Sinica 10 545Google Scholar
Cotofrei, P 2003
Cressie, NRead, T 1984 Multinomial Goodness of Fit TestsJournal of Royal Statistical Society of Series B 46 440Google Scholar
Gibbs, J. W 1981 Elementary Principles in Statistical MechanicsNew YorkOx Bow PressGoogle Scholar
Godambe, V 1960 An Optimum Property of Regular Maximum Likelihood EstimationAnnals of Mathematical Statistics 31 1208CrossRefGoogle Scholar
Golan, AJudge, G. GMiller, D 1996 Maximum Entropy EconometricsNew YorkJohn Wiley and SonsGoogle Scholar
Gorban, AGorban, PJudge, G 2010 Entropy: The Markov Ordering ApproachEntropy 5 1145CrossRefGoogle Scholar
Grunwald, PDavid, A 2004 Game Theory, Maximum Entropy, Minimum Discrepancy and Robust Bayesian Decision TheoryAnnals of Statistics 32 1367Google Scholar
Hansen, L. P 1982 Large Sample Properties of Generalized Method of Moments EstimatorsEconometrica 50 1029CrossRefGoogle Scholar
Haubold, HMathai, ASaxena, R 2004 Boltzmann-Gibbs Entropy versus Tsallis EntropyAstrophysics and Space Sciences 290 241CrossRefGoogle Scholar
Heyde, C 1989 Quasi-Likelihood and Optimality of Estimating Functions: Some Current and Unifying ThemesBulletin of International Statistical Institute 1 19Google Scholar
Heyde, CMorton, R 1998 Multiple Roots in General Estimating EquationsBiometrika 85 954CrossRefGoogle Scholar
Huber, P. J 1981 Robust StatisticsNew YorkJohn Wiley and SonsCrossRefGoogle Scholar
Imbens, G. WSpady, R. HJohnson, P 1998 Information Theoretic Approaches to Inference in Moment Condition ModelsEconometrica 66 333CrossRefGoogle Scholar
Jaynes, E. T 1957 Information Theory and Statistical MechanicsPhysics Review 106 620CrossRefGoogle Scholar
Jaynes, E. T 1957 Information Theory and Statistical MechanicsPhysics Review 108 171CrossRefGoogle Scholar
Judge, GHill, RGriffiths, WLutkepohl, HLee, T 1985 The Theory and Practice of EconometricsNew YorkJohn Wiley and SonsGoogle Scholar
Koenker, RBassett, Jr G 1978 Regression QuantilesEconometrica 46 33CrossRefGoogle Scholar
Kullback, SLeibler, R. A 1951 On Information and SufficiencyAnnals of Mathematica Statistics 22 79CrossRefGoogle Scholar
Lindsay, BQu, A 2003 Inference Functions and Quadratic Score TestsStatistical Science 18 394Google Scholar
Mittelhammer, RJudge, G 2002 Endogeneity and Moment Based Estimation under Squared Error LossUllah, AWan, AChaturvedi, AHandbook of Applied Econometrics and Statistical InferenceNew YorkMarcel Dekker347Google Scholar
Mittelhammer, R. CJudge, G. G 2003 Some Empirical Evidence on EL-Weighted Combinations of Structural Equation EstimatorsJournal of Agricultural and Applied Economics 35 91Google Scholar
Mittelhammer, RJudge, G. GMiller, D 2000 Econometric FoundationsCambridgeCambridge University PressGoogle Scholar
Mittelhammer, RJudge, G. GSchoenberg, R 2004 Empirical Evidence Concerning the Finite Sample Performance of EL-Type Structural Equation Estimation and Inference MethodsFestschrift in Honor of Thomas RothenbergAndrews, D. KStock, J. HNew YorkCambridge University Press282Google Scholar
Newey, W. KSmith, R. G 2000
Osterreicher, F 2002 Csiszar's f-Divergencies-Basic PropertiesSalzburgInstitute of Mathematics, University of Salzburg, AustriaGoogle Scholar
Osterreicher, FVajda, I 2003 A New Class of Metric Divergences on Probability Spaces and Its Applicability in StatisticsAnnals of the Institute of Statistical Mathematics 55 639CrossRefGoogle Scholar
Owen, A 1988 Empirical Likelihood Ratio Confidence Intervals for a Single FunctionalBiometrika 75 237CrossRefGoogle Scholar
Owen, A 1991 Empirical Likelihood for Linear ModelsAnnals of Statistics 19 1725CrossRefGoogle Scholar
Owen, A 2001 Empirical LikelihoodNew YorkChapman and HallCrossRefGoogle Scholar
Qin, J 2000 Combining Parametric and Empirical Likelihood DataBiometrika 87 484CrossRefGoogle Scholar
Qin, JLawless, J 1994 Empirical Likelihood and General Estimating EquationsAnnals of Statistics 22 300CrossRefGoogle Scholar
Read, T. RCressie, N. A 1988 Goodness of Fit Statistics for Discrete Multivariate DataNew YorkSpringer VerlagCrossRefGoogle Scholar
Renyi, A 1961 1 561
Renyi, A 1970 Probability TheoryAmsterdam, The NetherlandsNorth-HollandGoogle Scholar
Shannon, C. E 1948 A Mathematical Theory of CommunicationBell System Technical Journal 27 379CrossRefGoogle Scholar
Topsoe, F 1979 Informational Theoretical Optimization TechniquesKybernetika 15 8Google Scholar
Tsallis, C 1988 Possible Generalization of Boltzmann-Gibbs StatisticsJournal of Statistical Physics 52 479CrossRefGoogle Scholar
Walley, P 1991 Statistical Reasoning with Imprecise ProbabilitiesLondonChapman and HallCrossRefGoogle Scholar
Wolpert, DWolf, D. R 1995 Estimating Functions of Probability Distributions from a Finite Set of DataPhysical Review E 6 6841CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×