Hostname: page-component-cd9895bd7-mkpzs Total loading time: 0 Render date: 2024-12-30T16:18:47.606Z Has data issue: false hasContentIssue false

Assessing the Validity of Enns and Koch's Measure of State Policy Mood

Published online by Cambridge University Press:  25 January 2021

William D. Berry*
Affiliation:
Florida State University, Tallahassee, FL, USA
Evan J. Ringquist
Affiliation:
Indiana University Bloomington, IN, USA The author Evan J. Ringquist is deceased
Richard C. Fording
Affiliation:
University of Alabama, Tuscaloosa, AL, USA
Russell L. Hanson
Affiliation:
Indiana University Bloomington, IN, USA
*
William D. Berry, Marian D. Irish Professor and Syde P. Deeb Eminent Scholar in Political Science, Department of Political Science, Florida State University, Bellamy Building, Tallahassee, FL 32306-2230, USA. Email: wberry@fsu.edu

Abstract

Enns and Koch (hereafter E&K) use multilevel regression and poststratification (MRP) along with survey aggregation to measure state policy mood. As E&K rely on direct information about public opinion, it would be preferable to Berry et al.‘s widely used indirect measure relying on data about the issue positions and vote shares of members of Congress, if E&K's measure were valid. Assessing the validity of E&K's measure takes on special importance because the measure proves to be nearly uncorrelated with Berry et al.‘s measure, implying that at least one is invalid. Because the “true” policy mood of states is unknown, it is impossible to definitively assess the validity of E&K's measure. Instead, we raise some concerns about E&K's measurement methodology and present evidence pertaining to the indicator's face validity, convergent validity, and construct validity. Our analyses leave us doubtful that the E&K measure is valid because its characterization of state moods departs significantly from conventional wisdom and current scholarship.

Type
Research Article
Copyright
Copyright © The Author(s) 2015

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Berry, William D., Fording, Richard C., and Hanson, Russell L.. 2003. “Reassessing the ‘Race to the Bottom’ in State Welfare Policy.” Journal of Politics 65:327–49.CrossRefGoogle Scholar
Berry, William D., Ringquist, Evan J., Fording, Richard C., and Hanson, Russell L.. 1998. “Measuring Citizen and Government Ideology in the American States, 1960–93.” American Journal of Political Science 42:327–48.CrossRefGoogle Scholar
Berry, William D., Ringquist, Evan J., Fording, Richard C., and Hanson, Russell L.. 2007. “The Measurement and Stability of Citizen Ideology.” State Policy & Politics Quarterly 7:111–32.Google Scholar
Besley, Timothy, and Case, Anne. 2003. “Political Institutions and Policy Choices: Evidence from the United States.” Journal of Economic Literature 41:773.CrossRefGoogle Scholar
Bureau of Justice Statistics. Prisoners in (YEAR), 1980, 1990, 2000, and 2008. Washington, D.C.: U.S. Department of Justice, Bureau of Justice Statistics.Google Scholar
Bureau of the U.S. Census. Annual Survey of State Government Tax Collections for (YEAR), 1980, 1990, 2000, and 2008). Washington, D.C.: U.S. Department of Commerce, Census Bureau.Google Scholar
Buttice, Matthew K., and Highton, Benjamin. 2013. “How Does Multilevel Regression and Poststratification Perform with Conventional National Surveys?Political Analysis 21:449–67.CrossRefGoogle Scholar
Carsey, Thomas M., and Harden, Jeffrey J.. 2010. “New Measures of Partisanship, Ideology and Policy Mood in the American States.” State Politics and Policy Quarterly 10:136–56.CrossRefGoogle Scholar
Caughey, Devin, and Warshaw, Christopher. 2014. “Dynamic Estimation of Subnational Opinion: A Group-Level IRT Approach.” Political Analysis (forthcoming).Google Scholar
Centers for Medicare and Medicaid Services. Medicare and Medicaid Statistical Supplements for (YEAR), 1980, 1990, 2000, and 2008. Washington, D.C.: U.S. Department of Health and Human Services, Health Care Financing Administration.Google Scholar
Ellis, Christopher R., Ura, Joseph D., and Robinson, Jenna A.. 2006. “The Dynamic Consequences of Nonvoting in American National Elections.” Political Research Quarterly 59:227–33.CrossRefGoogle Scholar
Enns, Peter K., and Koch, Julianna. 2013. “Public Opinion in the U.S. States: 1956-2010.” State Politics and Policy Quarterly 13:349–72.CrossRefGoogle Scholar
Erikson, Robert, Wright, Gerald C., and McIver, John P.. 1993. Statehouse Democracy: Public Opinion and Policy in the American States. New York: Cambridge University Press.Google Scholar
Fording, Richard C. 1997. “The Conditional Effect of Violence as a Political Tactic: Mass Insurgency, Electoral Context and Welfare Generosity in the American States.” American Journal of Political Science 41:129.CrossRefGoogle Scholar
Grogan, Colleen M. 1994. “Political-Economic Factors Influencing State Medicaid Policy.” Political Research Quarterly 47:589623.CrossRefGoogle Scholar
Hanson, Russell L. 1984. “Medicaid and the Politics of Redistribution.” American Journal of Political Science 28:313–39.CrossRefGoogle Scholar
Kellstedt, Paul. 2003. The Mass Media and the Dynamics of American Racial Attitudes. New York: Cambridge University Press.CrossRefGoogle Scholar
Krause, George A., and Melusky, Benjamin F.. 2012. “Concentrated Powers: Unilateral Executive Authority and Fiscal Policymaking in the American States.” Journal of Politics 74:98112.CrossRefGoogle Scholar
Lax, Jeffrey R., and Phillips, Justin H.. 2009. “How Should We Estimate Public Opinion in the States?American Journal of Political Science 53:107–21.CrossRefGoogle Scholar
Lax, Jeffrey R., and Phillips, Justin H.. 2013. “How Should We Estimate Sub-national Opinion Using MRP? Preliminary Findings and Recommendations.” Unpublished manuscript.Google Scholar
Page, Benjamin I., and Shapiro, Robert Y.. 1992. The Rational Public. Chicago: University of Chicago Press.CrossRefGoogle Scholar
Reingold, Beth, and Smith, Adrienne R.. 2012. “Welfare Policymaking and Intersections of Race, Ethnicity, and Gender in U.S. State Legislatures.” American Journal of Political Science 56:131–47.CrossRefGoogle ScholarPubMed
Smith, Kevin. 2004. “The Politics of Punishment: A Political Model of Punishment.” Journal of Politics 66:925–38.Google Scholar
Stimson, James A. 1999. Public Opinion in America: Moods, Cycles, and Swings. 2nd ed. Boulder: Westview Press.Google Scholar
Warshaw, Christopher, and Rodden, Jonathan. 2012. “How Should We Measure District-Level Public Opinion on Individual Issues?Journal of Politics 74:203–19.CrossRefGoogle Scholar
Yates, Jeff, and Fording, Richard C.. 2005. “Politics and State Punitiveness in Black and White.” Journal of Politics 67:1099–121.CrossRefGoogle Scholar