Hostname: page-component-8448b6f56d-42gr6 Total loading time: 0 Render date: 2024-04-24T15:45:08.522Z Has data issue: false hasContentIssue false
  • English
  • Français

Does the Choice of Democracy Measure Matter? Comparisons between the Two Leading Democracy Indices, Freedom House and Polity IV

Published online by Cambridge University Press:  02 January 2013

John Högström
Get access Rights & Permissions [Opens in a new window]

Abstract

This article investigates whether two different measures of democracy generate the same empirical results. The Freedom House and Polity IV measures are used as the dependent variables. The result shows that statistical significance and explanatory power for different independent variables differ greatly, depending on which democracy index is used as the dependent variable. The results also indicate that Freedom House and Polity IV rate many countries’ levels of democracy differently. It is worrying and problematic for comparative studies of democracy that empirical results differ so much according to which measure of democracy is used.

Type
Articles
Information
Government and Opposition , Volume 48 , Issue 2 , April 2013 , pp. 201 - 221
Copyright
Copyright © Government and Opposition Ltd 2012

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

John Högström is a doctoral student in political science at Mid Sweden University, Östersund, Sweden. Contact email: john.hogstrom@miun.se.

References

Sources For The Dependent Variable And The Independent Variables

Area: Central Intelligence Agency, ‘The World Factbook’, www.cia.gov/library/publications/the-world-factbook.Google Scholar
Enrolment ratio in education: UNDP, International Human Development indicators; currently unavailable on the internet, but available from the author on request.Google Scholar
Freedom House: Freedom House, ‘Freedom in the World 2010’, www.freedomhouse.org/report/freedom-world/freedom-world-2010.Google Scholar
GDP/capita: United Nations Statistics Division, National Accounts Main Aggregates Database, http://unstats.un.org/unsd/snaama/selbasicFast.asp.Google Scholar
Polity IV: Polity IV, ‘Polity IV Project: Political Regime Characteristics and Transitions, 1800–2010’, www.systemicpeace.org/polity/polity4.htm.Google Scholar
Population: United States Census Bureau International Program, International Data Base (IDB), www.census.gov/ipc/www/idb/ranks.php.Google Scholar

References

Alvarez, M., Cheibub, J.A., Limongi, F.Przeworski, A. (1996), ‘Classifying Political Regimes’, Studies in Comparative International Development, 31(2): 3–36.Google Scholar
Anckar, C. (2008), ‘Size, Islandness, and Democracy: A Global Comparison’, International Political Science Review, 29(4): 433–459.CrossRefGoogle Scholar
Anckar, D. (2004), ‘Direct Democracy in Microstates and Small Island States’, World Development, 32(2): 379–390.Google Scholar
Anckar, D. (2010), ‘Small Is Democratic, but who Is Small?’, Arts and Social Sciences Journal, ASSJ-2, http://astonjournals.com/manuscripts/Vol2010/ASSJ-2_Vol2010.pdf.Google Scholar
Anckar, D.Anckar, C. (1995), ‘Size, Insularity and Democracy’, Scandinavian Political Studies, 18(4): 211–229.Google Scholar
Arat, Z.F. (1988), ‘Democracy and Economic Development: Modernization Theory Revisited’, Comparative Politics, 21(1): 21–36.Google Scholar
Arat, Z.F. (1991), Democracy and Human Rights in Developing Countries (Boulder, CO, and London: Lynne Rienner Publishers).Google Scholar
Barro, R.J. (1999), ‘Determinants of Democracy’, Journal of Political Economy, 107(6): 158–183.Google Scholar
Bollen, K.A. (1979), ‘Political Democracy and the Timing of Development’, American Sociological Review, 44(4): 572–587.Google Scholar
Bollen, K.A. (1980), ‘Issues in the Comparative Measurement of Political Democracy’, American Sociological Review, 45(3): 370–390.CrossRefGoogle Scholar
Bollen, K.A. (1990), ‘Political Democracy: Conceptual and Measurement Traps’, Studies in Comparative International Development, 25(1): 7–24.Google Scholar
Cheibub, J.A., Gandhi, J.Vreeland, J.R. (2010), ‘Democracy and Dictatorship Revisited’, Public Choice, 143(1–2): 67–101.CrossRefGoogle Scholar
Collier, D.Adcock, R. (1999), ‘Democracy and Dichotomies: A Pragmatic Approach to Choices about Concepts’, Annual Review of Political Science, 2: 537–565.Google Scholar
Coppedge, M.Reinicke, W.H. (1990), ‘Measuring Polyarchy’, Studies in Comparative International Development, 25(1): 51–72.Google Scholar
Cutright, P. (1963), ‘National Political Development: Measurement and Analysis’, American Sociological Review, 28(2): 253–264.Google Scholar
Dahl, R.A. (1971), Polyarchy (New Haven, CT, and London: Yale University Press).Google Scholar
Dahl, R.A.Tufte, E.R. (1973), Size and Democracy (Stanford, CA: Stanford University Press).Google Scholar
Diamond, L. (1999), Developing Democracy: Toward Consolidation (Baltimore, MD, and London: Johns Hopkins University Press).Google Scholar
EIU (Economist Intelligence Unit) (2010), ‘Democracy Index 2010: Democracy in Retreat’, http://graphics.eiu.com/PDF/Democracy_Index_2010_web.pdf.Google Scholar
Elkins, Z. (2000), ‘Gradations of Democracy? Empirical Tests of Alternative Conceptualizations’, American Journal of Political Science, 44(2): 293–300.Google Scholar
Epstein, D.L., Bates, R., Goldstone, J., Kristensen, I.O'Halloran, S. (2006), ‘Democratic Transitions’, American Journal of Political Science, 50(3): 551–569.Google Scholar
Freedom House (2010a), ‘Freedom in the World 2010’, www.freedomhouse.org/report/freedom-world/freedom-world-2010.Google Scholar
Freedom House (2010b), ‘Checklist Questions and Guidelines’, www.freedomhouse.org/report/freedom-world-2010/checklist-questions-and-guidelines.Google Scholar
Hadenius, A. (1992), Democracy and Development (Cambridge: Cambridge University Press).Google Scholar
Hadenius, A. (1994), ‘The Duration of Democracy: Institutional vs Socio-economic Factors’, in D. Beetham (ed.), Defining and Measuring Democracy (London, Thousand Oaks, CA, and New Delhi: Sage): 63–88.Google Scholar
Hadenius, A.Teorell, J. (2005), Assessing Alternative Indices of Democracy, Concepts and Methods Working Papers 6 (IPSA).Google Scholar
Huntington, S.P. (1991), The Third Wave: Democratization in the Late Twentieth Century (Norman, OK, and London: University of Oklahoma Press).Google Scholar
Jackman, R.W. (1973), ‘On the Relation of Economic Development to Democratic Performance’, American Journal of Political Science, 17(3): 611–621.CrossRefGoogle Scholar
Lipset, S.M. (1959), ‘Some Social Requisites of Democracy: Economic Development and Political Legitimacy’, American Political Science Review, 53(1): 69–105.CrossRefGoogle Scholar
Munck, G.L.Verkuilen, J. (2002), ‘Conceptualizing and Measuring Democracy: Evaluating Alternative Indices’, Comparative Politics Studies, 35(1): 5–34.Google Scholar
Neubauer, D.E. (1967), ‘Some Conditions of Democracy’, American Political Science Review, 61(4): 1002–1009.Google Scholar
Pemstein, D., Meserve, S.A.Melton, J. (2010), ‘Democratic Compromise: A Latent Variable Analysis of Ten Measures of Regime Type’, Political Analysis, 18: 426–449.Google Scholar
Polity IV (2009), ‘Polity IV Project: Dataset Users’ Manual’, www.systemicpeace.org/inscr/p4manualv2009.pdf.Google Scholar
Polity IV (2011), ‘Polity IV Project: Political Regime Characteristics and Transitions, 1800–2010’, www.systemicpeace.org/polity/polity4.htm.Google Scholar
Przeworski, A., Alvarez, M., Cheibub, J.A.Limongi, F. (1996), ‘What Makes Democracies Endure?’, Journal of Democracy, 7(1): 39–55.Google Scholar
Przeworski, A.Alvarez, M.Cheibub, J.A.Limongi, F. (2000), Democracy and Development: Political Institutions and Well-being in the World, 1950–1990 (Cambridge: Cambridge University Press).Google Scholar
Sartori, G. (1987), The Theory of Democracy Revisited. Part 1: The Contemporary Debate (Chatham, NJ: Chatham House).Google Scholar
Saward, M. (1994), ‘Democratic Theory and Indices of Democratization’, in D. Beetham (ed.), Defining and Measuring Democracy (London, Thousand Oaks, CA, and New Delhi: Sage): 6–24.Google Scholar
Schumpeter, J.A. (1992), Capitalism, Socialism and Democracy (London and New York: Routledge; first published 1942).Google Scholar
Teorell, J. (2010), Determinants of Democratization: Explaining Regime Change in the World, 1972–2006 (Cambridge: Cambridge University Press).Google Scholar
Treier, S.Jackman, S. (2008), ‘Democracy as a Latent Variable’, American Journal of Political Science, 52(1): 201–217.Google Scholar
Vanhanen, T. (1990), The Process of Democratization: A Comparative Study of 147 States, 1980–88 (New York: Crane Russak).Google Scholar
Vanhanen, T. (1997), Prospects of Democracy: A Study of 172 Countries (London and New York: Routledge).Google Scholar
Vanhanen, T. (2000), ‘A New Dataset for Measuring Democracy, 1810–1998’, Journal of Peace Research, 37(2): 251–265.Google Scholar
Vanhanen, T. (2003), Democratization: A Comparative Analysis of 170 Countries (London and New York: Routledge).Google Scholar