Skip to main content Accessibility help

On the limited interchangeability of rule of law measures

  • Jørgen Møller (a1) and Svend-Erik Skaaning (a1)


During the latest decade, empirical research on the causes and consequences of the rule of law has expanded and, in the process, become extremely influential. However, we show that a number of widely used indices of the rule of law are not interchangeable. This lack of interchangeability is reflected in the fact that they are based on different defining attributes, to some extent cover distinct empirical scopes, do not correlate highly with each other, and support different explanatory factors. Until a consensus has been established with respect to the conceptualization of the rule of law, scholars are thus not free to opt for the measure that fits their data requirements best regarding spatial and/or temporal scope. Instead, they must carefully assess the content validity vis-à-vis their stipulated definition of the rule of law. Given the amount of money and time poured into the rule of law agenda, the problems identified reflect the lack of maturity of ‘good governance’ research.


Corresponding author


Hide All
Adcock, R. Collier, D. (2001), ‘Measurement validity: a shared standard for qualitative and quantitative research’, American Political Science Review 95: 529546.
Alesina, A., Devleeschauwer, A., Easterly, W., Kurlat, S. Wacziarg, R. (2003), ‘Fractionalization’, Journal of Economic Growth 8: 155194.
Ali, A.M. (2003), ‘Institutional differences as sources of growth differences’, Atlantic Economic Journal 31: 348362.
Alvarez, M., Cheibub, J.A., Limongi, F. Przeworski, A. (1996), ‘Classifying political regime types’, Studies in Comparative International Development 31: 336.
Andrews, J.T. Montinola, G.R. (2004), ‘Veto players and the rule of law in emerging democracies’, Comparative Political Studies 37: 5587.
Arndt, C. Oman, C. (2006), The Uses and Abuses of Governance Indicators, OECD: OECD Publishing.
Ashby, N.J. Sobel, R.S. (2008), ‘Income inequality and economic freedom in the U.S. States’, Public Choice 134: 329346.
Barahona, D. (2007), ‘The freedom house files’. Monthly Review, March.
Barro, R. (2000), ‘Rule of law, democracy, and economic performance’, in O'Driscoll G.P. Jr., Holmes K.R. and Kirkpatrick M. (eds), 2000 Index of Economic Freedom, Washington and New York: Heritage Foundation and Wall Street Journal, pp. 3149.
Belton, R.K. (2005), ‘Competing definitions of the rule of law’, Carnegie Endowment. Carnegie Paper no. 55.
Bertelsmann Transformation Index (2006), ‘Bertelsmann Transformation Index’. Retrieved 15 March 2008 from
Bleaney, M., Dimico, A. (2008), ‘Biogeographical conditions, the transition to agriculture and long-run growth’. CREDIT Research Paper no. 08/15.
Bolaky, B., Freund, C. (2006). ‘Trade, regulations, and growth’. Paper presented at the IMF Trade and Growth Conference, January 9, 2006, Washington, DC.
Bollen, K.A. (1992), ‘Political rights and political liberties’, in T.B. Jabine and R.P. Claude (eds), Human Rights and Statistics: Getting the Record Straight, Philadelphia: University of Pennsylvania Press,, pp. 188213.
Bollen, K. Paxton, P. (2000), ‘Subjective measures of liberal democracy’, Comparative Political Studies 31: 5886.
Burnside, C., Dollar, D. (2004), ‘Aid, policies, and growth’. World Bank Policy Research Working Paper no. 3251.
Butkiewicz, J.L. Yanikkaya, H. (2006), ‘Institutional quality and economic growth’, Economic Modelling 23: 648661.
Card, D., Freeman, R. (2002), ‘What have two decades of British economic reform delivered?’. Retrieved 7 September 2010 from
Casper, G. Tufis, C. (2003), ‘Correlation versus interchangeability: the limited robustness of empirical findings on democracy using highly correlated data sets’, Political Analysis 11: 196203.
Chomsky, N. Herman, E.S. (1988), Manufacturing Consent. New York, Scottsville: Pantheon Books.
Coppedge, M. Reinicke, W. (1990), ‘Measuring polyarchy’, Studies in Comparative International Development 25: 5172.
Dahl, R.A. (1971), Polyarchy: Participation and Opposition, New Haven: Yale University Press.
Doornbos, M. (2003), ‘ “Good governance”: the metamorphosis of a policy metaphor’, Journal of International Affairs 57: 317.
Eisenberg, M.A. (1988), The Nature of the Common Law, Cambridge: Harvard University Press.
Fish, M.S. (2002), ‘Islam and authoritarianism’, World Politics 55: 437.
Forewaker, J. Krznaric, R. (2001), ‘How to construct a database of liberal democratic performance’, Democratization 8: 125.
Fraser Institute (2009), ‘Economic freedom of the world’. Retrieved 15 November 2009 from
Freedom House (2006), ‘Freedom in the world’. Retrieved 15 March 2008 from
Gerring, J. (1999), ‘What makes a concept good?’, Polity 31: 357393.
Giannone, D. (2010), ‘Political and ideological aspects of the measurement of democracy’, Democratization 17: 6897.
Goertz, G. (2005), Social Science Concepts: A Users’ Guide, Princeton: Princeton University Press.
Hadenius, A., Teorell, J. (2005). ‘Assessing alternative indices of democracy’. IPSA Concepts & Methods Working Papers 6.
Hansson, G., Olsson, O. (2006), ‘Country size and the rule of law’. Working Paper 200, School of Economics: University of Gothenburg.
Hawken, A., Munck, G.L. (2009), ‘Do you know your data? Measurement validity in corruption research’, Manuscript.
Hayek, F.A. (1973), Law, Legislation and Liberty, Chicago: University of Chicago Press.
Hayo, B., Voigt, S. (2005), ‘Explaining de facto judicial independence’. Marburg Working Papers on Economics 200507, Philipps-Universität Marburg: Department of Economics.
Heritage Foundation (2009), ‘Index of economic freedom’. Retrieved 15 November 2009 from
Hoff, K. Stiglitz, J. (2004), ‘After the big bang? Obstacles to the emergence of rule of law in post-communist societies’, American Economic Review 94: 753763.
IMF (2007), ‘Guide on resource transparency’. Retrieved 15 March 2008 from
Joireman, S.F. (2001), ‘Inherited legal systems and effective rule of law’, Journal of Modern African Studies 39: 571596.
Joireman, S.F. (2004), ‘Colonization and the rule of law’, Constitutional Political Economy 15: 315338.
Kaufman, D., Kray, A., Mastruzzi, M. (2007), ‘Governance matters VI: governance indicators for 1996–2006’. Retrieved 15 March 2008 from
Knack, S. (1996), ‘Institutions and the convergence hypothesis’, Public Choice 87: 207228.
Knack, S. (2002), ‘Governance and growth’. The IRIS Discussion Papers on Institutions & Development no. 2/05.
Koelble, T.A. Lipuma, E. (2008), ‘Democratizing democracy’, Democratization 15: 128.
La Porta, R., Lopez-de-Silanes, F., Shleifer, A. Vishny, R. (1999), ‘The quality of government’, Journal of Law, Economics, and Organization 15: 222279.
Mo Ibrahim Foundation (2010), ‘The Ibrahim Index of African Governance’. Retrieved 7 September 2010 from
Møller, J., Skaaning, S.-E. (2010), ‘Systematizing thin and thick conceptions of the rule of law’. Paper presented at the APSA 2010 Annual Meeting Paper. from SSRN:
Moore, D. (ed.) (2007), The World Bank. KwaZulu-Natal University Press.
Mudde, C. Schedler, A. (2010), ‘Introduction: rational data choice’, Political Research Quarterly 63: 410416.
Munck, G.L. (2003), ‘Measures of democracy, governance and rule of law’. Paper prepared for the World Bank Workshop on Understanding Growth and Freedom from the Bottom Up, July 15–17, Washington, DC.
Munck, G. (2009), Measuring Democracy, Baltimore: The Johns Hopkins University Press.
Munck, G. (2010), ‘Comparative politics: taking stock and looking forward’. Paper prepared for presentation at the 2010 APSA Annual Meeting, September 2–5, Washington, D.C.
Munck, G.L. Verkuilen, J. (2002), ‘Conceptualizing and measuring democracy’, Comparative Political Studies 35: 534.
Nanda, P. (2006), ‘The “Good Governance” concept revisited’, The ANNALS of the American Academy of Political Science 603: 269283.
Norton, S.W. (1998), ‘Poverty, property rights, and human well-being’, Cato Journal 18: 233245.
Penn World Tables (2007), ‘PWT 6.2’. Retrieved 15 March 2008 from
Political Risk Services (2007), ‘ICRG’. Retrieved 15 March 2008 from
Ríos-Figueroa, J., Staton, J. (2008), ‘Unpacking the rule of law’. Committee of Concepts and Methods Working Paper no. 21.
Sandholz, W. Taagepera, R. (2005), ‘Coruption, culture, and communism’, International Review of Sociology 15: 109131.
Skaaning, S.-E. (2010), ‘Measuring the rule of law’, Political Research Quarterly 63: 449460.
Sunde, U., Cervallati, M. Fortunato, P. (2008), ‘Are all democracies equally good?’, Economic Letters 99(3): 552556.
Tamanaha, B. (2004), On the Rule of Law, Cambridge: Cambridge University Press.
The Economist (2008), Economics and the Rule of Law. March 13.
Thomas, M. (2007), ‘What do the worldwide governance indicators measure?’. Retrieved 1 May 2009 from
Uvin, P. (2002), ‘On high moral grounds: the incorporation of human rights by the development enterprise’, PRAXIS 17: 111.
Weingast, B.R. (1997), ‘The political foundations of democracy and the rule of law’, American Political Science Review 91: 245263.
Williams, A. Siddique, A. (2008), ‘The use (and Abuse) of governance indicators in economics’, Economics of Governance 9: 131175.
World Bank (2008), ‘World Development Indicators’. Retrieved 15 March 2008 from
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

European Political Science Review
  • ISSN: 1755-7739
  • EISSN: 1755-7747
  • URL: /core/journals/european-political-science-review
Please enter your name
Please enter a valid email address
Who would you like to send this to? *



Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed