Skip to main content Accessibility help
×
Home
Hostname: page-component-55b6f6c457-ln9sz Total loading time: 0.314 Render date: 2021-09-27T20:55:29.757Z Has data issue: true Feature Flags: { "shouldUseShareProductTool": true, "shouldUseHypothesis": true, "isUnsiloEnabled": true, "metricsAbstractViews": false, "figures": true, "newCiteModal": false, "newCitedByModal": true, "newEcommerce": true, "newUsageEvents": true }

Measuring the Rule of Law: A Comparison of Indicators

Published online by Cambridge University Press:  27 December 2018

Abstract

The rule of law era has given rise to multiple indicators purporting to measure the concept. This article compares four major indicators of the rule of law and shows that their approaches to conceptualization and measurement differ. Given their disparate conceptualizations and measurement strategies, one might expect a weak correlation between them. Strikingly, however, all four indicators are highly correlated with each other (with the pair-wise correlations between three of them exceeding 0.95). They are also correlated with the widely used measure of corruption. This suggests that the indicators might capture a more encompassing concept, like impartial administration. The article critiques the rule of law measurement enterprise as insufficiently linked to the underlying normative concept. It points to the reliance on expert perceptions and information constraints as a possible cause for the convergence. It concludes that measurement strategy, rather than differences in conceptualization, explains the convergence between the indicators.

Type
Articles
Copyright
Copyright © American Bar Foundation, 2017 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Arndt, Christiane, and Oman, Charles. 2006. The Uses and Abuses of Governance Indicators. Paris: OECD.Google Scholar
Bauer, Joanne, and Bell, Daniel. 1999. The East Asian Challenge for Human Rights. Cambridge: Cambridge University Press.Google Scholar
Berkowitz, Daniel, Pistor, Katarina, and Richard, Jean‐Francois. 2003. The Transplant Effect. American Journal of Comparative Law 51:163203.CrossRefGoogle Scholar
Brooks, Rosa. 2003. The New Imperialism: Violence, Norms, and the “Rule of Law.” Michigan Law Review 101 (7): 22752340.CrossRefGoogle Scholar
Casper, Gretchen, and Tufis, Claudiu D. 2003. Correlation Versus Interchangeability: The Limited Robustness of Empirical Findings on Democracy Using Highly Correlated Datasets. Political Analysis 11 (2): 196203.CrossRefGoogle Scholar
Chilton, Adam S. and Versteeg, Mila. 2015. The Failure of Constitutional Torture Prohibitions. Journal of Legal Studies 44 (2): 137.Google Scholar
Davis, Kevin E. 2004. What Can the Rule of Law Variable Tell Us About Rule of Law Reforms? Michigan Journal of International Law 26:141–61.Google Scholar
Davis, Kevin E. 2014. Legal Indicators: The Power of Quantitative Measures of Law. Annual Review of Law and Social Science 10:3752.CrossRefGoogle Scholar
Emmerson, Donald K. 1995. Singapore and the “Asian Values” Debate. Journal of Democracy 6 (4): 95105.CrossRefGoogle Scholar
Fariss, Christopher. 2014. Respect for Human Rights Has Improved Over Time: Modeling the Changing Standard of Accountability. American Political Science Review 108 (2): 297318.CrossRefGoogle Scholar
Fisman, Raymond, and Miguel, Edward. 2007. Corruption, Norms, and Legal Enforcement: Evidence from Diplomatic Parking Tickets. Journal of Political Economy 115 (6): 1020–48.CrossRefGoogle Scholar
Freedom House. 2014a. About Us. http://www.freedomhouse.org/about-us#.VBhuvlbXHG4 (accessed November 2014).Google Scholar
Freedom House. 2014b. Freedom in the World 2014: Methodology. http://www.freedomhouse.org/sites/default/files/Methodology%20FIW%202014.pdf (accessed November 2014).Google Scholar
Fuller, Lon. 1969. The Morality of Law. New Haven, CT: Yale University Press.Google Scholar
Gerring, John. 2001. Social Science Methodology: A Criterial Framework. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Ginsburg, Tom. 2011. Pitfalls of Measuring the Rule of Law. Hague Journal on the Rule of Law 3 (2): 269–80.CrossRefGoogle Scholar
Goertz, Gary. 2006. Social Science Concepts: A User's Guide. Princeton, NJ: Princeton University Press.Google Scholar
Gutmann, Jerg, and Voigt, Stefan. 2014. Mapping the Road to Freedom—The Correlates and Roots of the Rule of Law. Manuscript on file with authors.Google Scholar
Hadfield, Gillian, and Weingast, Barry. 2014. Microfoundations of the Rule of Law. Annual Review of Political Science 17:2142.CrossRefGoogle Scholar
Haggard, Stephan, MacIntyre, Andrew, and Tiede, Lydia. 2008. The Rule of Law and Economic Development. Annual Review of Political Science 29:205–34.Google Scholar
Haggard, Stephan, and Tiede, Lydia. 2011. The Rule of Law and Economic Growth: Where Are We? World Development 39 (5): 673–85.CrossRefGoogle Scholar
Hardin, Russell. 2013. Why a Constitution? In The Social and Political Foundations of Constitutions, ed. Galligan, Denis and Versteeg, Mila, 5172. New York: Cambridge University Press.CrossRefGoogle Scholar
Hayek, F. A. 1944. The Road to Serfdom. London: Routledge.Google Scholar
Hayek, F. A. 1960. The Constitution of Liberty. Chicago, IL: University of Chicago Press.Google Scholar
Heritage Foundation. 2014a. About Heritage. http://www.heritage.org/about (accessed November 2014).Google Scholar
Heritage Foundation. 2014b. Freedom from Corruption. http://www.heritage.org/index/freedom-from-corruption (accessed November 2014).Google Scholar
Heritage Foundation. 2014c. Property Rights. http://www.heritage.org/index/property-rights (accessed November 2014).Google Scholar
Jensenius, Francesca Refsum, and Wood, Abby. 2014. Caught in the Act But Not Punished: Why the Rule of Law Is Key to Effective Deterrence. Unpublished manuscript.Google Scholar
Joireman, Sandra F. 2004. Colonization and the Rule of Law: Comparing the Effectiveness of Common Law and Civil Law Countries. Constitutional Political Economy 15 (4): 315–38.CrossRefGoogle Scholar
Kaufmann, Daniel, Kraay, Aart, and Mastruzzi, Massimo. 2010. The Worldwide Governance Indicators: Methodology and Analytical Issues. World Bank Policy Research Working Paper No. 5430. Washington, DC: World Bank. http://info.worldbank.org/governance/wgi/pdf/WGI.pdf (accessed November 2014).Google Scholar
Kurtz, Marcus J., and Schrank, Andrew. 2007. Growth and Governance: Models, Measures, and Mechanisms. Journal of Politics 69 (2): 538–54.CrossRefGoogle Scholar
la Porta, Rafael, Lopez‐de‐Silanes, Florencio, Shleifer, Andrei, and Vishny, Robert W. 1998. Law and Finance. Journal of Political Economy 106 (6): 1113–55.CrossRefGoogle Scholar
Law, David S., and Versteeg, Mila. 2013. Sham Constitutions. California Law Review 101:863951.Google Scholar
Mahoney, Paul. 2001. The Common Law and Economic Growth: Hayek Might Be Right. Journal of Legal Studies 30 (2): 503–25.Google Scholar
Malik, Adeel. 2002. State of the Art in Governance Indicators. In Human Development Occasional Papers (1992–2007) New York: UN Development Programme.Google Scholar
Marshall, Monty G., Gurr, Ted Robert, and Jaggers, Keith. 2014. Political Regime Characteristics and Transitions, 18002013: Dataset Users' Manual. Polity IV Project. http://www.systemicpeace.org/inscr/p4manualv2013.pdf (accessed November 2014).Google Scholar
Merry, Sally. 2011. Measuring the World: Indicators, Human Rights, and Global Governance. Current Anthropology 52 (S3): S83S95.CrossRefGoogle Scholar
Merry, Sally. Forthcoming. The Seductions of Quantification: Global Governance and Indicators of Human Rights, Violence Against Women, and Sex Trafficking. Chicago, IL: University of Chicago Press.CrossRefGoogle Scholar
M⊘ller, J⊘rgen, and Skaaning, Svend‐Erik. 2011. On the Limited Interchangeability of Rule of Law Measures. European Political Science Review 3 (3): 371–94.Google Scholar
M⊘ller, J⊘rgen, and Skaaning, Svend‐Erik. 2014. The Rule of Law: Definitions, Measures, Patterns and Causes. Basingstoke, UK: Palgrave.CrossRefGoogle Scholar
Nardulli, Peter F., Peyton, Buddy, and Bajjalieh, Joseph. 2013. Conceptualizing and Measuring Rule of Law Constructs, 1850–2010. Journal of Law and Courts 1:139–92CrossRefGoogle Scholar
Priest, George L., and Klein, Benjamin. 1984. The Selection of Disputes for Litigation. Journal of Legal Studies 13 (1): 155.CrossRefGoogle Scholar
Rajah, Jothie. 2015. Rule of Law as a Transnational Legal Order. In Transnational Legal Orders, ed. Halliday, Terrence and Shaffer, Gregory, 340–73. New York: Cambridge University Press.Google Scholar
Raz, Joseph. 1979. The Rule of Law and Its Virtue. In The Authority of Law: Essays on Law and Morality, ed. Raz, Joseph, 211–29. Oxford: Oxford University Press.CrossRefGoogle Scholar
Rodriguez, Daniel, McCubbins, Mathew, and Weingast, Barry. 2010. The Rule of Law Unplugged. Emory Law Journal 59:1455–94.Google Scholar
Rothstein, Bo. 2011. The Quality of Government: Corruption, Social Trust, and Inequality in International Perspective. Chicago, IL: University of Chicago Press.CrossRefGoogle Scholar
Rothstein, Bo. 2014. What Is the Opposite of Corruption? Third World Quarterly 35 (5): 737–52.CrossRefGoogle Scholar
Skaaning, Svend‐Erik. 2010. Measuring the Rule of Law. Political Research Quarterly 63 (2): 449–60.CrossRefGoogle Scholar
Tamanaha, Brian. 2004. On the Rule of Law: History, Politics, Theory. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Tamanaha, Brian. 2008. The Dark Side of the Relationship Between Rule of Law and Liberalism. NYU Journal of Law and Liberty 33:516–47.Google Scholar
Tamanaha, Brian. 2011. The Primacy of Society and the Failures of Law and Development. Cornell International Law Journal 44:209–47.Google Scholar
Teorell, Jan, Dahlström, Carl, and Dahlberg, Stefan. 2011. The QoG Expert Survey Dataset. Gothenburg: University of Gothenburg, Quality of Government Institute.Google Scholar
Thomas, Melissa. 2010. What Do the Worldwide Governance Indicators Measure? European Journal of Development Research 22 (1): 3154.CrossRefGoogle Scholar
Transparency International. 2013a. Corruption Perceptions Index 2013: Full Source Descriptions. http://www.transparency.org/files/content/pressrelease/2013_CPISourceDescription_EN.pdf (accessed November 2014).Google Scholar
Transparency International. 2013b. Corruption Perceptions Index 2013: In Detail. http://cpi.transparency.org/cpi2013/in_detail/#myAnchor1 (accessed November 2014).Google Scholar
Weingast, Barry. 1997. The Political Foundations of Democracy and the Rule of Law. American Political Science Review 91 (2): 245–63.CrossRefGoogle Scholar
World Bank. 2014. Worldwide Governance Indicators. http://info.worldbank.org/governance/wgi/index.aspx#doc-methodology (accessed November 2014).Google Scholar
World Justice Project (WJP). 2014. The World Justice Project Rule of Law Index 2014. http://worldjusticeproject.org/sites/default/files/files/wjp_rule_of_law_index_2014_report.pdf (accessed November 2014).Google Scholar
Jacobellis v. Ohio, 378 U.S. 184 (1964).Google Scholar
22
Cited by

Send article to Kindle

To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Measuring the Rule of Law: A Comparison of Indicators
Available formats
×

Send article to Dropbox

To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

Measuring the Rule of Law: A Comparison of Indicators
Available formats
×

Send article to Google Drive

To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

Measuring the Rule of Law: A Comparison of Indicators
Available formats
×
×

Reply to: Submit a response

Please enter your response.

Your details

Please enter a valid email address.

Conflicting interests

Do you have any conflicting interests? *