Hostname: page-component-76fb5796d-qxdb6 Total loading time: 0 Render date: 2024-04-27T11:35:00.068Z Has data issue: false hasContentIssue false
  • English
  • Français

The Psychometric Properties of the Christian Nationalism Scale

Published online by Cambridge University Press:  11 July 2022

Nicholas T. Davis Open the ORCID record for Nicholas T. Davis [Opens in a new window]
Nicholas T. Davis*
Affiliation:
Department of Political Science, University of Alabama, Tuscaloosa, AL, USA
*
Corresponding author: Nicholas T. Davis, email: niickdavis@gmail.com, ntdavis2@ua.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

A growing body of research connects Christian nationalism—a preference for a religiously conservative political regime—to social and political beliefs. This paper raises questions about the validity of a popular scale used to measure those attitudes. I begin by exploring the factor structure of the six-item Christian nationalism index. I then show how semi-supervised machine learning can be used to illustrate classification problems within that scale. Finally, I demonstrate that this index performs poorly at the interval level, a combination of measurement error and the sorting out of religious and political preferences. These attitudes have become so bound up in conventional politics that they often exhibit a threshold rather than a linear relationship to political preferences. I conclude with an appeal for care in matching theory to empirics: Christian nationalism is a prominent political theology, but research must grapple with the limitations of prevailing measurement tools when operationalizing it.

Keywords

Christian nationalismreligious nationalismsortingconservatism
Type
Article
Information
Politics and Religion , Volume 16 , Issue 1 , March 2023 , pp. 1 - 26
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press on behalf of Religion and Politics Section of The American Political Science Association

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

A previous draft of this paper was titled ““Who” is a Christian nationalist? Investigating the psychometric properties of the Christian nationalism scale.” The author thanks Amanda Friesen, Ryan Burge, and Kevin Reuning for thoughtful conversations regarding the subject of this paper; the editor and two anonymous referees contributed very helpful feedback that made the paper much stronger. All remaining errors are, of course, the author's own.

References

Aho, J (2013) Christian Heroism and the Reconstruction of America. Critical Sociology 39(4), 545–560.CrossRefGoogle Scholar
Al-Kire, RL, MH, Pasek, J-A, Tsang, J, Leman and WC, Rowatt (2022) Protecting America's Borders: Christian Nationalism, Threat, and Attitudes Toward Immigrants in the United States. Group Processes & Intergroup Relations 25(2), 354–378.CrossRefGoogle Scholar
Baumgartner, JC, Francia, PL and Morris, JS (2008) A Clash of Civilizations? The Influence of Religion on Public Opinion of US Foreign Policy in the Middle East. Political Research Quarterly 61(2), 171–179.CrossRefGoogle Scholar
Brubaker, R (2011) Religion and Nationalism: Four Approaches. Nations and Nationalism 18(1), 2–20.CrossRefGoogle Scholar
Calfano, B and P, Djupe (2013) God Talk: Experimenting with the Religious Causes of Public Opinion. Philadelphia, PA: Temple University Press.Google Scholar
Cattell, R (1978 [2012]) The Scientific use of Factor Analysis in Behavioral and Life Sciences. New York, NY: Plenum Press.CrossRefGoogle Scholar
Converse, PE (2006) The Nature of Belief Systems in Mass Publics (1964). Critical Review 18(1–3), 1–74.CrossRefGoogle Scholar
Davis, NT (2018) Religion and Partisan-Ideological Sorting, 1984–2016. Social Science Quarterly 99(4), 1446–1466.CrossRefGoogle Scholar
Davis, NT and Federico, CM (2019) Constructing Images of the Divine: Latent Heterogeneity in Americans’ Impressions of God. Journal for the Scientific Study of Religion 58(1), 47–66.CrossRefGoogle Scholar
Davis, JT and Perry, SL (2021) White Christian Nationalism and Relative Political Tolerance for Racists. Social Problems 68(3), 513–534.CrossRefGoogle Scholar
Ellis, C and Stimson, JA (2012) Ideology in America. New York: Cambridge University Press.CrossRefGoogle Scholar
Fariss, CJ, Kenwick, MR and Reuning, K (2020) Measurement Models. In Curini L and Franzese Jr R (eds), The SAGE Handbook of Research Methods in Political Science and International Relations. Los Angeles, CA: Sage Press, pp. 353–370.CrossRefGoogle Scholar
Fea, J (2018) Believe Me: The Evangelical Road to Donald Trump. Grand Rapids, MI: Wm. B. Eerdmans Publishing.Google Scholar
Feldman, S and Johnston, CD (2014) Understanding the Determinants of Political Ideology: Implications of Structural Complexity. Political Psychology 35(3), 337–358.CrossRefGoogle Scholar
Froese, P and FC, Mencken (2009) A US Holy War? The Effects of Religion on Iraq War Policy Attitudes. Social Science Quarterly 90(1), 103–116.CrossRefGoogle Scholar
Furr, M (2011) Scale Construction and Psychometrics for Social and Personality Psychology. Thousand Oaks, CA: SAGE Publications.CrossRefGoogle Scholar
Gardner, PL (1995) Measuring Attitudes to Science: Unidimensionality and Internal Consistency Revisited. Research in Science Education 25(3), 283–289.CrossRefGoogle Scholar
Gorski, PS (2010) Civil Religion Today. State College, PA: Association of Religion Data Archives.Google Scholar
Gorski, PS (2020) American Babylon: Christianity and Democracy Before and After Trump. New York, NY: Routledge.CrossRefGoogle Scholar
Gorski, PS and Perry, SL (2022) The Flag and the Cross: White Christian Nationalism and the Threat to American Democracy. New York: Oxford University Press.CrossRefGoogle Scholar
Green, JC (2007) The Faith Factor: How Religion Influences American Elections. Westport, CT: Praeger.Google Scholar
Habel, P and Grant, JT (2013) Demand for God and Government: The Dynamics of Religion and Public Opinion. Politics and Religion 6(2), 282–302.CrossRefGoogle Scholar
Harder, J (2014) “Heal Their Land”: Evangelical Political Theology from the Great Awakening to the Moral Majority (Published dissertation). University of Nebraska–Lincoln. Available at http://digitalcommons.unl.edu/cgi/viewcontent.cgi?article=1067&context=historydiss.Google Scholar
Jelen, TG (1997) Culture Wars and the Party System: Religion and Realignment, 1972–1993. In Williams, RH (ed.), Cultural Wars in American Politics: Critical Reviews of a Popular Myth. New York: Aldine De Gruyter, pp. 145–158.Google Scholar
Johnston, CD and Ollerenshaw, T (2020) How Different are Cultural and Economic Ideology? Current Opinion in Behavioral Sciences 34, 94–101.CrossRefGoogle Scholar
Juergensmeyer, M (2011) The Global Rise of Religious Nationalism. In Hopkins, DN, Batsone, D, Lorentzen, LA and Mendieta, E (eds), Religions/Globalizations: Theories and Cases. London, UK: Duke University Press, pp. 66–83.Google Scholar
Kemp, S and Grace, RC (2021) Using Ordinal Scales in Psychology. Methods in Psychology 5, 1–6.CrossRefGoogle Scholar
Kinder, DR and Kalmoe, NP (2017) Neither Liberal, nor Conservative: Ideological Innocence in the American Public. Chicago, IL: The University of Chicago Press.Google Scholar
Kosek, J (ed.) (2017) American Religion, American Politics: An Anthology. New Haven, CT: Yale University Press.CrossRefGoogle Scholar
Lambert, F (2008) Religion and Politics: A Short History. Princeton, NJ: Princeton University Press.CrossRefGoogle Scholar
Layman, GC (1999) “Culture Wars” in the American Party System: Religious and Cultural Change among Partisan Activists Since 1972. American Politics Quarterly 27(1), 89–121.CrossRefGoogle Scholar
Layman, G (2001) The Great Divide: Religious and Cultural Conflict in American Party Politics. New York, NY: Columbia University Press.Google Scholar
Lewis, AR (2017) The Rights Turn in Conservative Christian Politics: How Abortion Transformed the Culture Wars. New York, NY: Cambridge University Press.CrossRefGoogle Scholar
Liebman, RC and Wuthnow, R (eds) (1983) The New Christian Right: Mobilization and Legitimation. Piscataway, NJ: Transaction Publishers.Google Scholar
Margolis, MF (2018) From Politics to the Pews: How Partisanship and the Political Environment Shape Religious Identity. Chicago, IL: University of Chicago Press.CrossRefGoogle Scholar
Mathew, NA (2018) Evangelizing Congress: The Emergence of Evangelical Republicans and Party Polarization in Congress. Legislative Studies Quarterly 43(3), 409–455.CrossRefGoogle Scholar
Mcdaniel, EL, Nooruddin, I and Shortle, AF (2011) Divine Boundaries: How Religion Shapes Citizens’ Attitudes Toward Immigrants. American Politics Research 39(1), 205–233.CrossRefGoogle Scholar
Muthén, BO (2002) Beyond SEM: General Latent Variable Modeling. Behaviormetrika 29(1), 81–117.CrossRefGoogle Scholar
Olson, LR, W, Cadge and JT, Harrison (2006) Religion and Public Opinion about Same-Sex Marriage. Social Science Quarterly 87(2), 340–360.CrossRefGoogle Scholar
Patrikios, S (2008) American Republican Religion? Disentangling the Causal Link Between Religion and Politics in the US. Political Behavior 30(3), 367–389.CrossRefGoogle Scholar
Perry, SL and Whitehead, AL (2015) Christian Nationalism and White Racial Boundaries: Examining Whites’ Opposition to Interracial Marriage. Ethnic and Racial Studies 38(10), 1671–1689.CrossRefGoogle Scholar
Perry, SL, Whitehead, AL and Davis, JT (2019) God's Country in Black and Blue: How Christian Nationalism Shapes Americans’ Views about Police (Mis) Treatment of Blacks. Sociology of Race and Ethnicity 5(1), 130–146.CrossRefGoogle Scholar
Perry, SL, Whitehead, AL and Grubbs, JB (2020) Culture Wars and COVID-19 Conduct: Christian Nationalism, Religiosity, and Americans’ Behavior During the Coronavirus Pandemic. Journal for the Scientific Study of Religion 59(3), 405–416.CrossRefGoogle Scholar
Pew Research Center (2021) In U.S., Far More Support Than Oppose Separation of Church and State. Available at https://www.pewresearch.org/religion/2021/10/28/in-u-s-far-more-support-than-oppose-separation-of-church-and-state/.Google Scholar
Smidt, C, L, Kellstedt and JL, Guth (eds) (2017) The Oxford Handbook of Religion and American Politics. New York, NY: Oxford University Press.Google Scholar
Tein, J-Y, Coxe, S and Cham, H (2013) Statistical Power to Detect the Correct Number of Classes in Latent Profile Analysis. Structural Equation Modeling: A Multidisciplinary Journal 20(4), 640–657.CrossRefGoogle ScholarPubMed
Thurstone, LL (1947) Multiple-Factor Analysis: A Development and Expansion of The Vectors of Mind. Chicago, IL: University of Chicago Press.Google Scholar
Wald, KD and Wilcox, C (2006) Getting Religion: Has Political Science Rediscovered the Faith Factor? American Political Science Review 100(4), 523–529.CrossRefGoogle Scholar
Weijters, B and Baumgartner, H (2012) Misresponse to Reversed and Negated Items in Surveys: A Review. Journal of Marketing Research 49(5), 737–747.CrossRefGoogle Scholar
Whitehead, AL and Perry, SL (2015) A More Perfect Union? Christian Nationalism and Support for Same-Sex Unions. Sociological Perspectives 58(3), 422–440.CrossRefGoogle Scholar
Whitehead, AL and Perry, SL (2020) Taking America Back for God: Christian Nationalism in the United States. New York, NY: Oxford University Press.CrossRefGoogle Scholar
Whitehead, AL, Perry, SL and Baker, JO (2018a) Make America Christian Again: Christian Nationalism and Voting for Donald Trump in the 2016 Presidential Election. Sociology of Religion 79(2), 147–171.CrossRefGoogle Scholar
Whitehead, AL, Schnabel, L and Perry, SL (2018b) Gun Control in the Crosshairs: Christian Nationalism and Opposition to Stricter Gun Laws. Socius 4, 1–13.CrossRefGoogle Scholar
Wuthnow, R (1995) Christianity in the Twenty-First Century: Reflections on the Challenges Ahead. New York, NY: Oxford University Press.CrossRefGoogle Scholar