Hostname: page-component-848d4c4894-tn8tq Total loading time: 0 Render date: 2024-06-21T05:57:46.807Z Has data issue: false hasContentIssue false
  • English
  • Français

Evidential Variety and Mixed-Methods Research in Social Science

Published online by Cambridge University Press:  16 February 2023

Jaakko Kuorikoski Open the ORCID record for Jaakko Kuorikoski [Opens in a new window]  and
Caterina Marchionni Open the ORCID record for Caterina Marchionni [Opens in a new window]
Jaakko Kuorikoski*
Affiliation:
Practical Philosophy, Faculty of Social Science, University of Helsinki, Helsinki, Finland
Caterina Marchionni
Affiliation:
Practical Philosophy, Faculty of Social Science, University of Helsinki, Helsinki, Finland
*
Corresponding author: Jaakko Kuorikoski; Email: jaakko.kuorikoski@helsinki.fi
Get access Rights & Permissions [Opens in a new window]

Abstract

Mixed-methods research (MMR)—the combination of qualitative and quantitative data within the same design to strengthen causal inference—is gaining prominence in the social sciences but its benefits are contested. There remains confusion over which methods to mix and what is the point of mixing them. We argue that variety of evidence is what matters, not of data or methods, and that distinct epistemic principles underlie its added value for causal inference. The centrality of evidential variety also implies that strong causal pluralism is untenable as a foundation for MMR.

Type
Contributed Paper
Information
Philosophy of Science , Volume 90 , Issue 5 , December 2023 , pp. 1449 - 1458
Copyright
© The Author(s), 2023. Published by Cambridge University Press on behalf of the Philosophy of Science Association

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Achinstein, Peter. 2001. The Book of Evidence. New York: Oxford University Press.Google Scholar
Ahmed, Amel, and Sil, Rudra. 2012. “When Multi-Method Research Subverts Methodological Pluralism—Or, Why We Still Need Single-Method Research.” Perspectives on Politics 10 (4):935–53.10.1017/S1537592712002836CrossRefGoogle Scholar
Beach, Derek. 2020. “Multi-Method Research in the Social Sciences: A Review of Recent Frameworks and a Way Forward.” Government and Opposition 55 (1):163–82.Google Scholar
Beach, Derek, and Kaas, Jonas. 2020. “The Great Divides: Incommensurability, the Impossibility of Mixed-Methodology, and What to Do about It.” International Studies Review 22 (2):214–35.Google Scholar
Bogen, Jim, and Woodward, James. 1988. “Saving the Phenomena.” The Philosophical Review 97 (3):303–52.Google Scholar
Cartwright, Nancy. 2007. Hunting Causes and Using Them: Approaches in Philosophy and Economics. New York: Cambridge University Press.Google Scholar
Cartwright, Nancy. 2013. “Evidence, Argument and Prediction.” In EPSA11 Perspectives and Foundational Problems in Philosophy of Science, edited by Vasillios Karakostas and Dennis Dieks, 3–17. Cham: Springer.Google Scholar
Cartwright, Nancy. 2021. “Rigour Versus the Need for Evidential Diversity.” Synthese 199 (5):13095–119.Google Scholar
Claveau, Francois. 2013. “The Independence Condition in the Variety-of-Evidence Thesis.” Philosophy of Science 80 (1):94–118.Google Scholar
Claveau, Francois, and Grenier, Olivier. 2019. “The Variety-of-Evidence Thesis: A Bayesian Exploration of its Surprising Failures.” Synthese 196 (8):3001–28.Google Scholar
Coppedge, Michael. 2005. “Explaining Democratic Deterioration in Venezuela through Nested Induction.” In The Third Wave of Democratization in Latin America, edited by Frances Hagopian and Scott Mainwaring, 289–316. Cambridge and New York: Cambridge University Press.Google Scholar
Crasnow, Sharon. 2010. “Evidence for Use: Causal Pluralism and the Role of Case Studies in Political Science Research.” Philosophy of the Social Sciences 41 (1):26–49.Google Scholar
Fitelson, Brandon. 2001. “A Bayesian Account of Independent Evidence with Applications.” Philosophy of Science 68 (S3):S123–S140.Google Scholar
Heesen, Remco, Bright, Liam, and Zucker, Andrew. 2019. “Vindicating Methodological Triangulation.” Synthese 196 (8):3067–81.Google Scholar
Humphreys, Macartan, and Jacobs, Alan. 2015. “Mixing Methods: A Bayesian Approach.” The American Political Science Review 109 (4):653–73.Google Scholar
Illari, Phyllis. 2011. Mechanistic evidence: disambiguating the Russo–Williamson thesis. International Studies in the Philosophy of Science, 25(2), 139–157.Google Scholar
Illari, Phyllis, and Russo, Federica. 2014. Causality: Philosophical Theory Meets Scientific Practice. Oxford: Oxford University Press.Google Scholar
Johnson, R. Burke, Onwuegbuzie, Anthony, and Turner, Lisa. 2007. “Toward a Definition of Mixed Methods Research.” Journal of Mixed Methods Research 1 (2):112–33.Google Scholar
Johnson, R. Burke, Russo, Federica, and Schoonenboom, Judith. 2019. “Causation in Mixed Methods Research: The Meeting of Philosophy, Science, and Practice.” Journal of Mixed Methods Research 13 (2):143–62.10.1177/1558689817719610CrossRefGoogle Scholar
Kuorikoski, Jaakko, and Marchionni, Caterina. 2016. “Evidential Diversity and the Triangulation of Phenomena.” Philosophy of Science 83 (2):227–47.10.1086/684960CrossRefGoogle Scholar
Kuorikoski, Jaakko, and Marchionni, Caterina. 2022. “Mixed Method Research and Variety of Evidence in Political Science.” in Oxford Handbook of Philosophy of Political Science, edited by Harold Kincaid and Jeroen van Bouwel, 266–280. New York: Oxford University Press.Google Scholar
Leonelli, Sabina. 2015. “What Counts as Scientific Data? A Relational Framework.” Philosophy of Science 82 (S5):S810–S821.Google Scholar
Lieberman, Evan, 2005. “Nested Analysis as a Mixed-Method Strategy for Comparative Research.” American Political Science Review 99 (3):435–52.Google Scholar
Lloyd, Elisabeth. 2009. “Varieties of Support and Confirmation of Climate Models.” Aristotelian Society Supplementary Volume 83 (1):213–32.Google Scholar
Ludwig, Jens, Kling, Jeffrey, and Mullainathan, Sendhil. 2011. “Mechanism Experiments and Policy Evaluations.” Journal of Economic Perspectives 25 (3):17–38.10.1257/jep.25.3.17CrossRefGoogle Scholar
Marchionni, Caterina, and Reijula, Samuli. 2019. “What Is Mechanistic Evidence and Why Do We Need It for Evidence-Based Policy?” Studies in History and Philosophy of Science Part A 73:54–63.Google Scholar
Plano Clark, Vicky, and Ivankova, Natalya. 2016. “How to Use Mixed Methods Research? Understanding the Basic Mixed Methods Designs.” In Mixed Methods Research: A Guide to the Field, edited by Clark, Vicky Plano and Ivanova, Natalya, 105–34. Los Angeles: SAGE.Google Scholar
Reiss, Julian. 2009. “Causation in the Social Sciences: Evidence, Inference, and Purpose.” Philosophy of the Social Sciences 39 (1):20–40.Google Scholar
Rohlfing, Ingo, and Schneider, Carsten. 2018. “A Unifying Framework for Causal Analysis in Set-Theoretic Multimethod Research.” Sociological Methods & Research 47 (1):37–63.Google Scholar
Rohlfing, Ingo, and Zuber, Christina. 2021. ”Check Your Truth Conditions! Clarifying the Relationship between Theories of Causation and Social Science Methods for Causal Inference.” Sociological Methods & Research 50 (4):1623–59.Google Scholar
Runhardt, Rosa. 2022. “Limits to Limits to Evidential Pluralism: Multi-Method Large-N Qualitative Analysis and the Primacy of Mechanistic Studies.” Synthese 200 (2): 171.10.1007/s11229-022-03650-wCrossRefGoogle Scholar
Russo, Federica, and Williamson, Jon. 2007. “Interpreting Causality in the Health Sciences.” International Studies in the Philosophy of Science 21 (2):157–70.Google Scholar
Schupbach, Jonah. 2018. “Robustness Analysis as Explanatory Reasoning.” The British Journal for the Philosophy of Science 69 (1):275–300.Google Scholar
Seawright, Jason. 2016. Multi-Method Social Science: Combining Qualitative and Quantitative Tools. Cambridge and New York: Cambridge University Press.Google Scholar
Shan, Yafeng, and Williamson, Jon. 2021. “Applying Evidential Pluralism to the Social Sciences.” European Journal for Philosophy of Science 11 (4):127.Google Scholar
Staley, Kent. 2004. “Robust Evidence and Secure Evidence Claims.” Philosophy of Science 71 (4):467–88.Google Scholar
Stegenga, Jacob. 2009. “Robustness, Discordance, and Relevance.” Philosophy of Science 76 (5):650–61.Google Scholar
Woolcock, Michael. 2019. “Reasons for Using Mixed Methods in the Evaluation of Complex Projects.” In Contemporary Philosophy and Social Science: An Interdisciplinary Dialogue. Edited by Michiru Nagatsu and Attilia Ruzzene, 147–171. London: Bloomsbury Academic.Google Scholar
Zahle, Julie. 2019. “Data, Epistemic Values, and Multiple Methods in Case Study Research.” Studies in History and Philosophy of Science Part A 78:32–39.Google Scholar