Skip to main content Accessibility help
×
Home

HOW KNOWLEDGEABLE ARE APPLIED LINGUISTICS AND SLA RESEARCHERS ABOUT BASIC STATISTICS?: DATA FROM NORTH AMERICA AND EUROPE

  • Shawn Loewen (a1), Talip Gönülal (a2), Daniel R. Isbell (a3), Laura Ballard (a4), Dustin Crowther (a5), Jungmin Lim (a1), Jeffrey Maloney (a6) and Magda Tigchelaar (a7)...

Abstract

Despite the prevalence of quantitative approaches in applied linguistics (AL) and second language acquisition (SLA) research (Gass, 2009), evidence indicates a need for improvement in analyzing and reporting SLA data (e.g., Larson-Hall & Plonsky, 2015). However, to improve quantitative research, researchers must possess the statistical knowledge necessary to conduct quality research. This study assesses AL and SLA researchers’ knowledge of key statistical concepts on a statistical knowledge test. One hundred and ninety-eight AL and SLA researchers from North America and Europe responded to 26 discipline-specific questions designed to measure participants’ ability to (a) understand basic statistical concepts and procedures, (b) interpret statistical analyses, and (c) critically evaluate statistical information. Results indicate that participants generally understood basic descriptive statistics, but performance on items requiring more advanced statistical knowledge was lower. Quantitative research orientation, number of statistics courses taken, and frequent use of statistics textbooks had positive influences on researchers’ statistical knowledge.

Copyright

Corresponding author

*Correspondence concerning this article should be addressed to Shawn Loewen, Second Language Studies, B255 Wells Hall, 619 Red Cedar Road, Michigan State University, East Lansing, MI 48824-1027. E-mail: loewens@msu.edu

Footnotes

Hide All

The experiment in this article earned an Open Data badge for transparent practices. The materials are available at https://www.iris-database.org/iris/app/home/detail?id=york%3a932451&ref=search.

We would like to thank Emma Marsden for her help in recruiting European respondents. We would also like to thank the SSLA editors and anonymous reviewers for their insights and input, which made the paper stronger. Any shortcomings are ours alone.

Footnotes

References

Hide All
Byrnes, H. (2013). Notes from the editor. The Modern Language Journal, 97, 825827.
Dörnyei, Z., & Csizér, K. (2012). How to design and analyze surveys in second language acquisition research. In Mackey, A. & Gass, S. M. (Eds.), Research methods in second language acquisition: A practical guide (pp. 7494). Malden, MA: Blackwell.
Finney, S. J., & Schraw, G. (2003). Self-efficacy beliefs in college statistics courses. Contemporary Educational Psychology, 28, 161186.
Gass, S. (2009). A survey of SLA research. In Ritchie, W. & Bhatia, T. (Eds.), Handbook of second language acquisition (pp. 328). Bingley, UK: Emerald.
Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models. New York, NY: Cambridge University Press.
Gonulal, T. (2016). Statistical Literacy among Second Language Acquisition Graduate Students (Unpublished doctoral dissertation). Michigan State University, East Lansing, MI.
Gonulal, T. (2018). An investigation of the predictors of statistical literacy in second language acquisition. Eurasian Journal of Applied Linguistics, 4, 4970.
Gonulal, T. (2019). Statistical knowledge and training in second language acquisition: The case of doctoral students. ITL – International Journal of Applied Linguistics. Advanced online publication. doi.org/10.1075/itl.18031.gon.
Gonulal, T., Loewen, S., & Plonsky, L. (2017). The development of statistical literacy in applied linguistics graduate students. ITL – International Journal of Applied Linguistics, 168, 432.
Hall, C. J., Smith, P. H., & Wicaksono, R. (2017). Mapping applied linguistics: A guide for students and practitioners (2nd ed.). New York, NY: Routledge.
Khany, R., & Tazik, K. (2019). Levels of statistical use in applied linguistics research articles: From 1986 to 2015. Journal of Quantitative Linguistics, 26, 4865.
King, K. A., & Mackey, A. (2016). Research methodology in second language studies: Trends, concerns, and new directions. The Modern Language Journal, 100, 209227.
Larson-Hall, J. (2010). A guide to doing statistics in second language research using SPSS. New York, NY: Routledge.
Larson-Hall, J., & Plonsky, L. (2015). Reporting and interpreting quantitative research findings: What gets reported and recommendations for the field. Language Learning, 65, 127159.
Lazaraton, A. (2000). Current trends in research methodology and statistics in applied linguistics. TESOL Quarterly, 34, 175181.
Lazaraton, A., Riggenbach, H., & Ediger, A. (1987). Forming a discipline: Applied linguists’ literacy in research methodology and statistics. TESOL Quarterly, 21, 263277.
Linacre, J. M. (2014). Winsteps® Rasch measurement computer program. Beaverton, OR: Winsteps.com.
Loewen, S., & Gass, S. (2009). The use of statistics in L2 acquisition research. Language Teaching, 42, 181196.
Loewen, S., Lavolette, E., Spino, L. A., Papi, M., Schmidtke, J., Sterling, S., & Wolff, D. (2014). Statistical literacy among applied linguists and second language acquisition researchers. TESOL Quarterly, 48, 360388.
Mackey, A., & Gass, S. M. (2015). Second language research: Methodology and design (2nd ed.). New York, NY: Routledge.
Norris, J. M. (2015). Statistical significance testing in second language research: Basic problems and suggestions for reform. Language Learning, 65, 97126.
Plonsky, L. (2013). Study quality in SLA: An assessment of designs, analyses, and reporting practices in quantitative L2 research. Studies in Second Language Acquisition, 35, 655687.
Plonsky, L. (2014). Study quality in quantitative L2 research (1990–2010): A methodological synthesis and call for reform. The Modern Language Journal, 98, 450470.
Plonsky, L. (2015). Statistical power, p values, descriptive statistics, and effect sizes: A “back-to-basics” approach to advancing quantitative methods in L2 research. In Plonsky, L. (Ed.), Advancing quantitative methods in second language research (pp. 2345). New York, NY: Routledge.
Plonsky, L. (2017). Quantitative research methods in instructed SLA. In Loewen, S. & Sato, M. (Eds.), The Routledge handbook of instructed second language acquisition (pp. 505521). New York, NY: Routledge.
Plonsky, L. (Ed.). (2015). Advancing quantitative methods in second language research. New York, NY: Routledge.
Plonsky, L., & Gass, S. (2011). Quantitative research methods, study quality, and outcomes: The case of interaction research. Language Learning, 61, 325366.
Plonsky, L., & Gonulal, T. (2015). Methodological synthesis in quantitative L2 research: A review of reviews and a case study of exploratory factor analysis. Language Learning, 65, 936.
Rasch, G. (1960/1980). Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: Danish Institute for Educational Research.
Ross, S. (1998). Self-assessment in second language testing: A meta-analysis and analysis of experiential factors. Language Testing, 15, 120.
Shrout, P. E., & Rodgers, J. L. (2018). Psychology, science, and knowledge construction: Broadening perspectives from the Replication Crisis. Annual Review of Psychology, 69, 487510.
Trofimovich, P., Isaacs, T., Kennedy, S., Saito, K., & Crowther, D. (2015). Flawed self-assessment: Investigating self- and other-perception of second language speech. Bilingualism: Language and Cognition, 19, 122140.
Wright, B. D., & Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8, 370371.
Type Description Title
PDF
Supplementary materials

Loewen et al. supplementary material
Loewen et al. supplementary material

 PDF (66 KB)
66 KB

HOW KNOWLEDGEABLE ARE APPLIED LINGUISTICS AND SLA RESEARCHERS ABOUT BASIC STATISTICS?: DATA FROM NORTH AMERICA AND EUROPE

  • Shawn Loewen (a1), Talip Gönülal (a2), Daniel R. Isbell (a3), Laura Ballard (a4), Dustin Crowther (a5), Jungmin Lim (a1), Jeffrey Maloney (a6) and Magda Tigchelaar (a7)...

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed.