Hostname: page-component-848d4c4894-m9kch Total loading time: 0 Render date: 2024-05-10T18:22:24.028Z Has data issue: false hasContentIssue false
  • English
  • Français

WHAT THE RESEARCH SHOWS ABOUT WRITTEN RECEPTIVE VOCABULARY TESTING

A REPLY TO WEBB

Published online by Cambridge University Press:  12 July 2021

Jeffrey Stewart Open the ORCID record for Jeffrey Stewart [Opens in a new window] ,
Tim Stoeckel Open the ORCID record for Tim Stoeckel [Opens in a new window] ,
Stuart McLean Open the ORCID record for Stuart McLean [Opens in a new window] ,
Paul Nation Open the ORCID record for Paul Nation [Opens in a new window]  and
Geoffrey G. Pinchbeck Open the ORCID record for Geoffrey G. Pinchbeck [Opens in a new window]
Jeffrey Stewart
Affiliation:
Tokyo University of Science
Tim Stoeckel
Affiliation:
University of Niigata Prefecture
Stuart McLean
Affiliation:
Momoyama Gakuin University
Paul Nation
Affiliation:
Victoria University of Wellington
Geoffrey G. Pinchbeck
Affiliation:
Carleton University
Get access Rights & Permissions [Opens in a new window]

Abstract

An abstract is not available for this content so a preview has been provided. Please use the Get access link above for information on how to access this content.
Image of the first page of this content. For PDF version, please use the ‘Save PDF’ preceeding this image.'
Type
Critical Commentary
Information
Studies in Second Language Acquisition , Volume 43 , Issue 2 , May 2021 , pp. 462 - 471
Check for updates
Copyright
© The Author(s), 2021. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

We are grateful to Norbert Schmitt, Henrik Gyllstad, Christopher Nicklin, Joseph Vitta, Nick Bovee, and Dale Brown for their comments on earlier versions of this article.

References

Aviad-Levitzky, T., Laufer, B., & Goldstein, Z. (2019). The new computer adaptive test of size and strength (CATSS): Development and validation. Language Assessment Quarterly, 16, 345–368. https://doi.org/10.1080/15434303.2019.1649409CrossRefGoogle Scholar
Bauer, L., & Nation, P. (1993). Word families. International Journal of Lexicography, 6, 253–279. https://doi.org/10.1093/ijl/6.4.253CrossRefGoogle Scholar
Beglar, D., & Hunt, A. (1999). Revising and validating the 2000 word level and university word level vocabulary tests. Language Testing, 16, 131–162. https://doi.org/10.1177/026553229901600202CrossRefGoogle Scholar
Brown, D., Stewart, J., Stoeckel, T., & McLean, S. (in press). The coming paradigm shift in the use of lexical units. Studies in Second Language Acquisition.Google Scholar
Brown, D., Stoeckel, T., McLean, S., & Stewart, J. (2020). The most appropriate lexical unit for L2 vocabulary research and pedagogy: A brief review of the evidence. Applied Linguistics. Advance online publication. https://doi.org/10.1093/applin/amaa061CrossRefGoogle Scholar
Culligan, B. (2008). Estimating word difficulty using yes/no tests in an IRT framework and its application for pedagogical objectives. (Unpublished doctoral dissertation). Temple University, Japan.Google Scholar
Gibson, A., & Stewart, J. (2014). Estimating learners’ vocabulary size under item response theory. Vocabulary Learning and Instruction, 3, 78–84. http://www.vli-journal.org/issues/03.2/issue03.2.full.pdf#page=82Google Scholar
Grabe, W. (2009). Reading in a second language. Cambridge University Press.Google Scholar
Gyllstad, H., McLean, S., & Stewart, J. (2020a). [Unpublished raw data comparing confidence intervals for vocabulary size estimates produced by a poll of a proportion and the standard error of measurement.]Google Scholar
Gyllstad, H., McLean, S., & Stewart, J. (2020b). Using confidence intervals to determine adequate item sample sizes for vocabulary tests: An essential but overlooked practice. Language Testing. Advance online publication. https://doi.org/10.1177/0265532220979562CrossRefGoogle Scholar
Gyllstad, H., Vilkaitė, L., & Schmitt, N. (2015). Assessing vocabulary size through multiple-choice formats: Issues with guessing and sampling rates. ITL - International Journal of Applied Linguistics, 166, 278–306. https://doi.org/10.1075/itl.166.2.04gylCrossRefGoogle Scholar
Jeon, E. H., & Yamashita, J. (2014). L2 reading comprehension and its correlates: A meta‐analysis. Language Learning, 64, 160–212. https://doi.org/10.1111/lang.12034CrossRefGoogle Scholar
Kremmel, B., & Schmitt, N. (2016). Interpreting vocabulary test scores: What do various item formats tell us about learners’ ability to employ words? Language Assessment Quarterly, 13, 377–392. https://doi.org/10.1080/15434303.2016.1237516CrossRefGoogle Scholar
Laufer, B., & Aviad-Levitzky, T. (2017). What type of vocabulary knowledge predicts reading comprehension: Word meaning-recall or word meaning-recognition? The Modern Language Journal, 101, 729–741. https://doi.org/10.1111/modl.12431Google Scholar
McDonald, K. (2015). The potential impact of guessing on monolingual and bilingual versions of the vocabulary size test. Osaka JALT Journal, 2, 44–61. http://www.osakajalt.org/journal/Google Scholar
McLean, S. (2018). Evidence for the adoption of the flemma as an appropriate word counting unit. Applied Linguistics, 39, 823–845. https://doi.org/10.1093/applin/amw050CrossRefGoogle Scholar
McLean, S. (2021). The coverage comprehension model, its importance to pedagogy and research, and threats to the validity with which it is operationalized. Reading in a Foreign Language, 33, 126–140. https://nflrc.hawaii.edu/rfl/item/528Google Scholar
McLean, S., Kramer, B., & Stewart, J. (2015). An empirical examination of the effect of guessing on vocabulary size test scores. Vocabulary Learning and Instruction, 4, 26–35. http://vli-journal.org/wp/wp-content/uploads/2015/10/vli.v04.1.2187-2759.pdf#page=31Google Scholar
McLean, S., Stewart, J., & Batty, A. O. (2020). Predicting L2 reading proficiency with modalities of vocabulary knowledge: A bootstrapping approach. Language Testing, 37, 389–411. https://doi.org/10.1177/0265532219898380CrossRefGoogle Scholar
McLean, S., Stewart, J., & Kramer, B. (2016, September 12–14). A comparison of multiple-choice and yes/no test formats with a meaning-recall knowledge criterion [Paper presentation]. Vocab@Tokyo. Tokyo, Japan.Google Scholar
Nation, I. S. P. (2009). Teaching ESL/EFL reading and writing. Routledge.Google Scholar
Nation, I. S. P., & Webb, S. (2011). Researching and analyzing vocabulary. Heinle.Google Scholar
Nation, P. (2012). The vocabulary size test. http://www.victoria.ac.nz/lals/about/staff/publications/paul-nation/Vocabulary-Size-Test-information-and-specifications.pdfGoogle Scholar
Nation, P. (2013). Learning vocabulary in another language (2nd ed.). Cambridge University Press.CrossRefGoogle ScholarPubMed
Nation, P., & Beglar, D. (2007). A vocabulary size test. The Language Teacher, 31, 9–13. https://jaltpublications.org/tlt/issues/2007-07_31.7Google Scholar
Schmitt, N., Nation, P., & Kremmel, B. (2020). Moving the field of vocabulary assessment forward: The need for more rigorous test development and validation. Language Teaching, 53, 109–120. https://doi.org/10.1017/S0261444819000326CrossRefGoogle Scholar
Schmitt, N., Schmitt, D., & Clapham, C. (2001). Developing and exploring the behaviour of two new versions of the Vocabulary Levels Test. Language Testing, 18, 55–88. https://doi.org/10.1177/026553220101800103CrossRefGoogle Scholar
Smith, M. H. (2004). A sample/population size activity: Is it the sample size of the sample as a fraction of the population that matters? Journal of Statistics Education, 12. https://doi.org/10.1080/10691898.2004.11910735Google Scholar
Stewart, J. (2012). A multiple-choice test of active vocabulary knowledge. Vocabulary Learning and Instruction, 1, 53–59.CrossRefGoogle Scholar
Stewart, J. (2014). Do multiple-choice options inflate estimates of vocabulary size on the VST? Language Assessment Quarterly, 11, 271–282. http://vli-journal.org/issues/01.1/issue01.1.09.pdfCrossRefGoogle Scholar
Stewart, J., & White, D. A. (2011). Estimating guessing effects on the vocabulary levels test for differing degrees of word knowledge. TESOL Quarterly, 45, 370–380. https://doi.org/10.5054/tq.2011.254523CrossRefGoogle Scholar
Stoeckel, T., Bennett, P., & McLean, S. (2016). Is “I Don’t Know” a viable answer choice on the Vocabulary Size Test? TESOL Quarterly, 50, 965–975. https://doi.org/10.1002/tesq.325CrossRefGoogle Scholar
Stoeckel, T., Ishii, T., & Bennett, P. (2020). Is the lemma more appropriate than the flemma as a word counting unit? Applied Linguistics, 41, 601–606. https://doi.org/10.1093/applin/amy059CrossRefGoogle Scholar
Stoeckel, T., McLean, S., & Nation, P. (2021). Limitations of size and levels tests of written receptive vocabulary knowledge. Studies in Second Language Acquisition, 43, 181–203. https://doi.org/10.1017/S027226312000025XCrossRefGoogle Scholar
Stoeckel, T., Stewart, J., McLean, S., Ishii, T., Kramer, B., & Matsumoto, Y. (2019). The relationship of four variants of the Vocabulary Size Test to a criterion measure of meaning-recall vocabulary knowledge. System, 87, 102161. https://doi.org/10.1016/j.system.2019.102161CrossRefGoogle Scholar
Ward, J., & Chuenjundaeng, J. (2009). Suffix knowledge acquisition and applications. System, 37, 461–469. https://doi.org/10.1016/j.system.2009.01.004CrossRefGoogle Scholar
Webb, S. (2008). The effects of context on incidental vocabulary learning. Reading in a Foreign Language, 20, 232–245. https://nflrc.hawaii.edu/rfl/item/178Google Scholar
Webb, S. (2021). A different perspective on the limitations of size and levels tests of written receptive vocabulary knowledge. Studies in Second Language Acquisition, 43, 454–461. https://doi.org/10.1017/S0272263121000449Google Scholar
Webb, S., Sasao, Y., & Ballance, O. (2017). The updated Vocabulary Levels Test. ITL - International Journal of Applied Linguistics, 168, 33–69. https://doi.org/10.1075/itl.168.1.02webCrossRefGoogle Scholar
Zhang, S., & Zhang, X. (2020). The relationship between vocabulary knowledge and L2 reading/listening comprehension: A meta-analysis. Language Teaching Research. Advance online publication. https://doi.org/10.1177/1362168820913998CrossRefGoogle Scholar