Hostname: page-component-848d4c4894-sjtt6 Total loading time: 0 Render date: 2024-06-20T14:39:01.432Z Has data issue: false hasContentIssue false

REVISITING THE SPANISH ELICITED IMITATION TASK

A TOOL FOR ASSESSING ADVANCED LANGUAGE LEARNERS?

Published online by Cambridge University Press:  24 June 2019

Megan Solon*
Affiliation:
University at Albany, SUNY
Hae In Park
Affiliation:
University at Albany, SUNY
Carly Henderson
Affiliation:
Augusta University
Marzieh Dehghan-Chaleshtori
Affiliation:
University at Albany, SUNY
*
*Correspondence concerning this article should be addressed to Megan Solon, Department of Languages, Literatures, and Cultures, Humanities 235, University at Albany, SUNY, 1400 Washington Avenue, Albany, NY 12222. E-mail: msolon@albany.edu

Abstract

Elicited imitation tasks (EITs) have been shown to be a valid, reliable, and practical method for establishing second-language (L2) oral proficiency across a variety of languages. Nevertheless, research that has validated existing EITs has most often explored a narrow range of learner proficiencies or has examined how well the EIT distinguishes between low- and high-level learners. Bowden’s (2016) validation study of the Spanish EIT was the first to expand the range of learner proficiencies by including low, advanced, and very advanced L2 learners; her results suggested that, in its current state, the EIT may not be equipped to distinguish finer-grained levels of proficiency, especially at more advanced levels. The present study revisits the Spanish EIT to examine (a) its ability to distinguish between higher level learners and (b) whether including additional, more challenging EIT items allows for finer-grained distinctions at higher levels. Results suggest that the addition of longer, more challenging EIT items can improve the discriminability of the test among more advanced L2 learners.

Type
Research Article
Copyright
Copyright © Cambridge University Press 2019 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

We would like to thank Cecily Corbett, Pamela Alvarado-McNamara, and Ángel Milla Muñoz for their invaluable assistance in the creation and piloting of the revised EIT instrument. This project benefitted enormously from the feedback provided by attendees to the Evolving Perspectives on Advancedness: A Symposium on Second Language Spanish organized by Mandy Menke and Paul Malovrh in February 2018. We are also grateful to the anonymous reviewers and the SSLA editorial team for their comments, suggestions, and critiques. All remaining errors are our own.

References

REFERENCES

Bley-Vroman, R., & Chaudron, C. (1994). Elicited imitation as a measure of second-language competence. In Tarone, E., Gass, S., & Cohen, A. (Eds.), Research methodology in second language acquisition (pp. 245261). Mahwah, NJ: Lawrence Erlbaum.Google Scholar
Bowden, H. W. (2016). Assessing second-language oral proficiency for research: The Spanish elicited imitation task. Studies in Second Language Acquisition, 38, 647675.CrossRefGoogle Scholar
Brown, J. D. (2000). Statistics corner. Questions and answers about language testing statistics (how can we calculate item statistics for weighted items?). Shiken: JALT Testing and Education SIG Newsletter, 3, 1921.Google Scholar
Brown, J. D. (2003). Norm-referenced item analyses (item facilitation and item discrimination). Shiken: JALT Testing and Evaluation SIG Newsletter, 7, 1619.Google Scholar
Byrnes, H. (2012). Advanced language proficiency. In Gass, S. M. & Mackey, A. (Eds.), The Routledge handbook of second language acquisition (pp. 506520). New York, NY: Routledge.Google Scholar
Dosi, I., Papadopoulou, D., & Tsimpli, I. M. (2016). Linguistic and cognitive factors in elicited imitation tasks: A study with mono-and biliterate Greek-Albanian bilingual children. In Scott, J. & Waughtal, D. (Eds.), Proceedings of the 40th Annual Boston University Conference on Language Development (pp. 101115). Somerville, MA: Cascadilla Press.Google Scholar
Ebel, R. L. (1979). Essentials of educational measurement (3rd ed.). Englewood Cliffs, NJ: Prentice-Hall.Google Scholar
Erlam, R. (2006). Elicited imitation as a measure of L2 implicit knowledge: An empirical validation study. Applied Linguistics, 27, 464491.CrossRefGoogle Scholar
Gaillard, S., & Tremblay, A. (2016). Linguistic proficiency assessment in second language acquisition research: The elicited imitation task. Language Learning, 66, 419447.CrossRefGoogle Scholar
Garvida, M. M. (2009). A review of Diplomas de Español como Lengua Extranjera (DELE). International Journal of Pedagogies and Learning, 5, 410.CrossRefGoogle Scholar
Graham, C. R., McGhee, J., & Millard, B. (2010). The role of lexical choice in elicited imitation item difficulty. In Prior, M. T., Watanabe, Y., & Lee, S. (Eds.), Selected Proceedings of the 2008 Second Language Research Forum (pp. 5772). Somerville, MA: Cascadilla Proceedings Project.Google Scholar
Graham, C. R., Lonsdale, D., Kennington, C., Johnson, A., & McGhee, J. (2008). Elicited imitation as an oral proficiency measure with ASR scoring. In Proceedings of the International Conference on Language Resources and Evaluation. Retrieved from www.lrec-conf.org/proceedings/lrec2008/index.html.Google Scholar
Hendrickson, R., Aitken, M., McGhee, J., & Johnson, A. (2010). What makes an item difficult? A syntactic, lexical, and morphological study of elicited imitation test items. In Prior, M. T., Watanabe, Y., & Lee, S. (Eds.), Selected Proceedings of the 2008 Second Language Research Forum (pp. 4856). Somerville, MA: Cascadilla Proceedings Project.Google Scholar
Hulstijn, J. H. (2010). Measuring second language proficiency. In Unsworth, S. & Blom, E. (Eds.), Experimental methods in language acquisition research (pp. 185199). Amsterdam, The Netherlands: Benjamins.CrossRefGoogle Scholar
Hulstijn, J. H. (2012). The construct of language proficiency in the study of bilingualism from a cognitive perspective. Bilingualism: Language and Cognition, 15, 422433.CrossRefGoogle Scholar
Jensen, E. D., & Vinther, T. (2003). Exact repetition as input enhancement in second language acquisition. Language Learning, 53, 373428.CrossRefGoogle Scholar
Kelley, T. L. (1939). The selection of upper and lower groups for the validation of test items. Journal of Educational Psychology, 30, 1724.CrossRefGoogle Scholar
Kim, Y., Tracy-Ventura, N., & Jung, Y. (2016). A measure of proficiency or short-term memory? Validation of an elicited imitation test for SLA research. Modern Language Journal, 100, 655673.CrossRefGoogle Scholar
Malovrh, P. A., & Benati, A. G. (2018). Introduction. In Malovrh, P. A. & Benati, A. G. (Eds.), The Handbook of advanced proficiency in second language acquisition (pp. 15). Oxford, UK: Wiley Blackwell.CrossRefGoogle Scholar
Moll, K., Hulme, C., Nag, S., & Snowling, M. J. (2015). Sentence repetition as a marker of language skills in children with dyslexia. Applied Psycholinguistics, 36, 203221.CrossRefGoogle Scholar
Montrul, S. (2012). DELE Proficiency Test. Unpublished instrument. Retrieved from http://international.ucla.edu/nhlrc/data/example.Google Scholar
Montrul, S. (2016). The acquisition of heritage languages. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Okura, E., & Lonsdale, D. (2012). Working memory’s meager involvement in sentence repetition tests. In Miyake, N., Peebles, D., & Cooper, R. P. (Eds.), Proceedings of the 34th Annual Conference of the Cognitive Science Society (pp. 21322137). Hillsdale, NJ: Lawrence Erlbaum.Google Scholar
Ortega, L., Iwashita, N., Norris, J. M., & Rabie, S. (2002). An investigation of elicited imitation tasks in crosslinguistic SLA research. Paper presented at the Second Language Research Forum, Toronto, Canada, October.Google Scholar
Park, H. I., Solon, M., Henderson, C., & Dehghan-Chaleshtori, M. (under review). Revisiting an elicited imitation task as a proficiency measure: The role of working memory in EIT performance.Google Scholar
Qualtrics. (2018). Provo, UT: Qualtrics [computer software].Google Scholar
Riches, N. G. (2012). Sentence repetition in children with specific language impairment: An investigation of underlying mechanisms. International Journal of Language & Communication Disorders, 47, 499510.CrossRefGoogle ScholarPubMed
Staples, S., & Biber, D. (2015). Cluster analysis. In Plonsky, L. (Ed.), Advancing quantitative methods in second language research (pp. 243274). New York, NY: Routledge.CrossRefGoogle Scholar
Thomas, M. (1994). Assessment of L2 proficiency in second language acquisition research. Language Learning, 44, 307336.CrossRefGoogle Scholar
Thomas, M. (2004). Research synthesis and historiography: The case of assessment of second language proficiency. In Norris, J. M. & Ortega, L. (Eds.), Synthesizing research on language learning and teaching (pp. 279298). Amsterdam, The Netherlands: Benjamins.Google Scholar
Tracy-Ventura, N., McManus, K., Norris, J., & Ortega, L. (2014). “Repeat as much as you can”: Elicited imitation as a measure of oral proficiency in L2 French. In Leclercq, P., Edmonds, A., & Hilton, H. (Eds.), Measuring L2 proficiency: Perspectives from SLA (pp. 143166). Bristol, UK: Multilingual Matters.CrossRefGoogle Scholar
Tremblay, A. (2011). Proficiency assessment standards in second language acquisition research: “Clozing” the gap. Studies in Second Language Acquisition, 33, 339372.CrossRefGoogle Scholar
Tremblay, A., & Garrison, M. D. (2010). Cloze tests: A tool for proficiency assessment in research on L2 French. In Prior, M. T., Watanabe, Y., & Lee, S.-K. (Eds.), Selected proceedings of the Second Language Research Forum 2008 (pp. 7388). Somerville, MA: Cascadilla Press.Google Scholar
Verhagen, J. (2011). Verb placement in second language acquisition: Experimental evidence for the different behavior of auxiliary and lexical verbs. Applied Psycholinguistics, 32, 821858.CrossRefGoogle Scholar
Vinther, T. (2002). Elicited imitation: A brief overview. International Journal of Applied Linguistics, 12, 5473.CrossRefGoogle Scholar
West, D. E. (2012). Elicited imitation as a measure of morphemic accuracy: Evidence from L2 Spanish. Language and Cognition, 4, 203222.CrossRefGoogle Scholar
Wu, S.-L., & Ortega, L. (2013). Measuring global oral proficiency in SLA research: A new elicited imitation test of L2 Chinese. Foreign Language Annals, 46, 680704.CrossRefGoogle Scholar
Yan, X., Maeda, Y., Lv, J., & Ginther, A. (2016). Elicited imitation as a measure of second language proficiency: A narrative review and meta-analysis. Language Teaching, 33, 497528.Google Scholar
Zhou, Y., & Wu, S.-L. (2009). Development and pilot of a Mandarin L2 elicited imitation task. Honolulu: University of Hawai‘i at Mānoa. Unpublished manuscript.Google Scholar