Hostname: page-component-848d4c4894-8bljj Total loading time: 0 Render date: 2024-07-07T12:18:31.125Z Has data issue: false hasContentIssue false

Performance Assessment in Language Testing

Published online by Cambridge University Press:  19 November 2008

Extract

In the past two decades, there has been a major shift in language testing towards the development and use of performance tests. The basis for this shift is the expectation that such tests would assess a more valid construct of what it really means to know a language. The purpose of this chapter is to review th topic of performance testing by focusing on its definitions, theory, development, and research. The chapter will begin with a review of the different definitions of performance testing and provide examples of the types of performance tests that have been developed and used. The chapter will then examine the extent to which performance tests have drawn upon the theoretical discussions of competence and performance. The next section will describe the research that has been carried out on performance tests. The chapter will end with an agenda for development and research on the manyu unanswered questions concerning performance testing.

Type
Language Assessment and Program Evaluation
Copyright
Copyright © Cambridge University Press 1995

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

UNANNOTATED BIBLIOGRAPHY

Alderson, J. 1980. Native and non-native speaker performance on cloze tests. Language Learning. 30.59–76.CrossRefGoogle Scholar
Alderson, J. and Hughes, A. (eds.) 1981. Issues in language testing. London: British Council. [ELT Documents 111.]Google Scholar
American Council on the Teaching of Foreign Languages. 1986. ACTFL proficiency guidelines. Hastings-on-Hudson, NY: American Council on the Teaching of Foreign Languages.Google Scholar
Bachman, L. 1990. Fundamental considerations in language testing. Oxford: Oxford University Press.Google Scholar
Bachman, L. and Palmer, A.. 1982. The construct validation of some components of communicative proficiency. TESOL Quarterly. 16.449–465.CrossRefGoogle Scholar
Bailey, K. 1985. If I had known then what I know now: Performance testing of foreign teaching assistants. In Hauptman, P., Leblanc, R. and Wesche, M. (eds.) Second language performance testing. Ottawa: University of Ottawa Press. 153180.Google Scholar
Barnwell, D. 1989a. ‘Naive’ native speaders and judgements of oral proficiency in Spanish. Language Testing. 6.152–63.CrossRefGoogle Scholar
Barnwell, D. 1989b. Proficency and the native speaker. ADFL Bulletin. 20.42–46.Google Scholar
Brindley, G. 1986. The assesssment of second language proficiency: Issues and Approaches. Adelaide: National Curriculum Resource Center.Google Scholar
British Council/UCLES. 1989. IELTS specifications. Cambridge: British Council/UCLES.Google Scholar
Canale, M. and Swain, M.. 1980. Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics. 1.1–47.CrossRefGoogle Scholar
Carroll, B. 1980. Testing communicative performance. London: Pergamon Institute of English.Google Scholar
Carroll, B. and Hall, P.. 1985. Make your own language tests. Oxford: Pergamon.Google Scholar
Chomsky, N. 1965. Aspects of the theory of syntax. Cambridge, MA: MIT Press.Google Scholar
Clark, J. L. D. 1975. Direct testing of speaking proficiency: Theory and practice. Princeton, NJ: Educational Testing Service.Google Scholar
Cole, G. and Neufeld, D.. 1991. Les tests d'evaluation de langue second de la fonction publique du Canada. [Tests for evaluating the second language of public officials in Canada.] Actes du Colloque Bulletin: Association quebequoise des enseignants du francais langue seconde (AQEFLS). Ottawa: University of Ottwa.Google Scholar
Delandshere, G. and Petrosky, A.. 1994. Capturing teachers' knowledge: Performance assessment a) and post-stuctural epistemology, b) from a post structuralist perspective, c) and post-structuralism, and d) none of the above. Educational Researcher. 23.5.11–18.Google Scholar
Elder, C. 1993. Language proficiency as a predictor of performance in teacher education. Melbourne Papers in Applied Linguistics. 2.68–89.Google Scholar
Emmett, A. 1985. The Associated Examining Board's Test in English for Educational Purposes (TEEP). In Hauptman, P. C., Leblanc, R. and Wesche, M. B. (eds.) Second language performance testing. Ottawa: Ottawa University Press. 131151.Google Scholar
Hamilton, J., Lopes, M., McNamara, T. and Sheridan, E.. 1993. Rating scales and native speaker performance on a communicatively oriented EAP test. Melbourne Papers in Applied Linguistics. 2.1–24.Google Scholar
Harley, B., Allen, P., Cummins, J. and Swain, M. (eds.) 1990. The development of second language proficiency. New York: Cambridge University Press.CrossRefGoogle Scholar
Hughes, A. 1989. Testing for language teachers. Cambridge, UK: Cambridge University Press.Google Scholar
Hymes, D. 1972. On communicative competence. In Pride, J. B. and Holmes, J. (eds.) Sociolinguistics. Harmondsworth, UK: Penguin Books. 269292.Google Scholar
Jones, R. L. 1977. Testing: A vital connection. In Phillips, J. (ed.) The language connection: From the classroom to the world. Skokie, IL: National Textbook Company. 237265. [The ACTFL Review of Foreign Language Education Series. 9.]Google Scholar
Jones, R. L. 1985. Second language performance testing. In Hauptman, P. C., Leblanc, R. and Wesche, M. B. (ed.) Second language performance testing. Ottawa: University of Ottwa Press. 1524.Google Scholar
Lazaraton, A. 1994. Question turn modification in language proficiency interviews. Paper presented at the annual American Association for Applied Linguistics Conference. Baltimore, MD, 03, 1994.Google Scholar
Linn, R., Baker, E. and Dunbar, S.. 1991. Complex, performance-based assessment: Expectations and validation criteria. Educational Researcher. 20.8.15–24.CrossRefGoogle Scholar
Lumley, T. 1993. Reading comprehension sub-skills: Teacher's perceptions of content in an EAP test. Melbourne Papers in Applied Linguistics. 2.25–55.Google Scholar
McNamara, T. F. 1990. Item Response Theory and the validation of and ESP test for health professionals. Language Testing. 7.52–77.CrossRefGoogle Scholar
McNamara, T. F. 1991. Test dimensionality: IRT analysis of an ESP listening test. Language Testing. 8.139–159.CrossRefGoogle Scholar
McNamara, T. F. Forthcoming. Second language performance assesment: Theory and research. London: Longman.Google Scholar
Messick, S. 1994. The interplay of evidence and consequences in the validation of performance assessments. Educational Researcher. 23.213–23.CrossRefGoogle Scholar
Milanovic, M. 1988. The construction and validation of a performance-based battery of English language progres tests. London: Institute of Education, University of London. Ph.D. diss.Google Scholar
Morrow, K. 1977. Techiques of evaluation for a notional syllabus. London: Royal Society of Arts.Google Scholar
Moss, P. 1992. Shifiting conceptions of validity in educational measurement: Implications for performance assessement. Review of Educational Research. 62.229–258.CrossRefGoogle Scholar
Moss, P. 1994. Can there ber validity without reliability? Educational Researcher. 23.2.5–12.CrossRefGoogle Scholar
Munby, J. 1978. Communicative syllabus design. Cambridge, UK: Cambridge University Press.Google Scholar
Oller, J. W. 1976. Evidence for a general language proficiency factor: An expectancy grammar. Die Neueren Sprachen 2.165–74.Google Scholar
Oller, J. W. 1979. Language tests at school. London: Longman.Google Scholar
Oller, J. W. 1981. Language testing research 1979–1980. In Kaplan, R. B. et al. (eds.) Annual Review of Applied Linguistics, 1980. Rowley, MA: Newbury House. 124150.Google Scholar
Rae, P. 1985. Language testing and the communicative language teaching curriculum. In Lee, Y., Fok, C. and Low, G. (eds.) New directions in language testing. Oxford: Pergamon. 1532.Google Scholar
Ross, S. 1992. Accommodative questions in oral proficiency interviews. Language Testing. 9.173–186.CrossRefGoogle Scholar
Ross, S. 1994. Formulaic speech in language proficiency interviews. Paper presented at the annual American Association for Applied Linguistics Conference. Baltimore, MD, 05, 1994.Google Scholar
Sajavaara, K. 1992. Designing tests to match the needs of the workplace. In Shohamy, E. and Walton, R. (eds.) Language asessment for feedback: Testing and other strategies. Dubuque, IA: Kendalt/Hunt Publishing Company. 123144.Google Scholar
Schachter, J. 1990. Communicative competence revisited. In Harley, B., Cummins, J., Swain, M. and Allen, P. (eds.) The development of second language proficiency. New York: Cambridge University Press. 3949.CrossRefGoogle Scholar
Sheridan, E. 1991. A comparison of native/non-native speaker performance on a communicative test of writting ability (I.E.L.T.S). Melbourne: University of Melbourne. Unpublished MA thesis.Google Scholar
Shohamy, E. 1994. The validity bof direct versus semi-direct oral tests. Language Testing 11.99–124.CrossRefGoogle Scholar
Shohamy, E., Donitze-Schmidt, S. and Waizer, R.. 1983. The effect of the elicitation method on the language samples obtained on oral tests. Paper presented at the annual Language Testing Research Colloquium. Cambridge, UK, 1983.Google Scholar
Shohamy, E., Gordon, C., Kenyon, D. and Stansfield, C.. 1989. The development and validation of a semi-direct test for assessing oral proficiency in Hebrew. Bulletin of higher Hebrew Education. 4.Google Scholar
Shohamy, E. and Stansfield, C.. 1991. The Hebrew oral test: An example of international cooperation. AILA Bulletin 7.79–90.Google Scholar
Skehan, P. 1984. Issues in the testing of English for specific purposes. Language Testing. 1.202–220.CrossRefGoogle Scholar
Skehan, P. 1989. Language Testing Part I and Part II. Language Teaching. 22.1–13.CrossRefGoogle Scholar
Spolsky, B. 1968. Preliminary studies in the development of techniques for testing overall second language proficiency. Problems in Foreign Language Testing. 79–101. [Special issue of Language Learning. No 3.]CrossRefGoogle Scholar
Spolsky, B. 1985. What does it mean to know how to use a language? An essay on the theoretical basis of language testing. Language Testing. 2.180–191.CrossRefGoogle Scholar
Spolsky, B. 1989. Communicative competence, language proficiency, and beyond. Applied Linguistics. 10.138–156.CrossRefGoogle Scholar
Stansfield, C. and Keyon, D.. 1988. Development of the Portuguese speaking test. Washington, DC: Center for Applied Linguistics. [Final report to the U.S. Dept. of Education.] [ED 296 586]Google Scholar
Swain, M. 1985. Communicative competence: Some roles of comprehensible input and comprehensible output in its development. In Gass, S. and Madden, C. (eds.) Input in second language acquisition. Rowley, MA: Newbury House.Google Scholar
Taylor, D. S. 1988. The meaning and use of the term “competence” in linguistics and applied linguistics. Applied Linguistics. 6.14–68.Google Scholar
Todesco, A., Cahill, W. and Frey, G.. 1983. A system of evaluation for the new English program. Ottawa: Language Training Canada, Public Service Commission of Canada.Google Scholar
Van Lier, L. 1989. Reeling, writhing, drawling, stretching and fainting in coils: Oral proficiency interviews as conversations. TESOL Quarterly. 23.489–508.CrossRefGoogle Scholar
Vollmer, H. and Sang, F.. 1983. Competing hypotheses about second language ability: A plea for caution. In Oller, J. (ed.) Issues in language testing research. Rowley, MA: Newbury House. 2975.Google Scholar
Weir, C. 1988. The specification, realization and validation of an English language proficiency test. In Hughes, A. (ed.) Testing English for university study. London: Modern English Publications/British Council. 45110.Google Scholar
Weiyun, He A. 1994. Elicited vs. volunteered elaboration: Talk and task in language proficiency interviews. Paper presented at the annual American Association for Applied Linguistics Conference. Baltimore, MD, March, 1994.Google Scholar
Wesche, M. 1987. Second language performance testing: The Ontario Test of ESL as an example. Language Testing. 4.28–47.CrossRefGoogle Scholar
Wesche, M. 1992. Performance testing for work-related second language assessment. In Shohamy, E. and Walton, R. (eds.) Language assessment for feedback: Testing and other strategies. Kendall/Hunt Publishing Company. 103122.Google Scholar
Wigglesworth, G. and O'Loughlin, K.. 1993. An investigation into the comparability of direct and semi-direct versions of an oral interaction test in English. Melbourne Papers in Applied Linguistics. 2.56–67.Google Scholar