Skip to main content Accessibility help
×
Home

Development of Listening Comprehension Tests with Narrative and Expository Texts for Portuguese Students

  • Sandra Santos (a1), Fernanda Leopoldina Viana (a1), Iolanda Ribeiro (a1), Gerardo Prieto (a2), Sara Brandão (a1) and Irene Cadime (a1)...

Abstract

This investigation aimed to develop and collect psychometric data for two tests assessing listening comprehension of Portuguese students in primary school: the Test of Listening Comprehension of Narrative Texts (TLC-n) and the Test of Listening Comprehension of Expository Texts (TLC-e). Two studies were conducted. The purpose of study 1 was to construct four test forms for each of the two tests to assess first, second, third and fourth grade students of the primary school. The TLC-n was administered to 1042 students, and the TLC-e was administered to 848 students. The purpose of study 2 was to test the psychometric properties of new items for the TLC-n form for fourth graders, given that the results in study 1 indicated a severe lack of difficult items. The participants were 260 fourth graders. The data were analysed using the Rasch model. Thirty items were selected for each test form. The results provided support for the model assumptions: Unidimensionality and local independence of the items. The reliability coefficients were higher than .70 for all test forms. The TLC-n and the TLC-e present good psychometric properties and represent an important contribution to the learning disabilities assessment field.

Copyright

Corresponding author

*Correspondence concerning this article should be addressed to Sandra Santos. Research Center on Psychology (CIPsi). School of Psychology. Universidade do Minho. Campus de Gualtar. 4710–057. Braga (Portugal). Phone: +351–937551393. E-mail: sandra.css@gmail.com

References

Hide All
American Educational Research Association (AERA) (1999). Standards for educational and psychological testing. Washington, DC: AERA.
Barrett, T. C. (1976). Taxonomy of reading comprehension. In Barrett, T. C. (Ed.), Teaching reading in the middle class (pp. 5158). Boston, MA: Addison-Wesley.
Berninger, V., & Abbott, R. (2010). Listening comprehension, oral expression, reading comprehension and written expression: Related yet unique language systems in grades 1, 3, 5, and 7. Journal of Educational Psychology, 102, 635651. http://dx.doi.org/10.1037/a0019319
Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model: Fundamental measurement in the human sciences (2 nd Ed.). Mahwah, NJ: Lawrence Erlbaum.
Cain, K., & Oakhill, J. (2008). Cognitive bases of children’s language comprehension difficulties. Where do we go from here? In Cain, K. & Oakhill, J. (Eds.), Children’s comprehension problems in oral and written language. A cognitive perspective (pp. 283295). New York, NY: The Guilford Press.
Català, G., Català, M., Molina, E., & Monclús, R. (2001). Evaluación de la comprensión lectora: Pruebas ACL (1o–6o de primaria) [Reading comprehension assessment: ACL Tests (from 1st to 6th grade)]. Barcelona, Spain: Editorial Graó.
de Ayala, R. J. (2009). The theory and practice of item response theory. New York, NY: The Guilford Press.
Diakidoy, I., Stylianou, P., Karefillidou, C., & Papageorgiou, P. (2004). The relationship between listening and reading comprehension of different types of text at increasing grade levels. Reading Psychology, 26, 5580. http://dx.doi.org/10.1080/02702710590910584
Dorans, N. J., Moses, T. P., & Eignor, D. (2011). Equating test scores: Toward best practices. In von Davier, A. A. (Ed.), Statistical models for test equating, scaling, and linking (pp. 2142). New York, NY: Springer.
Graesser, A., Golding, J. M., & Long, D. L. (1991). Narrative representation and comprehension. In Barr, R., Kamil, M. L., Mosenthal, P. B., & Pearson, P. D. (Eds.), Handbook of Reading Research: Vol. 2 (pp. 171205). New York, NY: Longman.
Graesser, A. C., Singer, M., & Trabasso, T. (1994). Constructing inferences during narrative text comprehension. Psychological Review, 101, 371395. http://dx.doi.org/10.1037/0033-295x.101.3.371
Harris, T., & Hodges, R. (Eds.) (1995). The literacy dictionary. Newark, DE: International Reading Association.
Herber, H. (1978). Teaching reading in content areas (2 nd Ed.). Englewood Cliffs, NJ: Prentice-Hall.
Hess, K. (2007). Reading development and assessment of early literacy: A review of the literature. Utah, UT: Utah Department of Education.
Hoover, W. A., & Gough, P. B. (1990). The simple view of reading. Reading and Writing: An Interdisciplinary Journal, 2, 127160. http://dx.doi.org/10.1007/BF00401799
Hulme, C., & Snowling, M. J. (2011). Children’s reading comprehension difficulties: Nature, causes, and treatments. Current Directions in Psychological Science, 20, 139142. http://dx.doi.org/10.1177/0963721411408673
Huynh, H., & Meyer, P. (2010). Use of robust z in detecting unstable items in item response theory models. Practical Assessment, Research & Evaluation, 15, 18.
Johns, J. L. (2008). Basic reading inventory: Pre-primer through grade twelve and early literacy assessments (10 th Ed.). Dubuque, IA: Kendall/Hunt Publishing Company.
Kintsch, W. (1998). Comprehension: A paradigm for cognition. New York, NY: Cambridge University Press.
Kolen, M., & Brennan, R. (2010). Test equating, scaling and linking (2 nd Ed.). New York, NY: Springer.
Lee, L. W. (2008). Development and validation of a reading-related assessment battery in Malay for the purpose of dyslexia assessment. Annals of Dyslexia, 58, 3757. http://dx.doi.org/10.1007/s11881-007-0011-0
Lehto, J. E., & Anttila, M. (2003). Listening comprehension in primary level grades two, four and six. Scandinavian Journal of Educational Research, 47, 133143. http://dx.doi.org/10.1080/00313830308615
Leslie, L., & Caldwell, J. (2006). Qualitative reading inventory-4. New York, NY: Pearson Education.
Linacre, J. M. (2002). What do infit and outfit, mean-square and standardized mean? Rasch Measurement Transactions, 16, 878.
Linacre, J. M. (2011). A user’s guide to WINSTEPS and MINISTEP: Rasch-model computer programs. Program manual 3.72.0. Chicago, CA: Mesa Press.
Nation, K. (2005). Children’s reading comprehension difficulties. In Snowling, M. & Hulme, C. (Eds.), The science of reading: A handbook (pp. 248265). Oxford, UK: Blackwell Publishing Ltd.
Oakhill, J. (1994). Individual differences in children’s text comprehension. In Gernsbacher, A. M. (Ed.), Handbook of psycholinguistics (pp. 821848). San Diego, CA: Academic.
Shanker, J. L., & Cockrum, W. (2009). Ekwall/Shanker reading inventory (5 th Ed.). Boston, MA: Allyn & Bacon.
Snowling, M. J., & Hulme, C. (2005). The science of reading: A handbook. Oxford, UK: Blackwell Publishing Ltd.
Torgesen, J. K. (2002). The prevention of reading difficulties. Journal of School Psychology, 40, 726. http://dx.doi.org/10.1016/S0022-4405(01)00092-9
Vellutino, F. R., Tunmer, W. E., Jaccard, J. J., & Chen, R. S. (2007). Components of reading ability: Multivariate evidence for a convergent skills model of reading development. Scientific Studies of Reading, 11, 332. http://dx.doi.org/10.1080/10888430709336632

Keywords

Metrics

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed