Book contents
- The Cambridge Handbook of Experimental Syntax
- The Cambridge Handbook of Experimental Syntax
- Copyright page
- Contents
- Figures
- Tables
- Contributors
- Introduction
- Part I General Issues in Acceptability Experiments
- 1 Sentence Acceptability Experiments: What, How, and Why
- 2 Response Methods in Acceptability Experiments
- 3 Approaching Gradience in Acceptability with the Tools of Signal Detection Theory
- 4 Variation in Participants and Stimuli in Acceptability Experiments
- 5 Acceptability, Grammar, and Processing
- 6 Satiation
- 7 Acceptability (and Other) Experiments for Studying Comparative Syntax
- Part II Experimental Studies of Specific Phenomena
- Part III Experimental Studies of Specific Populations and Language Families
- Part IV Experimental Syntax beyond Acceptability
- Index
- References
2 - Response Methods in Acceptability Experiments
from Part I - General Issues in Acceptability Experiments
Published online by Cambridge University Press: 16 December 2021
Edited by
Book contents
- The Cambridge Handbook of Experimental Syntax
- The Cambridge Handbook of Experimental Syntax
- Copyright page
- Contents
- Figures
- Tables
- Contributors
- Introduction
- Part I General Issues in Acceptability Experiments
- 1 Sentence Acceptability Experiments: What, How, and Why
- 2 Response Methods in Acceptability Experiments
- 3 Approaching Gradience in Acceptability with the Tools of Signal Detection Theory
- 4 Variation in Participants and Stimuli in Acceptability Experiments
- 5 Acceptability, Grammar, and Processing
- 6 Satiation
- 7 Acceptability (and Other) Experiments for Studying Comparative Syntax
- Part II Experimental Studies of Specific Phenomena
- Part III Experimental Studies of Specific Populations and Language Families
- Part IV Experimental Syntax beyond Acceptability
- Index
- References
Summary
This chapter attempts to give an overview of current methods of gathering controlled acceptability judgments, noting what parameters of variation there are.Issues dealt with include the ways that the stimulus can be presented, the task assigned to the informant, the criterion for acceptability which the informant is instructed to use, and the format in which the response is delivered.A particular focus is the issue of the scale type on which the judgments are given.The chapter argues for more sophisticated (and admittedly) complex scales, and presents the case for anchoring the scale points with lingustic examples in order to ground the scale intersubjectively. These anchor points can be provided by the use of standard items instantiating cardinal well-formedness values, such as those proposed in Gerbrich et al. (2019).
Keywords
- Type
- Chapter
- Information
- The Cambridge Handbook of Experimental Syntax , pp. 39 - 61Publisher: Cambridge University PressPrint publication year: 2021
References
Anderson, N. (1989). Integration psychophysics. Behavioral Brain Science, 12, 268–269.Google Scholar
Bader, M. & Bayer, J. (2006). Case and Linking in Language Comprehension. Dordrecht: Springer.Google Scholar
Bader, M. & Häussler, J. (2010). Toward a model of grammaticality judgments. Journal of Linguistics, 46(2), 273–330.Google Scholar
Bard, E., Robertson, D., & Sorace, A. (1996). Magnitude estimation of linguistic acceptability. Language, 72(1), 32–68.Google Scholar
Birnbaum, M. (1980). Comparison of two theories of ‘difference’ and ‘ratio’ judgements. Journal of Experimental Psychology: General, 109, 304–319.CrossRefGoogle Scholar
Boland, J., Tanenhaus, M., & Garnsey, S. (1990). Lexical structure and parsing: Evidence for the immediate use of verbal argument and control information in parsing. Journal of Memory and Language, 29, 413–432.Google Scholar
Chafe, W. (1988). Punctuation and the prosody of written language. Written Communication, 5(4), 395–426.Google Scholar
Clifton, C., Frazier, L., & Connine, C. (1984). Lexical expectations in sentence comprehension. Journal of Verbal Learning and Verbal Behavior, 23(6), 696–708.Google Scholar
Cowart, W. (1997). Experimental Syntax: Applying Objective Methods to Sentence Judgements. Thousand Oaks, CA: Sage.Google Scholar
David, H. (1988). The Method of Paired Comparisons. New York: Oxford University Press.Google Scholar
Davidson, D. (2011). Inquiries into Truth and Interpretation, 2nd ed. Oxford and New York: Clarendon Press.Google Scholar
Ellermeier, W. & Faulhammer, G. (2000). Empirical evaluation of axioms fundamental to Stevens’s ratio-scaling approach: I. Loudness production. Perception & Psychophysics, 62, 1505–1511.CrossRefGoogle ScholarPubMed
Featherston, S. (2007). Data in generative grammar: The stick and the carrot. Theoretical Linguistics, 33(3), 269–318.CrossRefGoogle Scholar
Featherston, S. (2009). Why linguistics needs boiling and freezing points. In Featherston, S. & Winkler, S., eds., The Fruits of Empirical Linguistics, vol. 1: Process. Berlin: De Gruyter, pp. 47–74.Google Scholar
Fodor, J. D. (2002). Prosodic disambiguation in silent reading. In Hirotani, M., ed., Proceedings of NELS 32. Amherst, MA: GLSA, pp. 113–132.Google Scholar
Frazier, L. (1985). Modularity and the representational hypothesis. Proceedings of NELS 15. Amherst, MA: GLSA, pp. 131–145.Google Scholar
Fukuda, S., Goodall, G., Michel, D., & Beecher, H. (2012). Is magnitude estimation worth the trouble? In Choi, J., Hogue, E. A., Punske, J., Tat, D., Schertz, J., & Trueman, A., eds., Proceedings of the 29th West Coast Conference on Formal Linguistics. Somerville, MA: Cascadilla Proceedings Project, pp. 328–336.Google Scholar
Gerbrich, H., Schreier, V., & Featherston, S. (2019). Standard items for English judgement studies: Syntax and semantics. In Featherston, S., Hörnig, R., von Wietersheim, S., & Winkler, S., eds., Experiments in Focus: Information Structure and Semantic Processing. Berlin: De Gruyter, pp. 305–327.Google Scholar
Gibson, E. & Fedorenko, E. (2013). The need for quantitative methods in syntax and semantics research. Language and Cognitive Processes, 28, 88–124.Google Scholar
Hofmeister, P., Jaeger, T. F., Sag, I., Arnon, I., & Snider, N. (2013). The source ambiguity problem: Distinguishing effects of grammar and processing on acceptability judgments. Language and Cognitive Processes, 28, 48–87.CrossRefGoogle ScholarPubMed
Höhle, T. (1982). Markiertheit, Linking, Regelformat – Evidenz aus dem Deutschen. In Vennemann, T., ed., Silben, Segmente, Akzente (Linguistische Arbeiten 126). Tübingen: Niemeyer, pp. 99–139.CrossRefGoogle Scholar
Jones, D., Shen, W., Shriberg, E., Stolcke, A., Kamm, T., & Reynolds, D. (2005). Two experiments comparing reading with listening for human processing of conversational telephone speech. INTERSPEECH-2005, 1145–1148.Google Scholar
Keller, F. (2000). Gradience in grammar: Experimental and computational aspects of degrees of grammaticality. Doctoral dissertation, University of Edinburgh.Google Scholar
Labov, W. (1996). When intuitions fail. In McNair, L., Singer, K., Dolbrin, L., & Aucon, M., eds., Papers from the Parasession on Theory and Data in Linguistics 32. Chicago: Chicago Linguistic Society, pp. 77–106.Google Scholar
McBride, R. (1993). Integration psychophysicon as: The use of functional measurement in the study of mixtures. Chemical Senses 18, 83–92.CrossRefGoogle Scholar
McElree, B. (1993). The locus of lexical preference effects in sentence comprehension. Journal of Memory and Language, 32, 536–571.Google Scholar
Phillips, C. (2007). Should we impeach armchair linguists? In Iwasaki, S., Hoji, H., Clancy, P. M., & Sohn, S.-O., eds., Japanese/Korean Linguistics 17. Stanford, CA: CSLI Publications, pp. 49–64.Google Scholar
Poulton, E. C. (1989). Bias in Quantifying Judgments. Hove and London: Lawrence Erlbaum.Google Scholar
Saaty, T. L. (2008). Relative measurement and its generalization in decision making: Why pairwise comparisons are central in mathematics for the measurement of intangible factors – the Analytic Hierarchy/Network Process. Review of the Royal Academy of Exact, Physical and Natural Sciences, Series A: Mathematics (RACSAM), 102(2), 251–318.Google Scholar
Schütze, C. T. (1996). The Empirical Base of Linguistics: Grammaticality Judgments and Linguistic Methodology: Grammaticality Judgements and Linguistic Methodology. Chicago: University of Chicago Press.Google Scholar
Sprouse, J. (2007). A program for experimental syntax. Doctoral dissertation, University of Maryland.Google Scholar
Sprouse, J., Schütze, C. T., & Almeida, D. (2013). A comparison of informal and formal acceptability judgments using a random sample from Linguistic Inquiry 2001–2010. Lingua, 134, 219–248.Google Scholar
Stevens, S. (1946). On the theory of scales of measurement. Science, 103(2684), 677–680.CrossRefGoogle ScholarPubMed
Stevens, S. (1975). Psychophysics: Introduction to Its Perceptual, Neural and Social Prospects. New York: John Wiley.Google Scholar
Stevens, S. & Galanter, E. (1957). Ratio scales and category scale for a dozen perceptual continua. Journal of Experimental Psychology, 54, 377–411.CrossRefGoogle ScholarPubMed
Tanenhaus, M., Boland, J., Garnsey, S., & Carlson, G. (1989). Lexical structure in parsing long-distance dependencies. Journal of Psycholinguistic Research, 18, 37–49.Google Scholar
Weskott, T. & Fanselow, G. (2011). On the informativity of different measures of linguistic acceptability. Language, 87(2), 249–273.CrossRefGoogle Scholar
- 3
- Cited by