Skip to main content Accessibility help
×
Home
  • Get access
    Check if you have access via personal or institutional login
  • Cited by 1
  • Print publication year: 2005
  • Online publication date: February 2010

3 - Intuitive Judgments about Sample Size

Summary

Suppose a state election is coming up in a certain European country and somebody asks you if you would bet on whether the Social Democrats will beat the Christian Democrats again as they did in the last election. Shortly before Election Day, you are presented the results of two opinion polls, based on random samples of either 100 or 1,000 voters. In the smaller sample, the Social Democrats have an advantage of 4 percentage points whereas in the larger sample, the Christian Democrats lead by the same amount. Would you take the bet? You probably would not and I assume that this would be the choice of most people asked this question. As we will see later, your choice would be justified on both empirical and theoretical grounds.

This chapter offers an explanation for how and when the “naïve intuitive statistician” (Fiedler & Juslin, this volume) understands the impact that the size of a sample should have on estimates about population parameters such as proportions or means. I will argue that, in general, people know intuitively that larger (random) samples yield more exact estimates of population means and proportions than smaller samples and that one should have more confidence in these estimates the larger the size of the sample. My main claim is that the size-confidence intuition – an intuition that properly captures the relationship between sample size and accuracy of estimates – governs people's judgments about sample size. This intuition can be regarded as the result of associative learning.

References
Cleveland, W. S. (1979). Robust locally weighted regression and smoothing scatterplots. Journal of the American Statistical Association, 74, 829–836
Cohen, J. (1962). The statistical power of abnormal-social psychological research. Journal of Abnormal and Social Psychology, 65, 145–153
Engel, J., & Sedlmeier, P. (2004). Zum Verständnis von Zufall und Variabilität in empirischen Daten bei Schülern. [School students' understanding of chance and variability in empirical data]Unterrichtswissenschaft, 32, 169–191
Erlick, D. E. (1964). Absolute judgments of discrete quantities randomly distributed over time. Journal of Experimental Psychology, 57, 475–482
Evans, J.St, B. T., & Dusoir, A. E. (1977). Proportionality and sample size as factors in intuitive statistical judgement. Acta Psychologica, 41, 129–137
Evans, J.St, B. T., & Pollard, P. (1985). Intuitive statistical inferences about normally distributed data. Acta Psychologica, 60, 57–71
Fiedler, K. (1991). The tricky nature of skewed frequency tables: An information loss account of distinctiveness-based illusory correlations. Journal of Personality and Social Psychology, 60, 24–36
Fiedler, K. (1996). Explaining and simulating judgment biases as an aggregation phenomenon in probabilistic, multiple-cue environments. Psychological Review, 103, 193–214
Fiedler, K. (2000). Beware of samples! A cognitive–ecological sampling approach to judgment biases. Psychological Review, 107, 659–676
Fiedler, K., Brinkmann, B., Betsch, R., & Wild, B. (2000). A sampling approach to biases in conditional probability judgments: Beyond baserate neglect and statistical format. Journal of Experimental Psychology: General, 129, 1–20
Fiedler, K., Walther, E., Freytag, P., & Plessner, H. (2002). Judgment biases in a simulated classroom – A cognitive-environmental approach. Organizational Behavior and Human Decision Processes, 88, 527–561
Fischbein, E. (1975). The intuitive sources of probabilistic thinking in children. Reidel: Dordrecht-Holland
Haberstroh, S., & Betsch, T. (2002). Online strategies versus memory-based strategies in frequency estimation. In Sedlmeier, P. & Betsch, T. (Eds.), Etc. Frequency processing and cognition (pp. 205–220). Oxford: Oxford University Press
Hamilton, D. L., & Gifford, R. K. (1976). Illusory correlation in interpersonal perception: A cognitive basis of stereotypic judgments. Journal of Experimental Social Psychology, 12, 392–407
Hogarth, R. (2001). Educating intuition. Chicago: University of Chicago Press
Kahneman, D., & Tversky, A. (1972). Subjective probability: A judgment of representativeness. Cognitive Psychology, 3, 430–454
Kahneman, D., & Tversky, A. (1982). The psychology of preferences. Scientific American, 246, 160–173
Klayman, J., & Ha, Y.-W. (1989). Hypothesis testing in rule discovery: Strategy, structure and content. Journal of Experimental Psychology: Learning, Memory and Cognition, 15, 596–604
Mazzoni, G., & Memon, A. (2003). Imagination can create false autobiographical memories. Psychological Science, 14, 186–188
Nisbett, R. E., Krantz, D. H., Jepson, C., & Kunda, Z. (1983). The use of statistical heuristics in everyday inductive reasoning. Psychological Review, 90, 339–363
Oakes, M. (1986). Statistical inference: A commentary for the social and behavioral sciences. New York: Wiley
Reagan, R. T. (1989). Variations on a seminal demonstration of people's insensitivity to sample size. Organizational Behavior and Human Decision Processes, 43, 52–57
Ruscio, J. (2003). Comparing Bayes's theorem to frequency-based approaches to teaching Bayesian reasoning. Teaching of Psychology, 30, 325–328
Sedlmeier, P. (1998). The distribution matters: Two types of sample-size tasks. Journal of Behavioral Decision Making, 11, 281–301
Sedlmeier, P. (1999). Improving statistical reasoning: Theoretical models and practical implications. Mahwah, NJ: Lawrence Erlbaum
Sedlmeier, P. (2002). Associative learning and frequency judgments: The PASS model. In Sedlmeier, P. & Betsch, T. (Eds.), Etc. Frequency processing and cognition (pp. 137–152). Oxford: Oxford University Press
Sedlmeier, P. (2003). Simulation of estimates of relative frequency and probability for serially presented patterns. Unpublished raw data
Sedlmeier, P. (2005). From associations to intuitive judgment and decision making: Implicitly learning from experience. In Betsch, T. & Haberstroh, S. (Eds.), Experience-based decision making (pp. 83–99). Mahwah, NJ: Lawrence Erlbaum
Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies?Psychological Bulletin, 107, 309–316
Sedlmeier, P., & Gigerenzer, G. (1997). Intuitions about sample size: The empirical law of large numbers. Journal of Behavioral Decision Making, 10, 33–51
Sedlmeier, P., & Gigerenzer, G. (2000). Was Bernoulli wrong? On intuitions about sample size. Journal of Behavioral Decision Making, 13, 133–139
Sedlmeier, P., & Gigerenzer, G. (2001). Teaching Bayesian reasoning in less than two hours. Journal of Experimental Psychology: General, 130, 380–400
Sedlmeier, P., Hertwig, R., & Gigerenzer, G. (1998). Are judgments of the positional frequencies of letters systematically biased due to availability?Journal of Experimental Psychology: Learning, Memory, and Cognition, 24, 754–770
Sedlmeier, P., & Kılınç, B. (2004). The hazards of underspecified models: the case of symmetry in everyday predictions. Psychological Review, 111, 770–780
Sedlmeier, P., & Köhlers, D. (2001). Wahrscheinlichkeiten im Alltag: Statistik ohne Formeln. [Probabilities in everyday life: statistics without formula]. Braunschweig: Westermann (textbook with CD)
Sedlmeier, P., & Renkewitz, F. (2004). Attentional processes and judgments about frequency: Does more attention lead to higher estimates? Manuscript submitted for publication
Shanks, D. R. (1995). The psychology of associative learning. Cambridge, UK: Cambridge University Press
Tversky, A., & Kahneman, D. (1971). Belief in the law of small numbers. Psychological Bulletin, 73, 105–110
Wassner, C., Martignon, L., & Sedlmeier, P. (2002). Entscheidungsfindung unter Unsicherheit als fächerübergreifende Kompetenz. Zeitschrift für Pädagogik, 45 (Suppl.), 35–50
Wender, K. F., & Rothkegel, R. (2000). Subitizing and its subprocesses. Psychological Research, 64, 81–92