Hostname: page-component-cd9895bd7-8ctnn Total loading time: 0 Render date: 2024-12-27T02:49:24.288Z Has data issue: false hasContentIssue false

A Proposed System for Awarding Medals at a Major U.S. Wine Competition*

Published online by Cambridge University Press:  08 June 2012

Domenic V. Cicchetti
Affiliation:
Yale Home Office, 94 Linsley Lake Road, North Branford, CT 06471; email: dom.cicchetti@yale.edu

Abstract

The objective of this research is to devise a reliable and accurate scoring algorithm for awarding medals at a major U.S. wine competition that was described earlier by Hodgson (2008). The new algorithm is comprised of a two-tiered method that considers an award on the basis of a total medal score averaged across four judges per each evaluated wine; and a reliability algorithm that grades the degree of inter-judge reliability according to the following criteria: <70% = Poor or Unacceptable; 70%–79% = Fair; 80%–89% = Good; and 90%–100% = Excellent agreement (Cicchetti, 2001). The method has advantages over a previous scoring method that based its decision upon incorrect estimates of majority opinion; and unacceptable levels of inter-judge agreement. (JEL Classification: C1, L15, Q13)

Type
Shorter Papers
Copyright
Copyright © American Association of Wine Economists 2009

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Cicchetti, D.V. (2001). The precision of reliability and validity estimates re-visited: Distinguishing between clinical and statistical significance of sample size requirements. Journal of Clinical and Experimental Neuropsychology, 23, 695700.CrossRefGoogle ScholarPubMed
Cicchetti, D.V. and Cicchetti, A.F. (2009). Wine rating scales: Assessing their utility for producers, consumers, and oenologic researchers. International Journal of Wine Research, 1, 7383.CrossRefGoogle Scholar
Cicchetti, D.V. and Sparrow, S.S. (1981). Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86, 127137.Google ScholarPubMed
Garmezy, N., Clarke, A.R. and Stockner, C. (1961). Child-rearing attitudes of mothers and fathers as reported by schizophrenic and normal patients. Journal of Abnormal and Social Psychology, 63, 176182.Google Scholar
Hodgson, R.T. (2008). An examination of judge reliability at a major U.S. wine competition. Journal of Wine Economics, 3, 105113.CrossRefGoogle Scholar