Bartussek, H 1999. A review of the animal needs index (ANI) for the assessment of animals’ well-being in the housing systems for Austrian proprietary products and legislation. Livestock Production Science 61, 179–192.
Battini, M, Barbieri, S, Vieira, A, Stilwell, G and Mattiello, S 2016. Results of testing the prototype of the AWIN welfare assessment protocol for dairy goats in 30 intensive farms in Northern Italy. Italian Journal of Animal Science 15, 283–293.
Battini, M, Vieira, A, Barbieri, S, Ajuda, I, Stilwell, G and Mattiello, S 2014. Invited review: animal-based indicators for on-farm welfare assessment for dairy goats. Journal of Dairy Science 97, 6625–6648.
Botreau, R, Veissier, I, Butterworth, A, Bracke, M and Keeling, L 2007. Definition of criteria for overall assessment of animal welfare. Animal Welfare 16, 225–228.
Brenner, H and Kliebsch, U 1996. Dependence of weighted kappa coefficients on the number of categories. Epidemiology 7, 199–202.
Burn, CC and Weir, AAS 2011. Using prevalence indices to aid interpretation and comparison of agreement ratings between two or more observers. Veterinary Journal 188, 166–170.
Can, E, Vieira, A, Battini, M, Mattiello, S and Stilwell, G 2016. On-farm welfare assessment of dairy goat farms using animal-based indicators: the example of 30 commercial farms in Portugal. Acta Agriculturae Scandinavica, Section A – Animal Science 66, 43–55.
Caroprese, M, Napolitano, F, Mattiello, S, Fthenakis, GC, Ribó, O and Sevi, A 2016. On-farm welfare monitoring of small ruminants. Small Ruminant Research 135, 20–25.
Cohen, J 1968. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin 70, 213–220.
De Rosa, G, Grasso, F, Pacelli, C, Napolitano, F and Winckler, C 2009. The welfare of dairy buffalo. Italian Journal of Animal Science 8, 103–116.
Fraser, D 1995. Science, values and animal welfare: exploring the ‘inextricable connection’. Animal Welfare 4, 103–117.
Hallgren, KA 2012. Computing inter-rater reliability for observational data: an overview and tutorial. Tutorials in Quantitative Methods for Psychology 8, 23–34.
Hewetson, M, Christley, RM, Hunt, ID and Voute, LC 2006. Investigations of the reliability of observational gait analysis for the assessment of lameness in horses. The Veterinary Record 158, 852–857.
Hoehler, FK 2000. Bias and prevalence effects on kappa viewed in terms of sensitivity and specificity. Journal of Clinical Epidemiology 53, 499–503.
Johnsen, PF, Johannesson, T and Sandøe, P 2001. Assessment of farm animal welfare at herd level: many goals, many methods. Acta Agriculturae Scandinavica, Section A – Animal Science 51, 26–33.
Kaler, J, Wassink, GJ and Green, LE 2009. The inter- and intra-observer reliability of a locomotion scoring scale for sheep. Veterinary Journal 180, 189–194.
Kaufman, AB and Rosenthal, R 2009. Can you believe my eyes? The importance of interobserver reliability statistics in observations of animal behaviour. Animal Behaviour 78, 1487–1491.
Kottner, J, Audigé, L, Brorson, S, Donner, A, Gajewski, BJ, Hróbjartsson, A, Roberts, C, Shoukri, M and Streiner, DL 2011. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. Journal of Clinical Epidemiology 64, 96–106.
Meagher, RK 2009. Observer ratings: validity and value as a tool for animal welfare research. Applied Animal Behaviour Science 119, 1–14.
Mullan, S, Edwards, SA, Butterworth, A, Whay, HR and Main, DCJ 2011. Inter-observer reliability testing of pig welfare outcome measures proposed for inclusion within farm assurance schemes. Veterinary Journal 190, 100–109.
Mülleder, C, Troxler, J, Laaha, G and Waiblinger, S 2007. Can environmental variables replace some animal-based parameters in welfare assessment of dairy cows? Animal Welfare 16, 153–156.
Phythian, CJ, Cripps, PJ, Michalopoulou, E, Jones, PH, Grove-White, D, Clarkson, MJ, Winter, AC, Stubbings, LA and Duncan, JS 2012. Reliability of indicators of sheep welfare assessed by a group observation method. Veterinary Journal 193, 257–263.
Phythian, CJ, Toft, N, Cripps, PJ, Michalopoulou, E, Winter, AC, Jones, PH, Grove-White, D and Duncan, JS 2013. Inter-observer agreement, diagnostic sensitivity and specificity of animal-based indicators of young lamb welfare. Animal: An International Journal of Animal Bioscience 7, 1182–1190.
Ruddat, I, Scholz, B, Bergmann, S, Buehring, A-L, Fischer, S, Manton, A, Prengel, D, Rauch, E, Steiner, S, Wiedmann, S, Kreienbrock, L and Campe, A 2014. Statistical tools to improve assessing agreement between several observers. Animal: An International Journal of Animal Bioscience 8, 643–649.
Scott, EM, Nolan, AM and Fitzpatrick, JL 2001. Conceptual and methodological issues related to welfare assessment: a framework for measurement. Acta Agriculturae Scandinavica, Section A – Animal Science 51, 5–10.
Shrout, PE 1998. Measurement reliability and agreement in psychiatry. Statistical Methods in Medical Research 7, 301–317.
Shrout, PE and Fleiss, JL 1979. Intraclass correlations: uses in assessing rater reliability. Psychological Bulletin 89, 420–428.
Streiner, DL and Norman, GR 2008. Health Measurement Scales: A practical guide to their development and use, 4th Edition. Oxford University Press, New York, USA.
Vieira, A, Battini, M, Ajuda, I, Mattiello, S and Stilwell, G 2012. Set up of a sampling strategy for the collection of animal-based welfare indicators during milking. In Proceeding of the XI International Conference on Goats, 23–27 September 2012, Las Palmas, Gran Canaria, Spain, p. 51.
Vieira, A 2015. Development and integration of animal-based welfare indicators, including pain, in goat farms in Portugal. PhD thesis, Universidade de Lisboa, Lisboa, Portugal.
Waiblinger, S, Knierim, U and Winckler, C 2001. The development of an epidemiologically based on-farm welfare assessment system for use with dairy cows. Acta Agriculturae Scandinavica, Section A – Animal Science 51, 73–77.