Hostname: page-component-76fb5796d-zzh7m Total loading time: 0 Render date: 2024-04-25T11:33:39.142Z Has data issue: false hasContentIssue false
  • English
  • Français

A Reliability Generalization Meta-Analysis of the Padua Inventory of Obsessions and Compulsions

Published online by Cambridge University Press:  04 December 2017

Julio Sánchez-Meca ,
María Rubio-Aparicio ,
Rosa María Núñez-Núñez ,
José López-Pina ,
Fulgencio Marín-Martínez  and
José Antonio López-López
Julio Sánchez-Meca*
Affiliation:
Universidad de Murcia (Spain)
María Rubio-Aparicio
Affiliation:
Universidad de Murcia (Spain)
Rosa María Núñez-Núñez
Affiliation:
Universidad Miguel Hernández de Elche (Spain)
José López-Pina
Affiliation:
Universidad de Murcia (Spain)
Fulgencio Marín-Martínez
Affiliation:
Universidad de Murcia (Spain)
José Antonio López-López
Affiliation:
University of Bristol (UK)
*
*Correspondence concerning this article should be addressed to Julio Sánchez-Meca. Departamento de Psicología Básica y Metodología de la Universidad de Murcia. 30100 Murcia (Spain). E-mail: jsmeca@um.es
Get access Rights & Permissions [Opens in a new window]

Abstract

The Padua Inventory (PI) of obsessions and compulsions is one of the most usually applied tests to assess obsessive-compulsive symptomatology in research contexts as well as for clinical and screening purposes. A reliability generalization meta-analysis was accomplished to estimate the average reliability of the PI scores and to search for characteristics of the samples and studies that can explain the variability among reliability estimates. An exhaustive literature search enabled us to select 39 studies (53 independent samples) that reported alpha and/or test-retest coefficients with the data at hand for the PI total score and subscales. An excellent average coefficient alpha was found for the PI total score (M = .935; 95%CI = .922–.949) and for Impaired Mental Control subscale (M = .911; 95%CI = .897–.924), being good for Contamination (M = .861; 95%CI = .841–.882) and Checking (M = .880; 95%CI = .856–.903), and fair for Urges and Worries (M = .783; 95%CI = .745–.822). The average test-retest reliability for PI total score was also satisfactory (M = .835; 95%CI = .782–.877). Moderator analyses showed larger coefficients alpha for larger standard deviation of the PI total scores (p = .0005; R2 = .46), for adapted versions of the test (p = .002; R2 = .32), and for samples composed of clinical participants (p = .066; R2 = .10). The practical implications of these results are discussed as well as the need for researchers to report reliability estimates with the data at hand.

Keywords

Meta-analysisobsessive-compulsive disorderPadua Inventory of obsessions and compulsionsreliability generalization
Type
Research Article
Information
The Spanish Journal of Psychology , Volume 20 , 2017 , E70
Copyright
Copyright © Universidad Complutense de Madrid and Colegio Oficial de Psicólogos de Madrid 2017 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

This research was supported by a grant from the Spanish Government and FEDER funds (Project No. PSI2016–77676–P)

How to cite this article:

Sánchez-Meca, J., Rubio-Aparicio, M., Núñez-Núñez, R. M., López-Pina, J. A., Marín-Martínez, F., & López-López, J. A. (2017). A reliability generalization meta-analysis of the Padua Inventory of obsessions and compulsions. The Spanish Journal of Psychology, 20. e70. Doi:10.1017/sjp.2017.65

References

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5 th ed.). Arlington, VA: American Psychiatric Publishing.Google Scholar
Beşiroğlu, L., Ağargün, M. Y., Boysan, M., Eryonucu, B., Güleç, M., & Selvi, Y. (2005). The assessment of obsessive-compulsive symptoms: Reliability and validity of the Padua Inventory in a Turkish population. Turkish Journal of Psychiatry, 16, 179–189.Google Scholar
Bonett, D. G. (2002). Sample size requirements for testing and estimating coefficient alpha. Journal of Educational and Behavioral Statistics, 27, 335–340. https://doi.org/10.3102/10769986027004335 CrossRefGoogle Scholar
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester, UK: Wiley.CrossRefGoogle Scholar
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2014). Comprehensive Meta-analysis (Vers. 3.0) [Computer software]. Englewood, NJ: Biostat, Inc.Google Scholar
Bottesi, G., Ghisi, M., Ouimet, A. J., Tira, M. D., & Sanavio, E. (2015). Compulsivity and impulsivity in pathological gambling: Does a dimensional-transdiagnostic approach add clinical utility to DSM–5 classification? Journal of Gambling Studies, 31, 825–847. https://doi.org/10.1007/s10899-014-9470-5 CrossRefGoogle ScholarPubMed
Burns, G. L., Keortge, S. G., Formea, G. M., & Sternberger, L. G. (1996). Revision of the Padua Inventory of obsessive compulsive disorder symptoms: Distinctions between worry, obsessions, and compulsions. Behaviour Research and Therapy, 34, 163–173. https://doi.org/10.1016/0005-7967(95)00035-6 CrossRefGoogle ScholarPubMed
Chappa, H. J. (1998). El Inventario de Obsesividad de Padua: Datos psicométricos y normativos de la versión en español [Padua’s Inventory of Obsession: Psychometric and normative data from the Spanish version]. Revista Argentina de Clínica Psicológica, 7, 117–129.Google Scholar
Charter, R. A. (2003). A breakdown of reliability coefficients by test type and reliability methods, and the clinical implications of low reliability. Journal of General Psychology, 130, 290–304. https://doi.org/10.1080/00221300309601160 CrossRefGoogle ScholarPubMed
Craig (2014). Seeking the other side of the thought-action fusion: implications for risk-taking in young adultthood. Unpublished doctoral dissertation, University of Windsor, Canada.Google Scholar
Crocker, L. M., & Algina, J. (1986). Introduction to classical and modern test theory. New York, NY: Holt, Rinehart & Winston.Google Scholar
Cuttler, C., & Graf, P. (2009). Sub-clinical compulsive checkers show impaired performance on habitual, event-and time-cued episodic prospective memory tasks. Journal of Anxiety Disorders, 23, 813–823. https://doi.org/10.1016/j.janxdis.2009.03.006 CrossRefGoogle ScholarPubMed
Deditius-Island, H. K., & Caruso, J. C. (2002).An examination of the reliability of scores from Zuckerman’s sensation seeking scales, form V. Educational and Psychological Measurement, 64, 728–734. https://doi.org/10.1177/0013164402062004012 CrossRefGoogle Scholar
Goodarzi, M. A., & Firoozabadi, A. (2005). Reliability and validity of the Padua Inventory in an Iranian population. Behaviour Research and Therapy, 43, 43–54. https://doi.org/10.1016/j.brat.2003.11.004 CrossRefGoogle Scholar
Heldref Foundation (1997). Guidelines for contributors. Journal of Experimental Education, 65, 95–96.Google Scholar
Henson, R. K., & Thompson, B. (2002). Characterizing measurement error in scores across studies: Some recommendations for conducting “reliability generalization” studies. Measurement and Evaluation in Counseling and Development, 35, 113–127.CrossRefGoogle Scholar
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. British Medical Journal, 327, 557–560. https://doi.org/10.1136/bmj.327.7414.557 CrossRefGoogle ScholarPubMed
Ibáñez, I., Olmedo, E., Peñate, W., & González, M. (2002). Obsesiones y compulsiones: estructura del Inventario de Padua [Obsessions and compulsions: The structure of the Padua Inventory]. International Journal of Clinical and Health Psychology, 2, 263–288.Google Scholar
Kadak, M. T., Balsak, F., Besiroglu, L., & Çelik, C. (2014). Relationships between cognitive appraisals of adolescents with OCD and their mothers. Comprehensive Psychiatry, 55, 598–603. https://doi.org/10.1016/j.comppsych.2013.11.013 CrossRefGoogle ScholarPubMed
Kessler, R. C., Petukhova, M., Sampson, N. A., Zaslavsky, A. M., & Wittchen, H. U. (2012). Twelve-month and lifetime prevalence and lifetime morbid risk of anxiety and mood disorders in the United States. International Journal of Methods in Psychiatric Research, 21, 169–184. https://doi.org/10.1002/mpr.1359 CrossRefGoogle ScholarPubMed
Knapp, G., & Hartung, J. (2003). Improved tests for a random effects meta-regression with a single covariate. Statistics in Medicine, 22, 2693–2710. https://doi.org/10.1002/sim.1482 CrossRefGoogle ScholarPubMed
Kyrios, M., Bhar, S., & Wade, D. (1996). The assessment of obsessive-compulsive phenomena: Psychometric and normative data on the Padua Inventory from an Australian non-clinical student sample. Behaviour Research and Therapy, 34, 85–95. https://doi.org/10.1016/0005-7967(95)00039-Z CrossRefGoogle ScholarPubMed
Lavoie, M. E., Sauvé, G., Morand-Beaulieu, S., Charron, M. P., & O’Connor, K. P (2014). Effects of obsessive-compulsive disorder symptom intensity on brain electro-cortical activity associated with emotional memory. In Kalinin, V. (Ed.), Obsessive-compulsive disorder: The old and the new problems. Rijeka, Croacia: InTech.Google Scholar
López-López, J. A., Botella, J., Sánchez-Meca, , & Marín-Martínez, F. (2013). Alternatives for mixed-effects meta-regression models in the reliability generalization approach: A simulation study. Journal of Educational and Behavioral Statistics, 38, 443–469. https://doi.org/10.3102/1076998612466142 CrossRefGoogle Scholar
Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.Google Scholar
Macdonald, A. M., & de Silva, P. (1999). The assessment of obsessionality using the Padua Inventory: Its validity in a British non-clinical sample. Personality and Individual Differences, 27, 1027–1046. https://doi.org/10.1016/S0191-8869(99)00036-7 CrossRefGoogle Scholar
Mataix-Cols, D., Sànchez-Turet, M., & Vallejo, J. (2002). A Spanish version of the Padua Inventory: Factor structure and psychometric properties. Behavioural and Cognitive Psychotherapy, 30, 25–36. https://doi.org/10.1017/S1352465802001042 CrossRefGoogle Scholar
McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Erlbaum.Google Scholar
McLaren, S., & Crowe, S. F. (2003). The contribution of perceived control of stressful life events and thought suppression to the symptoms of obsessive–compulsive disorder in both non-clinical and clinical samples. Journal of Anxiety Disorders, 17, 389–403. https://doi.org/10.1177/1359105311433906 CrossRefGoogle Scholar
Norman, R. M., Davies, F., Malla, A. K., Cortese, L., & Nicholson, I. R. (1996). Relationship of obsessive-compulsive symptomatology to anxiety, depression and schizotypy in a clinical population. British Journal of Clinical Psychology, 35, 553–566. https://doi.org/10.1111/j.2044-8260.1996.tb01211.x CrossRefGoogle Scholar
Novy, D. M., Stanley, M. A., Averill, P., & Daza, P. (2001). Psychometric comparability of English-and Spanish-language measures of anxiety and related affective symptoms. Psychological Assessment, 13, 347–355. https://doi.org/10.1037/1040-3590.13.3.347 CrossRefGoogle ScholarPubMed
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3 rd ed.). New York, NY: McGraw-Hill.Google Scholar
Rodriguez, M. C., & Maeda, Y. (2006). Meta-analysis of coefficient alpha. Psychological Methods, 11, 306–322. https://doi.org/10.1037/1082-989X.11.3.306 CrossRefGoogle ScholarPubMed
Sanavio, E. (1988). Obsessions and compulsions: The Padua Inventory. Behaviour Research and Therapy, 26, 169–177. https://doi.org/10.1016/0005-7967(88)90116-7 CrossRefGoogle ScholarPubMed
Sánchez-Meca, J., López-López, J. A., & López-Pina, J. A. (2013). Some recommended statistical analytic practices when reliability generalization (RG) studies are conducted. British Journal of Mathematical and Statistical Psychology, 66, 402–425. https://doi.org/10.1111/j.2044-8317.2012.02057.x CrossRefGoogle ScholarPubMed
Sánchez-Meca, J., & Marín-Martínez, F. (2008). Confidence intervals for the overall effect size in random-effects meta-analysis. Psychological Methods, 13, 31–48. https://doi.org/10.1037/1082-989X.13.1.31 CrossRefGoogle ScholarPubMed
Sánchez-Meca, J., Rubio-Aparicio, M., Marín-Martínez, F., & López-Pina, J. A. (2015, July). The phenomenon of reliability induction in social and health sciences. Paper presented at the XIV Congress of Methodology of Behavioral Science. Palma de Mallora, Spain.Google Scholar
Sarısoy, G., Terzi, M., Gümüş, K., & Pazvantoğlu, O. (2013). Psychiatric symptoms in patients with multiple sclerosis. General Hospital Psychiatry, 35, 134–140. https://doi.org/10.1016/j.genhosppsych.2012.10.011 CrossRefGoogle ScholarPubMed
Scarrabelotti, M. B., Duck, J. M., & Dickerson, M. M. (1995). Individual differences in obsessive-compulsive behaviour: The role of the Eysenckian dimensions and appraisals of responsibility. Personality and Individual Differences, 18, 413–421. https://doi.org/10.1016/0191-8869(94)00122-9 CrossRefGoogle Scholar
Shields, A. L., & Caruso, J. C. (2004). A reliability induction and reliability generalization study of the Cage Questionnaire. Educational and Psychological Measurement, 64, 254–270. https://doi.org/10.1177/0013164403261814 CrossRefGoogle Scholar
Somers, J. M., Goldner, E. M., Waraich, P., & Hsu, L. (2006). Prevalence and incidence studies of anxiety disorders: A systematic review of the literature. Canadian Journal of Psychiatry, 51, 100–113. https://doi.org/10.1177/070674370605100206 CrossRefGoogle ScholarPubMed
Stanley, M. A., Beck, J. G., & Zebb, B. J. (1996). Psychometric properties of four anxiety measures in older adults. Behaviour Research and Therapy, 34, 827–838. https://doi.org/10.1016/0005-7967(96)00064-2 CrossRefGoogle ScholarPubMed
Sternberger, L. G., & Burns, G. L. (1990). Obsessions and compulsions: Psychometric properties of the Padua Inventory with an American college population. Behaviour Research and Therapy, 28, 341–345. https://doi.org/10.1016/0005-7967(90)90087-Y CrossRefGoogle ScholarPubMed
Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., ... Higgins, J. P. T. (2011). Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. British Medical Journal, 343, d4002. https://doi.org/10.1136/bmj.d4002 CrossRefGoogle ScholarPubMed
Streiner, D. L., & Norman, G. R. (2008). Health measurement scales: A practical guide to their development and use (4 th ed.) New York, NY: Oxford University Press.CrossRefGoogle Scholar
Sugiura, Y., & Tanno, Y. (2000). Self-report inventory of obsessive-compulsive symptoms: Reliability and validity of the Japanese version of the Padua Inventory. Archives of Psychiatric Diagnostics and Clinical Evaluation, 11, 175–189.Google Scholar
Suzuki, T. (2005). Relationship between two aspect of perfectionism and obsessive-compulsive symptoms. Psychological Reports, 96, 299–305. https://doi.org/10.2466/pr0.96.2.299-305 CrossRefGoogle ScholarPubMed
Thompson, B. (1994). Guidelines for authors. Educational and Psychological Measurement, 54, 837–847.Google Scholar
Thompson, B. (2003). Score reliability: Contemporary thinking on reliability issues. Thousand Oaks, CA: Sage.CrossRefGoogle Scholar
Vaccaro, L. D., Jones, M. K., Menzies, R. G., & Wootton, B. M. (2014). The treatment of obsessive compulsive checking: A randomized trial comparing danger ideation reduction therapy with exposure and response prevention. Clinical Psychologist, 18, 74–95. https://doi.org/10.1111/cp.12019 CrossRefGoogle Scholar
Vacha-Haase, T. (1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58, 6–20. https://doi.org/10.1177/0013164498058001002 CrossRefGoogle Scholar
Vacha-Haase, T., & Thompson, B. (2011). Score reliability: A retrospective look back at 12 years of reliability generalization studies. Measurement and Evaluation in Counseling and Development, 44, 159–168. https://doi.org/10.1177/0748175611409845 CrossRefGoogle Scholar
van Oppen, P. (1992). Obsessions and compulsions: dimensional structure, reliability, convergent and divergent validity of the Padua Inventory. Behaviour Research and Therapy, 30, 631–637. https://doi.org/10.1016/0005-7967(92)90008-5 CrossRefGoogle ScholarPubMed
van Oppen, P., Hoekstra, R. J., & Emmelkamp, P. M. G. (1995). The structure of obsessive-compulsive symptoms. Behaviour Research and Therapy, 33, 15–23. https://doi.org/10.1016/0005-7967(94)E0010-G CrossRefGoogle ScholarPubMed
Viechtbauer, W. (2010). Conducting meta-analyses in R with the metaphor package. Journal of Statistical Software, 36, 1–48. https://doi.org/10.18637/jss.v036.i03 CrossRefGoogle Scholar
Viechtbauer, W., López-López, J. A., Sánchez-Meca, J., & Marín-Martínez, F. (2015). A comparison of procedures to test for moderators in mixed-effects meta-regression models. Psychological Methods, 20, 360–374. https://doi.org/10.1037/met0000023 CrossRefGoogle ScholarPubMed
Wakabayashi, A., & Aobayashi, T. (2007). Psychometric properties of the Padua Inventory in a sample of Japanese university students. Personality and Individual Differences, 43, 1113–1123. https://doi.org/10.1016/j.paid.2007.03.004 CrossRefGoogle Scholar
Wilkinson, L., & APA Task Force on Statistical Inference. (1999). Statistical methods in psychology journal: Guidelines and explanations. American Psychologist, 54, 594–604. https://doi.org/10.1037/0003-066X.54.8.594 CrossRefGoogle Scholar
Williams, M. T., & Turkheimer, E. (2007). Identification and explanation of racial differences on contamination measures. Behaviour Research and Therapy, 45, 3041–3050. https://doi.org/10.1016/j.brat.2007.08.013 CrossRefGoogle ScholarPubMed
Williams, M. T., Turkheimer, E., Schmidt, K. M., & Oltmanns, T. F. (2005). Ethnic identification biases responses to the Padua Inventory for obsessive-compulsive disorder. Assessment, 12, 174–185. https://doi.org/10.1177/1073191105275620 CrossRefGoogle Scholar
Zetsche, U., Rief, W., Westermann, S., & Exner, C. (2015). Cognitive deficits are a matter of emotional context: Inflexible strategy use mediates context-specific learning impairments in OCD. Cognition and Emotion, 29, 360–371. https://doi.org/10.1080/02699931.2014.911144 CrossRefGoogle ScholarPubMed
Supplementary material: File

Sánchez-Meca et al supplementary material

Sánchez-Meca et al supplementary material 1

Download Sánchez-Meca et al supplementary material(File)
File 40.4 KB