Hostname: page-component-848d4c4894-cjp7w Total loading time: 0 Render date: 2024-07-05T14:36:07.970Z Has data issue: false hasContentIssue false
  • English
  • Français

Measuring palliative care self-efficacy of intellectual and developmental disability staff using Rasch models

Published online by Cambridge University Press:  23 January 2023

Jinsook Kim Open the ORCID record for Jinsook Kim [Opens in a new window]  and
Jennifer A. Gray
Jinsook Kim*
Affiliation:
School of Health Studies, Northern Illinois University, DeKalb, IL, USA
Jennifer A. Gray
Affiliation:
School of Health Studies, Northern Illinois University, DeKalb, IL, USA
*
Author for correspondence: Jinsook Kim, School of Health Studies, Northern Illinois University, Wirtz Hall 254, DeKalb, IL 60115, USA. Email: jkim4@niu.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Objectives

The objectives of this study were to evaluate the psychometric properties of a palliative care self-efficacy instrument developed for intellectual and developmental disability (IDD) staff using Rasch analysis and assess the change in palliative care self-efficacy between 2 time points using Rasch analysis of stacked data.

Methods

Staff from 4 nonprofit IDD services organizations in a US Midwestern state (n = 98) answered 11 questions with Likert-style responses at baseline and 1-month follow-up post training. Rasch analysis was performed to examine rating scale structure, unidimensionality, local independence, overall model fit, person and item reliability and separation, targeting, individual item and personal fit, differential item functioning (DIF), and change in palliative care self-efficacy between 2 time points.

Results

The rating scale structure improved when 5 response categories were collapsed to 3. With the revised 3 response categories, the instrument demonstrated good psychometric properties. Principal components analysis of Rasch residuals supported the assumption of unidimensionality. Model fit statistics indicated an excellent fit of the data to the Rasch model. The instrument demonstrated good person and item reliability and separation. Gender-related DIF was found in 1 item, and work tenure–related DIF in 3 items. Overall palliative care self-efficacy improved between 2 time points.

Significance of results

Rasch analysis allowed for a more thorough examination of this palliative care self-efficacy instrument than classical test theory and provided information on rating scale structure, targeting, DIF, and individual persons and items. These recommendations can improve this instrument for research and practical contexts.

Keywords

Palliative care self-efficacyTrainingRasch analysisIntellectual and developmental disabilityInstrument
Type
Original Article
Information
Palliative & Supportive Care , Volume 22 , Issue 1 , February 2024 , pp. 146 - 154
Check for updates
Copyright
© The Author(s), 2023. Published by Cambridge University Press.

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Adriaansen, MJ, Van Achterberg, T and Borm, G (2005) Effects of a postqualification course in palliative care. Journal of Advanced Nursing 49(1), 96–103. doi:10.1111/j.1365-2648.2004.03268.xCrossRefGoogle ScholarPubMed
American Association of Intellectual and Developmental Disabilities (2023) Defining criteria for intellectual disability. https://www.aaidd.org/intellectual-disability/definition (accessed 11  January 2023).Google Scholar
Anselmi, P, Vidotto, G, Bettinardi, O, et al. (2015) Measurement of change in health status with Rasch models. Health and Quality of Life Outcomes 13, . doi:10.1186/s12955-014-0197-xCrossRefGoogle ScholarPubMed
Bandura, A (1986) Social Foundations of Thought and Action: A Social Cognitive Theory. Upper Saddle River, NJ: Prentice-Hall.Google Scholar
Bekkema, N, de Veer, AJ, Hertogh, CM, et al. (2015) “From activating towards caring”: Shifts in care approaches at the end of life of people with intellectual disabilities; a qualitative study of the perspectives of relatives, care-staff and physicians. BMC Palliative Care 14, . doi:10.1186/s12904-015-0030-2CrossRefGoogle ScholarPubMed
Billings, ME, Randall, J, Engelberg, C, et al. (2009) Medicine residents’ self-perceived competence in end-of-life care. Academy Medicine 84(11), 1533–1539. doi:10.1097/ACM.0b013e3181bbb490CrossRefGoogle ScholarPubMed
Bond, T, Yan, Z and Heene, M (2021) Applying the Rasch Model: Fundamental Measurement in the Human Sciences, 4th edn. Milton Park, Oxfordshire: Taylor and Francis.Google Scholar
Buss, MK, Alexander, C, Switzer, GE, et al. (2005) Assessing competence of residents to discuss end-of-life issues. Journal of Palliative Medicine 8(2), 363–371. doi:10.1089/jpm.2005.8.363CrossRefGoogle ScholarPubMed
Cartlidge, D and Read, S (2010) Exploring the needs of hospice staff supporting people with an intellectual disability: A UK perspective. International Journal of Palliative Nursing 16(2), 93–99. doi:10.12968/ijpn.2010.16.2.46755CrossRefGoogle ScholarPubMed
Cha, E, Lee, S, Lee, J, et al. (2020) Health personnel’s knowledge, attitudes, and self-efficacy related to providing palliative care in persons with chronic diseases. The Korean Journal of Hospice and Palliative Care 23(4), 198–211. doi:10.14475/kjhpc.2020.23.4.198CrossRefGoogle ScholarPubMed
Chang, KC, Wang, JD, Tang, HP, et al. (2014) Psychometric evaluation, using Rasch analysis, of the WHOQOL-BREF in heroin-dependent people undergoing methadone maintenance treatment: Further item validation. Health and Quality of Life Outcomes 12, . doi:10.1186/s12955-014-0148-6CrossRefGoogle ScholarPubMed
Coppus, A. M. W. (2013) People with intellectual disability: What do we know about adulthood and life expectancy?. Developmental Disabilities Research Reviews 18(1), 6–16. doi:10.1002/ddrr.1123CrossRefGoogle ScholarPubMed
Desbiens, J and Fillon, L (2011) Development of the palliative care nursing self-competence scale. Journal of Hospice & Palliative Nursing 13(4), 230–241. doi:10.1097/NJH.0b013e318213d300CrossRefGoogle Scholar
Dobie, J, Plumb, M and Shepherd, S (2016) End of life care education to care home staff: An evaluation. Nursing and Residential Care 18(7), 369–374. doi:10.1186/s12904-016-0123-6CrossRefGoogle Scholar
Dryden, H and Addicott, R (2009) Evaluation of a pilot study day for healthcare assistants and social care officers. International Journal of Palliative Care Nursing 15(1), 6–11. doi:10.12968/ijpn.2009.15.1.37946CrossRefGoogle ScholarPubMed
Du, Y and Yates, F (1995) When to adjust for differential item functioning. Rasch Measurement Transactions 9(1), .Google Scholar
Edwards, C, Hardin-Pierce, M, Anderson, D, et al. (2020) Evaluation of self-efficacy and confidence levels among newly graduated nurses exposed to an end-of-life simulation: A comparison study. Journal of Hospice & Palliative Nursing 22(6), 504–511. doi:10.1097/NJH.0000000000000698CrossRefGoogle Scholar
Fahey-McCarthy, E, McCarron, M, Connaire, K, et al. (2009) Developing an education intervention for staff supporting persons with an intellectual disability and advanced dementia. Journal of Policy and Practice in Intellectual Disabilities 6(4), 267–275. doi:10.1111/j.1741-1130.2009.00231.xCrossRefGoogle Scholar
Fox, CR (2007) What health care providers know (and need to know) about palliative care. Journal of Allied Health 36(4), 209–215.Google ScholarPubMed
Frey, R, Gott, M and Banfield, R (2011) What indicators are measured by tools designed to address palliative care competence among “generalist” palliative care providers? A critical literature review. Progress in Palliative Care 19(3), 114–124. doi:10.1179/1743291X11Y.0000000003CrossRefGoogle Scholar
Friedman, SL, Choueiri, R and Gilmore, D (2008) Staff carers’ understanding of end of life care. Journal of Policy and Practice in Intellectual Disabilities 5(1), 56–64. doi:10.1111/j.1741-1130.2007.00142.xCrossRefGoogle Scholar
Friesen, L and Andersen, E (2019) Outcomes of collaborative and interdisciplinary palliative education for health care assistants: A qualitative metasummary. Journal of Nursing Management 27(3), 461–481. doi:10.1111/jonm.12714CrossRefGoogle ScholarPubMed
García-Domínguez, L, Navas, P, Verdugo, M, et al. (2020) Chronic health conditions in aging individuals with intellectual disabilities. International Journal of Environmental Research and Public Health 17(9), . doi:10.3390/ijerph17093126CrossRefGoogle ScholarPubMed
Gray, J and Kim, J (2020) Palliative care needs of direct care workers caring for people with intellectual and developmental disabilities. British Journal of Learning Disability 48(1), 69–77. doi:10.1111/bld.12318CrossRefGoogle Scholar
Grimby, G, Tennant, A and Tesio, L (2012) The use of raw scores from ordinal scales: Time to end malpractice? Journal of Rehabilitation Medicine 44(2), 97–98. doi:10.2340/16501977-0938CrossRefGoogle ScholarPubMed
Hahn, JE and Cadogan, MP (2011) Development and evaluation of a staff training program on palliative care for persons with intellectual and developmental disabilities. Journal of Policy and Practice in Intellectual Disabilities 8(1), 42–52. doi:10.1111/j.1741-1130.2011.00288.xCrossRefGoogle Scholar
Jenkins, K, Alberry, B, Daniel, J, et al. (2010) Beyond communication: The development of a training program for hospital and hospice staff in the detection and management of psychological distress: Preliminary results. Palliative & Supportive Care 8, 27–33. doi:10.1017/S1478951509990678CrossRefGoogle ScholarPubMed
Karacsony, S, Chang, E, Johnson, A, et al. (2015) Measuring nursing assistants’ knowledge, skills and attitudes in a palliative approach: A literature review. Nurse Education Today 35(12), 1232–1239. doi:10.1016/j.nedt.2015.05.008CrossRefGoogle Scholar
Kim, J and Gray, J (2018) Palliative care experiences and needs of direct care workers. Journal of Palliative Medicine 21(8), 1094–1099. doi:10.1089/jpm.2017.0555CrossRefGoogle ScholarPubMed
Kim, J and Gray, J (2021) Effect of online palliative care training on knowledge and self-efficacy of direct care workers. Intellectual and Developmental Disabilities 59(5), 392–404. doi:10.1352/1934-9556-59.5.392CrossRefGoogle ScholarPubMed
Kinnear, D, Morrison, J, Allan, L, et al. (2018) Prevalence of physical conditions and multimorbidity in a cohort of adults with intellectual disabilities with and without Down syndrome: Cross-sectional study. BMJ Open 8(2), . doi:10.1136/bmjopen-2017-018292CrossRefGoogle Scholar
Kirkendall, AM and Waldrop, D (2013) Staff perspectives on the provision of end-of-life care in a community residence for older adults with developmental disabilities. Journal of Palliative Medicine 16(9), 1121–1124. doi:10.1089/jpm.2012.0408CrossRefGoogle Scholar
Lange, JW, Mager, D, Greiner, PA, et al. (2011) The ELDER Project: Educational model and three‐year outcomes of a community‐based geriatric education initiative. Gerontology & Geriatrics Education 32(2), 164–181. doi:10.1080/02701960.2011.572056CrossRefGoogle ScholarPubMed
Linacre, JM (2002) Optimizing rating scale category effectiveness. Journal of Applied Measurement 3(1), 85–106.Google ScholarPubMed
Linacre, JM (2021a) Winsteps User Manual (Version 5.1.4). Winsteps. https://www.winsteps.com/manuals.htm (accessed 1 September 2021).Google Scholar
Linacre, JM (2021b) Winsteps (Version 4.8.0.0). Winsteps. https://www.winsteps.com/winbuy.htm (accessed 1 August 2021).Google Scholar
Lord, AJ, Field, S and Smith, IC (2017) The experiences of staff who support people with intellectual disability on issues about death, dying and bereavement: A metasynthesis. Journal of Applied Research in Intellectual Disabilities 30, 1007–1021. doi:10.1111/jar.12376CrossRefGoogle ScholarPubMed
Maher, JM, Markey, JC and Ebert-May, D (2013) The other half of the story: Effect size analysis in quantitative research. CBE Life Sciences Education 12(3), 345–351. doi:10.1187/cbe.13-04-0082CrossRefGoogle ScholarPubMed
McCarron, M, McCallion, P, Fahey-McCarthy, E, et al. (2010) Staff perceptions of essential prerequisites underpinning end-of-life care for persons with intellectual disability and advanced dementia. Journal of Policy and Practice in Intellectual Disabilities 7(2), 143–152. doi:10.1111/j.1741-1130.2010.00257.xCrossRefGoogle Scholar
McEvoy, J, MacHale, R and Tierney, E (2012) Concept of death and perceptions of bereavement in adults with intellectual disabilities. Journal of Intellectual Disability Research 56(2), 191–203. doi:10.1111/j.1365-2788.2011.01456.xCrossRefGoogle ScholarPubMed
Moura Minosso, JS, Martins, MM and De Campos Oliveira, MA (2017) Cross-cultural adaptation of the Bonn Palliative Care Knowledge Test: An instrument to assess knowledge and self-efficacy. Revista de Enfermagem Referência 4(13), 31–42. doi:10.12707/RIV16076CrossRefGoogle Scholar
Mulder, SF, Bleijenberg, G, Verhagen, SC, et al. (2009) Improved competence after a palliative care course for internal medicine residents. Palliative Medicine 23(4), 360–368. doi:10.1177/0269216308100250CrossRefGoogle ScholarPubMed
Mundfrom, DJ, Shaw, DG and Ke, TL (2005) Minimum sample size recommendations for conducting factor analyses. International Journal of Testing 5(2), 159–168. doi:10.1207/s15327574ijt0502_4CrossRefGoogle Scholar
Nakazawa, Y, Miyashita, M, Morita, T, et al. (2009) The palliative care knowledge test: Reliability and validity of an instrument to measure palliative care knowledge among health professionals. Palliative Medicine 23(8), 754–766. doi:10.1177/0269216309106871CrossRefGoogle ScholarPubMed
Ng, J and Li, S (2003) A survey exploring the educational needs of care practitioners in learning disability (LD) settings in relation to death, dying and people with learning disabilities. European Journal of Cancer Care 12(1), 12–19. doi:10.1046/j.1365-2354.2003.00323.xCrossRefGoogle ScholarPubMed
Phillips, J, Salamonson, Y and Davidson, PM (2011) An instrument to assess nurses’ and care assistants’ self-efficacy to provide a palliative approach to older people in residential aged care: A validation study. International Journal of Nursing Studies 48, 1096–1100. doi:10.1016/j.ijnurstu.2011.02.015CrossRefGoogle Scholar
Raîche, G (2005) Critical eigenvalue sizes in standardized residual principal components analysis. Rasch Measurement Transactions 19(1), .Google Scholar
Resnick, B, Galik, E, Pretzer-Aboff, I, et al. (2008) Testing the reliability and validity of self-efficacy and outcome expectations of restorative care performed by nursing assistants. Journal of Nursing Care Quality 25(2), 162–169. doi: 10.1097/01.NCQ.0000313766.09891.43CrossRefGoogle Scholar
Reynolds, S, Guerin, S, McEvoy, J, et al. (2008) Evaluation of a bereavement training program for staff in an intellectual disabilities service. Journal of Applied Research in Intellectual Disabilities 5(1), 1–5. doi:10.1111/j.1741-1130.2007.00132.xGoogle Scholar
Ryan, K, Guerin, S, Dodd, P, et al. (2011a) Communication contexts about illness, death and dying for people with intellectual disabilities and life-limiting illness. Palliative & Supportive Care 9, 201–208. doi:10.1017/S1478951511000137CrossRefGoogle ScholarPubMed
Ryan, K, Guerin, S, Dodd, P, et al. (2011b) End-of-life care for people with intellectual disabilities: Paid carer perspectives. Journal of Applied Research in Intellectual Disabilities 24, 199–207. doi:10.1111/j.1468-3148.2010.00605.xCrossRefGoogle Scholar
Ryan, K, McEvoy, J, Guerin, S, et al. (2010) An exploration of the experience, confidence and attitudes of staff to the provision of palliative care to people with intellectual disabilites. Palliative Medicine 24(6), 566–572. doi:10.1177/0269216310371413CrossRefGoogle Scholar
Shipman, C, Burt, J, Ream, E, et al. (2008) Improving district nurses’ confidence and knowledge in the principles and practice of palliative care. Journal of Advanced Nursing 63(5), 494–505. doi:10.1111/j.1365-2648.2008.04729.xCrossRefGoogle ScholarPubMed
Stein, GL (2008) Providing palliative care to people with intellectual disabilities: Services, staff knowledge, and challenges. Journal of Palliative Medicine 11(9), 1241–1248. doi:10.1089/jpm.2008.0130CrossRefGoogle ScholarPubMed
Stroebe, M, Stroebe, W and Schut, H (2001) Gender differences in adjustment to bereavement: An empirical and theoretical review. Review of General Psychology 5(1), 62–83. doi:10.1037/1089-2680.5.1.62CrossRefGoogle Scholar
Tennant, A and Conaghan, P (2007) The Rasch measurement model in rheumatology: What is it and why use it? When should it be applied, and what should one look for in a Rasch paper. Arthritis and Rheumatism 57(8), 1358–1362. doi:10.1002/art.23108CrossRefGoogle Scholar
Tuffrey-Wijne, I, Hogg, J and Curfs, L (2007) End-of-life and palliative care for people with intellectual disabilities who have cancer or other life-limiting illness: A review of the literature and available resources. Journal of Applied Research in Intellectual Disabilities 20, 331–344. doi:10.1111/j.1468-3148.2006.00350.xCrossRefGoogle Scholar
Wark, S, Hussain, R and Edwards, H (2014) The training needs of staff supporting individuals ageing with intellectual disability. Journal of Applied Research in Intellectual Disabilities 27, 273–288. doi:10.1111/jar.12087CrossRefGoogle ScholarPubMed
Watters, L, McKenzie, K and Wright, R (2012) The impact of staff training on the knowledge of support staff in relation to bereavement and people with an intellectual disability. British Journal of Learning Disabilities 40(3), 194–200. doi:10.1111/j.1468-3156.2011.00693.xCrossRefGoogle Scholar
Wiese, M, Stancliffe, RJ, Dew, A, et al. (2014) What is talked about? Community living staff experiences of talking with older people with intellectual disability about dying and death. Journal of Intellectual Disability Research 58(7), 679–690. doi:10.1111/jir.12065CrossRefGoogle ScholarPubMed
Wilkinson, S, Perry, R, Blanchard, K, et al. (2008) Effectiveness of a three-day communication skill course in changing nurses’ communication skills with cancer/palliative care patients: A randomised controlled trial. Palliative Medicine 22, 365–575. doi:10.1177/0269216308090770CrossRefGoogle ScholarPubMed
Wittenberg-Lyles, E, Goldsmith, J, Ferrell, B, et al. (2014) Assessment of an interprofessional online curriculum for palliative care communication training. Journal of Palliative Medicine 17(4), 400–407. doi:10.1089/jpm.2013.0270CrossRefGoogle ScholarPubMed
World Health Organization (2015) Palliative care. http://www.who.int/mediacentre/factsheets/fs402/en/ (accessed 1 September 2021).Google Scholar
World Health Organization and World Bank (2011) World report on disability. Geneva, Switzerland: World Health Organization Press.Google Scholar
Wright, BD (2003) Rack and stack: Time 1 vs. time 2 or pre-test vs. post-test. Rasch Measurement Transactions 17, 905–906.Google Scholar
Wright, BD and Linacre, JM (1994) Reasonable mean-square fit values. Rasch Measurement Transactions 8(3), .Google Scholar
Wright, BD, and Masters, GN (1982) Rating Scale Analysis. Chicago, IL: Mesa Press.Google Scholar