Skip to main content Accessibility help
×
Home

Development and psychometric evaluation of the Primary Health Care Engagement (PHCE) Scale: a pilot survey of rural and remote nurses

  • Julie G. Kosteniuk (a1), Erin C. Wilson (a2), Kelly L. Penz (a3), Martha L.P. MacLeod (a4), Norma J. Stewart (a5), Judith C. Kulig (a6), Chandima P. Karunanayake (a7) and Kelley Kilpatrick (a8)...

Abstract

Aim

To report the development and psychometric evaluation of a scale to measure rural and remote (rural/remote) nurses’ perceptions of the engagement of their workplaces in key dimensions of primary health care (PHC).

Background

Amidst ongoing PHC reforms, a comprehensive instrument is needed to evaluate the degree to which rural/remote health care settings are involved in the key dimensions that characterize PHC delivery, particularly from the perspective of professionals delivering care.

Methods

This study followed a three-phase process of instrument development and psychometric evaluation. A literature review and expert consultation informed instrument development in the first phase, followed by an iterative process of content evaluation in the second phase. In the final phase, a pilot survey was undertaken and item discrimination analysis employed to evaluate the internal consistency reliability of each subscale in the preliminary 60-item Primary Health Care Engagement (PHCE) Scale. The 60-item scale was subsequently refined to a 40-item instrument.

Findings

The pilot survey sample included 89 nurses in current practice who had experience in rural/remote practice settings. Participants completed either a web-based or paper survey from September to December, 2013. Following item discrimination analysis, the 60-item instrument was refined to a 40-item PHCE Scale consisting of 10 subscales, each including three to five items. Alpha estimates of the 10 refined subscales ranged from 0.61 to 0.83, with seven of the subscales demonstrating acceptable reliability (α⩾0.70). The refined 40-item instrument exhibited good internal consistency reliability (α=0.91). The 40-item PHCE Scale may be considered for use in future studies regardless of locale, to measure the extent to which health care professionals perceive their workplaces to be engaged in key dimensions of PHC.

    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Development and psychometric evaluation of the Primary Health Care Engagement (PHCE) Scale: a pilot survey of rural and remote nurses
      Available formats
      ×

      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Development and psychometric evaluation of the Primary Health Care Engagement (PHCE) Scale: a pilot survey of rural and remote nurses
      Available formats
      ×

      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Development and psychometric evaluation of the Primary Health Care Engagement (PHCE) Scale: a pilot survey of rural and remote nurses
      Available formats
      ×

Copyright

Corresponding author

Correspondence to: Julie G. Kosteniuk, Canadian Centre for Health and Safety in Agriculture, University of Saskatchewan, 104 Clinic Place, PO Box 23, Saskatoon, Saskatchewan, S7N 2Z4, Canada. Email: julie.kosteniuk@usask.ca

References

Hide All
Banner, D., MacLeod, M. and Johnston, S. 2010: Transition in rural and remote primary health care nursing: a scoping literature review. Canadian Journal of Nursing Research 42, 4057.
Bloch, G., Rozmovits, L. and Giambrone, B. 2011: Barriers to primary care responsiveness to poverty as a risk factor for health. BMC Family Practice 12, 62.
Bonett, D.G. 2002: Sample size requirements for testing and estimating coefficient alpha. Journal of Educational and Behavioral Statistics 27, 335340.
Canadian Institute for Health Information (CIHI). 2006: Pan-Canadian health care indicators. Volume 1 Ottawa: CIHI, 1109.
Canadian Institutes of Health Research (CIHR). 2014: Community-based primary health care. Ottawa, ON: Government of Canada. Retrieved 7 April 2014 from http://www.cihr-irsc.gc.ca/e/43626.html
Canadian Nurses Association. 2005: Primary health care: a summary of the issues. Retrieved 6 August 2014 from http://cna-aiic.ca/~/media/cna/page-content/pdf-en/bg7_primary_health_care_e.pdf
Cook, D. and Beckman, T. 2006: Current concepts in validity and reliability for psychometric instruments: theory and application. The American Journal of Medicine 119, e7e16.
Dahrouge, S., Hogg, W., Russell, G., Geneau, R., Kristjansson, E., Muldoon, L. and Johnston, S. 2009: The comparison of models of primary care in Ontario (COMP-PC) study: methodology of a multi-faceted cross-sectional practice-based study. Open Medicine 3, 149164.
Davis, K., Schoen, C., Schoenbaum, S., Doty, M., Holmgren, A., Kriss, J. and Shea, K. 2007: Mirror, mirror on the wall: an international update on the comparative performance of American health care. New York, NY: The Commonwealth Fund, publication number 1027. Retrieved 7 February 2014 from commonwealthfund.org/
DesMeules, M., Pong, R.W., Lagacé, C., Heng, D., Manuel, D., Pitblado, R., Bollman, R., Guernsey, J., Kazanjian, A. and Koren, I. 2006. How healthy are rural Canadians? An assessment of their health status and health determinants. Ottawa: Canadian Institute for Health Information.
DeVellis, R. 2003. Scale development theory and applications. Thousand Oaks, CA: Sage Publications Inc.
DeVon, H., Block, M., Moyle-Wright, P., Ernst, D., Hayden, S., Lazzara, D., Savoy, S. and Kostas-Polston, E. 2007: A psychometric toolbox for testing validity and reliability. Journal of Nursing Scholarship 39, 155164.
Donald, F., Martin-Misener, R., Lukosius, D., Kilpatrick, K., Kaasalainen, S., Carter, N., Harbman, P., Bourgeault, I. and DiCenso, A. 2010: The primary healthcare nurse practitioner role in Canada. Nursing Leadership 23 (Special Issue), 88113.
El-Masri, M.M. and Fox-Wasylyshyn, S.M. 2005: Missing data: an introductory conceptual overview for the novice researcher. Canadian Journal of Nursing Research 37, 156171.
Farmer, J., Prior, M. and Taylor, J. 2012: A theory of how rural health services contribute to community sustainability. Social Science and Medicine 75, 19031911.
Flocke, S. 1997: Measuring attributes of primary care: development of a new instrument. Journal of Family Practice 45, 6474.
Furr, R. and Bacharach, V. 2008: Psychometrics: an introduction. Thousand Oaks, CA: Sage Publications Inc.
Gauld, R., Blank, R., Burgers, J., Cohen, A., Dobrow, M., Ikegami, N., Kwon, S., Luxford, K., Millett, C. and Wendt, C. 2012: The World Health Report 2008 – primary healthcare: how wide is the gap between its agenda and implementation in 12 high-income health systems. Healthcare Policy 7, 3858.
Grzybowski, S. and Kornelsen, J. 2013: Rural health services: finding light at the end of the tunnel. Healthcare Policy 8, 1016.
Haggerty, J., Burge, F., Gass, D., Lévesque, J.F., Beaulieu, M.D., Pineault, R. and Santor, D. 2007: Operational definitions of attributes of primary health care: consensus among Canadian experts. Annals of Family Medicine 5, 336344.
Haggerty, J., Burge, F., Beaulieu, M.D., Pineault, R., Beaulieu, C., Levesque, J.F., Santor, D., Gass, D. and Lawson, B. 2011: Validation of instruments to evaluate primary health care from the patient perspective: overview of the method. Healthcare Policy 9 (Special Issue), 3146.
Hogg, E., Rowan, M., Russell, G., Geneau, R. and Muldoon, L. 2008: Framework for primary care organizations: the importance of a structural domain. International Journal for Quality in Health Care 20, 308313.
Johnston, S. and Burge, F. 2013: Measuring provider experiences in primary health care: report on the development of a PHC provider survey for the Canadian Institute for Health Information. Ottawa: Bruyere Research Institute. Retrieved 7 February 2014 from http://www.cphcrin-rcrissp.ca
Lavis, J. 2011. Dialogue summary: addressing the integration of nurse practitioners in primary healthcare settings in Canada. Hamilton, Canada: McMaster Health Forum.
Levesque, J.F., Haggerty, J., Burge, F., Beaulieu, I., Gass, D., Pineault, R. and Santor, D. 2011: Canadian experts’ views on the importance of attributes within professional and community-oriented primary healthcare models. Healthcare Policy 7 (Special Issue), 2130.
Mable, A., Marriott, J. and Mable, M. 2012: Canadian primary healthcare policy: the evolving status of reform. Ottawa: Canadian Health Services Research Foundation.
McPherson, C. and McGibbon, E. 2010: Rural interprofessional primary health care team development and sustainability: establishing a research agenda. Primary Health Care Research and Development 11, 301314.
Mitton, C., Francois, D., Masucci, L., Wong, S. and Law, S. 2011: Innovations in health service organization and delivery in northern rural and remote regions: a review of the literature. International Journal of Circumpolar Health 70, 460472.
Nunnally, J. and Bernstein, I. 1994. Psychometric theory, third edition. New York: McGraw-Hill Inc.
Safran, D.G., Kosinski, M., Tarlov, A.R., Rogers, W.H., Taira, D.H., Lieberman, N. and Ware, J.E. 1998: The primary care assessment survey: tests of data quality and measurement performance. Medical Care 36, 728739.
Saskatchewan Ministry of Health. 2002: The Saskatchewan action plan for primary health care. Regina: Saskatchewan.
Saskatchewan Ministry of Health. 2012: Saskatchewan framework for primary health care report. Regina: Saskatchewan. Retrieved 7 February 2014 from www.health.gov.sk.ca/primary-health-care
Schoen, C., Osborn, R. and Huynh, P. 2006: On the front lines of care: primary care doctors’ office systems, experiences, and views in seven countries. Health Affairs 25, w555w571.
Shi, L., Starfield, B. and Xu, J. 2001: Validating the adult primary care assessment tool. Journal of Family Practice 50, 1171.
Simou, E., Pliatsika, P., Koutsogeorgou, E. and Roumeliotou, A. 2013: Quality indicators of primary health care: a systematic review. Journal of Public Health Management Practice, 19. doi: 10.1097/PHH.0000000000000037
Swinscow, T. and Campbell, M. 2002: Statistics at square one, second edition. London, UK: BMJ Books.
Tavakol, M. and Dennick, R. 2011: Making sense of Cronbach’s alpha. International Journal of Medical Education 2, 5355.
Wakerman, J. and Humphreys, J. 2011: Sustainable primary healthcare services in rural and remote areas: innovation and evidence. Australian Journal of Rural Health 19, 118124.
White, D. 2013: Development of a rural health framework: implications for program service planning and delivery. Healthcare Policy 8, 2741.
Williams, E., Konrad, T., Linzer, M., McMurray, J., Pathman, D., Gerrity, M., Schwartz, M., Scheckler, W., Van Kirk, J., Rhodes, E. and Douglas, J. 1999: Refining the measurement of physician job satisfaction: results from the physician worklife survey. Medical Care 37, 11401154.
Williams, A. and Kulig, J. 2011: Health and place in rural Canada. In Kulig, J. and Williams, A., editors, Health in Rural Canada. Vancouver: UBC Press, 122.
Williams, J. 2011: The continuing quest for primary healthcare reform: measuring performance. Healthcare Policy 7 (Special Issue), 89.
Wilson, M.G. and Lavis, J.N. 2014: Rapid synthesis: engaging in priority setting about primary and Integrated Healthcare Innovations in Canada. Hamilton, Canada: McMaster Health Forum.
Wong, S., Browne, A., Varcoe, C., Lavoi, J., Smye, V., Godwin, O., Littlejohn, D. and Tu, D. 2011: Enhancing measurement of primary health care indicators using an equity lens: an ethnographic study. International Journal for Equity in Health 10, 38.
Wong, S. and Haggerty, J. 2013: Measuring patient experiences in primary health care: a review and classification of items and scales used in publicly-available questionnaires. Vancouver: UBC Centre for Health Services and Policy Research. Retrieved 7 February 2014 from http://www.chspr.ubc.ca/pubs/report/measuring-patient-experiences-primary-health-care-review-and-classification
World Health Organization (WHO). 1986: Ottawa charter for health promotion. Ottawa: WHO. Retrieved 7 February 2014 from www.phac-aspc.gc.ca/ph-sp/docs/charter-chartre/pdf/charter.pdf

Keywords

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed