Hostname: page-component-848d4c4894-xm8r8 Total loading time: 0 Render date: 2024-06-25T17:06:30.208Z Has data issue: false hasContentIssue false
  • English
  • Français

Development and validation of the RQC: a daily contact log for ACT and ICM teams

Published online by Cambridge University Press:  11 April 2011

Alain D. Lesage ,
Daniel Gélinas ,
Jocelyn Bisson ,
Éric Dion  and
Nicole Ricard
Alain D. Lesage*
Affiliation:
Department of Psychiatry, Université de Montréal; Centre de recherche Fernand-Seguin and Hôpital Louis-H. Lafontaine, Montreal (Canada)
Daniel Gélinas
Affiliation:
Centre de recherche Fernand-Seguin and Hôpital Louis-H. Lafontaine affiliated with Université de Montréal, Montreal (Canada)
Jocelyn Bisson
Affiliation:
Hôpital Louis-H. Lafontaine affiliated with Université de Montréal, Montreal (Canada)
Éric Dion
Affiliation:
Université du Québec à Montréal, Montreal (Canada)
Nicole Ricard
Affiliation:
Faculty of Nursing Science of Université de Montréal, Centre de recherche Fernand-Seguin and Hôpital Louis-H. Lafontaine, Montreal (Canada)
*
Address for correspondence: Dr. A. Lesage, Social Psychiatry Research Unit, Centre de recherche Fernand-Seguin, Hôpital Louis-H. Lafontaine, 7401, rue Hochelaga, Montreal, QC, H1N 3M5 (Canada). Fax: (514) 251-5404 E-mail: alesage@ssss.gouv.qc.ca
Get access Rights & Permissions [Opens in a new window]

Extract

Aim – Instruments to measure the process - the daily activities of home care workers - have received little attention and may impede research in refining the active ingredients, the clientele best served and continuous quality improvement. We developed a decade ago in Quebec, Canada, a new daily contact log (relevé quotidien des contacts or RQC) that has now reached in practice 1 million entries. Methods – Three features distinguish the RQC development, namely, practical ergonomics, a clear logic, and response categories easy to understand and retain. The instrument is filled following any 10-minute or more contact with or about the client, and covers the location, time and actors of the episode of care, and the nature of the intervention (crisis, representing, accompanying, discussing) in 10 areas (i.e. medication, daily living activities, housing, relationships, substance abuse, legal, etc.). Inter-rater agreement for each RQC response category and rater agreement with a criterion measure (coded vignettes) were evaluated. Results – Kappa coefficients and intra-class correlation coefficients yielded results ranging from at least moderate to generally substantial agreement for all 77 response categories. Conclusions – The new RQC may support international studies of the implementation and application of various forms of intensive home care, refining its indications, and serves as a clinical and managerial tool to ensure quality of the interventions. Declaration of Interest: The study was financed by funds from the Fonds de la recherche en santé du Québec (FRSQ) and the Canadian Institutes of Health Research (CIHR). The authors have not been involved with any other forms of financing that might be considered a conflict of interest in connection with the submitted article.

Declaration of Interest: The study was financed by funds from the Fonds de la recherche en santé du Québec (FRSQ) and the Canadian Institutes of Health Research (CIHR). The authors have not been involved with any other forms of financing that might be considered a conflict of interest in connection with the submitted article.

Keywords

Case ManagementCommunity Mental Health ServicesProgram EvaluationOutcome and Process Assessment (Healthcare)Forms and Records Control
Type
Original Articles
Information
Epidemiology and Psychiatric Sciences , Volume 19 , Issue 1 , March 2010 , pp. 44 - 51
Copyright
Copyright © Cambridge University Press 2010

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Bale, R., Fiander, M. & Burns, T. (1997). Computers and process description for community mental health care. In Making Rational Mental Health Services (ed. M, Tansella), pp 81–90. Il Pensiero Scientifico Editore: Roma.Google Scholar
Bjorkman, T. & Hansson, L. (2000). What do case managers do? An investigation of case manager interventions and their relationship to client outcome. Social Psychiatry and Psychiatric Epidemiology 35, 43–50.Google ScholarPubMed
Brekke, J.S. (1987). The model-guided method for monitoring program implementation. Evaluation Review 11, 281–299.CrossRefGoogle Scholar
Brekke, J.S. & Test, M.A. (1987). An empirical analysis of services delivered in a model community support program. Psychosocial Rehabilitation Journal 10, 51–61.CrossRefGoogle Scholar
Brekke, J.S. & Wolkon, G.H. (1988). Monitoring program implementation in community mental health settings. Evaluation & The Health Professions 11, 425–440.CrossRefGoogle ScholarPubMed
Burns, T. (2004). Community Mental Health Teams: a Guide to Current Practices. Oxford University Press: Oxford.CrossRefGoogle Scholar
Burns, T., Fiander, M., Kent, A., Ukoumunne, O.C., Byford, S., Fahy, T. & Kumar, K.R. (2000). Effects of case-load size on the process of care of patients with severe psychotic illness. Report from the UK700 trial. British Journal of Psychiatry 177, 427–433.Google ScholarPubMed
Dewa, C.S., Horgan, S., Russell, M. & Keates, M. (2001). What? Another form? The process of measuring and comparing service utilization in a community mental health program model. Evaluation and Program Planning 24, 239–247.CrossRefGoogle Scholar
Dewa, C.S., Horgan, S., Mcintyre, D., Robinson, G., Krupa, T. & Eastabrook, S. (2003). Direct and indirect time inputs and assertive community treatment. Community Mental Health Journal 39, 17–32.CrossRefGoogle ScholarPubMed
Donner, A. & Eliasziw, M. (1987). Sample size requirements for reliability studies. Statistics in Medicine 6, 441–448.CrossRefGoogle ScholarPubMed
Durbin, J., Goering, P., Wasylenki, D. & Roth, J.L. (1997). Who gets how much of what: a description of intensive case management. Psychiatric Rehabilitation Journal 20, 49–55.CrossRefGoogle Scholar
Fiander, M., Burns, T., Mchugo, G.J. & Drake, R.E. (2003). Assertive community treatment across the Atlantic: comparison of model fidelity in the UK and USA. British Journal of Psychiatry 182, 248–254.CrossRefGoogle ScholarPubMed
Fleiss, J.L. (1981). Statistical Methods for Rates and Proportions, 2nd ed. Wiley: Toronto.Google Scholar
Goering, P., Wasylenki, D. & Durbin, J. (2000). Canada's mental health system. International Journal of Law and Psychiatry 23, 345–359.CrossRefGoogle ScholarPubMed
Hansson, K.S., Allebeck, P. & Malm, U. (2001). Event recording in psychiatric care: development of an instrument and 1-year results. Nord Journal of Psychiatry 55, 25–31.Google Scholar
Killaspy, H., Johnson, S., King, M. & Bebbington, P. (2008). Developing mental health services in response to research evidence. Epidemiologia e Psichiatria Sociale 17, 47–56.CrossRefGoogle ScholarPubMed
Landis, J.R. & Koch, G.G. (1977). The measurement of observer agreement for categorical data. Biometrics 33, 159–174.CrossRefGoogle ScholarPubMed
Lin, H.-M., Williamson, J.M. & Lipsitz, S.R. (2003). Calculating power for the comparison of dependent k-coefficients. Applied Statistics 52 (part 4), 391–404.Google Scholar
McGrew, J.H. & Bond, G.R. (1997). The association between program characteristics and service delivery in assertive community treatment. Administration and Policy in Mental Health 25, 175–189.CrossRefGoogle ScholarPubMed
McGrew, J.H., Bond, G.R., Dietzen, L. & Salyers, M. (1994). Measuring the fidelity of implementation of a mental health program model. Journal of Consulting and Clinical Psychology 62, 670–678.CrossRefGoogle ScholarPubMed
Marshall, M & Lockwood, A. (2000). Assertive community treatment for people with severe mental disorders. Cochrane Database of Systematic Reviews, Issue 2, CD001089.Google Scholar
Phillips, S.D., Burns, B.J., Edgar, E.R., Mueser, K.T., Linkins, K.W., Rosenheck, R.A., Drake, R.E. & McDonel, Herr E.C. (2001). Moving assertive community treatment into standard practice. Psychiatric Services 52, 771–779.CrossRefGoogle ScholarPubMed
Ricard, N., Lesage, A.D., Reinharz, D., Gélinas, D., Bisson, J., Lauzon, S., Ouadahi, Y., Beauvais, L. & Ohana, P. (2006). L'évaluation des aspects organisationnels, professionnels et cliniques de l'implantation et du fonctionnement du Suivi intensif dans le milieu. Montréal (QC): Axe de recherche en psychiatrie sociale du Centre de recherche Fernand-Seguin de l'Hôpital Louis-H. Lafontaine affilié à l'Université de Montréal: Montreal.Google Scholar
Ryan, C.S., Sherman, P.S. & Judd, C.M. (1994). Accounting for case manager effects in the evaluation of mental health services. Journal of Consulting and Clinical Psychology 62, 965–974.CrossRefGoogle ScholarPubMed
Ryan, C.S., Sherman, P.S. & Bogart, L.M. (1997). Patterns of services and consumer outcome in an intensive case management program. Journal of Consulting and Clinical Psychology 65, 485–493.CrossRefGoogle Scholar
Salyers, M.P., Bond, G.R., Teague, G.B., Cox, J.F., Smith, M.E., Hicks, M.L. & Koop, J.I. (2003). Is it ACT yet? Real-world examples of evaluating the degree of implementation for assertive community treatment. Journal of Behavioral Health Services & Research 30, 304–320.CrossRefGoogle ScholarPubMed
Shrout, P.E. & Fleiss, J.L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin 86, 420–428.CrossRefGoogle ScholarPubMed
Siegel, S. & Castellan, N.J. (1988). Nonparametric Statistics for the Behavioral Sciences, 2nd ed. McGraw-Hill: Toronto.Google Scholar
Teague, G.B., Drake, R.E. & Ackerson, T.H. (1995). Evaluating use of continuous treatment teams for persons with mental illness and substance abuse. Psychiatric Services 46, 689–695.Google ScholarPubMed
Teague, G.B., Bond, G.R. & Drake, R.E. (1998). Program fidelity in assertive community treatment: Development and use of a measure. American Journal of Orthopsychiatry 68, 216–232.CrossRefGoogle ScholarPubMed
Thornicroft, G. & Tansella, M. (1999). The Mental Health Matrix. A Manual to Improve Services. Cambridge University Press: Cambridge.CrossRefGoogle Scholar
Thornicroft, G. & Tansella, M. (2003). What Are the Arguments for Community-based Mental Health Care? World Health Organization/Health Evidence Network: Copenhagen.Google Scholar
Winter, J.P. & Calsyn, R.J. (2000). The Dartmouth Assertive Community Treatment Scale (DACTS). A generalizability study. Evaluation Review 24, 319–338.CrossRefGoogle ScholarPubMed