Skip to main content Accessibility help
×
Hostname: page-component-8448b6f56d-t5pn6 Total loading time: 0 Render date: 2024-04-18T16:14:29.226Z Has data issue: false hasContentIssue false

2 - Workplace-based assessment methods: literature overview

Published online by Cambridge University Press:  01 January 2018

Amit Malik
Affiliation:
Clinical Services Director and Consultant Psychiatrist
Dinesh Bhugra
Affiliation:
Professor of Mental Health and Cultural Diversity
Get access

Summary

This chapter provides a short introduction and background to some of the WPBA methods: the long case, Assessment of Clinical Expertise (ACE), multi-source feedback (MSF), mini-Clinical Evaluation Exercise (mini-CEX), Direct Observation of Procedural Skills (DOPS), case-based discussion, and Journal Club Presentation.

For each assessment method, what the approach practically involves is first defined, before considering the key messages and research evidence from the literature.

The long case

Across most medical specialties, the traditional long case has historically occupied a central and critical role in the evaluation of clinical skills (Weiss, 2002). In the long case, trainees are given 30–60 min of unobserved time to interview and examine an unstandardised patient, before presenting and discussing the case with one or more examiners. This assessment can take up to an hour.

For examination purposes, the underlying belief is that within a single long case, active and usually unstructured questioning by an experienced examiner can determine a trainee's competency. The key assessment strength of this approach is that trainees are required to formulate differential diagnosis and management plans for real patients in an actual clinical setting. However, the method has been criticised for the poor reliability of its assessments, and the lack of direct examiner observation of the trainee/patient encounter (reducing the validity of assessments). Consequently, a new instrument for undertaking long-case assessments with psychiatric trainees has been developed – the ACE.

Reliability of the long case

Concerns have repeatedly been voiced about the reliability of information generated through the traditional long case. This is because it is usually based upon a single patient encounter and unstructured examiner questioning. This causes three problems (Norcini, 2001, 2002).

  • Inter-case reliability. The long case is typically based on one in-depth patient encounter. However, trainees’ performances will vary across cases, reflecting their strengths and weaknesses across different patient problems, and the different responses of patients to them. Good inter-case reliability requires that a larger number, and broader sample, of different cases are included.

  • Interrater reliability. The long case is typically based upon the scores of no more than two examiners. Research shows that examiners differ in their ratings when assessing the same event. Good interrater reliability requires that multiple examiners are used.

  • Type
    Chapter
    Information
    Publisher: Royal College of Psychiatrists
    Print publication year: 2011

    Access options

    Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

    Save book to Kindle

    To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

    Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

    Find out more about the Kindle Personal Document Service.

    Available formats
    ×

    Save book to Dropbox

    To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

    Available formats
    ×

    Save book to Google Drive

    To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

    Available formats
    ×