Hostname: page-component-76fb5796d-9pm4c Total loading time: 0 Render date: 2024-04-26T03:00:53.093Z Has data issue: false hasContentIssue false

How Does an Observational Assessment Adapted for Online Delivery Perform Compared to an In-Person Assessment? Learning From the National Autism Service for Adults

Published online by Cambridge University Press:  20 June 2022

Charlotte Blackmore
Affiliation:
South London and Maudsley NHS Foundation Trust, London, United Kingdom King's College London, London, United Kingdom
Alexandra Nolan*
Affiliation:
South London and Maudsley NHS Foundation Trust, London, United Kingdom
Vladimira Stoencheva
Affiliation:
South London and Maudsley NHS Foundation Trust, London, United Kingdom
Natalie Greenwood
Affiliation:
South London and Maudsley NHS Foundation Trust, London, United Kingdom
Natasha Liu-Thwaites
Affiliation:
South London and Maudsley NHS Foundation Trust, London, United Kingdom
Stefanos Maltezos
Affiliation:
South London and Maudsley NHS Foundation Trust, London, United Kingdom
Grainne McAlonan
Affiliation:
South London and Maudsley NHS Foundation Trust, London, United Kingdom King's College London, London, United Kingdom
*
*Presenting author.
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.
Aims

The National Autism Service for Adults receives over 600 referrals annually and with an extensive waitlist, COVID-19 restrictions on in-person assessments were a challenge for service delivery. We aimed to adapt the Autism Diagnostic Observation Schedule (ADOS) for online delivery and investigate whether it is comparable to the in-person ADOS in predicting Autism Spectrum Disorder (ASD) diagnostic outcome. We also aimed to obtain qualitative feedback from service users and clinicians regarding experiences of the online ADOS.

Methods

A working group of staff who administer ADOS and representatives from psychiatry, psychology and management reached consensus that an online version of ADOS module 4 was feasible based on experience that a lot information required for coding is obtained verbally and some tasks were adaptable for online delivery. After the pilot, it was agreed all algorithm items could be coded except ‘unusual eye-contact’. Subsequently, 163 service users attended an online ADOS between August 2020 and February 2021. A matched-comparison group consisted of 198 service users seen for an in-person ADOS between May 2014 and February 2020. Algorithm scores were recorded and ASD diagnosis was made by a trained clinician. Qualitative feedback regarding the online ADOS was collected from 46 service users and 11 clinicians.

Results

The working group agreed the online and in-person ADOS were closely matched regarding administration and coding. Mean scores for service users who received an ASD diagnosis were comparable for the online and in-person ADOS groups (7 and 8 respectively). This was also shown for those who were not diagnosed with ASD (3 and 4 respectively). A two-sample t-test showed no significant difference in total scores between the online and in-person ADOS (p = 0.38). Qualitative feedback suggested good service user and clinician satisfaction; only 27% of service users indicated they would have preferred an in-person assessment; 88% of clinicians reported there were gains from offering an online alternative. Although the online and in-person ADOS perform similarly, clinicians reported relying more on qualitative reports over scores from the online version to inform diagnostic decision.

Conclusion

To our knowledge, this is the first study to examine using an online ADOS within an adult diagnostic service. Due to its comparable performance, the online-ADOS is a viable alternative option for service delivery when in-person assessments are not possible. As this clinic group has high rates of comorbid mental health difficulties, the applicability of online assessments could generalise to other services and have an impact beyond the pandemic.

Type
Research
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press on behalf of the Royal College of Psychiatrists
Submit a response

eLetters

No eLetters have been published for this article.