Skip to main content Accessibility help
×
Hostname: page-component-848d4c4894-4rdrl Total loading time: 0 Render date: 2024-07-01T05:45:09.230Z Has data issue: false hasContentIssue false

thirteen - Non-experimental quantitative methods

Published online by Cambridge University Press:  09 September 2022

Huw T. O. Davies
Affiliation:
University of St Andrews
Sandra M. Nutley
Affiliation:
University of St Andrews
Peter C. Smith
Affiliation:
Imperial College London
Get access

Summary

Introduction

As Chapter Three noted, the use of the randomised controlled trial(RCT) has become widespread, and in many senses obligatory, in manyareas of healthcare. However, there are legitimate grounds forconcern about uncritical adoption of RCT methods, even inhealthcare. As the chapters in this book indicate, the extent towhich the principles of controlled experimentation have penetratedother areas of public sector activity has been much more limited.Even in education services, which share many of the characteristicsof healthcare, the RCT methodology has not been embraced withenthusiasm (see Chapter Four), in other services – such as welfare(Chapter Seven) – its use clearly poses substantial problems.

There are numerous reasons why RCT methods might not be adopted in aparticular setting. For example:

  • • it might be difficult to recruit participants willing toenter a trial;

  • • professionals might be reluctant or unable to administer atrial;

  • • a trial might for a number of reasons be consideredunethical;

  • • the costs of undertaking a prospective trial might beconsidered unacceptably high;

  • • the length of time before results emerge from a prospectivetrial might be considered unacceptably long;

  • • it might be considered impractical to design ascientifically acceptable RCT for the intervention inquestion;

  • • the intervention under investigation may have population aswell as individual effects, bringing into question therelevance of the traditional RCT;

  • • any trial would have to be undertaken in an artificialsetting, which might compromise the general relevance of theresults;

  • • outcomes and side-effects of an intervention may bedifficult to capture in any meaningful way;

  • • the impact of the intervention may be widely heterogeneousmaking the assessment of aggregate effects inappropriate(see Chapter Twelve).

Underlying several of these concerns is the fact that participants ina behavioural trial (either professionals or subjects) are consciousof their own role in the experiment, and are therefore capable ofsubverting the outcome. More generally, there is often a concernthat the very act of studying a social phenomenon changes itsbehaviour, frustrating the intended purpose of the examination (theso-called ‘Hawthorne effect’). For these and other reasons (seeChapter Twelve), there appears to have been a marked reluctance onthe part of UK researchers to pursue experimental methods in publicservices, especially when compared to their US counterparts, whohave developed a distinctive ‘evaluation’ tradition.

Type
Chapter
Information
What Works?
Evidence-Based Policy and Practice in Public Services
, pp. 277 - 290
Publisher: Bristol University Press
Print publication year: 2000

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×