Skip to main content Accessibility help
×
Home
Hostname: page-component-78bd46657c-2pqp7 Total loading time: 0.405 Render date: 2021-05-09T12:57:07.055Z Has data issue: true Feature Flags: { "shouldUseShareProductTool": true, "shouldUseHypothesis": true, "isUnsiloEnabled": true, "metricsAbstractViews": false, "figures": false, "newCiteModal": false, "newCitedByModal": true }

OP71 Evidence Grading Systems Used In Health Technology Assessment Practice

Published online by Cambridge University Press:  03 January 2019

Abstract

Introduction:

To facilitate moving from research findings to conclusions when conducting systematic reviews (SRs) and health technology assessments (HTAs), evidence grading systems (EGSs) have been developed to assess the quality of bodies of evidence and communicate (un)certainty about the effects of evaluated technologies. Use of EGSs has become an essential step in conducting SRs and HTAs and those relying on review conclusions should be aware of EGSs’ potential limitations.

Methods:

This study aims to identify EGSs used in SR and HTA practice, and summarize findings on their inter-rater reliability (IRR). Relevant sources were searched to identify EGSs used in recently published SRs and IRR studies of available EGSs. Members of the International Network of Agencies for Health Technology Assessment were surveyed regarding their current approaches.

Results:

Preliminary results indicate that only two conceptually similar EGSs are currently used by several organizations in SR and HTA practice: (i) the Grading of Recommendations Assessment, Development and Evaluation (GRADE) and (ii) the Agency for Healthcare Research and Quality Evidence-based Practice Center Program (AHRQ-EPC). Both approaches emphasize a structured and transparent method. However, results from published IRR studies suggest there is a risk for variability in their application due to researchers’ diverse levels of training and experience in using them, and the complexity and heterogeneity of evidence in SRs.

Conclusions:

Validated EGSs can play a critical role in whether and how research findings are eventually translated into practice. However, our results indicate a low level of uptake of EGSs in HTA practice. Both currently used EGSs are susceptible to misuse that allows different researchers to grade the same body of evidence differently, and their performance has not been robustly explored in terms of IRR. If these results stand up to replication, one cannot rely on conclusions of published SRs, which has implications for the decisions they inform.

Type
Oral Presentations
Copyright
Copyright © Cambridge University Press 2018 

Access options

Get access to the full version of this content by using one of the access options below.

Send article to Kindle

To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

OP71 Evidence Grading Systems Used In Health Technology Assessment Practice
Available formats
×

Send article to Dropbox

To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

OP71 Evidence Grading Systems Used In Health Technology Assessment Practice
Available formats
×

Send article to Google Drive

To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

OP71 Evidence Grading Systems Used In Health Technology Assessment Practice
Available formats
×
×

Reply to: Submit a response


Your details


Conflicting interests

Do you have any conflicting interests? *