Skip to main content Accessibility help
Hostname: page-component-684899dbb8-mhx7p Total loading time: 0.842 Render date: 2022-05-28T18:09:59.666Z Has data issue: true Feature Flags: { "shouldUseShareProductTool": true, "shouldUseHypothesis": true, "isUnsiloEnabled": true, "useRatesEcommerce": false, "useNewApi": true }

Chapter 8 - Quantifying Treatment Effects Using Randomized Trials

Published online by Cambridge University Press:  02 May 2020

Thomas B. Newman
University of California, San Francisco
Michael A. Kohn
University of California, San Francisco
Get access


As we noted in the Preface and Chapter 1, because the purpose of doing diagnostic tests is often to determine how to treat the patient, we may need to quantify the effects of treatment to decide whether to do a test. For example, if the treatment for a disease provides a dramatic benefit, we should have a lower threshold for testing for that disease than if the treatment is of marginal or unknown efficacy. In Chapters 2, 3, and 6, we showed how the expected benefit of testing depends on the treatment threshold probability (PTT = C/[C + B]) in addition to the prior probability and test characteristics. In this chapter, we discuss how to quantify the benefits and harms of treatments (which determine C and B) using the results of randomized trials. In Chapter 9, we will extend the discussion to observational studies of treatment efficacy; in Chapter 10, we will look at screening tests themselves as treatments and how to quantify their efficacy.

Evidence-Based Diagnosis
An Introduction to Clinical Epidemiology
, pp. 205 - 230
Publisher: Cambridge University Press
Print publication year: 2020

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)


Ehrhardt, S, Appel, LJ, Meinert, CL. Trends in National Institutes of Health Funding for Clinical Trials Registered in JAMA. 2015;314(23):2566–7.CrossRefGoogle ScholarPubMed
Lexchin, J, Bero, LA, Djulbegovic, B, Clark, O. Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ. 2003;326(7400):1167–70.CrossRefGoogle ScholarPubMed
Bekelman, JE, Li, Y, Gross, CP. Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA. 2003;289(4):454–65.CrossRefGoogle ScholarPubMed
Heres, S, Davis, J, Maino, K, et al. Why olanzapine beats risperidone, risperidone beats quetiapine, and quetiapine beats olanzapine: an exploratory analysis of head-to-head comparison studies of second-generation antipsychotics. Am J Psychiatry. 2006;163(2):185–94.CrossRefGoogle ScholarPubMed
Lundh, A, Lexchin, J, Mintzes, B, Schroll, JB, Bero, L. Industry sponsorship and research outcome. Cochrane Database Syst Rev. 2017;2:MR000033.Google ScholarPubMed
Turner, EH, Matthews, AM, Linardatos, E, Tell, RA, Rosenthal, R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008;358(3):252–60.CrossRefGoogle ScholarPubMed
Hulley, S, Grady, D, Bush, T, et al. Randomized trial of estrogen plus progestin for secondary prevention of coronary heart disease in postmenopausal women. Heart and Estrogen/progestin Replacement Study (HERS) Research Group. JAMA. 1998;280(7):605–13.CrossRefGoogle ScholarPubMed
Van Spall, HG, Toren, A, Kiss, A, Fowler, RA. Eligibility criteria of randomized controlled trials published in high-impact general medical journals: a systematic sampling review. JAMA. 2007;297(11):1233–40.CrossRefGoogle ScholarPubMed
Zimmerman, M, Chelminski, I, Posternak, MA. Generalizability of antidepressant efficacy trials: differences between depressed psychiatric outpatients who would or would not qualify for an efficacy trial. Am J Psychiatry. 2005;162(7):1370–2.CrossRefGoogle Scholar
Anker, SD, Comin Colet, J, Filippatos, G, et al. Ferric carboxymaltose in patients with heart failure and iron deficiency. N Engl J Med. 2009;361(25):2436–48.CrossRefGoogle ScholarPubMed
Stempel, DA, Raphiou, IH, Kral, KM, et al. Serious asthma events with fluticasone plus salmeterol versus fluticasone alone. N Engl J Med. 2016;374(19):1822–30.CrossRefGoogle ScholarPubMed
Salpeter, SR, Buckley, NS, Ormiston, TM, Salpeter, EE. Meta-analysis: effect of long-acting beta-agonists on severe asthma exacerbations and asthma-related deaths. Ann Intern Med. 2006;144(12):904–12.CrossRefGoogle ScholarPubMed
Chen, SL, Yan, J, Wang, FS. Two topical calcineurin inhibitors for the treatment of atopic dermatitis in pediatric patients: a meta-analysis of randomized clinical trials. J Dermatolog Treat. 2010;21(3):144–56.CrossRefGoogle ScholarPubMed
Huang, X, Xu, B. Efficacy and safety of tacrolimus versus pimecrolimus for the treatment of atopic dermatitis in children: a network meta-analysis. Dermatology. 2015;231(1):41–9.CrossRefGoogle ScholarPubMed
Sigurgeirsson, B, Boznanski, A, Todd, G, et al. Safety and efficacy of pimecrolimus in atopic dermatitis: a 5-year randomized trial. Pediatrics. 2015;135(4):597606.CrossRefGoogle ScholarPubMed
Sihvonen, R, Paavola, M, Malmivaara, A, et al. Arthroscopic partial meniscectomy versus sham surgery for a degenerative meniscal tear. N Engl J Med. 2013;369(26):2515–24.CrossRefGoogle ScholarPubMed
Noseworthy, JH, Ebers, GC, Vandervoort, MK, et al. The impact of blinding on the results of a randomized, placebo-controlled multiple sclerosis clinical trial. Neurology. 1994;44(1):1620.CrossRefGoogle ScholarPubMed
Sugiyama, T, Tsugawa, Y, Tseng, CH, Kobayashi, Y, Shapiro, MF. Different time trends of caloric and fat intake between statin users and nonusers among US adults: gluttony in the time of statins? JAMA Intern Med. 2014;174(7):1038–45.CrossRefGoogle ScholarPubMed
Eaton, LA, Kalichman, S. Risk compensation in HIV prevention: implications for vaccines, microbicides, and other biomedical HIV prevention technologies. Curr HIV/AIDS Rep. 2007;4(4):165–72.CrossRefGoogle ScholarPubMed
Kemp, R, Prasad, V. Surrogate endpoints in oncology: when are they acceptable for regulatory and clinical decisions, and are they currently overused? BMC Med. Jul 21, 2017;15(1):134. doi: 10.1186/s12916-017-0902-9. PubMed PMID: 28728605; PubMed Central PMCID: PMC5520356.CrossRefGoogle ScholarPubMed
Ciani, O, Buyse, M, Garside, R, et al. Comparison of treatment effect sizes associated with surrogate and final patient relevant outcomes in randomised controlled trials: meta-epidemiological study. BMJ. 2013;346:f457.CrossRefGoogle ScholarPubMed
Guyatt, GD, Rennie, D, Meade, M, et al. Users’ guides to the medical literature: a manual for evidence-based clinical practice. 2nd ed. Chicago: AMA Press; 2008.Google Scholar
Action to Control Cardiovascular Risk in Diabetes Study G, Gerstein, HC, Miller, ME, Byington, RP, et al. Effects of intensive glucose lowering in type 2 diabetes. N Engl J Med. 2008;358(24):2545–59.Google ScholarPubMed
Group, AS, Gerstein, HC, Miller, ME, et al. Long-term effects of intensive glucose lowering on cardiovascular outcomes. N Engl J Med. 2011;364(9):818–28.Google Scholar
Sabatine, MS, Giugliano, RP, Keech, AC, et al. Evolocumab and clinical outcomes in patients with cardiovascular disease. N Engl J Med. 2017;376(18):1713–22.CrossRefGoogle ScholarPubMed
Ferreira-Gonzalez, I, Busse, JW, Heels-Ansdell, D, et al. Problems with use of composite end points in cardiovascular trials: systematic review of randomised controlled trials. BMJ. 2007;334(7597):786.CrossRefGoogle ScholarPubMed
Tan, NS, Ali, SH, Lebovic, G, et al. Temporal trends in use of composite end points in major cardiovascular randomized clinical trials in prominent medical journals. Circ Cardiovasc Qual Outcomes. 2017;10(10).CrossRefGoogle ScholarPubMed
Akl, EA, Briel, M, You, JJ, et al. Potential impact on estimated treatment effects of information lost to follow-up in randomised controlled trials (LOST-IT): systematic review. BMJ. 2012;344:e2809.CrossRefGoogle ScholarPubMed
Parker, MJ, Pryor, G, Gurusamy, K. Hemiarthroplasty versus internal fixation for displaced intracapsular hip fractures: a long-term follow-up of a randomised trial. Injury. 2010;41(4):370–3.CrossRefGoogle ScholarPubMed
Hernan, MA, Robins, JM. Per-protocol analyses of pragmatic trials. N Engl J Med. 2017;377(14):1391–8.CrossRefGoogle ScholarPubMed
ISIS-2. Randomised trial of intravenous streptokinase, oral aspirin, both, or neither among 17,187 cases of suspected acute myocardial infarction: ISIS-2. ISIS-2 (Second International Study of Infarct Survival) Collaborative Group. Lancet. 1988;2(8607):349–60.Google Scholar
Gabler, NB, Duan, N, Raneses, E, et al. No improvement in the reporting of clinical trial subgroup effects in high-impact general medical journals. Trials. 2016;17(1):320.CrossRefGoogle ScholarPubMed
U.S. District Court for the State of Massachusetts. United States vs GlaxoSmithKine, Complaint. 2011. accessed September 5, 2019.Google Scholar
Keller, MB, Ryan, ND, Strober, M, et al. Efficacy of paroxetine in the treatment of adolescent major depression: a randomized, controlled trial. J Am Acad Child Adolesc Psychiatry. 2001;40(7):762–72.CrossRefGoogle ScholarPubMed
Le Noury, J, Nardo, JM, Healy, D, et al. Restoring Study 329: efficacy and harms of paroxetine and imipramine in treatment of major depression in adolescence. BMJ. 2015;351:h4320.CrossRefGoogle ScholarPubMed
Thomas, K, Schmidt, M. Glaxo agrees to pay $3 billion in fraud settlement. New York Times. July 2, 2012;Sect. Business Day.Google Scholar
Nissen, SE, Tsunoda, T, Tuzcu, EM, et al. Effect of recombinant ApoA-I Milano on coronary atherosclerosis in patients with acute coronary syndromes: a randomized controlled trial. JAMA. 2003;290(17):2292–300.CrossRefGoogle ScholarPubMed
Jones, B, Jarvis, P, Lewis, JA, Ebbutt, AF. Trials to assess equivalence: the importance of rigorous methods. BMJ. 1996;313(7048):36–9.CrossRefGoogle ScholarPubMed
Treanor, JJ, Hayden, FG, Vrooman, PS, et al. Efficacy and safety of the oral neuraminidase inhibitor oseltamivir in treating acute influenza: a randomized controlled trial. US Oral Neuraminidase Study Group. JAMA. 2000;283(8):1016–24.CrossRefGoogle ScholarPubMed
Miner, PB Jr., Koltun, WD, Wiener, GJ, et al. A randomized phase III clinical trial of plecanatide, a uroguanylin analog, in patients with chronic idiopathic constipation. Am J Gastroenterol. 2017;112(4):613–21.CrossRefGoogle ScholarPubMed
Norton, EC, Dowd, BE, Maciejewski, ML. Odds ratios-current best practice and use. JAMA. 2018;320(1):84–5.CrossRefGoogle ScholarPubMed
Tonstad, S, Tonnesen, P, Hajek, P, et al. Effect of maintenance therapy with varenicline on smoking cessation: a randomized controlled trial. JAMA. 2006;296(1):6471.CrossRefGoogle ScholarPubMed
Welliver, R, Monto, AS, Carewicz, O, et al. Effectiveness of oseltamivir in preventing influenza in household contacts: a randomized controlled trial. JAMA. 2001;285(6):748–54.CrossRefGoogle ScholarPubMed
Dobson, J, Whitley, RJ, Pocock, S, Monto, AS. Oseltamivir treatment for influenza in adults: a meta-analysis of randomised controlled trials. Lancet. 2015;385(9979):1729–37.CrossRefGoogle ScholarPubMed
Mandel, EM, Rockette, HE, Bluestone, CD, Paradise, JL, Nozza, RJ. Efficacy of amoxicillin with and without decongestant-antihistamine for otitis media with effusion in children. Results of a double-blind, randomized trial. N Engl J Med. 1987;316(8):432–7.CrossRefGoogle ScholarPubMed
Cantekin, EI, McGuire, TW, Griffith, TL. Antimicrobial therapy for otitis media with effusion (“secretory” otitis media). JAMA. 1991;266(23):3309–17.CrossRefGoogle Scholar
Cantekin, EI, McGuire, TW, Potter, RL. Biomedical information, peer review, and conflict of interest as they influence public health. JAMA. 1990;263(10):1427–30.CrossRefGoogle ScholarPubMed
Rennie, D. The Cantekin affair. JAMA. 1991;266(23):3333–7.CrossRefGoogle ScholarPubMed
Krupp, LB, Hyman, LG, Grimson, R, et al. Study and treatment of post Lyme disease (STOP-LD): a randomized double masked clinical trial. Neurology. 2003;60(12):1923–30.CrossRefGoogle ScholarPubMed
Austin, PF, Ferguson, G, Yan, Y, et al. Combination therapy with desmopressin and an anticholinergic medication for nonresponders to desmopressin for monosymptomatic nocturnal enuresis: a randomized, double-blind, placebo-controlled trial. Pediatrics. 2008;122(5):1027–32.CrossRefGoogle Scholar
Dodick, DW, Silberstein, SD, Bigal, ME, et al. Effect of Fremanezumab compared with placebo for prevention of episodic migraine: a randomized clinical trial. JAMA. 2018;319(19):19992008.CrossRefGoogle ScholarPubMed
Sabatine, MS, Giugliano, RP, Keech, AC, et al. Evolocumab and clinical outcomes in patients with cardiovascular disease. N Engl J Med. 2017;376(18):1713–22.CrossRefGoogle ScholarPubMed

Save book to Kindle

To save this book to your Kindle, first ensure is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the or variations. ‘’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats