Skip to main content Accessibility help


  • Lidia García-Pérez (a1) (a2) (a3) (a4), Renata Linertová (a1) (a2) (a3), Alejandro Arvelo-Martín (a1), Carolina Guerra-Marrero (a1), Carlos Enrique Martínez-Alberto (a5), Leticia Cuéllar-Pompa (a1) (a2), Antonio Escobar (a2) (a6) and Pedro Serrano-Aguilar (a2) (a3) (a7)...


Objectives: The methodological quality of an economic evaluation performed alongside a clinical trial can be underestimated if the paper does not report key methodological features. This study discusses methodological assessment issues on the example of a systematic review on cost-effectiveness of physiotherapy for knee osteoarthritis.

Methods: Six economic evaluation studies included in the systematic review and related clinical trials were assessed using the 10-question check-list by Drummond and the Physiotherapy Evidence Database (PEDro) scale.

Results: All economic evaluations were performed alongside a clinical trial but the studied interventions were too heterogeneous to be synthesized. Methodological quality of the economic evaluations reported in the papers was not free of drawbacks, and in some cases, it improved when information from the related clinical trial was taken into account.

Conclusions: Economic evaluation papers dedicate little space to methodological features of related clinical trials; therefore, the methodological quality can be underestimated if evaluated separately from the trials. Future economic evaluations should follow more strictly the recommendations about methodology and the authors should pay special attention to the quality of reporting.



Hide All
1. Drummond, MF, Sculpher, MJ, Torrance, GW, O'Brien, BJ, Stoddart, GL. Methods for the economic evaluation of health care programmes. 3rd ed. Oxford: Oxford University Press; 2005.
2. O'Sullivan, AK, Thompson, D, Drummond, MF. Collection of health-economic data alongside clinical trials: Is there a future for piggyback evaluations? Value Health. 2005;8:6779. doi:10.1111/j.1524-4733.2005.03065.
3. Centre for Reviews and Dissemination. Systematic reviews. CRD's guidance for undertaking reviews in health care. York: CRD, University of York; 2009. (accessed January 29, 2017).
4. Armijo-Olivo, S, Cummings, GG, Fuentes, J, et al. Identifying items to assess methodological quality in physical therapy trials: A factor analysis. Phys Ther. 2014;94:12721284. doi:10.2522/ptj.20130464.
5. Falagas, ME, Grigori, T, Ioannidou, E. A systematic review of trends in the methodological quality of randomized controlled trials in various research fields. J Clin Epidemiol. 2009;62:227231.e9. doi:10.1016/j.jclinepi.2008.07.012.
6. Dechartres, A, Charles, P, Hopewell, S, Ravaud, P, Altman, DG. Reviews assessing the quality or the reporting of randomized controlled trials are increasing over time but raised questions about how quality is assessed. J Clin Epidemiol. 2011;64:136144. doi:10.1016/j.jclinepi.2010.04.015.
7. Mhaskar, R, Djulbegovic, B, Magazin, A, Soares, HP, Kumar, A. Published methodological quality of randomized controlled trials does not reflect the actual quality assessed in protocols. J Clin Epidemiol. 2012;65:602609. doi:10.1016/j.jclinepi.2011.10.016.
8. García Pérez, L, Arvelo Martín, A, Guerra Marrero, C, et al. Revisión del coste-efectividad de las intervenciones de fisioterapia en la artrosis de rodilla. Ministerio de Sanidad, Servicios Sociales e Igualdad. Servicio de Evaluación del Servicio Canario de la Salud; 2013. Informes de Evaluación de Tecnologías Sanitarias.
9. PEDro Scale [Internet]. Australia: The Centre of Evidence-Based Physiotherapy (accessed January 29, 2017).
10. Maher, CG, Sherrington, C, Herbert, RD, Moseley, AM, Elkins, M. Reliability of the PEDro scale for rating quality of randomized controlled trials. Phys Ther. 2003;83:713721.
11. Lord, J, Victor, C, Littlejohns, P, Ross, FM, Axford, JS. Economic evaluation of a primary care-based education programme for patients with osteoarthritis of the knee. Health Technol Assess. 1999;3:155. doi:10.3310/hta3230.
12. Sevick, MA, Bradham, DD, Muender, M, et al. Cost-effectiveness of aerobic and resistance exercise in seniors with knee osteoarthritis. Med Sci Sports Exerc. 2000;32:15341540.
13. Beaupre, LA, Lier, D, Davies, DM, Johnston, DBC. The effect of a preoperative exercise and education program on functional recovery, health related quality of life, and health service utilization following primary total knee arthroplasty. J Rheumatol. 2004;31:11661173.
14. McCarthy, CJ, Mills, PM, Pullen, R, et al. Supplementation of a home-based exercise programme with a class-based programme for people with osteoarthritis of the knees: A randomised controlled trial and health economic analysis. Health Technol Assess. 2004;8:iii-iv, 161. doi:10.3310/hta8460.
15. Richardson, G, Hawkins, N, McCarthy, CJ, et al. Cost-effectiveness of a supplementary class-based exercise program in the treatment of knee osteoarthritis. Int J Technol Assess Health Care. 2006;22:8489. doi:10.1017/S0266462306050872.
16. Mitchell, C, Walker, J, Walters, S, et al. Costs and effectiveness of pre- and post-operative home physiotherapy for total knee replacement: Randomized controlled trial. J Eval Clin Pract. 2005;11:283292. doi:10.1111/j.1365-2753.2005.00535.x.
17. Sevick, MA, Miller, GD, Loeser, RF, Williamson, JD, Messier, SP. Cost-effectiveness of exercise and diet in overweight and obese adults with knee osteoarthritis. Med Sci Sports Exerc. 2009;41:11671174. doi:10.1249/MSS.0b013e318197ece7.
18. Ettinger, WH, Burns, R, Messier, SP, et al. A randomized trial comparing aerobic exercise and resistance exercise with a health education program in older adults with knee osteoarthritis. The Fitness Arthritis and Seniors Trial (FAST). JAMA. 1997;277:2531. doi:10.1001/jama.1997.03540250033028.
19. Messier, SP, Loeser, RF, Miller, GD, et al. Exercise and dietary weight loss in overweight and obese older adults with knee osteoarthritis: The Arthritis, Diet, and Activity Promotion Trial. Arthritis Rheum. 2004;50:15011510. doi:10.1002/art.20256.
20. McCarthy, CJ, Mills, PM, Pullen, R, et al. Supplementing a home exercise programme with a class-based exercise programme is more effective than home exercise alone in the treatment of knee osteoarthritis. Rheumatology (Oxford). 2004;43:880886. doi:10.1093/rheumatology/keh188.
21. Mahon, JL, Bourne, RB, Rorabeck, CH, et al. Health-related quality of life and mobility of patients awaiting elective total hip arthroplasty: A prospective study. CMAJ. 2002;167:11151121.
22. Dawson, J, Linsell, L, Zondervan, K, et al. Epidemiology of hip and knee pain and its impact on overall health status in older adults. Rheumatology (Oxford). 2004;43:497504. doi:10.1093/rheumatology/keh086.
23. Quintana, JM, Escobar, A, Arostegui, I, et al. Prevalence of symptoms of knee or hip joints in older adults from the general population. Aging Clin Exp Res. 2008;20:329336.
24. Zhang, W, Moskowitz, RW, Nuki, G, et al. OARSI recommendations for the management of hip and knee osteoarthritis, Part II: OARSI evidence-based, expert consensus guidelines. Osteoarthritis Cartilage. 2008;16:137162. doi:10.1016/j.joca.2007.12.013.
25. National Institute for Health and Clinical Excellence. Osteoarthritis: The care and management of osteoarthritis in adults [Internet]. London: National Institute for Health and Clinical Excellence; 2008. (accessed January 29, 2017).
26. Hiligsmann, M, Cooper, C, Arden, N, et al. Health economics in the field of osteoarthritis: An expert's consensus paper from the European Society for Clinical and Economic Aspects of Osteoporosis and Osteoarthritis (ESCEO). Semin Arthritis Rheum. 2013;43:303313. doi:10.1016/j.semarthrit.2013.07.003.
27. Sabharwal, S, Carter, A, Darzi, LA, Reilly, P, Gupte, CM. The methodological quality of health economic evaluations for the management of hip fractures: A systematic review of the literature. Surgeon. 2015;13:170176. doi:10.1016/j.surge.2014.10.005.
28. Ramsey, SD, Willke, RJ, Glick, H, et al. Cost-effectiveness analysis alongside clinical trials II-An ISPOR Good Research Practices Task Force report. Value Health. 2015;18:161172. doi:10.1016/j.jval.2015.02. 001.
29. Drummond, M, Maetzel, A, Gabriel, S, March, L. Towards a reference case for use in future economic evaluations of interventions in osteoarthritis. J Rheumatol Suppl. 2003;68:2630.
30. Gabriel, S, Drummond, M, Maetzel, A, et al. OMERACT 6 Economics Working Group report: A proposal for a reference case for economic evaluation in rheumatoid arthritis. J Rheumatol. 2003;30:886890.
31. Hiligsmann, M, Cooper, C, Guillemin, F, et al. A reference case for economic evaluations in osteoarthritis: An expert consensus article from the European Society for Clinical and Economic Aspects of Osteoporosis and Osteoarthritis (ESCEO). Semin Arthritis Rheum. 2014;44:271282. doi:10.1016/j.semarthrit.2014.06.005.
32. Husereau, D, Drummond, M, Petrou, S, et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. Value Health. 2013;16:e1-e5. doi:10.1016/j.jval.2013.02.010.
33. Drummond, MF, Jefferson, TO. Guidelines for authors and peer reviewers of economic submissions to the BMJ. The BMJ Economic Evaluation Working Party. BMJ. 1996;313:275283.
34. Begg, C, Cho, M, Eastwood, S, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996;276:637639.
35. Moseley, AM, Herbert, RD, Maher, CG, Sherrington, C, Elkins, MR. Reported quality of randomized controlled trials of physiotherapy interventions has improved over time. J Clin Epidemiol. 2011;64:594601. doi:10.1016/j.jclinepi.2010.08.009.
36. Sherrington, C, Moseley, AM, Herbert, RD, Elkins, MR, Maher, CG. Ten years of evidence to guide physiotherapy interventions: Physiotherapy Evidence Database (PEDro). Br J Sports Med. 2010;44:836837. doi:10.1136/bjsm.2009.066357.
37. Pinto, D, Robertson, MC, Hansen, P, Abbott, JH. Cost-effectiveness of nonpharmacologic, nonsurgical interventions for hip and/or knee osteoarthritis: Systematic review. Value Health. 2012;15:112.


Type Description Title
Supplementary materials

García-Pérez et al supplementary material
García-Pérez et al supplementary material 1

 Word (38 KB)
38 KB
Supplementary materials

García-Pérez et al supplementary material
García-Pérez et al supplementary material 2

 Word (26 KB)
26 KB
Supplementary materials

García-Pérez et al supplementary material
García-Pérez et al supplementary material 3

 Word (25 KB)
25 KB
Supplementary materials

García-Pérez et al supplementary material
García-Pérez et al supplementary material 4

 Word (24 KB)
24 KB
Supplementary materials

García-Pérez et al supplementary material
García-Pérez et al supplementary material 5

 Word (24 KB)
24 KB


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed