Hostname: page-component-7c8c6479df-p566r Total loading time: 0 Render date: 2024-03-28T11:05:10.130Z Has data issue: false hasContentIssue false

A review of HTA guidelines on societal and novel value elements

Published online by Cambridge University Press:  25 May 2023

Rachel Milstein Breslau
Affiliation:
Center for the Evaluation of Value and Risk in Health, Institute for Clinical Research and Health Policy Studies, Tufts Medical Center, Boston, MA, USA
Joshua T. Cohen
Affiliation:
Center for the Evaluation of Value and Risk in Health, Institute for Clinical Research and Health Policy Studies, Tufts Medical Center, Boston, MA, USA
Jose Diaz
Affiliation:
Bristol-Myers Squibb Pharmaceuticals Ltd., Uxbridge, UK
Bill Malcolm
Affiliation:
Bristol-Myers Squibb Pharmaceuticals Ltd., Uxbridge, UK
Peter J. Neumann*
Affiliation:
Center for the Evaluation of Value and Risk in Health, Institute for Clinical Research and Health Policy Studies, Tufts Medical Center, Boston, MA, USA
*
Corresponding author: Peter J. Neumann; Email: pneumann@tuftsmedicalcenter.org
Rights & Permissions [Opens in a new window]

Abstract

Objectives

Health technology assessment (HTA) organizations vary in terms of how they conduct assessments. We assess whether and to what extent HTA bodies have adopted societal and novel elements of value in their economic evaluations.

Methods

After categorizing “societal” and “novel” elements of value, we reviewed fifty-three HTA guidelines. We collected data on whether each guideline mentioned each societal or novel element of value, and if so, whether the guideline recommended the element’s inclusion in the base case, sensitivity analysis, or qualitative discussion in the HTA.

Results

The HTA guidelines mention on average 5.9 of the twenty-one societal and novel value elements we identified (range 0–16), including 2.3 of the ten societal elements and 3.3 of the eleven novel value elements. Only four value elements (productivity, family spillover, equity, and transportation) appear in over half of the HTA guidelines, whereas thirteen value elements are mentioned in fewer than one-sixth of the guidelines, and two elements receive no mention. Most guidelines do not recommend value element inclusion in the base case, sensitivity analysis, or qualitative discussion in the HTA.

Conclusions

Ideally, more HTA organizations will adopt guidelines for measuring societal and novel value elements, including analytic considerations. Importantly, simply recommending in guidelines that HTA bodies consider novel elements may not lead to their incorporation into assessments or ultimate decision making.

Type
Assessment
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2023. Published by Cambridge University Press

Introduction

It is well known that health technology assessment (HTA) organizations vary in terms of how they conduct assessments (Reference Fontrier, Visintin and Kanavos1). This paper focuses on whether and how HTA bodies have adopted “societal” and so-called novel elements of value in their economic evaluations. Following recent guidance, we define HTA as “a multidisciplinary process that uses explicit methods to determine the value of a health technology at different points in its lifecycle…” and whose purpose is “to inform decision making in order to promote an equitable, efficient, high-quality health system” (Reference O’Rourke, Oortwijn, Schuller and International Joint Task2).

By societal elements, we mean components beyond health impacts to the treated individual and costs beyond those incurred by the healthcare sector to deliver those interventions. By novel elements, we denote certain additional elements (e.g., insurance value, severity modifiers, and value of hope), that may reflect value but are not normally captured in conventional cost-effectiveness analyses (CEAs) and were highlighted by the ISPOR Special Task Force on U.S. value assessments (Reference Lakdawalla, Doshi and Garrison3).

We acknowledge at the outset some arbitrariness in the way we categorized “societal” versus “novel” elements or included them at all and that other investigators might categorize them differently. HTA organizations and consensus panels have differed in the manner in which they have defined and included societal elements, and some bodies that have mainly used a payer perspective have sometimes included certain societal elements (Reference Neumann, Sanders, Russell, Siegel and Ganiats4). Moreover, research on defining value elements continues to evolve, particularly in light of the COVID-19 pandemic (Reference Neumann, Cohen, Kim and Ollendorf5). Nonetheless, given the growing importance of HTA organizations in informing drug pricing and reimbursement, and ongoing debates about appropriate methods for value assessment, it is important to explore whether and how HTAs are formally incorporating these elements into evaluations. Our aim was to investigate whether and to what extent HTA bodies have adopted “societal” and novel elements of value in their economic evaluations, and whether such adoption has increased over time. We hypothesized that HTA guidelines published more recently would include a greater proportion of the value elements because of the heightened discussion of and research on these elements in recent years.

Methods

Identification of societal and novel value elements

Societal elements. Health economists have long recognized the importance of “perspective” in economic evaluations and have broadly distinguished a healthcare sector (or payer) perspective from a societal perspective. As noted, for example, by the Second Panel on Cost-Effectiveness in Health and Medicine, the healthcare sector perspective “reflects the view of a decision maker whose responsibility rests only within that sector”; in contrast, a “societal perspective reflects the perspective of a decision maker whose intention is to make decisions about the broad allocation of resources across the entire population” (Reference Neumann, Sanders, Russell, Siegel and Ganiats4).

The perspective taken in an analysis determines the components to consider. A healthcare payer perspective typically includes the medical costs borne by public or private payers and a healthcare sector perspective includes these costs in addition to out-of-pocket health costs shouldered by patients. (Some analysts focus on a healthcare payer perspective, including only those costs directly affecting the payer.) While definitions of societal elements differ somewhat across jurisdictions and guidelines, they often include elements, such as time costs incurred by patients in seeking and receiving care, time costs incurred by informal (unpaid) caregivers, transportation costs, effects on future productivity and consumption, and other costs and effects outside the healthcare sector (Reference Neumann, Sanders, Russell, Siegel and Ganiats4). The Second Panel recommended that CEAs include an impact inventory, which enumerates societal elements in the informal healthcare sector (patient-time costs, unpaid caregiver-time costs, and transportation costs) and non-healthcare sectors (productivity, consumption, social services, legal or criminal justice, education, housing, and environment) (Reference Neumann, Sanders, Russell, Siegel and Ganiats4).

Motivated by the impacts of COVID-19, we also included economic activity and healthcare capacity as elements of value in this study. By economic activity, we mean the impact a disease can have on supply and demand in the broader economy and the subsequent changes a treatment for that disease might induce. By healthcare capacity, we mean the effects of the strain on the healthcare system when a disease causes it to approach or reach its capacity to treat patients.

Novel elements. The term “novel” elements stems from the 2018 report of the ISPOR Strategic Task Force (STF), which called attention to other elements typically not included in conventional CEAs (Reference Lakdawalla, Doshi and Garrison3). The STF identified two common, but inconsistently included value elements (labor productivity and adherence-improving factors), which we will categorize as novel elements in this study, and eight newer elements (reduction of uncertainty, fear of contagion, insurance value, severity of disease, value of hope, real option value, equity, and scientific spillovers) (Reference Lakdawalla, Doshi and Garrison3). Some of the novel elements reflect the idea that quality-adjusted life-years (QALYs) may not account for people’s preferences to avoid risk and uncertainty (Reference Lakdawalla and Phelps6). For example, even if it does not improve outcomes on average, individuals may prefer a drug with more predictable benefits; QALYs would not account for this preference. Furthermore, QALYs do not distinguish between a long period spent in a moderately diminished health state and a shorter period spent in a more severe health state. In reality, people may prioritize severe disease treatments, whether or not that is consistent with QALY maximization. In addition, individuals may place a premium on therapies that offer a small chance of substantial health gains, a phenomenon sometimes called the “value of hope” (Reference Lakdawalla, Romley and Sanchez7Reference Shafrin, Schwartz, Okoro and Romley9). That is, many patients would be willing to gamble on a risky but promising cancer drug, even if a QALY-maximizing strategy would not recognize such preferences (Reference Lakdawalla, Romley and Sanchez7). Building on our previous work on lifecycle drug pricing, we also assessed HTA guideline inclusion of drug genericization, an allowance for future generic drug entry and subsequent price declines (Reference Neumann, Podolsky, Basu, Ollendorf and Cohen10). Though it is not a value element, per se, but rather a methodological consideration for calculating future costs, we include drug genericization here for completeness because it is an often omitted and debated component of value assessment (Table 1).

Table 1. List of societal and novel value elements considered

Selection of HTA guidelines

We reviewed fifty-three HTA guidelines to determine whether and how they referenced societal and novel elements of value (Reference Neumann, Sanders, Russell, Siegel and Ganiats4;1162). The sample draws upon our prior work reviewing HTA guidelines on other aspects of CEA (Reference Kim, Silver and Kunst63), and is based on an updated search of the literature (as of December 2021) as well as a review of web sites of HTA organizations and the ISPOR inventory of “Pharmacoeconomic Guidelines Around the World” (64). As in our prior research, for completeness, we included seven notable nongovernment, United States, and international HTA guidelines (from the Institute for Clinical and Economic Review (ICER), the ISPOR Drug Cost Task Force, the Second Panel, the Academy of Managed Care Pharmacy, WellPoint, Drummond et al., and Wilkinson et al.) (Reference Neumann, Sanders, Russell, Siegel and Ganiats4;11;Reference Hay, Smeeding and Carroll52;54;Reference Sweet, Tadlock, Waugh, Hess and Nguyen59Reference Drummond, Sculpher, Claxton, Stoddart and Torrance61). While these practices or guidelines are not produced by government entities, they are well-known and commonly cited references for CEAs in the United States and internationally.

The fifty-three guidelines in our final sample represent fifty-two countries. In three cases (the MERCOSUR nations of Argentina, Brazil, Paraguay, and Uruguay (65); the Baltic states of Latvia, Estonia, and Lithuania (Reference Behmane, Lambot, Irs and Steikunas14); and the United Kingdom nations of England and Wales (24)), multiple countries share a single guideline. In other cases, the guidelines do not represent a specific country (ISPOR Drug Cost Task Force, the Second Panel, The Academy of Managed Care Pharmacy, WellPoint, Drummond et al., and Wilkinson et al.) (Reference Neumann, Sanders, Russell, Siegel and Ganiats4;11;Reference Hay, Smeeding and Carroll52;54;Reference Sweet, Tadlock, Waugh, Hess and Nguyen59Reference Drummond, Sculpher, Claxton, Stoddart and Torrance61) or multiple guidelines represent the same country (MERCOSUR guideline (65) and Brazilian guideline (62)) (Table 2 and Appendix Table 1 in the Supplementary Material).

Table 2. Characteristics of HTA guidelines by country income

Abbreviations: AMCP, Academy of Managed Care Pharmacy; HTA, health technology assessment; ICER, Institute for Clinical and Economic Review; ISPOR, The Professional Society for Health Economics and Outcomes Research; MERCOSUR, Common Markets for South Latin America (Argentina, Brazil Paraguay, and Uruguay); NA, not applicable.

Development of data collection form

We created a data collection form to record salient information. We collected data on whether each guideline mentioned each societal or novel element of value, and if so, whether the guideline recommended the element’s inclusion in the base case, sensitivity analysis, or qualitative discussion in the HTA. These categories are not mutually exclusive or exhaustive. A guideline could recommend an element’s inclusion in multiple categories or mention an element and not recommend its inclusion in any of these categories (Appendix Table 2 in the Supplementary Material).

Data collection

Two researchers pilot-tested the form on five randomly-selected HTA body guidelines and made minor changes to the form based on the results. Appendix Table 2 in the Supplementary Material includes the final form. One researcher then abstracted data on the remaining HTA body guidelines, which together with the five pilot guidelines we retained, yielded a final sample of fifty-three guidelines. The researcher abstracted data independently and met with other researchers to resolve any uncertainty.

Results

Characteristics of HTA guidelines

The HTA organizations in our sample included forty-six government agencies (Reference Merlin, Tamblyn, Schubert, Salisbury and Irish12Reference Chaikledkaew and Teerawattananon51;Reference Fajardo, Guerrero, Obmana, Reyes, Uezono and Zuniga53;Reference Liu, Hu and Wu55Reference Sweet, Tadlock, Waugh, Hess and Nguyen59;62), six independent organizations (Reference Neumann, Sanders, Russell, Siegel and Ganiats4;11;Reference Hay, Smeeding and Carroll52;54;Reference Wilkinson, Sculpher and Claxton60;Reference Drummond, Sculpher, Claxton, Stoddart and Torrance61), and one U.S. private payer (Wellpoint) (Reference Sweet, Tadlock, Waugh, Hess and Nguyen59). The government organizations come from countries with a range of per capita incomes, including high-income countries (thirty-four guidelines) (11Reference Riquelme, Laborde, Saldivia and Pastén17;20Reference Kristensen and Sigmund22;24Reference Dóczy, Dózsa and Dudás28;30Reference Fukuda33;35;3745;4750;Reference Hay, Smeeding and Carroll52;54;57;Reference Sweet, Tadlock, Waugh, Hess and Nguyen5962), upper middle-income (ten guidelines) (Reference Moreno Viscaya, Mejía Mejía and Castro Jaramillo18;Reference Gálvez González19;34;36;46;Reference Chaikledkaew and Teerawattananon51;Reference Liu, Hu and Wu55;56;62;65), and lower-middle (four guidelines) (Reference Elsisi, Kaló and Eldessouki23;29;Reference Fajardo, Guerrero, Obmana, Reyes, Uezono and Zuniga53;58) (Table 2). Government and foundation funding supports most of the work conducted by these HTA organizations. The HTA organizations published the guidelines included in our sample from 2002 to 2022. The guidelines make recommendations pertaining to different types of clinical and economic evaluations, including cost–utility analysis, CEA, cost–benefit analysis, cost–consequence analysis, cost minimization analysis, and budget impact analysis. Most of the guidelines are from high-income countries and most mentioned at least one of the value elements we considered (Table 2). Forty guidelines recommend a societal perspective, thirty-four recommend a healthcare payer perspective, and nine recommend a healthcare sector perspective (not mutually exclusive).

HTA guidelines’ mention of societal and novel elements

HTA guidelines vary in terms of the number and type of value elements they mention (Appendix Table 3 in the Supplementary Material). Most HTA guidelines mention few societal and novel value elements. The HTA guidelines in our sample mentioned on average 5.9 of the twenty-one value elements we identified, ranging from 0 to 16. The HTA guidelines mentioned on average 2.3 of the ten societal elements we identified and 3.3 of the eleven novel value elements. The frequency with which the value elements appear in the HTA guidelines also varies widely (Table 3). Only four value elements (productivity, family spillover, equity, and transportation) appear in over half of the HTA guidelines, thirteen value elements are mentioned in fewer than one-sixth of the guidelines, and two elements receive no mention (Table 3).

Table 3. HTA organizations inclusion of value elements

a There were a total of fifty-three HTAs.

Abbreviation: HTA, health technology assessment.

HTA guideline recommendations pertaining to societal and novel elements

Recommendations vary with regard to how HTAs should include the elements in their analysis. Some guidelines do not offer specific recommendations for measuring or including value elements and others provide varying levels of detail on the topic. Most guidelines do not recommend value element inclusion in the base case, sensitivity analysis, or qualitative discussion in the HTA. In our sample, the fifty-three HTA guidelines could have recommended the inclusion of each of the twenty-one value elements in the base case analysis for a total of 1,113 opportunities for an HTA guideline to recommend inclusion of a value element in the base case analysis. On average across all value elements included in our analysis, HTA guidelines recommend inclusion of a value element in the base case in 7 percent (seventy-seven) of those opportunities. Guidelines recommend inclusion of an element in the sensitivity analysis in 8 percent (eighty-eight) of those opportunities, and recommend qualitative discussion of an element in 4 percent (forty-six) of those opportunities. The elements that HTA guidelines most often recommended for inclusion in the base-case analysis are family spillover (34 percent), productivity (26 percent), and transportation (26 percent), followed by genericization (17 percent), social services (13 percent), and adherence-improving factors (9 percent). Fewer than 7 percent of HTA guidelines recommended the inclusion of the remaining elements in the base-case analysis. Patterns of recommendation vary by value element. For example, 43 percent of HTA guidelines (twenty-three of fifty-three) recommend including productivity in a sensitivity analysis, 26 percent (fourteen of fifty-three) recommend including productivity in the base case, and 4 percent (two of fifty-three) recommend including productivity in a qualitative discussion (Table 3). Thirty-four percent of HTA guidelines recommend including family spillover in the base case, and 34 percent recommend including this element in the sensitivity analysis (Table 3). Sixty-six percent of guidelines mention equity, although none of those guidelines recommends its inclusion in the base case analysis (Table 3). Only 9 percent of guidelines recommend including equity in the sensitivity analysis, whereas 43 percent recommend including equity in a qualitative discussion (Table 3).

Inclusion of societal and novel value elements over time

The proportion of societal and novel value elements included appears on average to be higher in guidelines published more recently (Figure 1).

Figure 1. HTA guideline inclusion of societal and novel value elements over time. This figure reflects a linear regression weighted by country total health expenditure. The outcome is the proportion of guidelines including either societal or novel elements; the independent variable is the year the guideline was published. The proportion of societal and novel value elements included appears on average to be higher in guidelines published more recently.

Discussion

HTA organizations vary substantially in terms of the societal and novel elements of value they consider in their guidelines. Although mention of novel and societal elements appears to be growing over time, many guidelines still exclude them. When HTA guidelines do mention value elements, they infrequently recommend their inclusion in base case analysis, though some recommend their inclusion in sensitivity analysis and in qualitative discussions.

The quantitative inclusion of value elements in the calculation of a cost-effectiveness ratio rather than qualitatively alongside a ratio has advantages and potential downsides. Quantitative inclusion allows for explicit weighting of different value attributes, though it poses challenges due to the lack of consensus in the field (e.g., on how to include elements such as family spillover effects and equity) and a lack of data to support estimates. Including such elements qualitatively allows audiences to synthesize information in a more holistic manner, though it masks information about the weight assigned to different factors.

Gaps may exist between HTA organizations’ recommendations and actual practice in the jurisdictions they cover. As one example, ICER recommends inclusion of a modified societal perspective when “the societal costs of care for any disease are large relative to the direct healthcare costs, and… the impact of treatment on these costs is substantial…” (11). However, ICER’s 2020 assessment of remdesivir for COVID-19 excluded consideration of certain societal value elements, such as a COVID-19 treatment’s potential impact on people’s ability to return to work and on reducing COVID-19’s impact on the United States healthcare system’s capacity (Reference Cohen, Neumann and Ollendorf66).

Debates about how expansive to make value assessments continue. Proponents of including societal and novel elements argue that conventional CEAs fail to account for important benefits conferred by healthcare interventions (Reference Garrison, Zamora, Li and Towse67). Skeptics express concerns about augmenting traditional analyses, pointing to the potential for double counting elements, and a lack of suitable data. Some view the practice as undermining a more pragmatic healthcare system centric (i.e., “extra-welfarist”) approach for CEA (Reference Watkins and Tsiao68;Reference Goring, Garrison, Jansen and Briggs69).

Future research should investigate how HTA organizations handle the inclusion and measurement of societal and novel value elements (Reference Yuasa, Yonemoto, Demiya, Foellscher and Ikeda70) and how much inclusion of elements influences results. Shafrin et al. found that willingness to pay by healthy individuals for generous insurance coverage (insurance value) for new lung cancer treatments may represent almost 90 percent of the value for these treatments (Reference Shafrin, May and Zhao71). In a study of the value of hope, Reed et al. found that, holding expected survival constant, participants would pay $6,446 to increase the chance of long-term survival from 5 to 10 percent (Reference Reed, Yang, Gonzalez and Johnson72). Multiple studies have estimated the real option value of a cancer drug that allowed patients to survive until the introduction of a new treatment, with estimates varying from .4 to 57 percent (Reference Li, Basu, Bennette, Veenstra and Garrison73Reference Wong, To and Li76).

HTA organizations may omit societal and novel elements for a number of reasons. First, their purview may extend to payers with narrow remits to allocate fixed health budgets. Second, they may have significant concerns about the feasibility of estimating societal and novel elements. Less mature HTA organizations may lack the expertise and resources to assess societal and novel elements and would benefit from collaboration with larger HTA organizations. Possibly, efforts such as the EuNetHTA core model could help in these efforts.

Ideally, more HTA organizations will consider adopting guidelines for measuring societal and novel value elements, including analytic considerations (i.e., whether to include them in base case, in sensitivity analysis, or in qualitative discussion). To be sure, including non-healthcare value elements can be technically challenging and can add uncertainty and these factors must be considered. But such a step would more appropriately reflect the full consequences of using new technologies and is worth undertaking.

Importantly, simply recommending in guidelines that HTA bodies consider novel elements may not lead to their incorporation into assessments or ultimate decision making. Future research should explore to what extent HTAs include societal and novel value elements in practice, to what extent decision makers factor this information into their coverage and reimbursement decisions, and the implications for resource allocation. Finally, it will be important for manufacturers to design, develop, and communicate robust and pertinent evidence on societal and novel value elements related to their products across different dimensions, stakeholders, and sectors.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S026646232300017X.

Funding statement

This work was supported by Bristol-Myers Squibb.

Competing interest

R.B. declares no conflicts of interest. J.T.C. has received grants from PhRMA Foundation, National Pharmaceutical Council, Astra Zeneca, Bristol Myers Squibb, Eli Lilly, Gilead, Regeneron, Pfizer, Merck, Johnson and Johnson, Vir Bio, Moderna, Amgen, and Lundbeck. He has consulted for AbbVie, Analysis Group, Biogen, IQVIA, Merck, Novartis, Partnership for Health Analytic Research, PharMerit, Precision Health Economics, Sage, Sanofi, and Sarepta. He reports stock in Bristol Myers Squibb, Johnson and Johnson, and Merck. J.D. and B.M. report stock and other financial interests with Bristol-Myers Squibb Company. P.J.N. has received grants from NPC, NIH, Alzheimer’s Association, Arnold Ventures, BMS, Otsuka, and Travere. He has received payment from the CEA registry sponsors and has consulted and participated on advisory boards for CBO, Bayer, Panalgo, Merck, ArgenX, Novartis Gene Therapy, and Sarepta.

References

Fontrier, AM, Visintin, E, Kanavos, P. Similarities and differences in health technology assessment systems and implications for coverage decisions: Evidence from 32 countries. Pharmacoecon Open. 2022;6(3):315328.CrossRefGoogle ScholarPubMed
O’Rourke, B, Oortwijn, W, Schuller, T, International Joint Task, G. The new definition of health technology assessment: A milestone in international collaboration. Int J Technol Assess Health Care. 2020;36(3):187190.CrossRefGoogle ScholarPubMed
Lakdawalla, DN, Doshi, JA, Garrison, LP Jr., et al. Defining elements of value in health care-A health economics approach: An ISPOR special task force report [3]. Value Health. 2018;21(2):131139.CrossRefGoogle ScholarPubMed
Neumann, PJ, Sanders, GD, Russell, LB, Siegel, JE, Ganiats, TG. Cost-effectiveness in health and medicine, 2nd ed. Oxford: Oxford University Press; 2017.Google Scholar
Neumann, PJ, Cohen, JT, Kim, DD, Ollendorf, DA. Consideration of value-based pricing for treatments and vaccines is important, even in the COVID-19 pandemic. Health Aff (Millwood). 2021;40(1):5361.CrossRefGoogle ScholarPubMed
Lakdawalla, DN, Phelps, CE. Health technology assessment with risk aversion in health. J Health Econ. 2020;72:102346.CrossRefGoogle ScholarPubMed
Lakdawalla, DN, Romley, JA, Sanchez, Y, et al. How cancer patients value hope and the implications for cost-effectiveness assessments of high-cost cancer therapies. Health Affairs. 2012;31(4):676682.CrossRefGoogle ScholarPubMed
Lin, P-J, Concannon, TW, Greenberg, D, et al. Does framing of cancer survival affect perceived value of care? A willingness-to-pay survey of US residents. Expert Rev Pharmacoecon Outcomes Res. 2013;13(4):513522.CrossRefGoogle Scholar
Shafrin, J, Schwartz, TT, Okoro, T, Romley, JA. Patient versus physician valuation of durable survival gains: Implications for value framework assessments. Value Health. 2017;20(2):217223.CrossRefGoogle ScholarPubMed
Neumann, PJ, Podolsky, MI, Basu, A, Ollendorf, DA, Cohen, JT. Do cost-effectiveness analyses account for drug genericization? A literature review and assessment of implications. Value Health. 2022;25(1):5968.CrossRefGoogle ScholarPubMed
Institute for Clinical and Economic Review. ICER’s reference case for economic evaluations: Principles and rationale. 2020 January 31; 2020.Google Scholar
Merlin, T, Tamblyn, D, Schubert, C, Salisbury, J, Irish, J. Guidelines for preparing a submission to the pharmaceutical benefits advisory committee. Australian Government Department of Health; 2016.Google Scholar
Walter, E, Zehetmatyr, S. Guidelines on health economic evaluation: Consensus paper. Wolfengasse, Vienna: Institute for Pharmaeconomic Research; 2006.Google Scholar
Behmane, D, Lambot, K, Irs, A, Steikunas, N. Baltic guideline for economic evaluation of pharmaceuticals (pharmacoeconomic analysis). Baltic Health Authorities, 2002 August 8; 2002.Google Scholar
Cleemput, I, Neyt, M, Van de Sande, S, Thiry, N. Belgian guidelines for economic evaluations and budget impact analyses, 2nd edn. Brussels: Health Care Knowledge Centre; 2012. Contract No.: 183C.Google Scholar
Lee, KM, McCarron, CE, Bryan, S, et al. Guidelines for the economic evaluation of health technologies: Canada. Ottawa: CADTH; 2017.Google Scholar
Riquelme, MC, Laborde, CC, Saldivia, SL, Pastén, MA. Guía metodológica para la evaluación económica de intervenciones en salud en Chile. Ministerio de Salud de Chile, Departamento de Economía de la Salud SdSP; 2013.Google Scholar
Moreno Viscaya, M, Mejía Mejía, A, Castro Jaramillo, HE. Manual para la elaboración de evaluaciones económicas en salud. Bogóta D.C.: Instituto de Evaluación Tecnológica en Salud; 2014.Google Scholar
Gálvez González, AM. Guía metodológica para la evaluación económica en salud. Cuba, 2003. Revista Cubana de Salud Pública. 2004;30(1): 135.Google Scholar
Agency for Quality and Accreditation in Health Care. The Croatian guideline for health technology assessment process and reporting. Zagreb: Agency for Quality and Accreditation in Health Care, Department for Development RaHTA; 2011.Google Scholar
Státní Ústav pro Kontrolu Léçiv. Postup pro posuzování analýzy nákladové efektivity. Státní Ústav pro Kontrolu Léçiv, 2017 May 17; 2017.Google Scholar
Kristensen, FB, Sigmund, H. Health technology assessment handbook. Denmark: Danish Centre for Health Technology Assessment; 2008 February 15, 2008.Google Scholar
Elsisi, GH, Kaló, Z, Eldessouki, R, et al. Recommendations for reporting pharmacoeconomic evaluations in Egypt. Value Health Reg Issues. 2013;2(2):319327.CrossRefGoogle ScholarPubMed
National Institute for Health and Care Excellence. Developing NICE guidelines: The manual. National Institute for Health and Care Excellence; 2014.Google Scholar
Pharmaceuticals Pricing Board. Preparing a health economic evaluation to be attached to the application for reimbursement status and wholesale price for a medicinal product. Application instructions. Ministry of Social Affairs and Health; 2019.Google Scholar
Haute Autorité de santé. Choix méthodologiques pour l’évaluation économique à la HAS. Saint-Denis, France: Haute Autorité de santé; 2020 July 2, 2020.Google Scholar
Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen. Allgemeine methoden. Köln: Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen; 2020.Google Scholar
Dóczy, V, Dózsa, C, Dudás, D, et al. Professional healthcare guideline on the methodology of health technology assessment. Gyógyszereink. 2017;67(1).Google Scholar
Indonesian Health Technology Assessment Committee. Health technology assessment (HTA) guideline. Jakarta, India: Ministry of Health; 2017.Google Scholar
Health Information and Quality Authority. Guidelines for the economic evaluation of health technologies in Ireland. Health Information and Quality Authority; 2019.Google Scholar
Ministry of Health Pharmaceutical Administration. Guidelines for the submission of a request to include a pharmaceutical product in the national list of health services. Jerusalem, Israel: Ministry of Health Pharmaceutical Administration; 2010.Google Scholar
Farmaco AId. Per la Compilazione del Dossier a supporto della domanda di rimborsabilità e prezzo di un medicinale; 2020.Google Scholar
Fukuda, T Guideline for preparing cost-effectiveness evaluation to the central social insurance medical council. Center for Outcomes Research and Economic Evaluation for Health, National Institute of Public Health (C2H); 2019 February 20, 2019.Google Scholar
Pharmacy Practice & Development Division. Pharmacoeconomic guidelines for Malaysia. Selangor, Malaysia: Ministry of Health Malaysia; 2019.Google Scholar
Grupo Mercado Común. Guía para estudios de evaluación económica de tecnologías sanitarias. Ministerio de Justicia y Derechos Humanos Argentina; 2015 July 15, 2015. Contract No.: RMR2015000025.Google Scholar
Comisión Interinstitucional del Cuadro Básico y Catálogo de Insumos del Sector Salud. Guía para la conducción de estudios de evaluación económica para la actualización del cuadro básico y catálogo de insumos del sector salud en México. México, Ciudad de México: D.R. Consejo de Salubridad General; 2017.Google Scholar
Zorginstituut Nederland. Guideline for economic evaluations in healthcare Zorginstituut Nederland; 2016 June 16, 2016.Google Scholar
Pharmaceutical Management Agency. Prescription for pharmacoeconomic analysis. Methods for cost-utility analysis. Pharmaceutical Management Agency; 2015.Google Scholar
Statens legemiddelverk. Guidelines for the submission of documentation for single technology assessment (STA) of pharmaceuticals. Statens legemiddelverk; 2018 January 1, 2018.Google Scholar
Agencja Oceny Technologii Medycznych i Taryfikacji. Wytyczne oceny technologii medycznych. Agencja Oceny Technologii Medycznych i Taryfikacji; 2016.Google Scholar
Aprova os princípios e a caraterização das Orientações Metodológicas para Estudos de Avaliação Económica de Tecnologias de Saúde; 2019.Google Scholar
Scottish Medicines Consortium. Guidance to submitting companies for completion of New Product Assessment Form (NPAF). Scottish Medicines Consortium; 2020.Google Scholar
Agency for Care Effectiveness. Drug evaluation methods and process guide. Ministry of Health, Republic of Singapore; 2019.Google Scholar
Ministerstvo Zdravotníctva Slovenskej Republiky. Metodická pomôcka pre vykonávanie farmako-ekonomického rozboru lieku, medicínsko-ekonomického rozboru zdravotníckej pomôcky a medicínsko-ekonomického rozboru dietetickej potraviny. Ministerstvo Zdravotníctva Slovenskej Republiky; 2012.Google Scholar
Zavod za zdravstveno zavarovanje Slovenije. Pravilnik o razvrščanju zdravil na list. Ljubljana, Slovenia: Zavod za zdravstveno zavarovanje Slovenije; 2013 April 3, 2013.Google Scholar
Republic of South Africa Department of Health. Publication of the guidelines for pharmacoeconomic submissions. Department of Health, Republic of South Africa; 2013 February 1, 2013.Google Scholar
Health Insurance Review and Assessment Service. 의약품경제성평가 지침 및 자료작성요령. Health Insurance Review and Assessment Service (HIRA); 2011.Google Scholar
López-Bastida, J, Oliva, J, Antoñanzas, F, et al. Spanish recommendations on economic evaluation of health technologies. Eur J Health Econ. 2010;11:513520.CrossRefGoogle ScholarPubMed
Tandvårds- och läkemedelsförmånsverket (TLV). Tandvårds- och läkemedelsförmånsverkets allmänna råd; 2017 January 26, 2017.Google Scholar
Taiwan Society for Pharmacoeconomics and Outcomes Research. Guidelines of methodological standards for pharmacoeconomic evaluations in Taiwan. Taiwan Society for Pharmacoeconomics and Outcomes Research; 2006 December 14, 2006.Google Scholar
Chaikledkaew, U, Teerawattananon, Y. คู่มือการประเมินเทคโนโลยีด้านสุขภาพสําหรับประเทศไทย ฉบับที่2. Pathumwan, Bangkok: Health Intervention and Technology Assessment Program, Thailand Ministry of Public Health; 2014.Google Scholar
Hay, JW, Smeeding, J, Carroll, NV, et al. Good research practices for measuring drug costs in cost effectiveness analyses: Issues and recommendations: The ISPOR drug cost task force report—Part I. Value Health. 2010;13(1):37.CrossRefGoogle ScholarPubMed
Fajardo, MS, Guerrero, AMS, Obmana, SML, Reyes, CJL, Uezono, DR, Zuniga, YMH. Philippine methods guide for health technology assessment. 2020. 2020.Google Scholar
Committee AF. A format for submission of clinical and economic evidence in support of formulary consideration. www.acmp.org; 2016 April, 2016.Google Scholar
Liu, GG, Hu, S, Wu, J, et al. China Guidelines for Pharmacoeconomic Evaluations; 2020 December, 2020.Google Scholar
УЧРЕЖДЕНИЕ ФГБ, помощи» Цэиккм, Федерации МзР, России») ФЦМ. МЕТОДИЧЕСКИЕ РЕКОМЕНДАЦИИ ПО ПРОВЕДЕНИЮ СРАВНИТЕЛЬНОЙ КЛИНИКО-ЭКОНОМИЧЕСКОЙ ОЦЕНКИ ЛЕКАРСТВЕННОГО ПРЕПАРАТА. 2016.Google Scholar
Gesundheit Bf. Operationalisierung der Begriffe Wirksamkeit, Zweckmässigkeit und Wirtschaftlichkeit; 21 July 2011.Google Scholar
(INEAS) INdlEedlAeS. Evaluation des technologies de santé. Choix méthodologiques pour les études pharmaco-économiques à l’INEAS; 2021.Google Scholar
Sweet, B, Tadlock, CG, Waugh, W, Hess, A, Nguyen, A. The wellpoint outcomes based formularySM: Enhancing the health technology assessment process. J Med Econ. 2005;8(1-4):1325.CrossRefGoogle Scholar
Wilkinson, T, Sculpher, MJ, Claxton, K, et al. The international decision support initiative reference case for economic evaluation: An aid to thought. Value Health. 2016;19(8):921928.CrossRefGoogle ScholarPubMed
Drummond, MF, Sculpher, MJ, Claxton, K, Stoddart, GL, Torrance, GW. Methods for the economic evaluation of health care programmes, 4th ed. Oxford: Oxford University Press; 2015.Google Scholar
MINISTÉRIO DA SAÚDE Secretaria de Ciência TeIEDdCeT. DIRETRIZES METODOLÓGICAS Diretriz de Avaliação Econômica; 2014.Google Scholar
Kim, DD, Silver, M, Kunst, N, et al. Perspective and costing in cost-effectiveness analysis, 1974–2018. PharmacoEconomics. 2020;38:11351145.CrossRefGoogle ScholarPubMed
The International Society for Pharmacoeconomics and Outcomes Research. Pharmacoeconomic guidelines around the world: The International Society for Pharmacoeconomics and Outcomes Research; 2020. Available from: https://tools.ispor.org/PEguidelines/.Google Scholar
The International Society for Pharmacoeconomics and Outcomes Research. Pharmacoeconomic guidelines around the world: country/region: MERCOSUR (Argentina, Brazil, Paraguay, Uruguay); 2020. Updated 21 January 2020. Available from: https://www.ispor.org/heor-resources/more-heor-resources/pharmacoeconomic-guidelines/pe-guideline-detail/mercosur-(argentina-brazil-paraguay-uruguay.Google Scholar
Cohen, JT, Neumann, PJ, Ollendorf, DA. Valuing and pricing remdesivir: Should drug makers get paid for helping us get back to work? Health Aff (Millwood). 2020.Google Scholar
Garrison, LP Jr, Zamora, B, Li, M, Towse, A. Augmenting cost-effectiveness analysis for uncertainty: The implications for value assessment-rationale and empirical support. J Manag Care Spec Pharm. 2020;26(4):400406.Google ScholarPubMed
Watkins, JB, Tsiao, EG. Augmenting cost-effectiveness analysis will not improve affordability. J Manag Care Spec Pharm. 2020;26(4):407408.Google Scholar
Goring, S, Garrison, LP Jr, Jansen, JP, Briggs, AH. Novel elements of the value flower: Fake or truly Novel? Value Outcomes Spotlight. 2021;7:1.Google Scholar
Yuasa, A, Yonemoto, N, Demiya, S, Foellscher, C, Ikeda, S. Investigation of factors considered by health technology assessment agencies in eight countries. Pharmacoecon Open. 2021;5(1):5769.CrossRefGoogle ScholarPubMed
Shafrin, J, May, SG, Zhao, LM, et al. Measuring the value healthy individuals place on generous insurance coverage of severe diseases: A stated preference survey of adults diagnosed with and without lung cancer. Value Health. 2021;24(6):855861.CrossRefGoogle Scholar
Reed, SD, Yang, JC, Gonzalez, JM, Johnson, FR. Quantifying value of hope. Value Health. 2021;24(10):15111519.CrossRefGoogle ScholarPubMed
Li, M, Basu, A, Bennette, C, Veenstra, D, Garrison, LP Jr. How does option value affect the potential cost-effectiveness of a treatment? The case of Ipilimumab for metastatic melanoma. Value Health. 2019;22(7):777784.CrossRefGoogle ScholarPubMed
Thornton Snider, J, Seabury, S, Tebeka, MG, Wu, Y, Batt, K. The option value of innovative treatments for metastatic melanoma. Forum Health Econ Policy. 2018;21(1).CrossRefGoogle ScholarPubMed
Lee, W, Li, M, William, WB, et al.. Modeling the ex post real option value in metastatic melanoma using real-world data. Value Health. 2021;24(10):17461753.CrossRefGoogle ScholarPubMed
Wong, WB, To, TM, Li, M, et al. Real-world evidence for option value in metastatic melanoma. J Manag Care Spec Pharm. 2021;27:15461555.Google ScholarPubMed
Figure 0

Table 1. List of societal and novel value elements considered

Figure 1

Table 2. Characteristics of HTA guidelines by country income

Figure 2

Table 3. HTA organizations inclusion of value elements

Figure 3

Figure 1. HTA guideline inclusion of societal and novel value elements over time. This figure reflects a linear regression weighted by country total health expenditure. The outcome is the proportion of guidelines including either societal or novel elements; the independent variable is the year the guideline was published. The proportion of societal and novel value elements included appears on average to be higher in guidelines published more recently.

Supplementary material: File

Breslau et al. supplementary material

Breslau et al. supplementary material 1

Download Breslau et al. supplementary material(File)
File 21.1 KB
Supplementary material: File

Breslau et al. supplementary material

Breslau et al. supplementary material 2

Download Breslau et al. supplementary material(File)
File 34.9 KB
Supplementary material: File

Breslau et al. supplementary material

Breslau et al. supplementary material 3

Download Breslau et al. supplementary material(File)
File 40.4 KB