To describe the type and level of ethical integration in published health technology assessment (HTA) reports and systematically identify the ethical approaches utilized.

A literature search was conducted with the Google™ search engine using the keyword “ethic” between 1 January 2015 and 20 August 2019. Only HTA assessment reports with a section on ethics were retained and classified according to their level of ethical integration: no ethical analysis, ethical issues highlighted, assessments according to legal or social norms, and assessments from a moral or axiological perspective—using a qualitative methodology to distinguish such integration.

This review yielded 188 reports with a section identified as being on ethics, produced by seventeen HTA agencies in eleven countries. One hundred and thirty-six reports did not develop an ethical analysis, thirty-one highlighted ethical issues, seventeen conducted a norm-based ethical assessment using a descriptive approach grounded in social norms, and four developed an assessment grounded in a moral or axiological perspective. The bioethical “four-principles” framework was used, but mainly for presenting ethical issues and not as a moral framework.

The majority of reports featuring a section on ethics mention ethical considerations without ethical analysis. Ethical issues are grouped with legal, social, and organizational issues and treated as contextual considerations that decision makers should be aware of. When reports present systematic norm-based ethical assessments from a descriptive perspective or ethical assessment based on a moral or axiological perspective, there is a tendency to ground these analyses in frameworks created for the purpose and reliant on a concept of ethics supporting them.

Integration of ethics into technology assessment in healthcare (HTA) reports is directly linked to the need of decision makers to provide rational grounds justifying their social choices. In a decision-making paradigm, facts and values are intertwined and the social role of HTA reports is to provide relevant information to decision makers. Since 2003, numerous surveys and discussions have addressed different aspects of the integration of ethics into HTA. This study aims to clarify how HTA professionals consider the integration of ethics into HTA, so an international survey was conducted in 2018 and the results are reported here.

A survey comprising twenty-two questions was designed and carried out from April 2018 to July 2018. Three hundred and twenty-eight HTA agencies from seventy-five countries were invited to participate in this survey.

Eighty-nine participants completed the survey, representing a participation rate of twenty-seven percent. As to how HTA reports should fulfill their social role, over 84 percent of respondents agreed upon the necessity to address this role for decision makers, patients, and citizens. At a lower level, the same was found regarding the necessity to make value-judgments explicit in different report sections, including ethical analysis. This contrasts with the response-variability obtained on the status of ethical analysis with the exception of the expertise required. Variability in stakeholder-participation usefulness was also observed.

This study reveals the importance of a three-phase approach, including assessment, contextual data, and recommendations, and highlights the necessity to make explicit value-judgments and have a systematic ethical analysis in order to fulfill HTA's social role in guiding decision makers.

After surveying its members on ethical issues (2003), the International Network of Agencies for Health Technology Assessment (INAHTA) mandated its Ethics Working Group (2005) to reflect on the role of health technology assessment (HTA) organizations in meeting social expectations. Some aspects of these have since been clarified by two studies addressing either the official position of INAHTA's members or the publication authors. An international survey was carried out on the perception of HTA professionals’ expectations when producing HTA reports: how to fulfil HTA's social role, which value judgments should be made explicit and what should be the status of ethical analysis.

A twenty-two question, web-based, anonymous survey was devised from our recent systematic review on the integration of ethics into HTA and carried from April to July 2018. The information on 328 HTA agencies/contact persons from seventy-five countries was collected from the website of INAHTA, Health Technology Assessment International (HTAi), the European Network for Health Technology Assessment (EUnetHTA), EuroScan International Network, the HTA Network of the Americas (RedETSA) and the HTA Network of Asia (HTAsiaLink), a 2015 World Health Organization survey, HTAi members, and our local HTA network (Québec, Canada).

Eighty-nine participants completed and submitted a finalized survey for a 27 percent participation rate representing thirty-three countries. Regarding how the HTA reports should fulfil their social role, our results showed that over 84 percent of the respondents agreed upon the necessity to address it to decision makers, patients and citizens. At a lower and more variable level, the same result was found about the necessity to make value judgements explicit in different sections of the report, including ethical analysis. This contrasts with the variability of responses obtained on the status of ethical analysis although an agreement on the expertise required was observed. Variability in the usefulness of patient, public or stakeholder participation was observed.

At the dawn of this decade, this study reveals high expectations on context-dependent decisions in HTA: the necessity to integrate the ‘explicitation’ of value judgements and systematic ethical analysis to fulfil HTA's social role.

The fact that HTA is a value-laden process is recognized in the literature. This is one of the reasons for promoting a better integration of ethics in HTA processes. Although what is meant by value-judgment (VJ) and how it can be used in HTA is not clear for some authors; others have proposed the elicitation of implicit VJs, to make them more explicit, as one way for clarifying the role ethics may play in HTA. In order to clarify what a VJ is, a conceptual analysis is needed to distinguish it from a factual-judgment and see how they diverge on certain aspects and converge on others.

The distinction between VJs and factual-judgments was debated in the fifties. At the core of the philosophy of language was a distinction between factual-scientific assertions about facts, considered objective, and VJs on what is right/wrong-good/bad, considered subjective. In speech-act theory these distinctions were treated as two different operations: assertive and evaluative. A conceptual analysis of VJs, considering them as specific speech-acts, was used for clarifying/deciphering the role of VJs in HTA.

VJs are intrinsically embedded in decision-making since they are the reasons justifying decisions. This is why implicit VJs can be identified at every decision-step in the HTA process. Assessment is usually considered objective while appraisal seems subjective. Since VJs are entrenched in the decisions taken throughout the assessment process, the results are not completely objective. Ethical analysis also distinguishes two types of VJs, those based on normative criteria and those based on various degrees of value actualization. Furthermore, since evaluation requires criteria based on a rational process, VJs are not totally subjective.

Elicitation of VJs in HTA is one way of integrating ethics in HTA and offers decision-makers a more thorough picture of the ethical issues involved in their decision.

Eliciting implicit value-judgments (VJs) in the HTA process is one way of integrating ethics in HTA since the latter is recognized as a value-laden process. An analysis of the diversity of opinions on implicit VJs in HTA and of their role, highlights the connection there exists between VJs and the different decisions involved in the whole HTA process. Such a link is corroborated by a conceptual analysis of VJ using a speech-act philosophical approach grounded in the philosophy of language, since VJs are linked with normative speech-acts such as commands, recommendations and advices.

We propose an analysis of the published citations mentioning VJs, extracted from our systematic review on the challenges of integrating ethics in HTA. In order to do so, those quotes were categorized in a chart, the latter of which presents: (i) the different steps of decision-making in the HTA process, (ii) the description of the implicit VJ(s) and (iii) the criteria involved. This chart was elaborated with the participation of the HTA local evaluators involved as co-investigators in our research group. The final version was discussed, debated and validated by the entire research group.

The chart shows 18 decision-making steps in the HTA process in which twenty-three implicit VJs can be observed. The range of such VJs encompasses the whole HTA process from the initial mandate to the agency presenting the decisional issues, to the dissemination of the final report. The published citations gathered for each category compile different expectations on the elicitation of the implicit VJs, thus making the latter VJs more explicit.

This chart allows a better understanding of the expectations that are at the core of the appeal for more transparency in the HTA process, since stakeholders need to understand which value-judgments the final conclusion of a report is relying on.

Integration of ethics into health technology assessment (HTA) remains challenging for HTA practitioners. We conducted a systematic review on social and methodological issues related to ethical analysis in HTA. We examined: (1) reasons for integrating ethics (social needs); (2) obstacles to ethical integration; (3) concepts and processes deployed in ethical evaluation (more specifically value judgments) and critical analyses of formal experimentations of ethical evaluation in HTA.

Search criteria included “ethic,” “technology assessment,” and “HTA”. The literature search was done in Medline/Ovid, SCOPUS, CINAHL, PsycINFO, and the international HTA Database. Screening of citations, full-text screening, and data extraction were performed by two subgroups of two independent reviewers. Data extracted from articles were grouped into categories using a general inductive method.

A list of 1,646 citations remained after the removal of duplicates. Of these, 132 were fully reviewed, yielding 67 eligible articles for analysis. The social need most often reported was to inform policy decision making. The absence of shared standard models for ethical analysis was the obstacle to integration most often mentioned. Fairness and Equity and values embedded in Principlism were the values most often mentioned in relation to ethical evaluation.

Compared with the scientific experimental paradigm, there are no settled proceedings for ethics in HTA nor consensus on the role of ethical theory and ethical expertise hindering its integration. Our findings enable us to hypothesize that there exists interdependence between the three issues studied in this work and that value judgments could be their linking concept.

The overarching goal of this research was to (i) evaluate the impact of reports with recommendations provided by a hospital-based health technology assessment (HB-HTA) unit on the local hospital decision-making processes and implementation activities and (ii) identify the underlying factors of the nonimplementation of recommendations.

All reports produced by the HB-HTA unit between December 2003 and March 2013 were retrieved, and hospital decision makers who requested these reports were solicited for enrolment. Participants were interviewed using a mixed design survey.

Twenty reports, associated with fifteen decision makers, fulfilled the study criteria. Nine decision makers accepted to participate, corresponding to thirteen reports and twenty-three recommendations. Of the twenty-three recommendations issued, 65 percent were implemented, 9 percent were accepted for implementation but not implemented, and 26 percent were declined. In terms of the utility of each report to guide decision makers, 92 percent of the reports were considered in the decision-making process; 85 percent had one or more recommendations adopted; and 77 percent had recommendations implemented. The most frequently mentioned reasons for nonimplementation were related to contextual factors (64 percent), production/diffusion process factors (14 percent), content/format factors (14 percent), or other factors (9 percent). Among the contextual factors, the complexity of the changes (i.e., administrative reasons), budget and resources constraints, failure to identify administrative responsibility to carry out the recommendation, and nonpriority status of the HTA recommendation, were provided.

This study highlights that although HB-HTA reports are useful to hospital managers in their decision-making processes, certain barriers such as contextual factors need to be better addressed to improve HB-HTA efficiency and usefulness.

One of the barriers of integrating ethics in Health Technology Assessment (HTA) relates to the social role of HTA (1). The aim of this study is to provide a better understanding of the way by which law circumscribes the social role of HTA. Our hypothesis: HTA's social role is embedded within a mixed governance based on hard law and soft law.

Three HTA agencies were conveniently selected for our study: Haute Autorité de santé (HAS) (France), National Institute for Health and Care Excellence (NICE) (United Kingdom) and Institut national d'excellence en santé et en services sociaux (INESSS) (Québec, Canada). Our analysis of the legal, administrative and procedural documents relating to the existence and assessment processes of these three agencies is guided by the following criteria:

1. 1. The normative strength of the documents (categories of hard law or soft law) (2)

2. 2. The definition of the agencies’ social role (1)

3. 3. The integration of ethics in the agencies’ mandate.

Hard law contributes to establish a general mandate and some legal legitimacy for these agencies. Soft law, grounded in the HTA producers' practices, plays a major role in the legal governance of HTA. Our results demonstrate that these agencies existing practices seem to circumscribe their social role further than their constitutive laws. In this context, social actors become responsible to define, structure and operationalize the implementation of HTA.

In addition, the legal framework (hard law) through which HTA unfolds does not clearly support its structural and social role. Despite existing legal frameworks, the normative legitimacy of HTA is not entirely established, as it depends on soft law. Taken altogether, this maintains a persisting conceptual vagueness in HTA governance.

The social role of HTA should be defined either through modifying existing legislations (hard law) or through harmonization of the agencies internal policies and regulations (soft law). Such legal initiatives would help clarify the aims of HTA evaluations: assessments (scientific) or appraisal (value-laden), and therefore give a clearer indication on how best to integrate ethics in HTA.

The main difficulties encountered in the integration of ethics in Health Technology Assessment (HTA) were identified in our systematic review. In the process of analyzing these difficulties we then addressed the question of the diversity of ethical approaches (1) and the difficulties in their operationalization (2,3).

Nine ethical approaches were identified: principlism, casuistry, coherence analysis, wide reflexive equilibrium, axiology, socratic approach, triangular method, constructive technology assessment and social shaping of technology. Three criteria were used to clarify the nature of each of these approaches:

1. 1. The characteristics of the ethical evaluation

2. 2. The disciplinary foundation of the ethical evaluation

3. 3. The operational process of the ethical evaluation in HTA analysis.

In HTA, both norm-based ethics and value-based ethics are mobilized. This duality is fundamental since it proposes two different ethical evaluations: the first is based on the conformity to a norm, whereas the second rests on the actualization of values. The disciplinary foundation generates diversity as philosophy, sociology and theology propose different justifications for ethical evaluation. At the operational level, ethical evaluation's characteristics are applied to the case at stake by specific practical reasoning. In a norm-based practical reasoning, one must substantiate the facts that will be correlated to a moral norm for clearly identifying conformity or non-conformity. In value-based practical reasoning, one must identify the impacts of the object of assessment that will be subject to ethical evaluation. Two difficulties arise: how to apply values to facts and prioritize amongst conflicting ethical evaluations of the impacts?

Applying these three criteria to ethical approaches in HTA helps understanding their complexity and the difficulty of operationalizing them in HTA tools. The choice of any ethical evaluations is never neutral; it must be justified by a moral point of view. Developing tools for ethics in HTA is operationalizing a specific practical reasoning in ethics.

In 2015, the province of Québec, Canada went through a major restructuration in its healthcare system which resulted in regional institutional merging. Our hospital-based Health Technology Assessment (HTA) unit is now part of a large network comprising fourteen institutions covering an area of 12,734 km2. This new organizational context poses major challenges in terms of addressing various local needs and for involving stakeholders into our assessments. In this paper we present how we addressed these difficulties.

This case study presents the procedural method we developed for involving local and regional stakeholders into an HTA concerning the need to extend a regional prenatal ultrasound screening program. We describe how we collected local data and networked local to regional stakeholders for producing the assessment and recommendation.

After completion of the literature review on first trimester ultrasound screening, local data from each institution were collected using a combination of focus group meetings with local managers, gynecologists and ultrasound technologists. Overall, fifteen people were consulted on diverse regional sites, including two services users. In order to assess the perception of the results regarding efficacy, users preferences, cost and organizational impact of expanding the screening program, people were asked to complete an online survey. The results of this survey were then used to write a first draft of a recommendation. A second survey was generated in order to obtain agreement of the fifteen people regarding the recommendation. Overall, this method decreased the time required to complete the assessment and reduced project operating costs. However, divergence of opinions may be difficult to resolve by this method and many rounds of consultation may be needed.

Our procedural method using a combination of focus groups and online surveys for collecting local and regional data and opinions from stakeholders and support recommendation, has succeeded to provide well contextualized information for supporting a decision.

The objective was to identify the conceptual and methodological issues surrounding integration of ethics in Health Technology Assessment (HTA). We conducted a systematic review examining: (i) social needs, (ii) methodological and procedural barriers, (iii) concepts or processes of ethics assessment used and (iv) results of experimentations for integrating ethics in HTA.

Search criteria included ‘ethic’, ‘technology assessment’ and ‘HTA’. The literature search was done up to 21 November 2016 in Medline/Ovid, SCOPUS, CINAHL, PsycINFO and international HTA Database. Screening of citations, screening of full-text and data extraction were performed by two subgroups of two independent reviewers. The first group was constituted of HTA experts, and the second of ethics and philosophy experts. Data extracted from articles were regrouped in categories for each objective.

A list of 2,420 citations was obtained while 1,646 remained after the removal of duplicates. Of these, 132 were fully reviewed, yielding 67 eligible articles for analysis. Eight categories were identified within the social needs. The mostly evoked were ‘Informed policy decision making’ (n = 16) and 'Informed public/patient decision making’ (n = 12). Ten categories of methodological and procedural barriers were identified. The most mentioned were 'Lack of standardized and recognized proceedings for ethical analysis’ (n = 28) and ‘Lack of shared consensus on the role of ethical theory and ethical expertise’ (n = 17). Within the concepts or processes of ethics assessment, thirteen categories were identified. The most mentioned were ‘Fairness and Equity’ (n = 12), ‘Beneficence and Non-maleficence’ (n = 10) and, ‘Autonomy’ (n = 10). Within results of experimentations, five categories were identified. The most mentioned was ‘Usefulness of ethics for identifying relevant problems’ (n = 3). While few experimentations were identified, no clear operational method was found in our research.

This study confirms the necessity to design an operational method integrating ethics and addressing social needs of HTA. Our results constitute the basis for developing a new theoretical and practical method.

Available data in the scientific literature is not always sufficient to make a clear Health Technology Assessment (HTA) recommendation without any other source of data. Contextual data and local expertize are an important source of data that cannot be ignored in HTA process. Despite a lack of evidence in the scientific literature, a technology can be recommended in a given context. We illustrate this by a case study about biplane angiography for vascular neurointervention.

A systematic review was conducted. The level of evidence was assessed by the grid of Downs and Black. An analysis of the context in our setting was also conducted. The main outcomes were: radiation doses, clinical complications, procedure times, purchase cost, impact on teaching programs, confidence of clinicians in the technology, quality of care, and volume of activity. A committee constituted of managers, clinical experts, physicians, physicists and HTA experts was created to produce a recommendation about biplane technology acquisition.

A list of 257 citations was obtained yielding 9 eligible articles for analysis. Despite the lack of evidence found in the literature (median of Downs and Black: 3/32), the biplane system appears to reduce ionizing radiation and medical complications as well as shorten procedure time. Contextual data indicated that biplane system could improve operator's confidence, which could translate into reduced risk, especially for complex procedures. We estimate that a minimum of 50 cases can be done in our context (University hospital center covering a population of 306,322 people) with a higher level of patient safety. In addition, the biplane system can support our institution in advanced procedures teaching program.

Given on the advantages provided by the biplane technology in our setting, the committee has recommended its acquisition. However, this technology should be implemented with a responsibility in collecting outcome data to optimize clinical protocol in doses of ionizing delivered.