Dataset Information

Assessing Technologies for COVID-19: What are the Challenges for Health Technology Assessment Agencies? Findings From a Survey and Roundtable Workshop.

ABSTRACT:

Background

To date, health technology assessment (HTA) agencies have not been at the forefront of decision making regarding the adoption of interventions for coronavirus disease 2019 (COVID-19). Instead, policymakers have prioritised rapid action in response to the pandemic emergency, with no assessment of value for money. As COVID-19 vaccination coverage increases and healthcare systems begin to recover, HTA agencies will be expected to assess technologies for COVID-19.

Objective

We aimed to identify the key challenges when assessing therapeutic and diagnostic technologies for COVID-19, from the perspective of HTA agencies, and identify whether there is a case for novel HTA methods and/or processes to address them.

Methods

We used a mixed-methods approach, by conducting an online survey of HTA agencies, to collect data about the challenges faced when assessing or planning to assess diagnostic and therapeutic technologies for COVID-19. The online survey was followed by a 'roundtable' workshop of HTA agencies' representatives to discuss the results and to elaborate on their responses.

Results

We received 21 completed surveys (response rate of 45%) and 11 of the respondents joined the roundtable discussion. Five themes emerged from the responses: assessing clinical effectiveness (44%), assessing cost effectiveness (19%), practical (19%), political (11%), and decision making (11%) challenges. At the roundtable, attendees elaborated on the challenges and identified two additional themes: how HTA agencies have responded to the pandemic to date, and how their role might change over time.

Conclusion

HTA agencies face both methodological and logistical challenges when assessing or planning to assess technologies for COVID-19. An interim best-practice HTA framework to address the key challenges would be valuable.

SUBMITTER: Elvidge J

PROVIDER: S-EPMC8505112 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectivesThe aim of this study was to review and compare current health technology assessment (HTA) activities for medical devices across non-European Union HTA agencies.MethodsHTA activities for medical devices were evaluated from three perspectives: organizational structure, processes, and methods. Agencies were primarily selected upon membership of existing HTA networks. The data collection was performed in two stages: stage 1-agency Web-site assessment using a standardized questionnaire, followed by review and validation of the collected data by a representative of the agency; and stage 2-semi-structured telephone interviews with key informants of a sub-sample of agencies.ResultsIn total, thirty-six HTA agencies across twenty non-EU countries assessing medical devices were included. Twenty-seven of thirty-six (75 percent) agencies were judged at stage 1 to have adopted HTA-specific approaches for medical devices (MD-specific agencies) that were largely organizational or procedural. There appeared to be few differences in the organization, process and methods between MD-specific and non-MD-specific agencies. Although the majority (69 percent) of both categories of agency had specific methods guidance or policy for evidence submission, only one MD-specific agency had developed methodological guidelines specific to medical devices. In stage 2, many MD-specific agencies cited insufficient resources (budget, skilled employees), lack of coordination (between regulator and reimbursement bodies), and the inability to generalize findings from evidence synthesis to be key challenges in the HTA of medical devices.ConclusionsThe lack of evidence for differentiation in scientific methods for HTA of devices raises the question of whether HTA needs to develop new methods for medical devices but rather adapt existing methodological approaches. In contrast, organizational and/or procedural adaptation of existing HTA agency frameworks to accommodate medical devices appear relatively commonplace.

Project description:The need to optimize drug development and facilitate faster access for patients has ignited discussions around the importance of improving interactions between health technology assessment (HTA) bodies and regulatory agencies. In this study, we conducted a systematic review to examine processes, progress, outcomes, and challenges of harmonization/interaction initiatives between HTA bodies and regulatory agencies. MEDLINE, EMBASE, and the International Pharmaceutical Abstracts database were searched up to 21 October 2019. Searches for gray literature (working papers, commissioned reports, policy documents, etc.) were performed via Google scholar and several institutional websites. An online cross-sectional survey was also conducted among HTA (n = 22) and regulatory agencies (n = 6) across Europe to supplement the systematic review. Overall, we found that while there are areas of divergence, there has been progress over time in narrowing the gap in evidentiary requirements for HTA bodies and regulatory agencies. Most regulatory agencies (4/6; 67%) and half (11/22, 50%) of the HTA bodies reported having a formal link for "collaborating" with the other. Several mechanisms such as early tripartite dialogues, parallel submissions (reviews), adaptive licensing pathways, and postauthorization data generation have been explored as avenues for improving collaboration. A number of pilot initiatives have shown positive effects of these models to reduce the time between regulatory and HTA decisions, which may translate into faster access for patients to life-saving therapies. Thus, future approaches aimed at improving harmonization/interaction between HTA bodies and regulatory agencies should build on these existing models/mechanisms while examining their long-term impacts. Several barriers including legal, organizational, and resource-related factors were also identified, and these need to be addressed to achieve greater alignment in the current regulatory and reimbursement landscape.

Project description:BackgroundThe number of Health Technology Assessment (HTA) agencies increases. One component of HTAs are economic aspects. To incorporate economic aspects commonly economic evaluations are performed. A convergence of recommendations for methods of health economic evaluations between international HTA agencies would facilitate the adaption of results to different settings and avoid unnecessary expense. A first step in this direction is a detailed analysis of existing similarities and differences in recommendations to identify potential for harmonization. The objective is to provide an overview and comparison of the methodological recommendations of international HTA agencies for economic evaluations.MethodsThe webpages of 127 international HTA agencies were searched for guidelines containing recommendations on methods for the preparation of economic evaluations. Additionally, the HTA agencies were requested information on methods for economic evaluations. Recommendations of the included guidelines were extracted in standardized tables according to 13 methodological aspects. All process steps were performed independently by two reviewers.ResultsFinally 25 publications of 14 HTA agencies were included in the analysis. Methods for economic evaluations vary widely. The greatest accordance could be found for the type of analysis and comparator. Cost-utility-analyses or cost-effectiveness-analyses are recommended. The comparator should continuously be usual care. Again the greatest differences were shown in the recommendations on the measurement/sources of effects, discounting and in the analysis of sensitivity. The main difference regarding effects is the focus either on efficacy or effectiveness. Recommended discounting rates range from 1.5%-5% for effects and 3%-5% for costs whereby it is mostly recommended to use the same rate for costs and effects. With respect to the analysis of sensitivity the main difference is that oftentimes the probabilistic or deterministic approach is recommended exclusively. Methods for modeling are only described vaguely and mainly with the rational that the "appropriate model" depends on the decision problem. Considering all other aspects a comparison is challenging as recommendations vary regarding detailedness and addressed issues.ConclusionThere is a considerable unexplainable variance in recommendations. Further effort is needed to harmonize methods for preparing economic evaluations.

Project description:BackgroundHealth technology assessment (HTA) agencies have an important role to play in managing the rising demands on health systems. However, creating and running such agencies potentially diverts resources from frontline services. A large number of studies address the question of 'what is the impact of HTA?'. Several points of heterogeneity in this literature include: purpose of the study, definition of HTA, definition of impact, and scope and rigour of evaluations. Our study seeks to address several limitations in this literature. This study aims to explore the mechanisms of impact of an HTA agency. In doing so, we consider HTA as an institution rather than a knowledge product to build an impact evaluation framework from an international, multi-stakeholder and multi-dimensional perspective.MethodsWe conducted 9 key informant interviews with experts from the international HTA community. We addressed several questions, informed by existing frameworks of impact within the literature, to understand their perspectives on the mechanisms of impact of an HTA agency. We analyse data using logic modelling and impact mapping, as tools to understand and visualise mechanisms of change.FindingsOur impact mapping highlights several distinct, but not necessarily mutually exclusive, mechanisms through which the overall impact of an HTA agency is achieved. These are: the effective conduct of HTA studies; effective use of HTA in agenda-setting and policy formulation processes; effective engagement and external communications; good institutional reputation and fit within the healthcare and policy-making system; effective use of HTA as a tool for the negotiation of health technology prices; and the effective implementation of policy change regarding health technologies. We also identify indicators of these effects.ConclusionsOur findings and resulting evaluation framework complement and add to existing literature by offering a new perspective on the mechanisms by which HTA agencies generate impact. This new perspective considers HTA as an institution rather than a knowledge product, is international, multi-dimensional, and includes multi-stakeholder views. We hope the analysis will be useful to countries interested in managing HTA performance.