Dataset Information

Assessing the performance of health technology assessment (HTA) agencies: developing a multi-country, multi-stakeholder, and multi-dimensional framework to explore mechanisms of impact.

ABSTRACT:

Background

Health technology assessment (HTA) agencies have an important role to play in managing the rising demands on health systems. However, creating and running such agencies potentially diverts resources from frontline services. A large number of studies address the question of 'what is the impact of HTA?'. Several points of heterogeneity in this literature include: purpose of the study, definition of HTA, definition of impact, and scope and rigour of evaluations. Our study seeks to address several limitations in this literature. This study aims to explore the mechanisms of impact of an HTA agency. In doing so, we consider HTA as an institution rather than a knowledge product to build an impact evaluation framework from an international, multi-stakeholder and multi-dimensional perspective.

Methods

We conducted 9 key informant interviews with experts from the international HTA community. We addressed several questions, informed by existing frameworks of impact within the literature, to understand their perspectives on the mechanisms of impact of an HTA agency. We analyse data using logic modelling and impact mapping, as tools to understand and visualise mechanisms of change.

Findings

Our impact mapping highlights several distinct, but not necessarily mutually exclusive, mechanisms through which the overall impact of an HTA agency is achieved. These are: the effective conduct of HTA studies; effective use of HTA in agenda-setting and policy formulation processes; effective engagement and external communications; good institutional reputation and fit within the healthcare and policy-making system; effective use of HTA as a tool for the negotiation of health technology prices; and the effective implementation of policy change regarding health technologies. We also identify indicators of these effects.

Conclusions

Our findings and resulting evaluation framework complement and add to existing literature by offering a new perspective on the mechanisms by which HTA agencies generate impact. This new perspective considers HTA as an institution rather than a knowledge product, is international, multi-dimensional, and includes multi-stakeholder views. We hope the analysis will be useful to countries interested in managing HTA performance.

SUBMITTER: Millar R

PROVIDER: S-EPMC8252304 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:IntroductionRecovery colleges (RCs) are mental health centres aimed at equipping people with skills to live a meaningful life despite the presence of mental distress. Unique to them is the aspect of cocreation; RCs are designed collaboratively with people of lived experiences of mental health and addictions and care providers. Despite established benefits, there remains a lack of empirical evidence on how RCs work and on their impact.AimsWe aim to address this gap by designing a cocreated evaluation framework for RCs. This will be accomplished by engaging RC student/facilitators to provide perspectives on RCs/RC evaluation and cocreate a scoping review identifying evaluation gaps in the literature. Themes identified through these processes will form the evaluation framework.Methods and analysisTwo methodologies will be used to explore RC evaluation: student/facilitator engagement and a scoping review of current published and grey literature on RC evaluation. Engagement will be achieved using a participatory action research approach consisting of informant interviews of ~25 RC students/facilitators across Canada, which will be thematically analysed. The scoping review will follow methodology described by Arksey and O'Malley modified to support cocreation. Concurrent conducting of the engagement process and scoping review will allow RC students and peer facilitators the opportunity to shape RC evaluations, address gaps in the literature and codesign an evaluation framework focused on recovery-oriented processes and outcomes mattering most to RCs students/facilitators.Ethics and disseminationEthics approval was received for the RC student/facilitator engagement component from the Centre for Addictions and Mental Health Research Ethics Board (#042-2020) and Ontario Shores Centre for Mental Health Sciences (#20-013-B). Scoping review results will be copresented through national and international medical education conferences and published in open-access peer-reviewed journals. Furthermore, a dissemination strategy on evaluation for the national RC community will be created.

Project description:BackgroundIn an era of a growing economic pressure for all health systems, the interest for "disinvestment" in healthcare increased. In this context, evidence based approaches such as Health Technology Assessment (HTA) are needed both to invest and to disinvest in health technologies. In order to investigate the extent of application of HTA in this field, methodological projects/frameworks, case studies, dissemination initiatives on disinvestment released by HTA agencies and organizations located in Europe were searched.MethodsIn July 2015, the websites of HTA agencies and organizations belonging to the European network for HTA (EUnetHTA) and the International Network of Agencies for HTA (INAHTA) were accessed and searched through the use of the term "disinvestment". Retrieved deliverables were considered eligible if they reported methodological projects/frameworks, case studies and dissemination initiatives focused on disinvestment in healthcare.Results62 HTA agencies/organizations were accessed and eight methodological projects/frameworks, one case study and one dissemination initiative were found starting from 2007. With respect to methodological projects/frameworks, two were delivered in Austria, one in Italy, two in Spain and three in U.K. As for the case study and the dissemination initiative, both came from U.K. The majority of deliverables were aimed at making an overview of existing disinvestment approaches and at identifying challenges in their introduction.ConclusionsToday, in a healthcare context characterized by resource scarcity and increasing service demand, "disinvestment" from low-value services and reinvestment in high-value ones is a key strategy that may be supported by HTA. The lack of evaluation of technologies in use, in particular at the end of their lifecycle, may be due to the scant availability of frameworks and guidelines for identification and assessment of obsolete technologies that was shown by our work. Although several projects were carried out in different countries, most remain constrained to the field of research. Disinvestment is a relatively new concept in HTA that could pose challenges also from a methodological point of view. To tackle these challenges, it is necessary to construct experiences at international level with the aim to develop new methodological approaches to produce and grow evidence on disinvestment policies and practices.

Project description:IntroductionCoverage of palliative care in low and middle-income countries is very limited, and global projections suggest large increases in need. Novel approaches are needed to achieve the palliative care goals of Universal Health Coverage. This study aimed to identify stakeholders' data and information needs and the role of digital technologies to improve access to and delivery of palliative care for people with advanced cancer in Nigeria, Uganda and Zimbabwe.MethodsWe conducted a multi-country cross-sectional qualitative study in sub-Saharan Africa. In-depth qualitative stakeholder interviews were conducted with N = 195 participants across Nigeria, Uganda and Zimbabwe (advanced cancer patients n = 62, informal caregivers n = 48, health care professionals n = 59, policymakers n = 26). Verbatim transcripts were subjected to deductive and inductive framework analysis to identify stakeholders needs and their preferences for digital technology in supporting the capture, transfer and use of patient-level data to improve delivery of palliative care.ResultsOur coding framework identified four main themes: i) acceptability of digital technology; ii) current context of technology use; iii) current vision for digital technology to support health and palliative care, and; iv) digital technologies for the generation, reporting and receipt of data. Digital heath is an acceptable approach, stakeholders support the use of secure data systems, and patients welcome improved communication with providers. There are varying preferences for how and when digital technologies should be utilised as part of palliative cancer care provision, including for increasing timely patient access to trained palliative care providers and the triaging of contact from patients.ConclusionWe identified design and practical challenges to optimise potential for success in developing digital health approaches to improve access to and enhance the delivery of palliative cancer care in Nigeria, Uganda and Zimbabwe. Synthesis of findings identified 15 requirements to guide the development of digital health approaches that can support the attainment of global health palliative care policy goals.

Project description:BackgroundThe Government of Indonesia implemented health technology assessment (HTA) to ensure quality and cost control in the National Health Insurance Program (Jaminan Kesehatan Nasional/JKN). The current aim of the study was to improve the usefulness of future economic evaluation for resource allocation by appraising current methodology, reporting, and source of evidence quality of studies.MethodsThe inclusion and exclusion criteria were applied to search for relevant studies using a systematic review. The methodology and reporting adherence were appraised according to Indonesia's HTA Guideline issued in 2017. The differences in adherence before and after the guideline dissemination were compared using Chi-square and Fisher's exact tests for methodology adherence wherever appropriate, and the Mann-Whitney test for reporting adherence. The source of evidence quality was assessed using evidence hierarchy. Two scenarios of the study start date and the guideline dissemination period were tested using sensitivity analyses.FindingsEighty-four studies were obtained from PubMed, Embase, Ovid, and two local journals. Only two articles cited the guideline. No statistically significant difference (P > 0.05) was found between the pre-dissemination and post-dissemination period with respect to methodology adherence, except for outcome choice. Studies during the post-dissemination period showed a higher score for reporting which was statistically significant (P = 0.01). However, the sensitivity analyses revealed no statistically significant difference (P > 0.05) in methodology (except for modelling type, P = 0.03) and reporting adherence between the two periods.InterpretationThe guideline did not impact the methodology and reporting standard used in the included studies. Recommendations were provided to improve the usefulness of economic evaluations for Indonesia.FundingThe Access and Delivery Partnership (ADP) hosted by the United Nations Development Programme (UNDP) and the Health Systems Research Institute (HSRI).