Dataset Information

Methods of international health technology assessment agencies for economic evaluations--a comparative analysis.

ABSTRACT:

Background

The number of Health Technology Assessment (HTA) agencies increases. One component of HTAs are economic aspects. To incorporate economic aspects commonly economic evaluations are performed. A convergence of recommendations for methods of health economic evaluations between international HTA agencies would facilitate the adaption of results to different settings and avoid unnecessary expense. A first step in this direction is a detailed analysis of existing similarities and differences in recommendations to identify potential for harmonization. The objective is to provide an overview and comparison of the methodological recommendations of international HTA agencies for economic evaluations.

Methods

The webpages of 127 international HTA agencies were searched for guidelines containing recommendations on methods for the preparation of economic evaluations. Additionally, the HTA agencies were requested information on methods for economic evaluations. Recommendations of the included guidelines were extracted in standardized tables according to 13 methodological aspects. All process steps were performed independently by two reviewers.

Results

Finally 25 publications of 14 HTA agencies were included in the analysis. Methods for economic evaluations vary widely. The greatest accordance could be found for the type of analysis and comparator. Cost-utility-analyses or cost-effectiveness-analyses are recommended. The comparator should continuously be usual care. Again the greatest differences were shown in the recommendations on the measurement/sources of effects, discounting and in the analysis of sensitivity. The main difference regarding effects is the focus either on efficacy or effectiveness. Recommended discounting rates range from 1.5%-5% for effects and 3%-5% for costs whereby it is mostly recommended to use the same rate for costs and effects. With respect to the analysis of sensitivity the main difference is that oftentimes the probabilistic or deterministic approach is recommended exclusively. Methods for modeling are only described vaguely and mainly with the rational that the "appropriate model" depends on the decision problem. Considering all other aspects a comparison is challenging as recommendations vary regarding detailedness and addressed issues.

Conclusion

There is a considerable unexplainable variance in recommendations. Further effort is needed to harmonize methods for preparing economic evaluations.

SUBMITTER: Mathes T

PROVIDER: S-EPMC3849629 | biostudies-literature | 2013 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Methods of international health technology assessment agencies for economic evaluations--a comparative analysis.

Mathes Tim T Jacobs Esther E Morfeld Jana-Carina JC Pieper Dawid D

BMC health services research 20130930

<h4>Background</h4>The number of Health Technology Assessment (HTA) agencies increases. One component of HTAs are economic aspects. To incorporate economic aspects commonly economic evaluations are performed. A convergence of recommendations for methods of health economic evaluations between international HTA agencies would facilitate the adaption of results to different settings and avoid unnecessary expense. A first step in this direction is a detailed analysis of existing similarities and dif ...[more]

PMID: 24079858

Similar Datasets

Project description:BackgroundThe Government of Indonesia implemented health technology assessment (HTA) to ensure quality and cost control in the National Health Insurance Program (Jaminan Kesehatan Nasional/JKN). The current aim of the study was to improve the usefulness of future economic evaluation for resource allocation by appraising current methodology, reporting, and source of evidence quality of studies.MethodsThe inclusion and exclusion criteria were applied to search for relevant studies using a systematic review. The methodology and reporting adherence were appraised according to Indonesia's HTA Guideline issued in 2017. The differences in adherence before and after the guideline dissemination were compared using Chi-square and Fisher's exact tests for methodology adherence wherever appropriate, and the Mann-Whitney test for reporting adherence. The source of evidence quality was assessed using evidence hierarchy. Two scenarios of the study start date and the guideline dissemination period were tested using sensitivity analyses.FindingsEighty-four studies were obtained from PubMed, Embase, Ovid, and two local journals. Only two articles cited the guideline. No statistically significant difference (P > 0.05) was found between the pre-dissemination and post-dissemination period with respect to methodology adherence, except for outcome choice. Studies during the post-dissemination period showed a higher score for reporting which was statistically significant (P = 0.01). However, the sensitivity analyses revealed no statistically significant difference (P > 0.05) in methodology (except for modelling type, P = 0.03) and reporting adherence between the two periods.InterpretationThe guideline did not impact the methodology and reporting standard used in the included studies. Recommendations were provided to improve the usefulness of economic evaluations for Indonesia.FundingThe Access and Delivery Partnership (ADP) hosted by the United Nations Development Programme (UNDP) and the Health Systems Research Institute (HSRI).

Project description:ObjectivesThe aim of this study was to review and compare current health technology assessment (HTA) activities for medical devices across non-European Union HTA agencies.MethodsHTA activities for medical devices were evaluated from three perspectives: organizational structure, processes, and methods. Agencies were primarily selected upon membership of existing HTA networks. The data collection was performed in two stages: stage 1-agency Web-site assessment using a standardized questionnaire, followed by review and validation of the collected data by a representative of the agency; and stage 2-semi-structured telephone interviews with key informants of a sub-sample of agencies.ResultsIn total, thirty-six HTA agencies across twenty non-EU countries assessing medical devices were included. Twenty-seven of thirty-six (75 percent) agencies were judged at stage 1 to have adopted HTA-specific approaches for medical devices (MD-specific agencies) that were largely organizational or procedural. There appeared to be few differences in the organization, process and methods between MD-specific and non-MD-specific agencies. Although the majority (69 percent) of both categories of agency had specific methods guidance or policy for evidence submission, only one MD-specific agency had developed methodological guidelines specific to medical devices. In stage 2, many MD-specific agencies cited insufficient resources (budget, skilled employees), lack of coordination (between regulator and reimbursement bodies), and the inability to generalize findings from evidence synthesis to be key challenges in the HTA of medical devices.ConclusionsThe lack of evidence for differentiation in scientific methods for HTA of devices raises the question of whether HTA needs to develop new methods for medical devices but rather adapt existing methodological approaches. In contrast, organizational and/or procedural adaptation of existing HTA agency frameworks to accommodate medical devices appear relatively commonplace.

Project description:IntroductionRandomized controlled trials (RCTs) are the gold standard when comparing treatment effectiveness, and Health Technology Assessment (HTA) agencies state a clear preference for such direct comparisons. When these are not available, an indirect treatment comparison (ITC) is an alternative option. The objective of this study was to assess the acceptance of ITC methods by HTA agencies across England, France, Germany, Italy, and Spain, using oncology cases for a homogeneous sample of HTA evaluations.MethodsThe study was conducted on the PrismAccess database in May 2021 to retrieve HTA evaluation reports for oncology treatments for solid tumors, in which an ITC was presented. The analysis was restricted to HTA evaluation reports published between April 2018 and April 2021 in England, France, Germany, Italy, and Spain. Identified HTA evaluation reports were screened and reviewed by two independent reviewers. For each ITC presented, the methodology and its acceptance by the HTA agency were analyzed.ResultsFive hundred and forty-three HTA evaluation reports were identified, of which 120 (22%) presented an ITC. This proportion was the highest in England (51%) and lowest in France (6%). The overall acceptance rate of ITC methods was 30%, with the highest in England (47%) and lowest in France (0%). Network meta-analysis (NMA; 23%) was the most commonly used ITC technique, with a 39% acceptance rate overall, followed by Bucher ITC (19%; 43% acceptance rate) and matching-adjusted indirect comparison (13%; 33% acceptance rate). The most common criticisms of the ITC methods from HTA agencies related to data limitations (heterogeneity and lack of data; 48% and 43%, respectively) and the statistical methods used (41%).ConclusionsThe generally low acceptance rate of ITC methods by HTA agencies in oncology suggests that, whilst in the absence of a direct comparison ITCs may provide relevant evidence, this evidence is not widely considered sufficient for the purpose of HTA evaluations. The perception of ITC methods for the purpose of HTA evaluations varies substantially between countries. There is a need for further clarity on the properties of ITC techniques and the assessment of their results as ITC methods continue to evolve quickly and further techniques may become available in the future.

Project description:INTRODUCTION:There has been a growing awareness of the need for rigorously and transparent reported health research, to ensure the reproducibility of studies by future researchers. Health economic evaluations, the comparative analysis of alternative interventions in terms of their costs and consequences, have been promoted as an important tool to inform decision-making. The objective of this study will be to investigate the extent to which articles of economic evaluations of healthcare interventions indexed in MEDLINE incorporate research practices that promote transparency, openness and reproducibility. METHODS AND ANALYSIS:This is the study protocol for a cross-sectional comparative analysis. We registered the study protocol within the Open Science Framework (osf.io/gzaxr). We will evaluate a random sample of 600 cost-effectiveness analysis publications, a specific form of health economic evaluations, indexed in MEDLINE during 2012 (n=200), 2019 (n=200) and 2022 (n=200). We will include published papers written in English reporting an incremental cost-effectiveness ratio in terms of costs per life years gained, quality-adjusted life years and/or disability-adjusted life years. Screening and selection of articles will be conducted by at least two researchers. Reproducible research practices, openness and transparency in each article will be extracted using a standardised data extraction form by multiple researchers, with a 33% random sample (n=200) extracted in duplicate. Information on general, methodological and reproducibility items will be reported, stratified by year, citation of the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement and journal. Risk ratios with 95% CIs will be calculated to represent changes in reporting between 2012-2019 and 2019-2022. ETHICS AND DISSEMINATION:Due to the nature of the proposed study, no ethical approval will be required. All data will be deposited in a cross-disciplinary public repository. It is anticipated the study findings could be relevant to a variety of audiences. Study findings will be disseminated at scientific conferences and published in peer-reviewed journals.

Dataset Information

Methods of international health technology assessment agencies for economic evaluations--a comparative analysis.

Background

Methods

Results

Conclusion

Publications

Methods of international health technology assessment agencies for economic evaluations--a comparative analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets