Dataset Information

Extending Treatment Networks in Health Technology Assessment: How Far Should We Go?

ABSTRACT:

Background

Network meta-analysis may require substantially more resources than does a standard systematic review. One frequently asked question is "how far should I extend the network and which treatments should I include?"

Objective

To explore the increase in precision from including additional evidence.

Methods

We assessed the benefit of extending treatment networks in terms of precision of effect estimates and examined how this depends on network structure and relative strength of additional evidence. We introduced a "star"-shaped network. Network complexity is increased by adding more evidence connecting treatments under five evidence scenarios. We also examined the impact of heterogeneity and absence of evidence facilitating a "first-order" indirect comparison.

Results

In all scenarios, extending the network increased the precision of the A versus B treatment effect. Under a fixed-effect model, the increase in precision was modest when the existing direct A versus B evidence was already strong and was substantial when the direct evidence was weak. Under a random-effects model, the gain in precision was lower when heterogeneity was high. When evidence is available for all "first-order" indirect comparisons, including second-order evidence has limited benefit for the precision of the A versus B estimate. This is interpreted as a "ceiling effect."

Conclusions

Including additional evidence increases the precision of a "focal" treatment comparison of interest. Once the comparison of interest is connected to all others via "first-order" indirect evidence, there is no additional benefit in including higher order comparisons. This conclusion is generalizable to any number of treatment comparisons, which would then all be considered "focal." The increase in precision is modest when direct evidence is already strong, or there is a high degree of heterogeneity.

SUBMITTER: Caldwell DM

PROVIDER: S-EPMC4553939 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundFollowing approximately 10 years from the beginning of Iran's national Health Technology Assessment (HTA) programme, the present study aims to evaluate its success by examining the impact of HTA and identifying the determinant factors leading to the implementation of HTA report results.MethodsThe triangulation method was employed herein. HTA reports were initially identified and their impact and determinant factors were then examined from the perspectives of both researchers (by preparing a questionnaire according to the Payback model and sending it to HTA principle investigators) and stakeholders (semi-structured interviews held with each HTA stakeholder). Simultaneously, the quality of the HTA reports was examined with relevant critical appraisal checklists.ResultsThe impact of 19 equipment technologies and four pharmaceutical technologies were assessed in this study. Twenty researchers replied (response rate, 86.96%) to the questionnaire on the impact of HTA reports from the researcher's perspective. To assess the impact of HTA reports from the stakeholder's perspective, seven policy-makers were chosen and interviewed as the main target audience. The most common step taken to disseminate the results of the HTA projects was publication. Conducting the HTA had taught researchers and their colleagues' new skills and had facilitated the securing of research grants from other organisations. Most reports had used the systematic review method but the relevant details had been scarcely presented regarding outcomes, costs and analysis. The greatest impact of HTA reports on decision-making had been on policy-makers providing and allocating finances. Barriers in stewardship, identification and prioritisation of topics, performance and dissemination of HTA results were the main barriers of implementing HTAs.ConclusionsIn most aspects, the status of HTA impact reports need improvement. Thus far, the barriers and facilitators of the HTA programme in Iran have been investigated in other studies. These findings should be pooled to reach a solution that can be actively applied to the health system to improve the status quo of HTA in Iran.

Project description:BackgroundSensorineural hearing loss occurs as a result of damage to the hair cells in the cochlea, or to the auditory nerve. It negatively affects learning and development in children, and employment and economic attainment in adults. Current policy in Ontario is to provide unilateral cochlear implantation for patients with bilateral severe to profound sensorineural hearing loss. However, hearing with both ears as a result of bilateral cochlear implantation may offer added benefits.MethodsWe completed a health technology assessment, which included an evaluation of clinical benefits and harms, value for money, budget impact, and patient preferences related to bilateral cochlear implantation. We performed a systematic literature search for studies on bilateral cochlear implantation in adults and children from inception to March 2017. We conducted a cost-utility analysis with a lifetime horizon from a public payer perspective and analyzed the budget impact of publicly funding bilateral cochlear implantation in adults and children in Ontario for the next 5 years. Finally, we conducted interviews with adults who have sensorineural hearing loss and unilateral or bilateral cochlear implants, and with parents of children with bilateral cochlear implants.ResultsWe included 24 publications (10 in adults, 14 in children) in the clinical evidence review. Compared with unilateral cochlear implantation, bilateral cochlear implantation improved sound localization, speech perception in noise, and subjective benefits of hearing in adults and children with severe to profound sensorineural hearing loss (GRADE: moderate to high). Bilateral cochlear implantation also allowed for better language development and more vocalization in preverbal communication in children (GRADE: moderate). The safety profile was acceptable.Bilateral cochlear implantation was more expensive and more effective than unilateral cochlear implantation. The incremental cost-effectiveness ratio was $48,978/QALY in adults and between $27,427/QALY and $30,386/QALY in children. Cost-effectiveness was highly dependent on the quality-of-life values used. We estimated that the net budget impact of publicly funding bilateral cochlear implantation for adults in Ontario would be between $510,000 and $780,000 per year for the next 5 years.Patients described the social and emotional effects of hearing loss, and the benefits and challenges of using cochlear implants.ConclusionsBased on evidence of moderate to high quality, we found that bilateral cochlear implantation improved hearing in adults and children with severe to profound sensorineural hearing loss. Bilateral cochlear implantation was potentially cost-effective compared to unilateral cochlear implantation in adults and children. Patients with sensorineural hearing loss reported the positive effects of cochlear implants, and patients with unilateral cochlear implants generally expressed a desire for bilateral implants.