Dataset Information

Bridging health technology assessment (HTA) with multicriteria decision analyses (MCDA): field testing of the EVIDEM framework for coverage decisions by a public payer in Canada.

ABSTRACT: BACKGROUND: Consistent healthcare decision making requires systematic consideration of decision criteria and evidence available to inform them. This can be tackled by combining multicriteria decision analysis (MCDA) and Health Technology Assessment (HTA). The objective of this study was to field-test a decision support framework (EVIDEM), explore its utility to a drug advisory committee and test its reliability over time. METHODS: Tramadol for chronic non-cancer pain was selected by the health plan as a case study relevant to their context. Based on extensive literature review, a by-criterion HTA report was developed to provide synthesized evidence for each criterion of the framework (14 criteria for the MCDA Core Model and 6 qualitative criteria for the Contextual Tool). During workshop sessions, committee members tested the framework in three steps by assigning: 1) weights to each criterion of the MCDA Core Model representing individual perspective; 2) scores for tramadol for each criterion of the MCDA Core Model using synthesized data; and 3) qualitative impacts of criteria of the Contextual Tool on the appraisal. Utility and reliability of the approach were explored through discussion, survey and test-retest. Agreement between test and retest data was analyzed by calculating intra-rater correlation coefficients (ICCs) for weights, scores and MCDA value estimates. RESULTS: The framework was found useful by the drug advisory committee in supporting systematic consideration of a broad range of criteria to promote a consistent approach to appraising healthcare interventions. Directly integrated in the framework as a "by-criterion" HTA report, synthesized evidence for each criterion facilitated its consideration, although this was sometimes limited by lack of relevant data. Test-retest analysis showed fair to good consistency of weights, scores and MCDA value estimates at the individual level (ICC ranging from 0.676 to 0.698), thus lending some support for the reliability of the approach. Overall, committee members endorsed the inclusion of most framework criteria and revealed important areas of discussion, clarification and adaptation of the framework to the needs of the committee. CONCLUSIONS: By promoting systematic consideration of all decision criteria and the underlying evidence, the framework allows a consistent approach to appraising healthcare interventions. Further testing and validation are needed to advance MCDA approaches in healthcare decisionmaking.

SUBMITTER: Tony M

PROVIDER: S-EPMC3248909 | biostudies-other | 2011

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Bridging health technology assessment (HTA) with multicriteria decision analyses (MCDA): field testing of the EVIDEM framework for coverage decisions by a public payer in Canada.

Tony Michèle M Wagner Monika M Khoury Hanane H Rindress Donna D Papastavros Tina T Oh Paul P Goetghebeur Mireille M MM

BMC health services research 20111130

<h4>Background</h4>Consistent healthcare decision making requires systematic consideration of decision criteria and evidence available to inform them. This can be tackled by combining multicriteria decision analysis (MCDA) and Health Technology Assessment (HTA). The objective of this study was to field-test a decision support framework (EVIDEM), explore its utility to a drug advisory committee and test its reliability over time.<h4>Methods</h4>Tramadol for chronic non-cancer pain was selected by ...[more]

PMID: 22129247

Similar Datasets

Project description:BackgroundIndia recently launched the largest universal health coverage scheme in the world to address the gaps in providing healthcare to its population. Health technology assessment (HTA) has been recognised as a tool for setting priorities as the government seeks to increase public health expenditure. This study aims to understand the current situation for healthcare decision-making in India and deliberate on the opportunities for introducing HTA in the country.MethodsA paper-based questionnaire, adapted from a survey developed by the International Decision Support Initiative (iDSI), was administered on the second day of the Topic Selection Workshop that was conducted as part of the HTA Awareness Raising Workshop held in New Delhi on 25-27 July, 2016. Participants were invited to respond to questions covering the need, demand and supply for HTA in their context as well as the role of their organisation vis-à-vis HTA. The response rate for the survey was about 68% with 41 participants having completed the survey.ResultsThree quarters of the respondents (71%) stated that the government allocated healthcare resources on the basis of expert opinion. Most respondents indicated reimbursement of individual health technologies and designing a basic health benefit package (93% each) were important health policy areas while medical devices and screening programmes were cited as important technologies (98% and 92%, respectively). More than half of the respondents noted that relevant local data was either not available or was limited. Finally, technical capacity was seen as a strength and a constraint facing organisations.ConclusionThe findings from this study shed light on the current situation, the opportunities, including potential topics, and challenges in conducting HTA in India. There are limitations to the study and further studies may need to be conducted to inform the role that HTA will play in the design or implementation of universal health coverage in India.

Project description:ObjectiveTo describe a framework for people making and using evidence-informed health system and public health recommendations and decisions.BackgroundWe developed the GRADE Evidence to Decision (EtD) framework for health system and public health decisions as part of the DECIDE project, in which we simultaneously developed frameworks for these and other types of healthcare decisions, including clinical recommendations, coverage decisions and decisions about diagnostic tests.Developing the frameworkBuilding on GRADE EtD tables, we used an iterative approach, including brainstorming, consultation of the literature and with stakeholders, and an international survey of policy-makers. We applied the framework to diverse examples, conducted workshops and user testing with health system and public health guideline developers and policy-makers, and observed and tested its use in real-life guideline panels.FindingsAll the GRADE EtD frameworks share the same basic structure, including sections for formulating the question, making an assessment and drawing conclusions. Criteria listed in the assessment section of the health system and public health framework cover the important factors for making these types of decisions; in addition to the effects and economic impact of an option, the priority of the problem, the impact of the option on equity, and its acceptability and feasibility are important considerations that can inform both whether and how to implement an option. Because health system and public health interventions are often complex, detailed implementation considerations should be made when making a decision. The certainty of the evidence is often low or very low, but decision-makers must still act. Monitoring and evaluation are therefore often important considerations for these types of decisions. We illustrate the different components of the EtD framework for health system and public health decisions by presenting their application in a framework adapted from a real-life guideline.DiscussionThis framework provides a structured and transparent approach to support policy-making informed by the best available research evidence, while making the basis for decisions accessible to those whom they will affect. The health system and public health EtD framework can also be used to facilitate dissemination of recommendations and enable decision-makers to adopt, and adapt, recommendations or decisions.

Dataset Information

Bridging health technology assessment (HTA) with multicriteria decision analyses (MCDA): field testing of the EVIDEM framework for coverage decisions by a public payer in Canada.

Publications

Bridging health technology assessment (HTA) with multicriteria decision analyses (MCDA): field testing of the EVIDEM framework for coverage decisions by a public payer in Canada.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets