Dataset Information

Multi-Criteria-Decision-Analysis (MCDA) for the Horizon Scanning of Health Innovations an Application to COVID 19 Emergency.

ABSTRACT: Aim: In this article, we aim to present a tool for the early assessment of medical technologies. This evaluation system was designed and implemented by the National Centre for HTA and the National Centre for Innovative Technologies of the Istituto Superiore di Sanita, Italy, in order to respond to an institutional commitment within the "Health Technologies Assessment Team" that was established to face the huge demand for the evaluation of Health Technologies during the pandemic event caused by COVID-19, with a smart and easy-to-use framework. Methods: Horizon scanning was conducted through a brief assessment carried out according to the multicriteria decision analysis methodology. Each HTA domain was attributed a score according to a pros/cons and opportunities/threats system, derived from evidence in the literature. Scores were weighted according to different perspectives. Scores were presented in a Cartesian graph showing the positioning according to the potential value and the perceived risk associated with the technology. Results: Two case studies regarding the early assessment were reported, concerning two specific technologies: an individual protection device and a contact tracking system.

SUBMITTER: Ruggeri M

PROVIDER: S-EPMC7662805 | biostudies-literature | 2020 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Multi-Criteria-Decision-Analysis (MCDA) for the Horizon Scanning of Health Innovations an Application to COVID 19 Emergency.

Ruggeri Matteo M Cadeddu Chiara C Roazzi Paolo P Mandolini Donatella D Grigioni Mauro M Marchetti Marco M

International journal of environmental research and public health 20201026 21

<i>Aim:</i> In this article, we aim to present a tool for the early assessment of medical technologies. This evaluation system was designed and implemented by the National Centre for HTA and the National Centre for Innovative Technologies of the Istituto Superiore di Sanita, Italy, in order to respond to an institutional commitment within the "Health Technologies Assessment Team" that was established to face the huge demand for the evaluation of Health Technologies during the pandemic event caus ...[more]

PMID: 33114587

Similar Datasets

Project description:BackgroundEvaluation of integrated care programmes for individuals with multi-morbidity requires a broader evaluation framework and a broader definition of added value than is common in cost-utility analysis. This is possible through the use of Multi-Criteria Decision Analysis (MCDA).Methods and resultsThis paper presents the seven steps of an MCDA to evaluate 17 different integrated care programmes for individuals with multi-morbidity in 8 European countries participating in the 4-year, EU-funded SELFIE project. In step one, qualitative research was undertaken to better understand the decision-context of these programmes. The programmes faced decisions related to their sustainability in terms of reimbursement, continuation, extension, and/or wider implementation. In step two, a uniform set of decision criteria was defined in terms of outcomes measured across the 17 programmes: physical functioning, psychological well-being, social relationships and participation, enjoyment of life, resilience, person-centeredness, continuity of care, and total health and social care costs. These were supplemented by programme-type specific outcomes. Step three presents the quasi-experimental studies designed to measure the performance of the programmes on the decision criteria. Step four gives details of the methods (Discrete Choice Experiment, Swing Weighting) to determine the relative importance of the decision criteria among five stakeholder groups per country. An example in step five illustrates the value-based method of MCDA by which the performance of the programmes on each decision criterion is combined with the weight of the respective criterion to derive an overall value score. Step six describes how we deal with uncertainty and introduces the Conditional Multi-Attribute Acceptability Curve. Step seven addresses the interpretation of results in stakeholder workshops.DiscussionBy discussing our solutions to the challenges involved in creating a uniform MCDA approach for the evaluation of different programmes, this paper provides guidance to future evaluations and stimulates debate on how to evaluate integrated care for multi-morbidity.

Project description:BACKGROUND:Acute trauma pain is poorly managed in the emergency department (ED). The reasons are partly organizational: ED crowding and rare trauma care pathways contribute to oligoanalgesia. Anticipating the organizational impact of an innovative care procedure might facilitate the decision-making process and help to optimize pain management. METHODS:We used a multiple criteria decision analysis (MCDA) approach to consider the organizational impact of methoxyflurane (self-administered) in the ED, introduced alone or supported by a trauma care pathway. A MCDA experiment was designed for this specific context, 8 experts in emergency trauma care pathways (leading physicians and pharmacists working in French urban tertiary hospitals) were recruited. The study involved four steps: (i) Selection of organizational criteria for evaluating the innovation's impact; (ii) assessment of the relative weight of each criterion; (iii) choice of appropriate scenarios for exploring the organizational impact of MEOX under various contexts; and (iv) software-assisted simulation based on pairwise comparisons of the scenarios. The final outcome measure was the expected overall organizational impact of methoxyflurane on a 0-to-100 scale (score >50: positive impact). RESULTS:Nine organizational criteria were selected. "Mean length of stay in the ED" was the most weighted. Methoxyflurane alone obtained 59 as a total score, with a putative positive impact for eight criteria, and a neutral effect on one. When a trauma care pathway was introduced concomitantly, the impact of methoxyflurane was greater overall (score: 75) and for each individual criterion. CONCLUSIONS:Our model highlighted the putative positive organizational impact of methoxyflurane in the ED-particularly when supported by a trauma care pathway-and the relevance of expert consensus in this particular pharmacoeconomic context. The MCDA approach could be extended to other research fields and healthcare challenges in emergency medicine.

Project description:ObjectiveDesign and build a strategy construction and evaluation software system to help stakeholders to develop viable strategies to expand (and adapt) the Chagas Platform healthcare model through the primary healthcare system in Bolivia.MethodsThe software was built based on a ranking of medical Interventions and Actions (needed to support Interventions' implementation) needed for comprehensive management of Chagas Disease in Bolivia. The ranking was performed using a Multi Criteria Decision Analysis (MCDA) methodology adapted to the WHO's building blocks framework. Data regarding the criteria and the rankings was obtained through surveys and interviews with health care professionals working on Chagas disease. The Analytical Hierarchy Process was used to construct the decision criteria weights. Data Envelopment Analysis was used to identify the Interventions that lay on the efficiency frontier of outcomes and the complexity of associated Actions. These techniques were combined with integer programing tools using the open-source software R to build a decision-making tool to assess the outcomes and complexity of any combination of Interventions and Actions. This model and tool were applied to data concerning the care of Chagas disease in Bolivia collected through surveys of experts. The tool works by loading the data from each specific context.ResultsThe initial set of Interventions and Actions recommended after analysis of the survey data was further refined through face-to-face interviews with field experts in Bolivia, resulting in a strategy of 18 Interventions and 15 Actions. Within the WHO model the Leadership and Governance building block came up as the one needing more support with Actions such as the inclusion of Chagas into Annual Municipal Operational Plans by appointing local and provincial coordinators.ConclusionThis project established the suitability of the model for constructing healthcare strategies. The model could be developed further resulting in a decision-making tool for program managers in a wide range of healthcare related issues, including neglected and/ or prevalent diseases. The tool has the potential to be used at different stages of decision making by diverse stakeholders in order to coordinate activities needed to address a health problem.

Project description:Background: Increasingly, multi-criteria decision analysis has gained importance as a method by which to assess the value of orphan drugs. However, very little attention has been given to the weight (relative preferences) of the individual criteria used in a framework. Aims: This study sought to gain an understanding of the preferential weights that should be allocated in a multi-criteria decision analysis framework for orphan drugs, from a multi-stakeholder perspective. Method: Using key MCDA criteria for orphan drugs reported in the literature, we developed an interactive web-based survey tool to capture preferences for different criteria from a general stakeholder sample who were requested to assign weights from a reimbursement perspective. Each criterion could be assigned a weight on a sliding scale from 0 to 100% as long as the sum of all the criteria was 100%. We subsequently used the interactive tool with an expert focus group, followed up with a group discussion regarding each criterion and their perspectives on the weight that each criterion should be allocated when assessing an orphan drug. The expert focus group participants were then able to adjust their weights, if the group discussion had changed their perspectives. Results: The interactive tool was completed by 120 general stakeholder sample from a wide range of countries and professional backgrounds and an expert focus group of ten members. The results showed the differences in perspectives on the importance of criteria. Both groups considered Treatment efficacy to be the most important criterion. The general stakeholder sample weighted Treatment safety at 12.03% compared to the expert focus group's average of 20%. The results also demonstrated the value of the group discussion, which provided additional insights into the perspectives on the importance of criteria in assessing orphan drugs. Conclusion: This study aimed to contribute to the important aspect of preferences for different criteria in MCDA. This study sheds light on the important aspect of the preferences of the different criteria. All respondents agreed on the relative importance of Treatment efficacy and Treatment safety, criteria that are captured in conventional cost-effectiveness studies, but they also expressed the view that in addition to those, several disease-related and drug-related criteria should be included in MCDA frameworks for assessing orphan drugs.

Project description:BackgroundCurrent practice guidelines offer different management recommendations for adults presenting with a sore throat. The key issue is the extent to which the clinical likelihood of a Group A streptococcal infection should affect patient management decisions. To help resolve this issue, we conducted a multi-criteria decision analysis using the Analytic Hierarchy Process.MethodsWe defined optimal patient management using four criteria: 1) reduce symptom duration; 2) prevent infectious complications, local and systemic; 3) minimize antibiotic side effects, minor and anaphylaxis; and 4) achieve prudent use of antibiotics, avoiding both over-use and under-use. In our baseline analysis we assumed that all criteria and sub-criteria were equally important except minimizing anaphylactic side effects, which was judged very strongly more important than minimizing minor side effects. Management strategies included: a) No test, No treatment; b) Perform a rapid strep test and treat if positive; c) Perform a throat culture and treat if positive; d) Perform a rapid strep test and treat if positive; if negative obtain a throat culture and treat if positive; and e) treat without further tests. We defined four scenarios based on the likelihood of group A streptococcal infection using the Centor score, a well-validated clinical index. Published data were used to estimate the likelihoods of clinical outcomes and the test operating characteristics of the rapid strep test and throat culture for identifying group A streptococcal infections.ResultsUsing the baseline assumptions, no testing and no treatment is preferred for patients with Centor scores of 1; two strategies--culture and treat if positive and rapid strep with culture of negative results--are equally preferable for patients with Centor scores of 2; and rapid strep with culture of negative results is the best management strategy for patients with Centor scores 3 or 4. These results are sensitive to the priorities assigned to the decision criteria, especially avoiding over-use versus under-use of antibiotics, and the population prevalence of Group A streptococcal pharyngitis.ConclusionThe optimal clinical management of adults with sore throat depends on both the clinical probability of a group A streptococcal infection and clinical judgments that incorporate individual patient and practice circumstances.

Dataset Information

Multi-Criteria-Decision-Analysis (MCDA) for the Horizon Scanning of Health Innovations an Application to COVID 19 Emergency.

Publications

Multi-Criteria-Decision-Analysis (MCDA) for the Horizon Scanning of Health Innovations an Application to COVID 19 Emergency.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets