Dataset Information

Weighing Clinical Evidence Using Patient Preferences: An Application of Probabilistic Multi-Criteria Decision Analysis.

ABSTRACT: The need for patient engagement has been recognized by regulatory agencies, but there is no consensus about how to operationalize this. One approach is the formal elicitation and use of patient preferences for weighing clinical outcomes. The aim of this study was to demonstrate how patient preferences can be used to weigh clinical outcomes when both preferences and clinical outcomes are uncertain by applying a probabilistic value-based multi-criteria decision analysis (MCDA) method. Probability distributions were used to model random variation and parameter uncertainty in preferences, and parameter uncertainty in clinical outcomes. The posterior value distributions and rank probabilities for each treatment were obtained using Monte-Carlo simulations. The probability of achieving the first rank is the probability that a treatment represents the highest value to patients. We illustrated our methodology for a simplified case on six HIV treatments. Preferences were modeled with normal distributions and clinical outcomes were modeled with beta distributions. The treatment value distributions showed the rank order of treatments according to patients and illustrate the remaining decision uncertainty. This study demonstrated how patient preference data can be used to weigh clinical evidence using MCDA. The model takes into account uncertainty in preferences and clinical outcomes. The model can support decision makers during the aggregation step of the MCDA process and provides a first step toward preference-based personalized medicine, yet requires further testing regarding its appropriate use in real-world settings.

SUBMITTER: Broekhuizen H

PROVIDER: S-EPMC5306398 | biostudies-literature | 2017 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Weighing Clinical Evidence Using Patient Preferences: An Application of Probabilistic Multi-Criteria Decision Analysis.

Broekhuizen Henk H IJzerman Maarten J MJ Hauber A Brett AB Groothuis-Oudshoorn Catharina G M CGM

PharmacoEconomics 20170301 3

The need for patient engagement has been recognized by regulatory agencies, but there is no consensus about how to operationalize this. One approach is the formal elicitation and use of patient preferences for weighing clinical outcomes. The aim of this study was to demonstrate how patient preferences can be used to weigh clinical outcomes when both preferences and clinical outcomes are uncertain by applying a probabilistic value-based multi-criteria decision analysis (MCDA) method. Probability ...[more]

PMID: 27832461

Similar Datasets

Project description:Background: Increasingly, multi-criteria decision analysis has gained importance as a method by which to assess the value of orphan drugs. However, very little attention has been given to the weight (relative preferences) of the individual criteria used in a framework. Aims: This study sought to gain an understanding of the preferential weights that should be allocated in a multi-criteria decision analysis framework for orphan drugs, from a multi-stakeholder perspective. Method: Using key MCDA criteria for orphan drugs reported in the literature, we developed an interactive web-based survey tool to capture preferences for different criteria from a general stakeholder sample who were requested to assign weights from a reimbursement perspective. Each criterion could be assigned a weight on a sliding scale from 0 to 100% as long as the sum of all the criteria was 100%. We subsequently used the interactive tool with an expert focus group, followed up with a group discussion regarding each criterion and their perspectives on the weight that each criterion should be allocated when assessing an orphan drug. The expert focus group participants were then able to adjust their weights, if the group discussion had changed their perspectives. Results: The interactive tool was completed by 120 general stakeholder sample from a wide range of countries and professional backgrounds and an expert focus group of ten members. The results showed the differences in perspectives on the importance of criteria. Both groups considered Treatment efficacy to be the most important criterion. The general stakeholder sample weighted Treatment safety at 12.03% compared to the expert focus group's average of 20%. The results also demonstrated the value of the group discussion, which provided additional insights into the perspectives on the importance of criteria in assessing orphan drugs. Conclusion: This study aimed to contribute to the important aspect of preferences for different criteria in MCDA. This study sheds light on the important aspect of the preferences of the different criteria. All respondents agreed on the relative importance of Treatment efficacy and Treatment safety, criteria that are captured in conventional cost-effectiveness studies, but they also expressed the view that in addition to those, several disease-related and drug-related criteria should be included in MCDA frameworks for assessing orphan drugs.

Project description:The Centers for Disease Control and Prevention (CDC) Select Agent Program establishes a list of biological agents and toxins that potentially threaten public health and safety, the procedures governing the possession, utilization, and transfer of those agents, and training requirements for entities working with them. Every 2 years the Program reviews the select agent list, utilizing subject matter expert (SME) assessments to rank the agents. In this study, we explore the applicability of multi-criteria decision analysis (MCDA) techniques and logic tree analysis to support the CDC Select Agent Program biennial review process, applying the approach broadly to include non-select agents to evaluate its generality. We conducted a literature search for over 70 pathogens against 15 criteria for assessing public health and bioterrorism risk and documented the findings for archiving. The most prominent data gaps were found for aerosol stability and human infectious dose by inhalation and ingestion routes. Technical review of published data and associated scoring recommendations by pathogen-specific SMEs was found to be critical for accuracy, particularly for pathogens with very few known cases, or where proxy data (e.g., from animal models or similar organisms) were used to address data gaps. Analysis of results obtained from a two-dimensional plot of weighted scores for difficulty of attack (i.e., exposure and production criteria) vs. consequences of an attack (i.e., consequence and mitigation criteria) provided greater fidelity for understanding agent placement compared to a 1-to-n ranking and was used to define a region in the upper right-hand quadrant for identifying pathogens for consideration as select agents. A sensitivity analysis varied the numerical weights attributed to various properties of the pathogens to identify potential quantitative (x and y) thresholds for classifying select agents. The results indicate while there is some clustering of agent scores to suggest thresholds, there are still pathogens that score close to any threshold, suggesting that thresholding "by eye" may not be sufficient. The sensitivity analysis indicates quantitative thresholds are plausible, and there is good agreement of the analytical results with select agent designations. A second analytical approach that applied the data using a logic tree format to rule out pathogens for consideration as select agents arrived at similar conclusions.

Project description:BackgroundSince decision making about treatment with disease-modifying drugs (DMDs) for multiple sclerosis (MS) is preference sensitive, shared decision making between patient and healthcare professional should take place. Patient decision aids could support this shared decision making process by providing information about the disease and the treatment options, to elicit the patient's preference and to support patients and healthcare professionals in discussing these preferences and matching them with a treatment. Therefore, a prototype of a patient decision aid for MS patients in the Netherlands-based on the principles of multi-criteria decision analysis (MCDA) -was developed, following the recommendations of the International Patient Decision Aid Standards. MCDA was chosen as it might reduce cognitive burden of considering treatment options and matching patient preferences with the treatment options.ResultsAfter determining the scope to include DMDs labelled for relapsing-remitting MS and clinically isolated syndrome, users' informational needs were assessed using focus groups (N = 19 patients) and best-worst scaling surveys with patients (N = 185), neurologists and nurses (N = 60) to determine which information about DMDs should be included in the patient decision aid. Next, an online format and computer-based delivery of the patient decision aid was chosen to enable embedding of MCDA. A literature review was conducting to collect evidence on the effectiveness and burden of use of the DMDs. A prototype was developed next, and alpha testing to evaluate its comprehensibility and usability with in total thirteen patients and four healthcare professionals identified several issues regarding content and framing, methods for weighting importance of criteria in the MCDA structure, and the presentation of the conclusions of the patient decision aid ranking the treatment options according to the patient's preferences. Adaptations were made accordingly, but verification of the rankings provided, validation of the patient decision aid, evaluation of the feasibility of implementation and assessing its value for supporting shared decision making should be addressed in further development of the patient decision aid.ConclusionThis paper aimed to provide more transparency regarding the developmental process of an MCDA-based patient decision aid for treatment decisions for MS and the challenges faced during this process. Issues identified in the prototype were resolved as much as possible, though some issues remain. Further development is needed to overcome these issues before beta pilot testing with patients and healthcare professionals at the point of clinical decision-making can take place to ultimately enable making conclusions about the value of the MCDA-based patient decision aid for MS patients, healthcare professionals and the quality of care.

Project description:BackgroundMedical decision-making is critical to patient survival and well-being. Patients with end stage renal disease (ESRD) are faced with incrementally complex decision-making throughout their treatment journey. The extent to which patients seek involvement in the decision-making process and factors which influence these in ESRD need to be understood.Methods535 ESRD patients were enrolled into the cross-sectional study arm and 30 patients who started dialysis were prospectively evaluated. Patients were enrolled into 3 groups- 'predialysis' (group A), 'in-centre' haemodialysis (HD) (group B) and self-care HD (93 % at home-group C) from across five tertiary UK renal centres. The Autonomy Preference Index (API) has been employed to study patient preferences for information-seeking (IS) and decision-making (DM). Demographic, psychosocial and neuropsychometric assessments are considered for analyses.Results458 complete responses were available. API items have high internal consistency in the study population (Cronbach's alpha > 0.70). Overall and across individual study groups, the scores for information-seeking and decision-making are significantly different indicating that although patients had a strong preference to be well informed, they were more neutral in their preference to participate in DM (p < 0.05). In the age, education and study group adjusted multiple linear regression analysis, lower age, female gender, marital status; higher API IS scores and white ethnicity background were significant predictors of preference for decision-making. DM scores were subdivided into tertiles to identify variables associated with high (DM > 70: and low DM (≤30) scores. This shows association of higher DM scores with lower age, lower comorbidity index score, higher executive brain function, belonging in the self-caring cohort and being unemployed. In the prospectively studied cohort of predialysis patients, there was no change in decision-making preference scores after commencement of dialysis.ConclusionESRD patients prefer to receive information, but this does not always imply active involvement in decision-making. By understanding modifiable and non-modifiable factors which affect patient preferences for involvement in healthcare decision-making, health professionals may acknowledge the need to accommodate individual patient preferences to the extent determined by the individual patient factors.

Project description:ObjectiveDesign and build a strategy construction and evaluation software system to help stakeholders to develop viable strategies to expand (and adapt) the Chagas Platform healthcare model through the primary healthcare system in Bolivia.MethodsThe software was built based on a ranking of medical Interventions and Actions (needed to support Interventions' implementation) needed for comprehensive management of Chagas Disease in Bolivia. The ranking was performed using a Multi Criteria Decision Analysis (MCDA) methodology adapted to the WHO's building blocks framework. Data regarding the criteria and the rankings was obtained through surveys and interviews with health care professionals working on Chagas disease. The Analytical Hierarchy Process was used to construct the decision criteria weights. Data Envelopment Analysis was used to identify the Interventions that lay on the efficiency frontier of outcomes and the complexity of associated Actions. These techniques were combined with integer programing tools using the open-source software R to build a decision-making tool to assess the outcomes and complexity of any combination of Interventions and Actions. This model and tool were applied to data concerning the care of Chagas disease in Bolivia collected through surveys of experts. The tool works by loading the data from each specific context.ResultsThe initial set of Interventions and Actions recommended after analysis of the survey data was further refined through face-to-face interviews with field experts in Bolivia, resulting in a strategy of 18 Interventions and 15 Actions. Within the WHO model the Leadership and Governance building block came up as the one needing more support with Actions such as the inclusion of Chagas into Annual Municipal Operational Plans by appointing local and provincial coordinators.ConclusionThis project established the suitability of the model for constructing healthcare strategies. The model could be developed further resulting in a decision-making tool for program managers in a wide range of healthcare related issues, including neglected and/ or prevalent diseases. The tool has the potential to be used at different stages of decision making by diverse stakeholders in order to coordinate activities needed to address a health problem.

Project description:BackgroundEvaluation of integrated care programmes for individuals with multi-morbidity requires a broader evaluation framework and a broader definition of added value than is common in cost-utility analysis. This is possible through the use of Multi-Criteria Decision Analysis (MCDA).Methods and resultsThis paper presents the seven steps of an MCDA to evaluate 17 different integrated care programmes for individuals with multi-morbidity in 8 European countries participating in the 4-year, EU-funded SELFIE project. In step one, qualitative research was undertaken to better understand the decision-context of these programmes. The programmes faced decisions related to their sustainability in terms of reimbursement, continuation, extension, and/or wider implementation. In step two, a uniform set of decision criteria was defined in terms of outcomes measured across the 17 programmes: physical functioning, psychological well-being, social relationships and participation, enjoyment of life, resilience, person-centeredness, continuity of care, and total health and social care costs. These were supplemented by programme-type specific outcomes. Step three presents the quasi-experimental studies designed to measure the performance of the programmes on the decision criteria. Step four gives details of the methods (Discrete Choice Experiment, Swing Weighting) to determine the relative importance of the decision criteria among five stakeholder groups per country. An example in step five illustrates the value-based method of MCDA by which the performance of the programmes on each decision criterion is combined with the weight of the respective criterion to derive an overall value score. Step six describes how we deal with uncertainty and introduces the Conditional Multi-Attribute Acceptability Curve. Step seven addresses the interpretation of results in stakeholder workshops.DiscussionBy discussing our solutions to the challenges involved in creating a uniform MCDA approach for the evaluation of different programmes, this paper provides guidance to future evaluations and stimulates debate on how to evaluate integrated care for multi-morbidity.

Dataset Information

Weighing Clinical Evidence Using Patient Preferences: An Application of Probabilistic Multi-Criteria Decision Analysis.

Publications

Weighing Clinical Evidence Using Patient Preferences: An Application of Probabilistic Multi-Criteria Decision Analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets