Peering into the black box: a meta-analysis of how clinicians use decision aids during clinical encounters.
Ontology highlight
ABSTRACT:
SUBMITTER: Wyatt KD
PROVIDER: S-EPMC3936841 | biostudies-literature | 2014 Feb
REPOSITORIES: biostudies-literature
Publications
Peering into the black box: a meta-analysis of how clinicians use decision aids during clinical encounters.
Wyatt Kirk D KD Branda Megan E ME Anderson Ryan T RT Pencille Laurie J LJ Montori Victor M VM Hess Erik P EP Ting Henry H HH LeBlanc Annie A
Implementation science : IS 20140222
<h4>Objective</h4>To quantify the extent to which clinicians use clinically-efficacious decision aids as intended during implementation in practice and how fidelity to usage instructions correlates with shared decision making (SDM) outcomes.<h4>Methods</h4>Participant-level meta-analysis including six practice-based randomized controlled trials of SDM in various clinical settings encompassing a range of decisions.<h4>Results</h4>Of 339 encounters in the SDM intervention arm of the trials, 229 we ...[more]
Similar Datasets
Project description:To mitigate the movement of non-native organisms with trade, phytosanitary systems have been implemented within and between countries. In some countries such as Cuba, little is known about the within-state plant health system. To facilitate the development of future trade partnership between Cuba and the United States, agencies need to understand the organizational structure and diagnostic capacity of the Cuban Plant Protection System, identify potential synergies between the United States and Cuban systems, and identify steps towards cooperation. This paper fills this critical void by presenting a descriptive analysis of the plant health system in Cuba. Information was integrated from available literature, informal interviews with Cuban experts, and workshops focused on Cuban policies, risk, and potential collaboration attended by Cuban and American experts. We identify the next practical steps in improving cooperation, including building trust and capacity. Mutual understanding of phytosanitary systems will be crucial for the regional economic and environmental stability of a post-embargo United States-Cuban relationship.
| S-EPMC7521714 | biostudies-literature
Project description:BackgroundTools for shared decision-making (e.g. decision aids) are intended to support health care professionals and patients engaged in clinical encounters involving shared decision-making. However, decision aids are hard to produce, and onerous to update. Consequently, they often do not reflect best current evidence, and show limited uptake in practice. In response, we initiated the Sharing Evidence to Inform Treatment decisions (SHARE-IT) project. Our goal was to develop and refine a new generation of decision aids that are generically produced along digitally structured guidelines and evidence summaries.MethodsApplying principles of human-centred design and following the International Patient Decision Aid Standards (IPDAS) and GRADE methods for trustworthy evidence summaries we developed a decision aid prototype in collaboration with the Developing and Evaluating Communication strategies to support Informed Decisions and practice based on Evidence project (DECIDE). We iteratively user-tested the prototype in clinical consultations between clinicians and patients. Semi-structured interviews of participating clinicians and patients were conducted. Qualitative content analysis of both user-testing sessions and interviews was performed and results categorized according to a revised Morville's framework of user-experience. We made it possible to produce, publish and use these decision aids in an electronic guideline authoring and publication platform (MAGICapp).ResultsDirect observations and analysis of user-testing of 28 clinical consultations between physicians and patients informed four major iterations that addressed readability, understandability, usability and ways to cope with information overload. Participants reported that the tool supported natural flow of the conversation and induced a positive shift in consultation habits towards shared decision-making. We integrated the functionality of SHARE-IT decision aids in MAGICapp, which has since generated numerous decision aids.ConclusionOur study provides a proof of concept that encounter decision aids can be generically produced from GRADE evidence summaries and clinical guidelines. Online authoring and publication platforms can help scale up production including continuous updating of electronic encounter decision aids, fully integrated with evidence summaries and clinical practice guidelines.
| S-EPMC8240084 | biostudies-literature
Project description:We describe the morpho-anatomical features of the ectomycorrhizas (ECMs) formed by Lactifluus rugatus on Cistus, a genus of about 20 species of woody shrubs typical of the Mediterranean maquis. The description of L. rugatus mycorrhizas on Cistus is the first ECM description of a species belonging to Lactifluus subgen. Pseudogymnocarpi. The ECM identity was verified through molecular tools. Anatomically, the characteristic of L. rugatus mycorrhiza is the presence of abundant, long "bottle-shaped" cystidia on mantle surface. Indeed, the overwhelming majority of milkcap mycorrhizas are acystidiate. This is the third Lactarius/Lactifluus mycorrhiza to have been described associated with Cistus, the others being Lactarius cistophilus and L. tesquorum. The phylogenetic distance between all these taxa is reflected by the diversity of the principal features of their ECMs, which share host-depending ECM features known for Cistus, but are otherwise distinguishable on the host roots. Comparison of Lactifluus rugatus ECM with those formed by L. vellereus and L. piperatus on Fagus reveals elevated intrageneric diversity of mycorrhizal structures. Such a diversity is supported by analysis of ITS sequences of relevant species within European Lactifluus species. Our study extends knowledge of Cistus mycorrhizal biology and confirms the informative value of mycorrhizal structures in understanding phylogenetic relationships in ECM fungi.
| S-EPMC5159598 | biostudies-literature
Project description:BackgroundClinicians' satisfaction with encounter decision aids is an important component in facilitating implementation of these tools. We aimed to determine the impact of decision aids supporting shared decision making (SDM) during the clinical encounter on clinician outcomes.MethodsWe searched nine databases from inception to June 2017. Randomised clinical trials (RCTs) of decision aids used during clinical encounters with an unaided control group were eligible for inclusion. Due to heterogeneity among included studies, we used a narrative evidence synthesis approach.ResultsTwenty-five papers met inclusion criteria including 22 RCTs and 3 qualitative or mixed-methods studies nested in an RCT, together representing 23 unique trials. These trials evaluated healthcare decisions for cardiovascular prevention and treatment (n=8), treatment of diabetes mellitus (n=3), treatment of osteoporosis (n=2), treatment of depression (n=2), antibiotics to treat acute respiratory infections (n=3), cancer prevention and treatment (n=4) and prenatal diagnosis (n=1). Clinician outcomes were measured in only a minority of studies. Clinicians' satisfaction with decision making was assessed in only 8 (and only 2 of them showed statistically significantly greater satisfaction with the decision aid); only three trials asked if clinicians would recommend the decision aid to colleagues and only five asked if clinicians would use decision aids in the future. Outpatient consultations were not prolonged when a decision aid was used in 9 out of 13 trials. The overall strength of the evidence was low, with the major risk of bias related to lack of blinding of participants and/or outcome assessors.ConclusionDecision aids can improve clinicians' satisfaction with medical decision making and provide helpful information without affecting length of consultation time. Most SDM trials, however, omit outcomes related to clinicians' perspective on the decision making process or the likelihood of using a decision aid in the future.
| S-EPMC6561726 | biostudies-literature
Project description:Shared decision making (SDM) and decision aids (DAs) increase patients' involvement in health care decisions and enhance satisfaction with their choices. Studies of SDM and DAs have primarily occurred in academic centers and large health systems, but most primary care is delivered in smaller practices, and over 20% of Americans live in rural areas, where poverty, disease prevalence, and limited access to care may increase the need for SDM and DAs.To explore perceptions and practices of rural primary care clinicians regarding SDM and DAs.Cross-sectional survey. Setting and Participants Primary care clinicians affiliated with the Oregon Rural Practice-based Research Network.Surveys were returned by 181 of 231 eligible participants (78%); 174 could be analyzed. Two-thirds of participants were physicians, 84% practiced family medicine, and 55% were male. Sixty-five percent of respondents were unfamiliar with the term shared decision making, but following definition, 97% reported that they found the approach useful for conditions with multiple treatment options. Over 90% of clinicians perceived helping patients make decisions regarding chronic pain and health behavior change as moderate/hard in difficulty. Although 69% of respondents preferred that patients play an equal role in making decisions, they estimate that this happens only 35% of the time. Time was reported as the largest barrier to engaging in SDM (63%). Respondents were receptive to using DAs to facilitate SDM in print- (95%) or web-based formats (72%), and topic preference varied by clinician specialty and decision difficulty.Rural clinicians recognized the value of SDM and were receptive to using DAs in multiple formats. Integration of DAs to facilitate SDM in routine patient care may require addressing practice operation and reimbursement.
| S-EPMC3665512 | biostudies-literature
Project description:To develop a conceptual model that explained common and divergent care processes in Green House (GH) nursing homes with high and low hospital transfer rates.Eighty-four face-to-face, semistructured interviews were conducted with direct care, professional, and administrative staff with knowledge of care processes in six GH organizations in six states.The qualitative grounded theory method was used for data collection and analysis. Data were analyzed using open, axial, and selective coding. Data collection and analysis occurred iteratively.Elements of the GH model created significant opportunities to identify, communicate, and respond to early changes in resident condition. Staff in GH homes with lower hospital transfer rates employed care processes that maximized these opportunities. Staff in GH homes with higher transfer rates failed to maximize, or actively undermined, these opportunities.Variations in how the GH model was implemented across GH homes suggest possible explanations for inconsistencies found in past research on the care outcomes, including hospital transfer rates, in culture change models. The findings further suggest that the details of culture change implementation are important considerations in model replication and policies that create incentives for care improvements.
| S-EPMC4939731 | biostudies-other
Project description:Background. Although effective interventions for shared decision making (SDM) exist, there is a lack of uptake of these tools into clinical practice. "Nudges," which draw on behavioral economics and target automatic thinking processes, are used by policy makers to influence population-level behavior change. Nudges have not been applied in the context of SDM interventions but have potential to influence clinician motivation, a primary barrier to long-term adoption of SDM tools. Objective. Describe, evaluate, and propose recommendations for the use of a behavioral economics framework (MINDSPACE) on clinician motivation and behavior during implementation of a validated decision aid (DA) for left ventricular assist device at nine hospitals. Methods. Qualitative thematic analysis of process notes from stakeholder meetings during the first 6 months of implementation to identify examples of how the MINDSPACE framework was operationalized. Quantitative implementation progress was evaluated using the RE-AIM framework. Results. MINDSPACE components were translated into concrete approaches that leveraged influential stakeholders, fostered ownership over the DA and positive emotional associations, spread desirable norms across sites, and situated the DA within established default processes. DA reach to eligible patients increased from 9.8% in the first month of implementation to 70.0% in the sixth month. Larger gains in reach were observed following meetings using MINDSPACE approaches. Limitations. The MINDSPACE framework does not capture all possible influences on behavior and responses to nudges may differ across populations. Conclusions. Behavioral economics can be applied to implementation science to foster uptake of SDM tools by increasing clinician motivation. Our recommendations can help other researchers effectively apply these approaches in real-world settings when there are often limited incentives and opportunities to change organizational- or structural-level factors.
| S-EPMC7227151 | biostudies-literature
Project description:State-of-the-art machine learning (ML) artificial intelligence methods are increasingly leveraged in clinical predictive modeling to provide clinical decision support systems to physicians. Modern ML approaches such as artificial neural networks (ANNs) and tree boosting often perform better than more traditional methods like logistic regression. On the other hand, these modern methods yield a limited understanding of the resulting predictions. However, in the medical domain, understanding of applied models is essential, in particular, when informing clinical decision support. Thus, in recent years, interpretability methods for modern ML methods have emerged to potentially allow explainable predictions paired with high performance. To our knowledge, we present in this work the first explainability comparison of two modern ML methods, tree boosting and multilayer perceptrons (MLPs), to traditional logistic regression methods using a stroke outcome prediction paradigm. Here, we used clinical features to predict a dichotomized 90 days post-stroke modified Rankin Scale (mRS) score. For interpretability, we evaluated clinical features' importance with regard to predictions using deep Taylor decomposition for MLP, Shapley values for tree boosting and model coefficients for logistic regression. With regard to performance as measured by Area under the Curve (AUC) values on the test dataset, all models performed comparably: Logistic regression AUCs were 0.83, 0.83, 0.81 for three different regularization schemes; tree boosting AUC was 0.81; MLP AUC was 0.83. Importantly, the interpretability analysis demonstrated consistent results across models by rating age and stroke severity consecutively amongst the most important predictive features. For less important features, some differences were observed between the methods. Our analysis suggests that modern machine learning methods can provide explainability which is compatible with domain knowledge interpretation and traditional method rankings. Future work should focus on replication of these findings in other datasets and further testing of different explainability methods.
| S-EPMC7135268 | biostudies-literature
Project description:BackgroundDigital innovations have shown promise for improving maternal health service delivery. However, low- and middle-income countries are still at the adoption-utilization stage. Evidence on mobile health has been described as a black box, with gaps in theoretical explanations that account for the ecosystem of health care and their effect on adoption mechanisms. Bliss4Midwives, a modular integrated diagnostic kit to support antenatal care service delivery, was piloted for 1 year in Northern Ghana. Although both users and beneficiaries valued Bliss4Midwives, results from the pilot showed wide variations in usage behavior and duration of use across project sites.ObjectiveTo strengthen the design and implementation of an improved prototype, the study objectives were two-fold: to identify causal factors underlying the variation in Bliss4Midwives usage behavior and understand how to overcome or leverage these in subsequent implementation cycles.MethodsUsing a multiple case study design, a realist evaluation of Bliss4Midwives was conducted. A total of 3 candidate program theories were developed and empirically tested in 6 health facilities grouped into low and moderate usage clusters. Quantitative and qualitative data were collected and analyzed using realist thinking to build configurations that link intervention, context, actors, and mechanisms to program outcomes, by employing inductive and deductive reasoning. Nonparametric t test was used to compare the perceived usefulness and perceived ease of use of Bliss4Midwives between usage clusters.ResultsWe found no statistically significant differences between the 2 usage clusters. Low to moderate adoption of Bliss4Midwives was better explained by fear, enthusiasm, and high expectations for service delivery, especially in the absence of alternatives. Recognition from pregnant women, peers, supervisors, and the program itself was a crucial mechanism for device utilization. Other supportive mechanisms included ownership, empowerment, motivation, and adaptive responses to the device, such as realignment and negotiation. Champion users displayed high adoption-utilization behavior in contexts of participative or authoritative supervision, yet used the device inconsistently. Intervention-related (technical challenges, device rotation, lack of performance feedback, and refresher training), context-related (staff turnover, competing priorities, and workload), and individual factors (low technological self-efficacy, baseline knowledge, and internal motivation) suppressed utilization mechanisms.ConclusionsThis study shed light on optimal conditions necessary for Bliss4Midwives to thrive in a complex social and organizational setting. Beyond usability and viability studies, advocates of innovative technologies for maternal care need to consider how implementation strategies and contextual factors, such as existing collaborations and supervision styles, trigger mechanisms that influence program outcomes. In addition to informing scale-up of the Bliss4Midwives prototype, our results highlight the need for interventions that are guided by research methods that account for complexity.
| S-EPMC6320439 | biostudies-literature
Project description:ObjectiveDecision aids (DAs) are tools to facilitate and standardize shared decision making (SDM). Although most emergency clinicians (ECs) perceive SDM appropriate for emergency care, there is limited uptake of DAs in clinical practice. The objective of this study was to explore barriers and facilitators identified by ECs regarding the implementation of DAs in the emergency department (ED).MethodsWe conducted a qualitative interview study guided by implementation science frameworks. ECs participated in interviews focused on the implementation of DAs for the disposition of patients with low-risk chest pain and unexplained syncope in the ED. Interviews were recorded and transcribed verbatim. We then iteratively developed a codebook with directed qualitative content analysis.ResultsWe approached 25 ECs working in urban New York, of whom 20 agreed to be interviewed (mean age, 41 years; 25% women). The following 6 main barriers were identified: (1) poor DA accessibility, (2) concern for increased medicolegal risk, (3) lack of perceived need for a DA, (4) patient factors including lack of capacity and limited health literacy, (5) skepticism about validity of DAs, and (6) lack of time to use DAs. The 6 main facilitators identified were (1) positive attitudes toward SDM, (2) patient access to follow-up care, (3) potential for improved patient satisfaction, (4) potential for improved risk communication, (5) strategic integration of DAs into the clinical workflow, and (6) institutional support of DAs.ConclusionsECs identified multiple barriers and facilitators to the implementation of DAs into clinical practice. These findings could guide implementation efforts targeting the uptake of DA use in the ED.
| S-EPMC8769071 | biostudies-literature