Dataset Information

Decision aids linked to evidence summaries and clinical practice guidelines: results from user-testing in clinical encounters.

ABSTRACT:

Background

Tools for shared decision-making (e.g. decision aids) are intended to support health care professionals and patients engaged in clinical encounters involving shared decision-making. However, decision aids are hard to produce, and onerous to update. Consequently, they often do not reflect best current evidence, and show limited uptake in practice. In response, we initiated the Sharing Evidence to Inform Treatment decisions (SHARE-IT) project. Our goal was to develop and refine a new generation of decision aids that are generically produced along digitally structured guidelines and evidence summaries.

Methods

Applying principles of human-centred design and following the International Patient Decision Aid Standards (IPDAS) and GRADE methods for trustworthy evidence summaries we developed a decision aid prototype in collaboration with the Developing and Evaluating Communication strategies to support Informed Decisions and practice based on Evidence project (DECIDE). We iteratively user-tested the prototype in clinical consultations between clinicians and patients. Semi-structured interviews of participating clinicians and patients were conducted. Qualitative content analysis of both user-testing sessions and interviews was performed and results categorized according to a revised Morville's framework of user-experience. We made it possible to produce, publish and use these decision aids in an electronic guideline authoring and publication platform (MAGICapp).

Results

Direct observations and analysis of user-testing of 28 clinical consultations between physicians and patients informed four major iterations that addressed readability, understandability, usability and ways to cope with information overload. Participants reported that the tool supported natural flow of the conversation and induced a positive shift in consultation habits towards shared decision-making. We integrated the functionality of SHARE-IT decision aids in MAGICapp, which has since generated numerous decision aids.

Conclusion

Our study provides a proof of concept that encounter decision aids can be generically produced from GRADE evidence summaries and clinical guidelines. Online authoring and publication platforms can help scale up production including continuous updating of electronic encounter decision aids, fully integrated with evidence summaries and clinical practice guidelines.

SUBMITTER: Heen AF

PROVIDER: S-EPMC8240084 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectivesInfographics have the potential to enhance knowledge translation and implementation of clinical practice guidelines at the point of care. They can provide a synoptic view of recommendations, their rationale and supporting evidence. They should be understandable and easy to use. Little evaluation of these infographics regarding user experience has taken place. We explored general practitioners' experiences with five selected BMJ Rapid Recommendation infographics suited for primary care.MethodsAn iterative, qualitative user testing design was applied on two consecutive groups of 10 general practitioners for five selected infographics. The physicians used the infographics before clinical encounters and we performed hybrid think-aloud interviews afterwards. 20 interviews were analysed using the Qualitative Analysis Guide of Leuven.ResultsMany clinicians reported that the infographics were simple and rewarding to use, time-efficient and easy to understand. They were perceived as innovative and their knowledge basis as trustworthy and supportive for decision-making. The interactive, expandable format was preferred over a static version as general practitioners focused mainly on the core message. Rapid access through the electronic health record was highly desirable. The main issues were about the use of complex scales and terminology. Understanding terminology related to evidence appraisal as well as the interpretation of statistics and unfamiliar scales remained difficult, despite the infographics.ConclusionsGeneral practitioners perceive infographics as useful tools for guideline translation and implementation in primary care. They offer information in an enjoyable and user friendly format and are used mainly for rapid, tailored and just in time information retrieval. We recommend future infographic producers to provide information as concise as possible, carefully define the core message and explore ways to enhance the understandability of statistics and difficult concepts related to evidence appraisal.Trial registration numberMP011977.

Project description:BackgroundClinicians' satisfaction with encounter decision aids is an important component in facilitating implementation of these tools. We aimed to determine the impact of decision aids supporting shared decision making (SDM) during the clinical encounter on clinician outcomes.MethodsWe searched nine databases from inception to June 2017. Randomised clinical trials (RCTs) of decision aids used during clinical encounters with an unaided control group were eligible for inclusion. Due to heterogeneity among included studies, we used a narrative evidence synthesis approach.ResultsTwenty-five papers met inclusion criteria including 22 RCTs and 3 qualitative or mixed-methods studies nested in an RCT, together representing 23 unique trials. These trials evaluated healthcare decisions for cardiovascular prevention and treatment (n=8), treatment of diabetes mellitus (n=3), treatment of osteoporosis (n=2), treatment of depression (n=2), antibiotics to treat acute respiratory infections (n=3), cancer prevention and treatment (n=4) and prenatal diagnosis (n=1). Clinician outcomes were measured in only a minority of studies. Clinicians' satisfaction with decision making was assessed in only 8 (and only 2 of them showed statistically significantly greater satisfaction with the decision aid); only three trials asked if clinicians would recommend the decision aid to colleagues and only five asked if clinicians would use decision aids in the future. Outpatient consultations were not prolonged when a decision aid was used in 9 out of 13 trials. The overall strength of the evidence was low, with the major risk of bias related to lack of blinding of participants and/or outcome assessors.ConclusionDecision aids can improve clinicians' satisfaction with medical decision making and provide helpful information without affecting length of consultation time. Most SDM trials, however, omit outcomes related to clinicians' perspective on the decision making process or the likelihood of using a decision aid in the future.

Project description:BackgroundWhile shared decision making (SDM) and adherence to clinical practice guidelines (CPGs) are important, some believe they are incompatible. This study explored the mutual influence between physicians' intention to engage in SDM and their intention to follow CPGs.MethodsEmbedded within a clustered randomized trial to assess the impact of training physicians in SDM about using antibiotics to treat acute respiratory tract infections, this study evaluated physicians' intentions to both engage in SDM and follow CPGs. A self-administered questionnaire based on the theory of planned behavior evaluated both behavioral intentions and their respective determinants (attitude, subjective norm and perceived behavioral control) at study entry and exit. We used path analysis to explore the relationships between the intentions. We conducted statistical analyses using the maximum likelihood method and the variance-covariance matrix. Goodness of fit indices encompassed the chi-square statistic, the comparative fit index and the root mean square error of approximation.ResultsWe analyzed 244 responses at entry and 236 at exit. In the control group, at entry we observed that physicians' intention to engage in SDM (r?=?0, t?=?0.03) did not affect their intention to follow CPGs; however, their intention to follow CPGs (r?=?-0.31 t?=?-2.82) did negatively influence their intention to engage in SDM. At exit, neither behavioral intention influenced the other. In the experimental group, at entry neither behavioral intention influenced the other; at exit, the intention to engage in SDM still did not influence the intention to use CPGs, although the intention to follow CPGs (r?=?-0.15 t?=?-2.02) slightly negatively influenced the intention to engage in SDM, but this was not clinically significant.ConclusionPhysicians' intention to engage in SDM does not affect their intention to adopt CPGs even after SDM training. Physicians' intention to adopt CPGs had no clinically significant influence on intention to engage in SDM.Trial registrationClinicalTrials.gov NCT01116076.

Project description:Importance: Early mobilization, out-of-bed activity, is a component of acute stroke unit care; however, stroke patient heterogeneity requires complex decision-making. Clinically credible and applicable CPGs are needed to support and optimize the delivery of care. In this study, we are specifically exploring the role of clinical practice guidelines to support individual patient-level decision-making by stroke clinicians about early mobilization post-stroke. Methods: Our study uses a novel, two-pronged approach. (1) A review of CPGs containing recommendations for early mobilization practices published after 2015 was appraised using purposely selected items from the Appraisal of Guidelines Research and Evaluation-Recommendations Excellence (AGREE-REX) tool relevant to decision-making for clinicians. (2) A cross-sectional study involving semi-structured interviews with Australian expert stroke clinicians representing content experts and CPG target users. Every CPG was independently assessed against the AGREE-REX standard by two reviewers. Expert stroke clinicians, invited via email, were recruited between June 2019 to March 2020.The main outcomes from the review was the proportion of criteria addressed for each AGREE-REX item by individual and all CPG(s). The main cross-sectional outcomes were the distributions of stroke clinicians' responses about the utility of CPGs, specific areas of uncertainty in early mobilization decision-making, and suggested parameters for inclusion in future early mobilization CPGs. Results: In 18 identified CPGs, many did not adequately address the "Evidence" and "Applicability to Patients" AGREE-REX items. Out of 30 expert stroke clinicians (11 physicians [37%], 11 physiotherapists [37%], 8 nurses [26%]; median [IQR] years of experience, 14 [10-25]), 47% found current CPGs "too broad or vague," while 40% rely on individual clinical judgement and interpretation of the evidence to select an evidence-based choice of action. The areas of uncertainty in decision-making revealed four key suggestions: (1) more granular descriptions of patient and stroke characteristics for appropriate tailoring of decisions, (2) clear statements about when clinical flexibility is appropriate, (3) detailed description of the intervention dose, and (4) physical assessment criteria including safety parameters. Conclusions: The lack of specificity, clinical applicability, and adaptability of current CPGs to effectively respond to the heterogeneous clinical stroke context has provided a clear direction for improvement.