Dataset Information

Comparative impact of guidelines, clinical data, and decision support on prescribing decisions: an interactive web experiment with simulated cases.

ABSTRACT: OBJECTIVE: The aim of this study was to compare the clinical impact of computerized decision support with and without electronic access to clinical guidelines and laboratory data on antibiotic prescribing decisions. DESIGN: A crossover trial was conducted of four levels of computerized decision support-no support, antibiotic guidelines, laboratory reports, and laboratory reports plus a decision support system (DSS), randomly allocated to eight simulated clinical cases accessed by the Web. MEASUREMENTS: Rate of intervention adoption was measured by frequency of accessing information support, cost of use was measured by time taken to complete each case, and effectiveness of decision was measured by correctness of and self-reported confidence in individual prescribing decisions. Clinical impact score was measured by adoption rate and decision effectiveness. RESULTS: Thirty-one intensive care and infectious disease specialist physicians (ICPs and IDPs) participated in the study. Ventilator-associated pneumonia treatment guidelines were used in 24 (39%) of the 62 case scenarios for which they were available, microbiology reports in 36 (58%), and the DSS in 37 (60%). The use of all forms of information support did not affect clinicians' confidence in their decisions. Their use of the DSS plus microbiology report improved the agreement of decisions with those of an expert panel from 65% to 97% (p=0.0002), or to 67% (p=0.002) when antibiotic guidelines only were accessed. Significantly fewer IDPs than ICPs accessed information support in making treatment decisions. On average, it took 245 seconds to make a decision using the DSS compared with 113 seconds for unaided prescribing (p<0.001). The DSS plus microbiology reports had the highest clinical impact score (0.58), greater than that of electronic guidelines (0.26) and electronic laboratory reports (0.45). CONCLUSION: When used, computer-based decision support significantly improved decision quality. In measuring the impact of decision support systems, both their effectiveness in improving decisions and their likely rate of adoption in the clinical environment need to be considered. Clinicians chose to use antibiotic guidelines for one third and microbiology reports or the DSS for about two thirds of cases when they were available to assist their prescribing decisions.

SUBMITTER: Sintchenko V

PROVIDER: S-EPMC305460 | biostudies-literature | 2004 Jan-Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Comparative impact of guidelines, clinical data, and decision support on prescribing decisions: an interactive web experiment with simulated cases.

Sintchenko Vitali V Coiera Enrico E Iredell Jonathan R JR Gilbert Gwendolyn L GL

Journal of the American Medical Informatics Association : JAMIA 20031005 1

<h4>Objective</h4>The aim of this study was to compare the clinical impact of computerized decision support with and without electronic access to clinical guidelines and laboratory data on antibiotic prescribing decisions.<h4>Design</h4>A crossover trial was conducted of four levels of computerized decision support-no support, antibiotic guidelines, laboratory reports, and laboratory reports plus a decision support system (DSS), randomly allocated to eight simulated clinical cases accessed by th ...[more]

PMID: 14527970

Similar Datasets

Project description:BackgroundA key barrier to controlling esophageal adenocarcinoma (EAC) is identifying those most likely to benefit from screening and surveillance. We aimed to develop an online educational tool, termed IC-RISC™, for providers and patients to estimate more precisely their absolute risk of developing EAC, interpret this estimate in the context of risk of dying from other causes, and aid in decision-making.ResultsU.S. incidence and mortality data and published relative risk estimates from observational studies and clinical trials were used to calculate absolute risk of EAC over 10 years adjusting for competing risks. These input parameters varied depending on presence of the key precursor, Barrett's esophagus. The open source application works across common devices to gather risk factor data and graphically illustrate estimated risk on a single page. Changes to input data are immediately reflected in the colored graphs. We used the calculator to compare the risk distribution between EAC cases and controls from six population-based studies to gain insight into the discrimination metrics of current practice guidelines for screening, observing that current guidelines sacrifice a significant amount of specificity to identify 78-86% of eventual cases in the US population.ConclusionsThis educational tool provides a simple and rapid means to graphically communicate risk of EAC in the context of other health risks, facilitates "what-if" scenarios regarding potential preventative actions, and can inform discussions regarding screening, surveillance and treatment options. Its generic architecture lends itself to being easily extended to other cancers with distinct pathways and/or intermediate stages, such as hepatocellular cancer. IC-RISC™ extends current qualitative clinical practice guidelines into a quantitative assessment, which brings the possibility of preventative actions being offered to persons not currently targeted for screening and, conversely, reducing unnecessary procedures in those at low risk. Prospective validation and application to existing well-characterized cohort studies are needed.

Project description:Rationale: Breakdowns in clinician-family communication in intensive care units (ICUs) are common, yet there are no easily scaled interventions to prevent this problem.Objectives: To assess the feasibility, usability, acceptability, and perceived effectiveness of a communication intervention that pairs proactive family meetings with an interactive, web-based tool to help surrogates prepare for clinician-family meetings.Methods: We conducted a two-arm, single-blind, patient-level randomized trial comparing the Family Support Tool with enhanced usual care in two ICUs in a tertiary-care hospital. Eligible participants included surrogates of incapacitated patients judged by their physicians to have ≥40% risk of death or severe long-term functional impairment. The intervention group received unlimited tool access, with prompts to complete specific content upon enrollment and before two scheduled family meetings. Before family meetings, research staff shared with clinicians a one-page summary of surrogates' main questions, prognostic expectations, beliefs about the patient's values, and attitudes about goals of care. The comparator group received usual care enhanced with scheduled family meetings. Feasibility outcomes included the proportion of participants who accessed the tool before the first family meeting, mean number of logins, and average tool engagement time. We assessed tool usability with the System Usability Scale, assessed tool acceptability and perceived effectiveness with internally developed questionnaires, and assessed quality of communication and shared decision-making using the Quality of Communication questionnaire.Results: Of 182 screened patients, 77 were eligible. We enrolled 52 (67.5%) patients and their primary surrogate. Ninety-six percent of intervention surrogates (24/25) accessed the tool before the first family meeting (mean engagement time, 62 min ± 27.7) and logged in 4.2 times (±2.1) on average throughout the hospitalization. Surrogates reported that the tool was highly usable (mean, 82.4/100), acceptable (mean, 4.5/5 ± 0.9), and effective (mean, 4.4/5 ± 0.2). Compared with the control group, surrogates who used the tool reported higher overall quality of communication (mean, 8.9/10 ± 1.6 vs. 8.0/10 ± 2.4) and higher quality in shared decision-making (mean, 8.7/10 ± 1.5 vs. 8.0/10 ± 2.4), but the difference did not reach statistical significance.Conclusions: It is feasible to deploy an interactive web-based tool to support communication and shared decision-making for surrogates in ICUs. Surrogates and clinicians rated the tool as highly usable, acceptable, and effective.

Project description:ObjectivesPhysicians adopt evidence-based guidelines with variable consistency. Narratives, or stories, offer a novel dissemination strategy for clinical recommendations. The study objective was to compare whether evidence-based narrative versus traditional summary improved recall of opioid prescribing guidelines from the American College of Emergency Physicians (ACEP).MethodsThis was a prospective, randomized controlled experiment to compare whether narrative versus summary promoted short-term recall of six themes contained in the ACEP opioid guideline. The experiment was modeled after the free-recall test, an established technique in studies of memory. At a regional conference, emergency physicians (EPs) were randomized to read either a summary of the guideline (control) or a narrative (intervention). The fictional narrative was constructed to match the summary in content and length. One hour after reading the text, participants listed all content that they could recall. Two reviewers independently scored the responses to assess recall of the six themes. The primary outcome was the total number of themes recalled per participant. Secondary outcomes included the proportion of responses in each study arm that recalled individual themes and the proportion of responses in each arm that contained falsely recalled or extraneous information.ResultsNinety-five physicians were randomized. Eighty-two physicians completed the experiment, for a response rate of 86%. The mean of the total number of themes recalled per participant was 3.1 in the narrative arm versus 2.0 in the summary arm (difference = 1.1, 95% confidence interval [CI] = 0.6 to 1.7). For three themes, the proportion of responses that recalled the theme was significantly greater in the narrative arm compared to the summary arm, with the differences ranging from 20% to 51%. For one theme, recall was significantly greater in the summary arm. For two themes, there was no statistically significant difference in recall between the arms. In the summary arm, 54% of responses were found to contain falsely recalled or extraneous information versus 21% of responses in the narrative arm (difference = 33%, 95% CI = 14% to 53%).ConclusionsPhysicians exposed to a narrative about opioid guidelines were more likely to recall guideline content at 1 hour than those exposed to a summary of the guidelines. Future studies should examine whether the incorporation of narratives in dissemination campaigns improves guideline adoption and changes clinical practice

Project description:BackgroundProstate cancer is a leading cause of cancer among men. Because screening for prostate cancer is a controversial issue, many experts in the field have defended the use of shared decision making using validated decision aids, which can be presented in different formats (eg, written, multimedia, Web). Recent studies have concluded that decision aids improve knowledge and reduce decisional conflict.ObjectiveThis meta-analysis aimed to investigate the impact of using Web-based decision aids to support men's prostate cancer screening decisions in comparison with usual care and other formats of decision aids.MethodsWe searched PubMed, CINAHL, PsycINFO, and Cochrane CENTRAL databases up to November 2016. This search identified randomized controlled trials, which assessed Web-based decision aids for men making a prostate cancer screening decision and reported quality of decision-making outcomes. Two reviewers independently screened citations for inclusion criteria, extracted data, and assessed risk of bias. Using a random-effects model, meta-analyses were conducted pooling results using mean differences (MD), standardized mean differences (SMD), and relative risks (RR).ResultsOf 2406 unique citations, 7 randomized controlled trials met the inclusion criteria. For risk of bias, selective outcome reporting and participant/personnel blinding were mostly rated as unclear due to inadequate reporting. Based on seven items, two studies had high risk of bias for one item. Compared to usual care, Web-based decision aids increased knowledge (SMD 0.46; 95% CI 0.18-0.75), reduced decisional conflict (MD -7.07%; 95% CI -9.44 to -4.71), and reduced the practitioner control role in the decision-making process (RR 0.50; 95% CI 0.31-0.81). Web-based decision aids compared to printed decision aids yielded no differences in knowledge, decisional conflict, and participation in decision or screening behaviors. Compared to video decision aids, Web-based decision aids showed lower average knowledge scores (SMD -0.50; 95% CI -0.88 to -0.12) and a slight decrease in prostate-specific antigen screening (RR 1.12; 95% CI 1.01-1.25).ConclusionsAccording to this analysis, Web-based decision aids performed similarly to alternative formats (ie, printed, video) for the assessed decision-quality outcomes. The low cost, readiness, availability, and anonymity of the Web can be an advantage for increasing access to decision aids that support prostate cancer screening decisions among men.

Project description:BackgroundGeneral practitioners (GPs) make numerous care decisions throughout their workdays. Extended periods of decision making can result in decision fatigue, a gradual shift toward decisions that are less cognitively effortful. This study examines whether observed patterns in GPs' prescribing decisions are consistent with the decision fatigue phenomenon. We hypothesized that the likelihood of prescribing frequently overprescribed medications (antibiotics, benzodiazepines, opioids; less effortful to prescribe) will increase and the likelihood of prescribing frequently underprescribed medications (statins, osteoporosis medications; more effortful to prescribe) will decrease over the workday.MethodsThis study used nationally representative primary care data on GP-patient encounters from the Bettering the Evaluation and Care of Health program from Australia. The association between prescribing decisions and order of patient encounters over a GP's workday was assessed with generalized linear mixed models accounting for clustering and adjusting for patient, provider, and encounter characteristics.ResultsAmong 262,456 encounters recorded by 2,909 GPs, the odds of prescribing antibiotics significantly increased by 8.7% with 15 additional patient encounters (odds ratio [OR] = 1.087; confidence interval [CI] = 1.059-1.116). The odds of prescribing decreased significantly with 15 additional patient encounters by 6.3% for benzodiazepines (OR = 0.937; CI = 0.893-0.983), 21.9% for statins (OR = 0.791; CI = 0.753-0.831), and 25.0% for osteoporosis medications (OR = 0.750; CI = 0.690-0.814). No significant effects were observed for opioids. All findings were replicated in confirmatory analyses except the effect of benzodiazepines.ConclusionsGPs were increasingly likely to prescribe antibiotics and were less likely to prescribe statins and osteoporosis medications as the workday wore on, which was consistent with decision fatigue. There was no convincing evidence of decision fatigue effects in the prescribing of opioids or benzodiazepines. These findings establish decision fatigue as a promising target for optimizing prescribing behavior.HighlightsWe found that as general practitioners progress through their workday, they become more likely to prescribe antibiotics that are reportedly overprescribed and less likely to prescribe statins and osteoporosis medications that are reportedly underprescribed.This change in decision making over time is consistent with the decision fatigue phenomenon. Decision fatigue occurs when we make many decisions without taking a rest break. As we make those decisions, we become gradually more likely to make decisions that are less difficult.The findings of this study show that decision fatigue is a possible target for improving guideline-compliant prescribing of pharmacologic medications.

Dataset Information

Comparative impact of guidelines, clinical data, and decision support on prescribing decisions: an interactive web experiment with simulated cases.

Publications

Comparative impact of guidelines, clinical data, and decision support on prescribing decisions: an interactive web experiment with simulated cases.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets