Dataset Information

Impact of Clinicians' Use of Electronic Knowledge Resources on Clinical and Learning Outcomes: Systematic Review and Meta-Analysis.

ABSTRACT:

Background

Clinicians use electronic knowledge resources, such as Micromedex, UpToDate, and Wikipedia, to deliver evidence-based care and engage in point-of-care learning. Despite this use in clinical practice, their impact on patient care and learning outcomes is incompletely understood. A comprehensive synthesis of available evidence regarding the effectiveness of electronic knowledge resources would guide clinicians, health care system administrators, medical educators, and informaticians in making evidence-based decisions about their purchase, implementation, and use.

Objective

The aim of this review is to quantify the impact of electronic knowledge resources on clinical and learning outcomes.

Methods

We searched MEDLINE, Embase, PsycINFO, and the Cochrane Library for articles published from 1991 to 2017. Two authors independently screened studies for inclusion and extracted outcomes related to knowledge, skills, attitudes, behaviors, patient effects, and cost. We used random-effects meta-analysis to pool standardized mean differences (SMDs) across studies.

Results

Of 10,811 studies screened, we identified 25 eligible studies published between 2003 and 2016. A total of 5 studies were randomized trials, 22 involved physicians in practice or training, and 10 reported potential conflicts of interest. A total of 15 studies compared electronic knowledge resources with no intervention. Of these, 7 reported clinician behaviors, with a pooled SMD of 0.47 (95% CI 0.27 to 0.67; P<.001), and 8 reported objective patient effects with a pooled SMD of 0.19 (95% CI 0.07 to 0.32; P=.003). Heterogeneity was large (I²>50%) across studies. When compared with other resources-7 studies, not amenable to meta-analytic pooling-the use of electronic knowledge resources was associated with increased frequency of answering questions and perceived benefits on patient care, with variable impact on time to find an answer. A total of 2 studies compared different implementations of the same electronic knowledge resource.

Conclusions

Use of electronic knowledge resources is associated with a positive impact on clinician behaviors and patient effects. We found statistically significant associations between the use of electronic knowledge resources and improved clinician behaviors and patient effects. When compared with other resources, the use of electronic knowledge resources was associated with increased success in answering clinical questions, with variable impact on speed. Comparisons of different implementation strategies of the same electronic knowledge resource suggest that there are benefits from allowing clinicians to choose to access the resource, versus automated display of resource information, and from integrating patient-specific information. A total of 4 studies compared different commercial electronic knowledge resources, with variable results. Resource implementation strategies can significantly influence outcomes but few studies have examined such factors.

SUBMITTER: Maggio LA

PROVIDER: S-EPMC6690166 | biostudies-literature | 2019 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Impact of Clinicians' Use of Electronic Knowledge Resources on Clinical and Learning Outcomes: Systematic Review and Meta-Analysis.

Maggio Lauren A LA Aakre Christopher A CA Del Fiol Guilherme G Shellum Jane J Cook David A DA

Journal of medical Internet research 20190725 7

<h4>Background</h4>Clinicians use electronic knowledge resources, such as Micromedex, UpToDate, and Wikipedia, to deliver evidence-based care and engage in point-of-care learning. Despite this use in clinical practice, their impact on patient care and learning outcomes is incompletely understood. A comprehensive synthesis of available evidence regarding the effectiveness of electronic knowledge resources would guide clinicians, health care system administrators, medical educators, and informatic ...[more]

PMID: 31359865

Similar Datasets

Project description:BackgroundA number of publications have demonstrated that deep learning (DL) algorithms matched or outperformed clinicians in image-based cancer diagnostics, but these algorithms are frequently considered as opponents rather than partners. Despite the clinicians-in-the-loop DL approach having great potential, no study has systematically quantified the diagnostic accuracy of clinicians with and without the assistance of DL in image-based cancer identification.ObjectiveWe systematically quantified the diagnostic accuracy of clinicians with and without the assistance of DL in image-based cancer identification.MethodsPubMed, Embase, IEEEXplore, and the Cochrane Library were searched for studies published between January 1, 2012, and December 7, 2021. Any type of study design was permitted that focused on comparing unassisted clinicians and DL-assisted clinicians in cancer identification using medical imaging. Studies using medical waveform-data graphics material and those investigating image segmentation rather than classification were excluded. Studies providing binary diagnostic accuracy data and contingency tables were included for further meta-analysis. Two subgroups were defined and analyzed, including cancer type and imaging modality.ResultsIn total, 9796 studies were identified, of which 48 were deemed eligible for systematic review. Twenty-five of these studies made comparisons between unassisted clinicians and DL-assisted clinicians and provided sufficient data for statistical synthesis. We found a pooled sensitivity of 83% (95% CI 80%-86%) for unassisted clinicians and 88% (95% CI 86%-90%) for DL-assisted clinicians. Pooled specificity was 86% (95% CI 83%-88%) for unassisted clinicians and 88% (95% CI 85%-90%) for DL-assisted clinicians. The pooled sensitivity and specificity values for DL-assisted clinicians were higher than for unassisted clinicians, at ratios of 1.07 (95% CI 1.05-1.09) and 1.03 (95% CI 1.02-1.05), respectively. Similar diagnostic performance by DL-assisted clinicians was also observed across the predefined subgroups.ConclusionsThe diagnostic performance of DL-assisted clinicians appears better than unassisted clinicians in image-based cancer identification. However, caution should be exercised, because the evidence provided in the reviewed studies does not cover all the minutiae involved in real-world clinical practice. Combining qualitative insights from clinical practice with data-science approaches may improve DL-assisted practice, although further research is required.Trial registrationPROSPERO CRD42021281372; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=281372.

Project description:ObjectivesCurrent US medical students have begun to rely on electronic information repositories-such as UpToDate, AccessMedicine, and Wikipedia-for their pre-clerkship medical education. However, it is unclear whether these resources are appropriate for this level of learning due to factors involving information quality, level of evidence, and the requisite knowledgebase. This study evaluated appropriateness of electronic information resources from a novel perspective: amount of mental effort learners invest in interactions with these resources and effects of the experienced mental effort on learning.MethodsEighteen first-year medical students read about three unstudied diseases in the above-mentioned resources (a total of fifty-four observations). Their eye movement characteristics (i.e., fixation duration, fixation count, visit duration, and task-evoked pupillary response) were recorded and used as psychophysiological indicators of the experienced mental effort. Post reading, students' learning was assessed with multiple-choice tests. Eye metrics and test results constituted quantitative data analyzed according to the repeated Latin square design. Students' perceptions of interacting with the information resources were also collected. Participants' feedback during semi-structured interviews constituted qualitative data and was reviewed, transcribed, and open coded for emergent themes.ResultsCompared to AccessMedicine and Wikipedia, UpToDate was associated with significantly higher values of eye metrics, suggesting learners experienced higher mental effort. No statistically significant difference between the amount of mental effort and learning outcomes was found. More so, descriptive statistical analysis of the knowledge test scores suggested similar levels of learning regardless of the information resource used.ConclusionsJudging by the learning outcomes, all three information resources were found appropriate for learning. UpToDate, however, when used alone, may be less appropriate for first-year medical students' learning as it does not fully address their information needs and is more demanding in terms of cognitive resources invested.

Project description:"Cumulative meta-analysis" describes a statistical procedure to calculate, retrospectively, summary estimates from the results of similar trials every time the results of a further trial in the series had become available. In the early 1990 s, comparisons of cumulative meta-analyses of treatments for myocardial infarction with advice promulgated through medical textbooks showed that research had continued long after robust estimates of treatment effects had accumulated, and that medical textbooks had overlooked strong, existing evidence from trials. Cumulative meta-analyses have subsequently been used to assess what could have been known had new studies been informed by systematic reviews of relevant existing evidence and how waste might have been reduced.We used a systematic approach to identify and summarise the findings of cumulative meta-analyses of studies of the effects of clinical interventions, published from 1992 to 2012. Searches were done of PubMed, MEDLINE, EMBASE, the Cochrane Methodology Register and Science Citation Index. A total of 50 eligible reports were identified, including more than 1,500 cumulative meta-analyses. A variety of themes are illustrated with specific examples. The studies showed that initially positive results became null or negative in meta-analyses as more trials were done; that early null or negative results were over-turned; that stable results (beneficial, harmful and neutral) would have been seen had a meta-analysis been done before the new trial; and that additional trials had been much too small to resolve the remaining uncertainties.This large, unique collection of cumulative meta-analyses highlights how a review of the existing evidence might have helped researchers, practitioners, patients and funders make more informed decisions and choices about new trials over decades of research. This would have led to earlier uptake of effective interventions in practice, less exposure of trial participants to less effective treatments, and reduced waste resulting from unjustified research.

Project description:BackgroundMorphine is commonly used in the management of acute cardiogenic pulmonary oedema. The European Society of Cardiology (ESC) and National Institute for Health and Care Excellence (NICE) do not recommend the routine use of opioids in acute heart failure (AHF) due to dose-dependent side effects. However, the effect of morphine remains unclear. Our study aims to investigate the link between morphine use in acute cardiogenic pulmonary oedema and mortality.MethodsPubMed and Embase databases were searched from inception to October 2021. All studies were included (randomized, non-randomized, observational, prospective and retrospective). The references for all the articles were reviewed for potential articles of interest with no language restrictions. Studies looking at in-hospital mortality along with other outcomes were chosen. The Newcastle-Ottawa scale was used to appraise the studies. Heterogeneity was assessed using I2. Meta-analysis was conducted using the Review Manager Software version 5.3 (The Nordic Cochrane Centre, The Cochrane Collaboration, 2014), by computing odds ratios (ORs) for pooled in-hospital mortality and clinical outcomes.ResultsSix observational studies out of the 73 publications identified were eligible for the meta-analysis giving a total sample size of 152,859 (mean age 75, males 48%). Of these, four were retrospective analyses. The use of morphine in acute cardiogenic pulmonary oedema was associated with an increased rate of in-hospital mortality [OR = 2.39, confidence interval (CI) = 1.13 to 5.08, p = 0.02], increased need for invasive ventilation (OR = 6.14, CI = 5.84 to 6.46, p < 0.00001), increased need for non-invasive ventilation (OR = 1.85, CI = 1.45 to 2.36, p < 0.00001) and increased need for vasopressors/inotropes (OR = 2.93, CI = 2.20 to 3.89, p < 0.00001).ConclusionBased on the observational studies, morphine use in acute cardiogenic pulmonary oedema is associated with worse outcomes. Further randomized controlled trials are needed to confirm any causative effect of morphine on mortality rates in acute cardiogenic pulmonary oedema.

Project description:The Coronavirus Disease 2019 (COVID-19) pandemic has caused an unprecedented disruption in medical education and healthcare systems worldwide. The disease can cause life-threatening conditions and it presents challenges for medical education, as instructors must deliver lectures safely, while ensuring the integrity and continuity of the medical education process. It is therefore important to assess the usability of online learning methods, and to determine their feasibility and adequacy for medical students. We aimed to provide an overview of the situation experienced by medical students during the COVID-19 pandemic, and to determine the knowledge, attitudes, and practices of medical students regarding electronic medical education. A cross-sectional survey was conducted with medical students from more than 13 medical schools in Libya. A paper-based and online survey was conducted using email and social media. The survey requested demographic and socioeconomic information, as well as information related to medical online learning and electronic devices; medical education status during the COVID-19 pandemic; mental health assessments; and e-learning knowledge, attitudes, and practices. A total of 3,348 valid questionnaires were retrieved. Most respondents (64.7%) disagreed that e-learning could be implemented easily in Libya. While 54.1% of the respondents agreed that interactive discussion is achievable by means of e-learning. However, only 21.1% agreed that e-learning could be used for clinical aspects, as compared with 54.8% who disagreed with this statement and 24% who were neutral. Only 27.7% of the respondents had participated in online medical educational programs during the COVID-19 pandemic, while 65% reported using the internet for participating in study groups and discussions. There is no vaccine for COVID-19 yet. As such, the pandemic will undeniably continue to disrupt medical education and training. As we face the prospect of a second wave of virus transmission, we must take certain measures and make changes to minimize the effects of the COVID-19 outbreak on medical education and on the progression of training. The time for change is now, and there should be support and enthusiasm for providing valid solutions to reduce this disruption, such as online training and virtual clinical experience. These measures could then be followed by hands-on experience that is provided in a safe environment.

Project description:Background:There is debate in the literature as to whether inclusion of a placebo arm may alter characteristics of antidepressant trials. However, previous research has focused on response rates of various antidepressants on average only, ignoring potential differences among drugs or other aspects of trial findings. Little is known about the impact of a placebo arm on all-cause dropout and dropout due to adverse events. Methods:We carried out a systematic review of published and unpublished double-blind randomized controlled trials (RCTs) for the acute treatment of unipolar major depression (update: January 2016). The probability of being allocated to placebo (?) was the exposure of interest, and we examined its influence on responders (efficacy), all-cause dropouts (acceptability) and dropouts due to adverse events (tolerability), while accounting for differences in drugs, trials and patient characteristics in multivariate random effects meta-regression. Results:We included 421 studies (68 305 participants) comparing 16 antidepressants or placebo; ? ranged from 20% to 50%. Response rate was lower [risk ratio (RR) 0.87; 95% confidence interval (CI) 0.83, 0.92] and all-cause dropout rate higher (RR 1.19; 95% CI 1.08, 1.31) for the same antidepressants in placebo-controlled trials compared with head-to-head trials. The probability of responding decreased by 3% (95% CI 2-5%) for every 10% increase in ?, whereas the risk of all-cause dropout increased by 4% (95% CI 1-7%). Tolerability was unaffected by ?. Response rate was inversely correlated with dropouts due to any cause (correlation coefficient -0.48; 95% CI -0.58, -0.36) and due to adverse events (-0.34; 95% CI -0.44, -0.23). Conclusions:For the same antidepressant, response rate was on average smaller and dropouts higher when placebo was included; however, no association was found with dropouts due to adverse events. Decreased patient expectations, larger dropout rates and use of inappropriate statistical methods to impute missing data may explain this phenomenon. The findings call for caution in the integration of randomized evidence involving placebo arms.

Dataset Information

Impact of Clinicians' Use of Electronic Knowledge Resources on Clinical and Learning Outcomes: Systematic Review and Meta-Analysis.

Background

Objective

Methods

Results

Conclusions

Publications

Impact of Clinicians' Use of Electronic Knowledge Resources on Clinical and Learning Outcomes: Systematic Review and Meta-Analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets