Dataset Information

Impact of a Workflow-Integrated Web Tool on Resource Utilization and Information-Seeking Behavior in an Academic Anesthesiology Department: Longitudinal Cohort Survey Study.

ABSTRACT:

Background

Medical resident reading and information-seeking behavior is limited by time constraints as well as comfort in accessing and assessing evidence-based resources. Educational technology interventions, as the preferred method for millennial leaners, can reduce these barriers. We implemented an educational web tool, consisting of peer-reviewed articles as well as local and national protocols and policies, built into the daily workflow of a university-based anesthesiology department. We hypothesized that this web tool would increase resource utilization and overall perceptions of the educational environment.

Objective

The goal of this study was to demonstrate that an educational web tool designed and built into the daily workflow of an academic anesthesia department for trainees could significantly decrease barriers to resource utilization, improve faculty-trainee teaching interactions, and improve the perceptions of the educational environment.

Methods

Following Institutional Review Board approval, a longitudinal cohort survey study was conducted to assess trainee resource utilization, faculty evaluation of trainees' resource utilization, and trainee and faculty perceptions about the educational environment. The survey study was conducted in a pre-post fashion 3 months prior to web tool implementation and 3 months following implementation. Data were deidentified and analyzed unpaired using Student t tests for continuous data and chi-square tests for ordinal data.

Results

Survey response rates were greater than 50% in all groups: of the 43 trainees, we obtained 27 (63%) preimplementation surveys and 22 (51%) postimplementation surveys; of the 46 faculty members, we obtained 25 (54%) preimplementation surveys and 23 (50%) postimplementation surveys. Trainees showed a significant improvement in utilization of peer-reviewed articles (preimplementation mean 8.67, SD 6.45; postimplementation mean 18.27, SD 12.23; P=.02), national guidelines (preimplementation mean 2.3, SD 2.40; postimplementation mean 6.14, SD 5.01; P<.001), and local policies and protocols (preimplementation mean 2.23, SD 2.72; postimplementation mean 6.95, SD 6.09; P=.02). There was significant improvement in faculty-trainee educational interactions (preimplementation mean 1.67, SD 1.33; postimplementation mean 6.05, SD 8.74; P=.01). Faculty assessment of trainee resource utilization also demonstrated statistically significant improvements across all resource categories. Subgroups among trainees and faculty showed similar trends toward improvement.

Conclusions

Learning technology interventions significantly decrease the barriers to resource utilization, particularly among millennial learners. Further investigation has been undertaken to assess how this may impact learning, knowledge retention, and patient outcomes.

SUBMITTER: Gopwani SR

PROVIDER: S-EPMC8367122 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe last formal review of academic anesthesiology department Web sites (ADWs) for content was conducted in 2009. ADWs have been rated as very important by medical students in researching residency training programs; however, the rapid evolution of sites require that descriptive statistics must be more current to be considered reliable. We set out to provide an updated overview of ADW content and to better understand residency program directors' (PD) role and comfort with ADWs.MethodsTwo independent reviewers (ND and HL) analyzed all 131 Accreditation Council for Graduate Medical Education (ACGME) accredited ADWs. A binary system (Yes/No) was used to determine which features were present. Reviewer reliability was confirmed with inter-rater reliability and percentage agreement calculation. Additionally, a blinded electronic survey (Survey Monkey, Portland, OR) was sent to anesthesiology residency PDs via electronic mail investigating the audiences for ADWs, the frequency of updates and the degree of PD involvement.Results13% of anesthesiology departments still lack a Web site with a homepage with links to the residency program and educational offerings (18% in 2009). Only half (55%) of Web sites contain information for medical students, including clerkship information. Furthermore, programs rarely contain up-to-date calendars (13%), accreditation cycle lengths (11%), accreditation dates (7%) or board pass rates (6%). The PD survey, completed by 42 of 131 PDs, noted a correlation (r = 0.36) between the number of years as PD and the frequency of Web site updates - less experienced PDs appear to update their sites more frequently (p = 0.03). Although 86% of PDs regarded a Web site as "very" important in recruitment, only 9% felt "very" comfortable with the skills required to advertise and market a Web site.ConclusionsDespite the overall increase in ADW content since 2009, privacy concerns, limited resources and time constraints may prevent PDs from providing the most up-to-date Web sites for applicants and other interested audiences. PDs are aware of value of Web sites for recruitment, are typically involved in determining ADW content, but few feel very comfortable marketing a training program on the Web.

Project description:IntroductionAdvanced practice providers (APP), including physicians' assistants and nurse practitioners, have been increasingly incorporated into emergency department (ED) staffing over the past decade. There is scant literature examining resource utilization and the cost benefit of having APPs in the ED. The objectives of this study were to compare resource utilization in EDs that use APPs in their staffing model with those that do not and to estimate costs associated with the utilized resources.MethodsIn this five-year retrospective secondary data analysis of the Emergency Department Benchmarking Alliance (EDBA), we compared resource utilization rates in EDs with and without APPs in non-academic EDs. Primary outcomes were hospital admission and use of computed tomography (CT), radiography, ultrasound, and magnetic resonance imaging (MRI). Costs were estimated using the 2014 physician fee schedule and inpatient payments from the Centers for Medicare and Medicaid Services. We measured outcomes as rates per 100 visits. Data were analyzed using a mixed linear model with repeated measures, adjusted for annual volume, patient acuity, and attending hours. We used the adjusted net difference to project utilization costs between the two groups per 1000 visits.ResultsOf the 1054 EDs included in this study, 79% employed APPs. Relative to EDs without APPs, EDs staffing APPs had higher resource utilization rates (use per 100 visits): 3.0 more admissions (95% confidence interval [CI], 2.0-4.1), 1.7 more CTs (95% CI, 0.2-3.1), 4.5 more radiographs (95% CI, 2.2-6.9), and 1.0 more ultrasound (95% CI, 0.3-1.7) but comparable MRI use 0.1 (95% CI, -0.2-0.3). Projected costs of these differences varied among the resource utilized. Compared to EDs without APPs, EDs with APPs were estimated to have 30.4 more admissions per 1000 visits, which could accrue $414,717 in utilization costs.ConclusionEDs staffing APPs were associated with modest increases in resource utilization as measured by admissions and imaging studies.

Project description:BACKGROUND:The right dataset is essential to obtain the right insights in data science; therefore, it is important for data scientists to have a good understanding of the availability of relevant datasets as well as the content, structure, and existing analyses of these datasets. While a number of efforts are underway to integrate the large amount and variety of datasets, the lack of an information resource that focuses on specific needs of target users of datasets has existed as a problem for years. To address this gap, we have developed a Dataset Information Resource (DIR), using a user-oriented approach, which gathers relevant dataset knowledge for specific user types. In the present version, we specifically address the challenges of entry-level data scientists in learning to identify, understand, and analyze major datasets in healthcare. We emphasize that the DIR does not contain actual data from the datasets but aims to provide comprehensive knowledge about the datasets and their analyses. METHODS:The DIR leverages Semantic Web technologies and the W3C Dataset Description Profile as the standard for knowledge integration and representation. To extract tailored knowledge for target users, we have developed methods for manual extractions from dataset documentations as well as semi-automatic extractions from related publications, using natural language processing (NLP)-based approaches. A semantic query component is available for knowledge retrieval, and a parameterized question-answering functionality is provided to facilitate the ease of search. RESULTS:The DIR prototype is composed of four major components-dataset metadata and related knowledge, search modules, question answering for frequently-asked questions, and blogs. The current implementation includes information on 12 commonly used large and complex healthcare datasets. The initial usage evaluation based on health informatics novices indicates that the DIR is helpful and beginner-friendly. CONCLUSIONS:We have developed a novel user-oriented DIR that provides dataset knowledge specialized for target user groups. Knowledge about datasets is effectively represented in the Semantic Web. At this initial stage, the DIR has already been able to provide sophisticated and relevant knowledge of 12 datasets to help entry health informacians learn healthcare data analysis using suitable datasets. Further development of both content and function levels is underway.