Dataset Information

Ultrafest: a novel approach to ultrasound in medical education leads to improvement in written and clinical examinations.

ABSTRACT:

Introduction

Our objective was to evaluate the effectiveness of hands-on training at a bedside ultrasound (US) symposium ("Ultrafest") to improve both clinical knowledge and image acquisition skills of medical students. Primary outcome measure was improvement in multiple choice questions on pulmonary or Focused Assessment with Sonography in Trauma (FAST) US knowledge. Secondary outcome was improvement in image acquisition for either pulmonary or FAST.

Methods

Prospective cohort study of 48 volunteers at "Ultrafest," a free symposium where students received five contact training hours. Students were evaluated before and after training for proficiency in either pulmonary US or FAST. Proficiency was assessed by clinical knowledge through written multiple-choice exam, and clinical skills through accuracy of image acquisition. We used paired sample t-tests with students as their own controls.

Results

Pulmonary knowledge scores increased by a mean of 10.1 points (95% CI [8.9-11.3], p<0.00005), from 8.4 to a posttest average of 18.5/21 possible points. The FAST knowledge scores increased by a mean of 7.5 points (95% CI [6.3-8.7] p<0.00005), from 8.1 to a posttest average of 15.6/21. We analyzed clinical skills data on 32 students. The mean score was 1.7 pretest and 4.7 posttest of 12 possible points. Mean improvement was 3.0 points (p<0.00005) overall, 3.3 (p=0.0001) for FAST, and 2.6 (p=0.003) for the pulmonary US exam.

Conclusion

This study suggests that a symposium on US can improve clinical knowledge, but is limited in achieving image acquisition for pulmonary and FAST US assessments. US training external to official medical school curriculum may augment students' education.

SUBMITTER: Connolly K

PROVIDER: S-EPMC4307699 | biostudies-literature | 2015 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Ultrafest: a novel approach to ultrasound in medical education leads to improvement in written and clinical examinations.

Connolly Kiah K Beier Lancelot L Langdorf Mark I MI Anderson Craig L CL Fox John C JC

The western journal of emergency medicine 20141215 1

<h4>Introduction</h4>Our objective was to evaluate the effectiveness of hands-on training at a bedside ultrasound (US) symposium ("Ultrafest") to improve both clinical knowledge and image acquisition skills of medical students. Primary outcome measure was improvement in multiple choice questions on pulmonary or Focused Assessment with Sonography in Trauma (FAST) US knowledge. Secondary outcome was improvement in image acquisition for either pulmonary or FAST.<h4>Methods</h4>Prospective cohort st ...[more]

PMID: 25671024

Similar Datasets

Project description:Background/Objectives: To evaluate the quality of an ultrasound practice, both large-scale and focused audits are recommended by professional organizations, but such audits can be time-consuming, inefficient, and expensive. Our objective was to develop a time-efficient, quantitative, objective, large-scale method to evaluate fetal biometry measurements for an entire practice, combined with a process for focused image review for personnel whose measurements are outliers. Methods: Ultrasound exam data for a full year are exported from commercial ultrasound reporting software to a statistical package. Fetal biometry measurements are converted to z-scores to standardize across gestational ages. For a large-scale audit, sonographer mean z-scores are compared using analysis of variance (ANOVA) with Scheffe multiple comparisons test. A focused image review is performed on a random sample of exams for sonographers whose mean z-scores differ significantly from the practice mean. A similar large-scale audit is performed, comparing physician mean z-scores. Results: Using fetal abdominal circumference measurements as an example, significant differences between sonographer mean z-scores are readily identified by the ANOVA and Scheffe test. A method is described for the blinded image audit of sonographers with outlier mean z-scores. Examples are also given for the identification and interpretation of several types of systematic errors that are unlikely to be detectable by image review, including z-scores with large or small standard deviations and physicians with outlier mean z-scores. Conclusions: The large-scale quantitative analysis provides an overview of the biometry measurements of all the sonographers and physicians in a practice, so that image audits can be focused on those whose measurements are outliers. The analysis takes little time to perform after initial development and avoids the time, complexity, and expense of auditing providers whose measurements fall within the expected range. We encourage commercial software developers to include tools in their ultrasound reporting software to facilitate such quantitative reviews.

Project description:PurposeDeveloping medical students' clinical reasoning requires a structured longitudinal curriculum with frequent targeted assessment and feedback. Performance-based assessments, which have the strongest validity evidence, are currently not feasible for this purpose because they are time-intensive to score. This study explored the potential of using machine learning technologies to score one such assessment-the diagnostic justification essay.MethodFrom May to September 2018, machine scoring algorithms were trained to score a sample of 700 diagnostic justification essays written by 414 third-year medical students from the Southern Illinois University School of Medicine classes of 2012-2017. The algorithms applied semantically based natural language processing metrics (e.g., coherence, readability) to assess essay quality on 4 criteria (differential diagnosis, recognition and use of findings, workup, and thought process); the scores for these criteria were summed to create overall scores. Three sources of validity evidence (response process, internal structure, and association with other variables) were examined.ResultsMachine scores correlated more strongly with faculty ratings than faculty ratings did with each other (machine: .28-.53, faculty: .13-.33) and were less case-specific. Machine scores and faculty ratings were similarly correlated with medical knowledge, clinical cognition, and prior diagnostic justification. Machine scores were more strongly associated with clinical communication than were faculty ratings (.43 vs .31).ConclusionsMachine learning technologies may be useful for assessing medical students' long-form written clinical reasoning. Semantically based machine scoring may capture the communicative aspects of clinical reasoning better than faculty ratings, offering the potential for automated assessment that generalizes to the workplace. These results underscore the potential of machine scoring to capture an aspect of clinical reasoning performance that is difficult to assess with traditional analytic scoring methods. Additional research should investigate machine scoring generalizability and examine its acceptability to trainees and educators.

Project description:Background: The purpose of this study was twofold: to assess the status of undergraduate medical ultrasound (US) education in the German-speaking area and to suggest a possible framework for a longitudinal undergraduate medical US curriculum based on the study results and a literature review. Methods: The survey included 44 medical faculties in the German-speaking area: 37 in Germany, four in Austria and three in German-speaking Switzerland. A standardized questionnaire focused on the following aspects of undergraduate medical US education: general information, organization, resources, assessment methods and evaluation. Results: Data from 28 medical faculties were analysed. 26 out of 28 medical faculties offered US courses, 21 offered compulsory as well as elective courses, four offered compulsory and one elective courses only. 27 medical faculties supported US skills implementation. Abdominal US (n=25) was most common in teaching basic US skills. A learning objective catalogue was provided at 15 medical faculties. At 22 medical faculties, medical specialists were involved in undergraduate medical US education. 24 out of 26 medical faculties thought that peer-teaching is important to convey US skills. Medical faculties used the following methods to assess US skills: objective structured clinical examination (OSCE, n=7), non-standardized practical exams (n=4), non-standardized combined oral-practical exams (n=2) or direct observation of procedural skills (DOPS, n=1). 25 out of 26 medical faculties evaluated their US courses and 19 made suggestions for improvements in undergraduate medical US education. Conclusion: Medical faculty members in the German-speaking area have recognized the relevance of undergraduate medical US education. So far, courses are offered heterogeneously with rather short hands-on scanning time and high student-instructor ratio. Based on the results of this study and a literature review we suggest a possible framework and milestones on the way to a longitudinal undergraduate medical US curriculum.

Dataset Information

Ultrafest: a novel approach to ultrasound in medical education leads to improvement in written and clinical examinations.

Introduction

Methods

Results

Conclusion

Publications

Ultrafest: a novel approach to ultrasound in medical education leads to improvement in written and clinical examinations.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets