Dataset Information

Comparison of in-person versus tele-ultrasound point-of-care ultrasound training during the COVID-19 pandemic.

ABSTRACT:

Background

Lack of training is currently the most common barrier to implementation of point-of-care ultrasound (POCUS) use in clinical practice, and in-person POCUS continuing medical education (CME) courses have been paramount in improving this training gap. Due to travel restrictions and physical distancing requirements during the COVID-19 pandemic, most in-person POCUS training courses were cancelled. Though tele-ultrasound technology has existed for several years, use of tele-ultrasound technology to deliver hands-on training during a POCUS CME course has not been previously described.

Methods

We conducted a retrospective observational study comparing educational outcomes, course evaluations, and learner and faculty feedback from in-person versus tele-ultrasound POCUS courses. The same POCUS educational curriculum was delivered to learners by the two course formats. Data from the most recent pre-pandemic in-person course were compared to tele-ultrasound courses during the COVID-19 pandemic.

Results

Pre- and post-course knowledge test scores of learners from the in-person (n = 88) and tele-ultrasound course (n = 52) were compared. Though mean pre-course knowledge test scores were higher among learners of the tele-ultrasound versus in-person course (78% vs. 71%; p = 0.001), there was no significant difference in the post-course test scores between learners of the two course formats (89% vs. 87%; p = 0.069). Both learners and faculty rated the tele-ultrasound course highly (4.6-5.0 on a 5-point scale) for effectiveness of virtual lectures, tele-ultrasound hands-on scanning sessions, and course administration. Faculty generally expressed less satisfaction with their ability to engage with learners, troubleshoot image acquisition, and provide feedback during the tele-ultrasound course but felt learners completed the tele-ultrasound course with a better basic POCUS skillset.

Conclusions

Compared to a traditional in-person course, tele-ultrasound POCUS CME courses appeared to be as effective for improving POCUS knowledge post-course and fulfilling learning objectives. Our findings can serve as a roadmap for educators seeking guidance on development of a tele-ultrasound POCUS training course whose demand will likely persist beyond the COVID-19 pandemic.

SUBMITTER: Soni NJ

PROVIDER: S-EPMC8419826 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe coronavirus disease (COVID-19) pandemic has disrupted medical education for trainees of all levels. Although telesimulation was initially used to train in resource-limited environments, it may be a reasonable alternative for replicating authentic patient experiences for medical students during the COVID-19 pandemic. It is unclear whether a more passive approach through telesimulation training is as effective as traditional in-person simulation training.ObjectiveOur aim was to evaluate the effectiveness of in-person versus remote simulation training on learners' comfort with managing critical care scenarios.MethodsThis was a prospective observational cohort study assessing the impact of an in-person versus remote simulation course on volunteer fourth-year medical students from February to April 2021 at the University of California San Diego School of Medicine. Precourse and postcourse surveys were performed anonymously using an online secure resource.ResultsIn the in-person learners, there was statistically significant improvement in learner comfort across all technical, behavioral, and cognitive domains. In remote learners, there was a trend toward improvement in self-reported comfort across technical and cognitive domains in the telesimulation course. However, the only statistically significant improvement in postcourse surveys of telesimulation learners, compared with baseline, was in running codes. Regardless of the training modality, the students had a positive experience with the critical care simulation course, ranking it, on average, 9.6 out of 10 (9.9 in in-person simulation vs. 9.3 in telesimulation; P = 0.06).ConclusionWe demonstrated that implementation of a telesimulation-based simulation course focusing on critical care cases is feasible and well received by trainees. Although a telesimulation-based simulation course may not be as effective for remote learners as active in-person participants, our study provided evidence that there was still a trend toward improving provider readiness across technical and cognitive domains when approaching critical care cases.

Project description:ProblemThe COVID-19 pandemic significantly disrupted point-of-care ultrasound (POCUS) education. Medical schools and residency programs placed restrictions on bedside teaching and clinical scanning as part of risk mitigation. In response, POCUS faculty from 15 institutions nationwide collaborated on an alternative model of ultrasound education, A Distance-learning Approach to POCUS Training (ADAPT).ApproachADAPT was repeated monthly from April 1 through June 30, 2020. It accommodated 70 learners, who included 1- to 4-week rotators and asynchronous learners. The curriculum included assigned prework and learning objectives covering 20 core POCUS topics. A rotating group of 30 faculty and fellows delivered daily virtual teaching sessions that included gamification to increase learner engagement and hands-on instruction through teleguidance. After participation, faculty and learners completed anonymous surveys.OutcomesEducators reported a significant decrease in preparatory time (6.2 vs 3.1 hours per week, P < .001) dedicated to ultrasound education after implementing ADAPT. The majority of 29 learners who completed surveys felt "somewhat confident" or "very confident" in their ability to acquire (n = 25, 86.2%) and interpret (n = 27, 93.1%) ultrasound images after the intervention; the majority of 22 educators completing surveys rated the program "somewhat effective" or "very effective" at contributing to learner's ability to acquire (n = 13, 59.1%) and interpret (n = 20, 90.9%) images. Most learners (n = 28, 96.6%) and all educators (n = 22, 100%) were "satisfied" or "very satisfied" with ADAPT as a whole, and the large majority of educators were "very likely" (n = 18, 81.8%) to recommend continued use of this program.Next stepsA virtual curriculum that pools the efforts of multiple institutions nationwide was implemented rapidly and effectively while satisfying educational expectations of both learners and faculty. This collaborative framework can be replicated and may be generalizable to other educational objectives.

Project description:ObjectivesThe primary objective was to survey pediatric emergency medicine (PEM) leaders and fellows regarding point-of-care ultrasound (POCUS) training in PEM fellowship programs, including teaching methods, training requirements, and applications taught. Secondary objectives were to compare fellows' and program leaders' perceptions of fellow POCUS competency and training barriers.MethodsThis was a cross-sectional survey of U.S. PEM fellows and fellowship program leaders of the 78 fellowship programs using two online group-specific surveys exploring five domains: program demographics; training strategies and requirements; perceived competency; barriers, strengths, and weaknesses of POCUS training; and POCUS satisfaction.ResultsEighty-three percent (65/78) of programs and 53% (298/558) of fellows responded. All participating PEM fellowship programs included POCUS training in their curriculum. Among the 65 programs, 97% of programs and 92% of programs utilized didactics and supervised scanning shifts as educational techniques, respectively. Sixty percent of programs integrated numerical benchmarks and 49% of programs incorporated real-time, hands-on demonstration as training requirements. Of the 19 POCUS applications deemed in the literature as core requirements for fellows, at least 75% of the 298 fellows reported training in 13 of those applications. Although less than half of fellows endorsed competency for identifying intussusception, ultrasound-guided pericardiocentesis, and transvaginal pregnancy evaluation, a higher proportion of leaders reported fellows as competent for these applications (40% vs. 68%, p ≤ 0.001; 21% vs. 39%, p = 0.003; and 21% vs. 43%, p ≤ 0.001). Forty-six percent of fellows endorsed a lack of PEM POCUS evidence as a training barrier compared to 31% of leaders (p = 0.02), and 39% of leaders endorsed a lack of local financial support as a training barrier compared to 23% of fellows (p = 0.01).ConclusionsAlthough most PEM fellowship programs provide POCUS training, there is variation in content and requirements. Training does conform to many of the expert recommended guidelines; however, there are some discrepancies and perceived barriers to POCUS training remain.

Project description:IntroductionThere is limited access to life-saving antenatal ultrasound in rural and low-resource settings largely due to shortages in skilled staff. Studies have shown healthcare practitioners can be upskilled in PoCUS through focused training, offering a viable solution to this deficit. However, standards for training and competency assessment are unclear and regulation surrounding practice is lacking. We aimed to review published literature examining antenatal PoCUS training programs, comparing teaching approaches and study methodologies.MethodsA search of electronic databases EMBASE, MEDLINE and Google Scholar was conducted. Original research articles evaluating antenatal PoCUS training of healthcare professionals worldwide were identified for analysis. Articles with limited detail on the PoCUS training intervention and those describing comprehensive diagnostic training programs were excluded. Evaluations were compared against the Kirkpatrick Evaluation Framework (KEF).ResultsTwenty-seven studies were included from an initial search result of 484 articles. There was considerable heterogeneity between the PoCUS training programs described. Course duration ranged from 3 hours to 2 years, with 11 of the 27 studies delivering obstetric-exclusive content. 44% trained multidisciplinary groups of health professionals. Long-term follow-up training and skills assessments were lacking in over half of the reviewed studies. Study quality and reporting detail varied, but overall beneficial outcomes were reported with 3/4s of the studies reaching upper KEF levels 3 and 4.ConclusionPoCUS performed by upskilled healthcare professionals offers an attractive solution to the problem of inequitable access to antenatal ultrasound. A review of available literature highlighted a paucity of comparable high-quality studies needed to establish a stronger evidence base for antenatal PoCUS, and a need to standardise training and competency assessment. This review may inform educators, researchers and policy-makers on existing training formats and methodologies to assist in establishing best practice antenatal PoCUS training methods for safe service delivery by remote healthcare professionals.

Project description:BackgroundAlthough lung ultrasound has been reported to be a portable, cost-effective, and accurate method to detect pneumonia, it has not been widely used because of the difficulty in its interpretation. Here, we aimed to investigate the effectiveness of a novel artificial intelligence-based automated pneumonia detection method using point-of-care lung ultrasound (AI-POCUS) for the coronavirus disease 2019 (COVID-19).MethodsWe enrolled consecutive patients admitted with COVID-19 who underwent computed tomography (CT) in August and September 2021. A 12-zone AI-POCUS was performed by a novice observer using a pocket-size device within 24 h of the CT scan. Fifteen control subjects were also scanned. Additionally, the accuracy of the simplified 8-zone scan excluding the dorsal chest, was assessed. More than three B-lines detected in one lung zone were considered zone-level positive, and the presence of positive AI-POCUS in any lung zone was considered patient-level positive. The sample size calculation was not performed given the retrospective all-comer nature of the study.ResultsA total of 577 lung zones from 56 subjects (59.4 ± 14.8 years, 23% female) were evaluated using AI-POCUS. The mean number of days from disease onset was 9, and 14% of patients were under mechanical ventilation. The CT-validated pneumonia was seen in 71.4% of patients at total 577 lung zones (53.3%). The 12-zone AI-POCUS for detecting CT-validated pneumonia in the patient-level showed the accuracy of 94.5% (85.1%- 98.1%), sensitivity of 92.3% (79.7%- 97.3%), specificity of 100% (80.6%- 100%), positive predictive value of 95.0% (89.6% - 97.7%), and Kappa of 0.33 (0.27-0.40). When simplified with 8-zone scan, the accuracy, sensitivity, and sensitivity were 83.9% (72.2%- 91.3%), 77.5% (62.5%- 87.7%), and 100% (80.6%- 100%), respectively. The zone-level accuracy, sensitivity, and specificity of AI-POCUS were 65.3% (61.4%- 69.1%), 37.2% (32.0%- 42.7%), and 97.8% (95.2%- 99.0%), respectively.InterpretationAI-POCUS using the novel pocket-size ultrasound system showed excellent agreement with CT-validated COVID-19 pneumonia, even when used by a novice observer.