Dataset Information

Development of a multisystem point of care ultrasound skills assessment checklist.

ABSTRACT:

Background

Many institutions are training clinicians in point-of-care ultrasound (POCUS), but few POCUS skills checklists have been developed and validated. We developed a consensus-based multispecialty POCUS skills checklist with anchoring references for basic cardiac, lung, abdominal, and vascular ultrasound, and peripheral intravenous line (PIV) insertion.

Methods

A POCUS expert panel of 14 physicians specializing in emergency, critical care, and internal/hospital medicine participated in a modified-Delphi approach to develop a basic POCUS skills checklist by group consensus. Three rounds of voting were conducted, and consensus was defined by ≥ 80% agreement. Items achieving < 80% consensus were discussed and considered for up to two additional rounds of voting.

Results

Thirteen POCUS experts (93%) completed all three rounds of voting. Cardiac, lung, abdominal, and vascular ultrasound checklists included probe location and control, basic machine setup, image quality and optimization, and identification of anatomical structures. PIV insertion included additional items for needle tip tracking. During the first round of voting, 136 (82%) items achieved consensus, and after revision and revoting, an additional 21 items achieved consensus. A total of 153 (92%) items were included in the final checklist.

Conclusions

We have developed a consensus-based, multispecialty POCUS checklist to evaluate skills in image acquisition and anatomy identification for basic cardiac, lung, abdominal, and vascular ultrasound, and PIV insertion.

SUBMITTER: Soni NJ

PROVIDER: S-EPMC9096739 | biostudies-literature | 2022 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development of a multisystem point of care ultrasound skills assessment checklist.

Soni Nilam J NJ Nathanson Robert R Andreae Mark M Khosla Rahul R Vadamalai Karthik K Kode Karthik K Boyd Jeremy S JS LoPresti Charles M CM Resop Dana D Basrai Zahir Z Williams Jason J Bales Brian B Sauthoff Harald H Wetherbee Erin E Haro Elizabeth K EK Smith Natalie N Mader Michael J MJ Pugh Jacqueline J Finley Erin P EP Schott Christopher K CK

The ultrasound journal 20220512 1

<h4>Background</h4>Many institutions are training clinicians in point-of-care ultrasound (POCUS), but few POCUS skills checklists have been developed and validated. We developed a consensus-based multispecialty POCUS skills checklist with anchoring references for basic cardiac, lung, abdominal, and vascular ultrasound, and peripheral intravenous line (PIV) insertion.<h4>Methods</h4>A POCUS expert panel of 14 physicians specializing in emergency, critical care, and internal/hospital medicine part ...[more]

PMID: 35551527

Similar Datasets

Project description:BackgroundObjective assessment of skills after training is essential for safe implementation of lung point-of-care ultrasound (POCUS). In low-and middle-income countries (LMIC) there is a need for assessment tools without onsite experts to scale up POCUS access. Our objective is to develop a web-based assessment tool and evaluate trainees across different countries and at different time points after initial lung POCUS training.MethodsWe adapted the objective and validated lung ultrasound score (LUS-OSAUS) to a web-based tool with quiz and practical skills test. Trainees were evaluated after a short (4-day) standardized lung POCUS training and were classified in distinct groups according to (i) their geographical location (Benin vs. South-Africa) and (ii) time elapsed since training (Benin 0 months vs. Benin 6 months). The Benin 6 months group had minimal continuous education. Skills test images were read by two blinded experts. We report the overall success rates and then compare these rates based on location and timing since training, using the Fischer's exact test.ResultsA total of 35 out of 43 participants completed the online LUS-OSAUS quiz and skills test. The overall success rate was 0.84 (95%CI 0.80-0.88), with lower success rates for "correct depth" 0.54 (0.37-0.71), "correct assessment of pleura" 0.63 (0.45-0.79) and "conclusion" 0.71 (0.54-0.85). There were no differences based on location, with respective rates of 0.86 (0.80-0.92) and 0.83 (0.75-0.91) (p-value = 0.125) for Benin and South Africa at 0 months, respectively. Similarly, there were no differences according to timing with success rates of 0.86 (0.80-0.92) and 0.82 (0.72-0.93) (p-value = 0.563) for Benin at 0 months and 6 months, respectively.ConclusionWeb-based objective and structured assessment of lung POCUS skills in LMIC following a short-standardized training is feasible and has a good overall success rate with consistent results across regions and up to 6 months after training given minimal continuous education. Overall, technical and POCUS-based clinical conclusion skills are the most difficult to acquire.

Project description:ObjectivesPoint-of-care ultrasound (POCUS) has become an integral diagnostic and interventional tool. Barriers to POCUS training persist, and it continues to remain heterogeneous across training programs. Structured POCUS assessment tools exist, but remain limited in their feasibility, acceptability, reliability, and validity; none of these tools are entrustment-based. The objective of this study was to derive a simple, entrustment-based POCUS competency assessment tool and pilot it in an assessment setting.MethodsThis study was composed of two phases. First, a three-step modified Delphi design surveyed 60 members of the Canadian Association of Emergency Physicians Emergency Ultrasound Committee (EUC) to derive the anchors for the tool. Subsequently, the derived ultrasound competency assessment tool (UCAT) was used to assess trainee (N = 37) performance on a simulated FAST examination. The intraclass correlation (ICC) for inter-rater reliability and Cronbach's alpha for internal consistency were calculated. A statistical analysis was performed to compare the UCAT to other competency surrogates.ResultsThe three-round Delphi had 22, 26, and 26 responses from the EUC members. Consensus was reached, and anchors for the domains of preparation, image acquisition, image optimization, and clinical integration achieved approval rates between 92 and 96%. The UCAT pilot revealed excellent inter-rater reliability (with ICC values of 0.69-0.89; p < 0.01) and high internal consistency (α = 0.91). While UCAT scores were not impacted by level of training, they were significantly impacted by the number of previous POCUS studies completed.ConclusionsWe developed and successfully piloted the UCAT, an entrustment-based bedside POCUS competency assessment tool suitable for rapid deployment. The findings from this study indicate early validity evidence for the use of the UCAT as an assessment of trainee POCUS competence on FAST. The UCAT should be trialed in different populations performing several POCUS study types.

Project description:BackgroundCurrent methods of assessing competence in acquiring point-of-care ultrasound images are inadequate. They rely upon cumbersome rating systems that do not depend on the actual outcome measured and lack evidence of validity. We describe a new method that uses a rigorous statistical model to assess performance of individual trainees based on the actual task, image acquisition. Measurements obtained from the images acquired (the actual desired outcome) are themselves used to validate effective training and competence acquiring ultrasound images. We enrolled a convenience sample of 21 spontaneously breathing adults from a general medicine ward. In random order, two trainees (A and B) and an instructor contemporaneously acquired point-of-care ultrasound images of the inferior vena cava and the right internal jugular vein from the same patients. Blinded diameter measurements from each ultrasound were analyzed quantitatively using a multilevel model. Consistent mean differences between each trainee's and the instructor's images were ascribed to systematic acquisition errors, indicative of poor measurement technique and a need for further training. Wider variances were attributed to sporadic errors, indicative of inconsistent application of measurement technique across patients. In addition, the instructor recorded qualitative observations of each trainee's performance during image acquisition.ResultsFor all four diameters, the means and variances of measurements from trainee A's images differed significantly from the instructor's, whereas those from trainee B's images were comparable. Techniques directly observed by the instructor supported these model-derived findings. For example, mean anteroposterior diameters of the internal jugular vein obtained from trainee A's images were 3.8 mm (90% CI 2.3-5.4) smaller than from the instructor's; this model-derived finding matched the instructor's observation that trainee A compressed the vein during acquisition. Instructor summative assessments agreed with model-derived findings, providing internal validation of the descriptive and quantitative assessments of competence acquiring ultrasound images.ConclusionsClinical measurements obtained from point-of-care ultrasound images acquired contemporaneously by trainees and an instructor can be used to quantitatively assess the image acquisition competence of specific trainees. This method may obviate resource-intensive qualitative rating systems that are based on ultrasound image quality and direct observation, while also helping instructors guide remediation.

Project description:ObjectivesImplementation barriers and lack of standardized point-of-care ultrasound (POCUS) curricula make the development of effective POCUS curricula and methods of assessment challenging. The authors aim to develop a longitudinal POCUS curriculum through staged intervention. In the first stage, the authors hypothesized that the use of high-fidelity ultrasound simulation during the Internal Medicine clerkship would improve POCUS confidence and knowledge among medical students, minimizing the need for trained faculty.MethodsA quasi-experimental study of third-year students on the Internal Medicine clerkship at a large academic medical center in the United States was performed assessing the efficacy of ultrasound simulation use. The control group consisted of students who received baseline POCUS education during teaching rounds but did not have access to the ultrasound simulator. The experimental group consisted of students who, in addition to baseline POCUS education, had access to a high-fidelity ultrasound simulator throughout the clerkship for a minimum of 1 hour per week. Students in both the control and experimental groups completed a pre- and post-intervention confidence survey and knowledge-based examination.ResultsEighty-two percent (50/61) of students completed pre- and post-tests, with the control group demonstrating no significant difference in POCUS confidence or knowledge. After exposure to the ultrasound simulator, the experimental group demonstrated statistically significant improvement in POCUS confidence and overall POCUS knowledge (p < .01).ConclusionThe use of high-fidelity ultrasound simulation can improve POCUS confidence and knowledge among medical students while addressing common barriers to the implementation of a POCUS curriculum. Despite showing statistically significant improvement in overall knowledge, the results did not appear to hold educational significance. Additional POCUS educational methods are necessary to overcome cognitive bias and potential overconfidence. The next stage of curriculum development will include resident-led POCUS workshops to supplement simulation.

Project description:BackgroundIn Japan, the nurse practitioner (NP) system has only been in place for a short time, and there is no ultrasound (US) simulation course for NPs. Therefore, NPs may have to attend US simulation courses for physicians. We evaluated whether US simulation course for physicians lead to improved image acquisition and interpretation amongst NPs and, if so, if these changes would be maintained over time.MethodsA 2-day point-of-care ultrasound (POCUS) course designed for physicians in cardiac US, lung US, lower extremity deep vein thrombosis (DVT) US, and abdominal US was held for Japanese nurse practitioners (JNP) and JNP trainees in 2018 and 2019. Participants kept a record of the number of US examinations they performed for 3 months before and 3 months after the course. The number of US exams performed was grouped into six categories. All participants underwent pre-course, immediate post-course, and 4-month post-course testing to assess image interpretation skills, image acquisition skills, and confidence.ResultsThirty-three participants from 21 facilities completed the program. Before and immediately after the course, test scores of the image interpretation test, image acquisition test, and confidence increased significantly (37.1, 72.6: P < 0.001), (13.7, 53.6: P < 0.001), and (15.8, 35.7: P < 0.001), respectively. Comparing the follow-up tests immediately after the course and 4 months later, there was no decrease in scores on the image interpretation test, the image acquisition test, or confidence (72.6, 71.8: P = 1.00) (53.6, 52.9: p = 1.00) (35.7, 33.0: P = 0.34). There was a statistically significant increase (P < 0.001) in both the total number of ultrasound examinations and in the number of ultrasound examinations by category (cardiac, lung, lower extremity DVT, and abdominal) in the 3 months before and 3 months after the course.ConclusionsThe POCUS simulation course for physicians is useful for JNPs to acquire US examination skills even if it is not arranged for JNPs. Image interpretation skill, image acquisition skill, and confidence improved significantly and were maintained even after 4 months of the course. It leads to behavioral changes such as increasing the number of US examinations in daily practice after the course.

Project description:Few studies have compared the effectiveness of brief training courses on point-of-care ultrasound (POCUS) skill acquisition of novice attending physicians vs. trainees. The purpose of this study was to evaluate the change in POCUS image interpretation skills and confidence of novice attending physicians vs. trainees after a 1-day POCUS training course.A 1-day POCUS training course was held in March 2017 in Japan. A standardized training curriculum was developed that included online education, live lectures, and hands-on training. The pre-course assessment tools included a written examination to evaluate baseline knowledge and image interpretation skills, and a physician survey to assess confidence in performing specific ultrasound applications. The same assessment tools were administered post-course, along with a course evaluation. All learners were novices and were categorized as trainees or attending physicians. Data were analyzed using two-way analysis of variance.In total, 60 learners attended the course, and 51 learners (85%) completed all tests and surveys. The 51 novice learners included 29 trainees (4 medical students, 9 PGY 1-2 residents, 16 PGY 3-5 residents) and 22 attending physicians (6 PGY 6-10 physicians, and 16 physicians PGY 11 and higher). The mean pre- and post-course test scores of novice trainees improved from 65.5 to 83.9% while novice attending physicians improved from 66.7 to 81.5% (p?<?0.001). The post-course physician confidence scores in using ultrasound significantly increased in all skill categories for both groups. Both trainees and attending physicians demonstrated similar improvement in their post-course test scores and confidence with no statistically significant differences between the groups. The course evaluation scores for overall satisfaction and satisfaction with faculty members' teaching skills were 4.5 and 4.6 on a 5-point scale, respectively.Both novice trainees and attending physicians showed similar improvement in point-of-care ultrasound image interpretation skills and confidence after a brief training course. Although separate training courses have traditionally been developed for attending physicians and trainees, novice learners of point-of-care ultrasound may acquire skills at similar rates, regardless of their ranking as an attending physician or trainee. Future studies are needed to compare the effectiveness of short training courses on image acquisition skills and determine the ideal course design.

Dataset Information

Development of a multisystem point of care ultrasound skills assessment checklist.

Background

Methods

Results

Conclusions

Publications

Development of a multisystem point of care ultrasound skills assessment checklist.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets