Dataset Information

Clinical measurements obtained from point-of-care ultrasound images to assess acquisition skills.

ABSTRACT:

Background

Current methods of assessing competence in acquiring point-of-care ultrasound images are inadequate. They rely upon cumbersome rating systems that do not depend on the actual outcome measured and lack evidence of validity. We describe a new method that uses a rigorous statistical model to assess performance of individual trainees based on the actual task, image acquisition. Measurements obtained from the images acquired (the actual desired outcome) are themselves used to validate effective training and competence acquiring ultrasound images. We enrolled a convenience sample of 21 spontaneously breathing adults from a general medicine ward. In random order, two trainees (A and B) and an instructor contemporaneously acquired point-of-care ultrasound images of the inferior vena cava and the right internal jugular vein from the same patients. Blinded diameter measurements from each ultrasound were analyzed quantitatively using a multilevel model. Consistent mean differences between each trainee's and the instructor's images were ascribed to systematic acquisition errors, indicative of poor measurement technique and a need for further training. Wider variances were attributed to sporadic errors, indicative of inconsistent application of measurement technique across patients. In addition, the instructor recorded qualitative observations of each trainee's performance during image acquisition.

Results

For all four diameters, the means and variances of measurements from trainee A's images differed significantly from the instructor's, whereas those from trainee B's images were comparable. Techniques directly observed by the instructor supported these model-derived findings. For example, mean anteroposterior diameters of the internal jugular vein obtained from trainee A's images were 3.8 mm (90% CI 2.3-5.4) smaller than from the instructor's; this model-derived finding matched the instructor's observation that trainee A compressed the vein during acquisition. Instructor summative assessments agreed with model-derived findings, providing internal validation of the descriptive and quantitative assessments of competence acquiring ultrasound images.

Conclusions

Clinical measurements obtained from point-of-care ultrasound images acquired contemporaneously by trainees and an instructor can be used to quantitatively assess the image acquisition competence of specific trainees. This method may obviate resource-intensive qualitative rating systems that are based on ultrasound image quality and direct observation, while also helping instructors guide remediation.

SUBMITTER: Lucas BP

PROVIDER: S-EPMC6638581 | biostudies-literature | 2019 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Clinical measurements obtained from point-of-care ultrasound images to assess acquisition skills.

Lucas Brian P BP D'Addio Antonietta A Block Clay C Manning Harold L HL Remillard Brian B Leiter James C JC

The ultrasound journal 20190222 1

<h4>Background</h4>Current methods of assessing competence in acquiring point-of-care ultrasound images are inadequate. They rely upon cumbersome rating systems that do not depend on the actual outcome measured and lack evidence of validity. We describe a new method that uses a rigorous statistical model to assess performance of individual trainees based on the actual task, image acquisition. Measurements obtained from the images acquired (the actual desired outcome) are themselves used to valid ...[more]

PMID: 31359267

Similar Datasets

Project description:Few studies have compared the effectiveness of brief training courses on point-of-care ultrasound (POCUS) skill acquisition of novice attending physicians vs. trainees. The purpose of this study was to evaluate the change in POCUS image interpretation skills and confidence of novice attending physicians vs. trainees after a 1-day POCUS training course.A 1-day POCUS training course was held in March 2017 in Japan. A standardized training curriculum was developed that included online education, live lectures, and hands-on training. The pre-course assessment tools included a written examination to evaluate baseline knowledge and image interpretation skills, and a physician survey to assess confidence in performing specific ultrasound applications. The same assessment tools were administered post-course, along with a course evaluation. All learners were novices and were categorized as trainees or attending physicians. Data were analyzed using two-way analysis of variance.In total, 60 learners attended the course, and 51 learners (85%) completed all tests and surveys. The 51 novice learners included 29 trainees (4 medical students, 9 PGY 1-2 residents, 16 PGY 3-5 residents) and 22 attending physicians (6 PGY 6-10 physicians, and 16 physicians PGY 11 and higher). The mean pre- and post-course test scores of novice trainees improved from 65.5 to 83.9% while novice attending physicians improved from 66.7 to 81.5% (p?<?0.001). The post-course physician confidence scores in using ultrasound significantly increased in all skill categories for both groups. Both trainees and attending physicians demonstrated similar improvement in their post-course test scores and confidence with no statistically significant differences between the groups. The course evaluation scores for overall satisfaction and satisfaction with faculty members' teaching skills were 4.5 and 4.6 on a 5-point scale, respectively.Both novice trainees and attending physicians showed similar improvement in point-of-care ultrasound image interpretation skills and confidence after a brief training course. Although separate training courses have traditionally been developed for attending physicians and trainees, novice learners of point-of-care ultrasound may acquire skills at similar rates, regardless of their ranking as an attending physician or trainee. Future studies are needed to compare the effectiveness of short training courses on image acquisition skills and determine the ideal course design.

Project description:BackgroundPainful arthropathy is a long-term complication in patients with hemophilia (PWH), affecting mobility and quality of life. A major barrier for the appraisal of joint health is the absence of point-of-care (POC) imaging modalities to promptly identify and manage arthropathic changes. Accordingly, we developed the Joint tissue Activity and Damage Exam (JADE) POC musculoskeletal ultrasound (MSKUS) protocol. JADE is validated for haemophilic joint tissue recognition with high intra/inter-rater and inter-operator reliability.AimsEvaluate associations of JADE with clinical (Hemophilia Joint Health Score, [HJHS]) and functional (total arc [combined flexion and extension range of motion [ROM]]) parameters.MethodologyIn this multi-centre prospective study, we recruited PWH A or B with at least one arthropathic joint. We evaluated joint health (both elbows, knees, and ankles) by comparing JADE measurements (soft tissue and cartilage thickness, and osteochondral alterations) with HJHS and total arc.ResultsOf 44 PWH, most had hemophilia A (35/44), were severe (36/44) and had a median age of 36 years. Increasing HJHSs and declining total arc, indicating worsening arthropathy, were associated with JADE measurements in the expected direction, including (1) increasing length of osteochondral alterations, (2) diminished cartilage thickness, and (3) greater soft tissue expansion. The ankles had the highest proportion of joints without measurable (missing) cartilage. In multivariable models MSKUS measurements explained 68% and 71% of the variation in HJHS and total arc respectively for the elbow, 55% and 29% respectively for the knee, and 50% and 73% for the ankle.ConclusionsThis study highlights the associations of direct intra-articular ultrasonography measurements using the JADE protocol with clinical and functional parameters. Our findings underscore the clinical value of POC MSKUS using the JADE protocol as a complementary instrument for the diagnosis and management of haemophilic arthropathy.

Project description:BackgroundObjective assessment of skills after training is essential for safe implementation of lung point-of-care ultrasound (POCUS). In low-and middle-income countries (LMIC) there is a need for assessment tools without onsite experts to scale up POCUS access. Our objective is to develop a web-based assessment tool and evaluate trainees across different countries and at different time points after initial lung POCUS training.MethodsWe adapted the objective and validated lung ultrasound score (LUS-OSAUS) to a web-based tool with quiz and practical skills test. Trainees were evaluated after a short (4-day) standardized lung POCUS training and were classified in distinct groups according to (i) their geographical location (Benin vs. South-Africa) and (ii) time elapsed since training (Benin 0 months vs. Benin 6 months). The Benin 6 months group had minimal continuous education. Skills test images were read by two blinded experts. We report the overall success rates and then compare these rates based on location and timing since training, using the Fischer's exact test.ResultsA total of 35 out of 43 participants completed the online LUS-OSAUS quiz and skills test. The overall success rate was 0.84 (95%CI 0.80-0.88), with lower success rates for "correct depth" 0.54 (0.37-0.71), "correct assessment of pleura" 0.63 (0.45-0.79) and "conclusion" 0.71 (0.54-0.85). There were no differences based on location, with respective rates of 0.86 (0.80-0.92) and 0.83 (0.75-0.91) (p-value = 0.125) for Benin and South Africa at 0 months, respectively. Similarly, there were no differences according to timing with success rates of 0.86 (0.80-0.92) and 0.82 (0.72-0.93) (p-value = 0.563) for Benin at 0 months and 6 months, respectively.ConclusionWeb-based objective and structured assessment of lung POCUS skills in LMIC following a short-standardized training is feasible and has a good overall success rate with consistent results across regions and up to 6 months after training given minimal continuous education. Overall, technical and POCUS-based clinical conclusion skills are the most difficult to acquire.

Dataset Information

Clinical measurements obtained from point-of-care ultrasound images to assess acquisition skills.

Background

Results

Conclusions

Publications

Clinical measurements obtained from point-of-care ultrasound images to assess acquisition skills.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets