Dataset Information

Cognitive load predicts point-of-care ultrasound simulator performance.

ABSTRACT:

Introduction

The ability to maintain good performance with low cognitive load is an important marker of expertise. Incorporating cognitive load measurements in the context of simulation training may help to inform judgements of competence. This exploratory study investigated relationships between demographic markers of expertise, cognitive load measures, and simulator performance in the context of point-of-care ultrasonography.

Methods

Twenty-nine medical trainees and clinicians at the University of Toronto with a range of clinical ultrasound experience were recruited. Participants answered a demographic questionnaire then used an ultrasound simulator to perform targeted scanning tasks based on clinical vignettes. Participants were scored on their ability to both acquire and interpret ultrasound images. Cognitive load measures included participant self-report, eye-based physiological indices, and behavioural measures. Data were analyzed using a multilevel linear modelling approach, wherein observations were clustered by participants.

Results

Experienced participants outperformed novice participants on ultrasound image acquisition. Ultrasound image interpretation was comparable between the two groups. Ultrasound image acquisition performance was predicted by level of training, prior ultrasound training, and cognitive load. There was significant convergence between cognitive load measurement techniques. A marginal model of ultrasound image acquisition performance including prior ultrasound training and cognitive load as fixed effects provided the best overall fit for the observed data.

Discussion

In this proof-of-principle study, the combination of demographic and cognitive load measures provided more sensitive metrics to predict ultrasound simulator performance. Performance assessments which include cognitive load can help differentiate between levels of expertise in simulation environments, and may serve as better predictors of skill transfer to clinical practice.

SUBMITTER: Aldekhyl S

PROVIDER: S-EPMC5807260 | biostudies-literature | 2018 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Cognitive load predicts point-of-care ultrasound simulator performance.

Aldekhyl Sara S Cavalcanti Rodrigo B RB Naismith Laura M LM

Perspectives on medical education 20180201 1

<h4>Introduction</h4>The ability to maintain good performance with low cognitive load is an important marker of expertise. Incorporating cognitive load measurements in the context of simulation training may help to inform judgements of competence. This exploratory study investigated relationships between demographic markers of expertise, cognitive load measures, and simulator performance in the context of point-of-care ultrasonography.<h4>Methods</h4>Twenty-nine medical trainees and clinicians a ...[more]

PMID: 29305817

Similar Datasets

Project description:BackgroundSimulators are an extensively utilized teaching tool in clinical settings. Simulation enables learners to practice and improve their skills in a safe and controlled environment before using these skills on patients. We evaluated the effect of a training session utilizing a novel intubation ultrasound simulator on the accuracy of provider detection of tracheal versus esophageal neonatal endotracheal tube (ETT) placement using point-of-care ultrasound (POCUS). We also investigated whether the time to POCUS image interpretation decreased with repeated simulator attempts.MethodsSixty neonatal health care providers participated in a three-hour simulator-based training session in the neonatal intensive care unit (NICU) of Aga Khan University Hospital (AKUH), Karachi, Pakistan. Participants included neonatologists, neonatal fellows, pediatric residents and senior nursing staff. The training utilized a novel low-cost simulator made with gelatin, water and psyllium fiber. Training consisted of a didactic session, practice with the simulator, and practice with intubated NICU patients. At the end of training, participants underwent an objective structured assessment of technical skills (OSATS) and ten rounds of simulator-based testing of their ability to use POCUS to differentiate between simulated tracheal and esophageal intubations.ResultsThe majority of the participants in the training had an average of 7.0 years (SD 4.9) of clinical experience. After controlling for gender, profession, years of practice and POCUS knowledge, linear mixed model and mixed effects logistic regression demonstrated marginal improvement in POCUS interpretation over repeated simulator testing. The mean time-to-interpretation decreased from 24.7 (SD 20.3) seconds for test 1 to 10.1 (SD 4.5) seconds for Test 10, p < 0.001. There was an average reduction of 1.3 s (β = - 1.3; 95% CI: - 1.66 to - 1.0) in time-to-interpretation with repeated simulator testing after adjusting for the covariates listed above.ConclusionWe found a three-hour simulator-based training session had a significant impact on technical skills and performance of neonatal health care providers in identification of ETT position using POCUS. Further research is needed to examine whether these skills are transferable to intubated newborns in various health settings.Trial registrationClinicalTrials.gov Identifier: NCT03533218 . Registered May 2018.

Project description:ObjectiveEmerging evidence suggests that chest radiography (CXR) following central venous catheter (CVC) placement is unnecessary when point-of-care ultrasound (POCUS) is used to confirm catheter position and exclude pneumothorax. However, few providers have adopted this practice, and it is unknown what contributing factors may play a role in this lack of adoption, such as ultrasound experience. The objective of this study was to evaluate the diagnostic accuracy of POCUS to confirm CVC position and exclude a pneumothorax after brief education and training of nonexperts.MethodsWe performed a prospective cohort study in a single academic medical center to determine the diagnostic characteristics of a POCUS-guided CVC confirmation protocol after brief training performed by POCUS nonexperts. POCUS nonexperts (emergency medicine senior residents and critical care fellows) independently performed a POCUS-guided CVC confirmation protocol after a 30-minute didactic training. The primary outcome was the diagnostic accuracy of the POCUS-guided CVC confirmation protocol for malposition and pneumothorax detection. Secondary outcomes were efficiency and feasibility of adequate image acquisition, adjudicated by POCUS experts.ResultsTwenty-six POCUS nonexperts collected data on 190 patients in the final analysis. There were five (2.5%) CVC malpositions and six (3%) pneumothoraxes on CXR. The positive likelihood ratios of POCUS for malposition detection and pneumothorax were 12.33 (95% confidence interval [CI] = 3.26 to 46.69) and 3.41 (95% CI = 0.51 to 22.76), respectively. The accuracy of POCUS for pneumothorax detection compared to CXR was 0.93 (95% CI = 0.88 to 0.96) and the sensitivity was 0.17 (95% CI = 0.00 to 0.64). The median (interquartile range) time for CVC confirmation was lower for POCUS (9 minutes [8.5-9.5 minutes]) compared to CXR (29 minutes [1-269 minutes]; Mann-Whitney U, p < 0.01). Adequate protocol image acquisition was achieved in 76% of the patients.ConclusionThirty-minute training of POCUS in nonexperts demonstrates adequate diagnostic accuracy, efficiency, and feasibility of POCUS-guided CVC position confirmation, but not exclusion of pneumothorax.

Project description:BACKGROUND:Point-of-care ultrasound (POCUS) is an important clinical tool for a growing number of medical specialties. The current American College of Emergency Physicians (ACEP) Ultrasound Guidelines recommend that trainees perform 150-300 ultrasound scans as part of POCUS training. We sought to assess the relationship between ultrasound scan numbers and performance on an ultrasound-focused observed structured clinical examination (OSCE). METHODS:This was a cross-sectional cohort study in which the number of ultrasound scans residents had previously performed were obtained from a prospective database and compared with their total score on an ultrasound OSCE. Ultrasound fellowship trained emergency physicians administered a previously published OSCE that consisted of standardized questions testing image acquisition and interpretation, ultrasound machine mechanics, patient positioning, and troubleshooting. Residents were observed while performing core applications including aorta, biliary, cardiac, deep vein thrombosis, Focused Assessment with Sonography in Trauma (FAST), pelvic, and thoracic ultrasound imaging. RESULTS:Twenty-nine postgraduate year (PGY)-3 and PGY-4 emergency medicine (EM) residents participated in the OSCE. The median OSCE score was 354 [interquartile range (IQR) 343-361] out of a total possible score of 370. Trainees had previously performed a median of 341 [IQR 289-409] total scans. Residents with more than 300 ultrasound scans had a median OSCE score of 355 [IQR 351-360], which was slightly higher than the median OSCE score of 342 [IQR 326-361] in the group with less than 300 total scans (p?=?0.04). Overall, a LOWESS curve demonstrated a positive association between scan numbers and OSCE scores with graphical review of the data suggesting a plateau effect. CONCLUSION:The results of this small single residency program study suggest a pattern of improvement in OSCE performance as scan numbers increased, with the appearance of a plateau effect around 300 scans. Further investigation of this correlation in diverse practice environments and within individual ultrasound modalities will be necessary to create generalizable recommendations for scan requirements as part of overall POCUS proficiency assessment.

Dataset Information

Cognitive load predicts point-of-care ultrasound simulator performance.

Introduction

Methods

Results

Discussion

Publications

Cognitive load predicts point-of-care ultrasound simulator performance.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets