Dataset Information

High-Fidelity Simulation to Assess Task Load Index and Performance: A Prospective Observational Study.

ABSTRACT:

Objective

The NASA Task Load Index is a questionnaire widely used in aviation. This index might help for attesting the quality of a scenario in high-fidelity simulation in healthcare. The main purpose of this study was to observe whether NASA Task Load Index for critical care-simulated scenarios, designed for residents, was consistent with the literature. The second purpose was to describe relationships between NASA Task Load Index, performance and generated stress during high-fidelity simulation.

Methods

All residents in anaesthesia and intensive care undergoing high-fidelity simulation were included. The primary endpoint was the task load generated by each scenario assessed by NASA Task Load Index. Based on the literature, the NASA Task Load Index scores between 39 and 61 were considered an acceptable level. Stress level (Visual Analogue Scale) and specific technical and non-technical skills performances (Team Emergency Assessment Measure) were also assessed.

Results

Totally 53 residents actively participated in 1 of 10 different scenarios, between June and December 2017. The median NASA Task Load Index score of scenarios was 61 [48-65]. Five scenarios generated acceptable task load levels. There was no association between the NASA Task Load Index score and technical or non-technical skills performance scores, but an association between NASA Task Load Index and the stress level (rho=4.7, P =.001) was observed.

Conclusion

Simulation scenarios generate different task loads for residents; the task load was deemed acceptable for half of the scenarios. The NASA Task Load Index could be considered as a tool to assess the pedagogic adequacy of scenarios. Scenario and generated stress level, but not task load, can modify residents' performance during simulation. This should be considered when planning normative simulation.

SUBMITTER: Favre-Felix J

PROVIDER: S-EPMC9524413 | biostudies-literature | 2022 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

High-Fidelity Simulation to Assess Task Load Index and Performance: A Prospective Observational Study.

Favre-Félix Jérémy J Dziadzko Mikhail M Bauer Christian C Duclos Antoine A Lehot Jean-Jacques JJ Rimmelé Thomas T Lilot Marc M

Turkish journal of anaesthesiology and reanimation 20220801 4

<h4>Objective</h4>The NASA Task Load Index is a questionnaire widely used in aviation. This index might help for attesting the quality of a scenario in high-fidelity simulation in healthcare. The main purpose of this study was to observe whether NASA Task Load Index for critical care-simulated scenarios, designed for residents, was consistent with the literature. The second purpose was to describe relationships between NASA Task Load Index, performance and generated stress during high-fidelity s ...[more]

PMID: 35979975

Similar Datasets

Project description:ObjectivesThe use of directed observers in high-fidelity simulation education is increasingly common. While evidence suggests similar educational outcomes for directed observers compared to active participants in technical skills, it remains uncertain if this benefit also exists for senior clinicians, especially in mental workload. We sought to compare the workload between active participants and directed observers using an objective measure.MethodsWe performed a prospective, repeated-measures observational study during the New South Wales Ambulance Aeromedical Operations induction training from 2019 to 2020. Participants included senior critical care doctors, paramedics, and nurses undergoing high-fidelity simulation of prehospital and interhospital aeromedical missions. Task load was measured using the National Aeronautics and Space Administration task load index (NASA-TLX) administered following each simulation debrief. Prehospital and interhospital simulations were compared separately by building a multilevel model for complete case and all study data. Post hoc comparisons of NASA-TLX score for each group were performed using estimated marginal means (EMMs).ResultsWe enrolled 70 participants, comprising 49 physicians (70%), 19 paramedics (27%), and two flight nurses (3%). From the complete case analysis, statistically significant differences were observed for total NASA-TLX scores between active participants and directed observers in both prehospital (participant EMM 78, observer EMM 65, estimated difference -13, 95% confidence interval [CI] -20 to -7) and interhospital simulations (participant EMM 69, observer EMM 59, estimated difference -10, 95% CI -16 to -3). When all available data were included, the pattern of results did not change.ConclusionsIn our sample of senior clinicians, the task load experienced by both active participants and directed observers in high-fidelity simulation education was high for both prehospital and interhospital simulation exercises. The statistically significant differences we report are unlikely to be practically significant. Our results support the use of directed observers when resource limitations do not allow all course attendees to participate in every simulation.

Project description:BackgroundThe postpartum hemorrhage (PPH) is the leading cause of maternal mortality in the world. Human factors and especially situation awareness has primarily responsibility to explain suboptimal cares. Based on eye tracking and behavior analysis in high fidelity simulation of PPH management, the goal of this study is to identify perceptual and cognitive key parameters of the expertise.MethodsTwo groups of fifteen anesthetists (residents and experienced anesthetists) watched the beginning of a severe simulated PPH management. During this first experimental phase, situation awareness was assessed using SAGAT (Situation Awareness Global Assessment Technique) questionnaire and visual behavior was analyzed with eye tracking. In the continuity of the video sequence, they have to step in the PPH situation and to provide care to the simulated patient. Performance of cares was evaluated and self-assessed as well as cognitive load.ResultsNo statistical difference between the residents and experienced anesthetists was observed on performance of simulated PPH management. The mean expected practice score was 76.9 ± 13.9%). Assessment of situation awareness (65 ± 7%), cognitive load (74.4 ± 11.3%) and theoretical knowledge of PPH (52.4 ± 3.5%) were also not statistically different between the two groups. Only results of self-assessed performance (respectively 66.1 ± 16.6 and 47.0 ± 20.8 for experts and residents) and eye-tracking data revealed that experts tended to get accurate evaluation of their performance and to monitor more the blood loss of the patient. Experts have in average 8.28% more fixating points than Novices and gazed the blood loss region longer (865 ms ± 439 vs. 717 ms ± 362).ConclusionsThis study pointed out the limits of classical assessment of performance, and human factors based on questionnaires to identify expertise in simulated PPH care. A neuroscientific approach with new technology like eye tracking could provide new objective and more sensitive insights on human factors in simulated medical emergency situations.

Project description:BackgroundWhilst competence in the management of a wide range of urological emergencies is a requirement for certification in urology, many conditions are uncommon and exposure during training may be limited. This prospective observational study sought to evaluate the feasibility and effectiveness of a standardised cadaveric emergency urology simulation course aimed at improving operative confidence and competence prior to independent on-call practice in the United Kingdom.MethodsA two-day cadaveric emergency urology simulation course supported by the British Association of Urological Surgeons (BAUS) was implemented at two pilot centres. All delegates that undertook one of the initial series of courses were invited to complete online pre- and post-course questionnaires relating to prior operative experience, documented competence and perceived confidence in being able to perform specific emergency procedures independently. Primary outcome was a self-reported 'confidence score' selected from a linear numeric scale ranging from 1 (not at all confident to perform a given procedure independently) to 10 (fully confident). Statistical analysis was undertaken using SPSS Statistics for Mac Version 25 and the paired student's t-test used to compare mean pre- and post-course scores.ResultsOne hundred and four delegates undertook the course during the study period. Of these, 85 (81.7%) completed the pre-course survey and 67 (64.4%) completed the post-course survey, with 61 (58.7%) completing both. The greatest proportion of respondents were Speciality Trainees in Urology of ST5 level or higher (equivalent of Resident/Fellows with 4 or more years of surgical training; n = 31, 36.5%). Delegates reported variable pre-course exposure, with most experience reported in loin approach to the kidney (median 10) and least in exploration and packing of a transurethral resection cavity and emergency nephrectomy (median 0). Following course completion, a statistically significant increase in confidence score was observed for each procedure, with the greatest increases seen for shunt for priapism (4.87 to 8.80, p < 0.001), ureteric reimplantation (3.52 to 7.33, p < 0.001) and primary ureteric anastomosis (3.90 to 7.49, p < 0.001).ConclusionsA standardised high fidelity cadaveric simulation course is feasible and significantly improves the confidence of trainees in performing a wide range of emergency procedures to which exposure is currently limited.

Project description:BackgroundInefficient processes of care delivery during acute resuscitation can compromise the "Golden Hour," the time when quick interventions can rapidly determine the course of the patient's outcome. Checklists have been shown to be an effective tool for standardizing care models. We developed a novel electronic tool, the Checklist for Early Recognition and Treatment of Acute Illness (CERTAIN) to facilitate standardized evaluation and treatment approach for acutely decompensating patients. The checklist was enforced by the use of a "prompter," a team member separate from the leader who records and reviews pertinent CERTAIN algorithms and verbalizes these to the team. Our hypothesis was that the CERTAIN model, with the use of the tool and a prompter, can improve clinician performance and satisfaction in the evaluation of acute decompensating patients in a simulated environment.MethodsVolunteer clinicians with valid adult cardiac life support (ACLS) certification were invited to test the CERTAIN model in a high-fidelity simulation center. The first session was used to establish a baseline evaluation in a standard clinical resuscitation scenario. Each subject then underwent online training before returning to a simulation center for a live didactic lecture, software knowledge assessment, and practice scenarios. Each subject was then evaluated on a scenario with a similar content to the baseline. All subjects took a post-experience satisfaction survey. Video recordings of the pre-and post-test sessions were evaluated using a validated method by two blinded reviewers.ResultsEighteen clinicians completed baseline and post-education sessions. CERTAIN prompting was associated with reduced omissions of critical tasks (46 to 32%, p < 0.01) and 12 out of 14 general assessment tasks were completed in a more timely manner. The post-test survey indicated that 72% subjects felt better prepared during an emergency scenario using the CERTAIN model and 85% would want to be treated with the CERTAIN if they were critically ill.ConclusionPrompting with electronic checklist improves clinicians' performance and satisfaction when dealing with medical emergencies in high-fidelity simulation environment.

Project description:BackgroundThe embedded participant (EP) plays a key role during a full scale/high-fidelity simulation (HFS) session. He/she is expected to guide the learner towards the achievement of the educational objectives of the scenario. However, his/her influence on learners' performance stands undetermined and this effect remains briefly addressed in the literature. This study primarily aims to assess whether the EP could have an influence on the performance of the learner during a HFS scenario. The secondary aim was to establish an inventory of the EP practices in France.MethodsThis retrospective study was conducted in Lyon Claude Bernard University Health Simulation Centre (France). Anaesthesia and critical care residents in postgraduate years 1 to 5 who were scheduled for their HFS sessions during the 2016 to 2021 academic years were included. Two investigators independently evaluated the resident performance regarding both technical and non-technical skills from video recordings. In addition, a nationwide survey was sent out by email through the networks of the Francophone Healthcare Simulation Society (SoFraSimS, Société Francophone de Simulation en Santé) to collect information on EP practices in French-speaking Simulation centres.ResultsFrom a total of 344 HFS videos analysed, a cohort of 19 experienced EPs was identified. The EPs had an influence on the technical and non-technical performances of the learners. The 147 responses to the survey showed that predefined rules of EP good practice existed in only 36% of the simulation centres and 65% of respondents believed that specific EP training would be justified.ConclusionThe EP can exert an influence on the performance of the learners during HFS. For acting as an EP, a great variability of practices and a lack of training are reported by professionals working in simulation centres. These results suggest that more attention must be paid to EP training and attitudes during simulation, especially if summative simulations are extensively developed.

Dataset Information

High-Fidelity Simulation to Assess Task Load Index and Performance: A Prospective Observational Study.

Objective

Methods

Results

Conclusion

Publications

High-Fidelity Simulation to Assess Task Load Index and Performance: A Prospective Observational Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets