Dataset Information

Assessment Tools for Use During Anesthesia-Centric Pediatric Advanced Life Support Training and Evaluation.

ABSTRACT: Pediatric perioperative cardiac arrests are rare events that require rapid, skilled and coordinated efforts to optimize outcomes. We developed an assessment tool for assessing clinician performance during perioperative critical events termed Anesthesia-centric Pediatric Advanced Life Support (A-PALS). Here, we describe the development and evaluation of the A-PALS scoring instrument.A group of raters scored videos of a perioperative team managing simulated events representing a range of scenarios and competency. We assessed agreement with the reference standard grading, as well as interrater and intrarater reliability.Overall, raters agreed with the reference standard 86.2% of the time. Rater scores concerning scenarios that depicted highly competent performance correlated better with the reference standard than scores from scenarios that depicted low clinical competence (P < 0.0001). Agreement with the reference standard was significantly (P < 0.0001) associated with scenario type, item category, level of competency displayed in the scenario, correct versus incorrect actions and whether the action was performed versus not performed. Kappa values were significantly (P < 0.0001) higher for highly competent performances as compared to lesser competent performances (good: mean = 0.83 [standard deviation = 0.07] versus poor: mean = 0.61 [standard deviation = 0.14]). The intraclass correlation coefficient (interrater reliability) was 0.97 for the raters' composite scores on correct actions and 0.98 for their composite scores on incorrect actions.This study provides evidence for the validity of the A-PALS scoring instrument and demonstrates that the scoring instrument can provide reliable scores, although clinician performance affects reliability.

SUBMITTER: Watkins SC

PROVIDER: S-EPMC5831729 | biostudies-literature | 2017 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Assessment Tools for Use During Anesthesia-Centric Pediatric Advanced Life Support Training and Evaluation.

Watkins Scott C SC Nietert Paul J PJ Hughes Elisabeth E Stickles Eric T ET Wester Tracy E TE McEvoy Matthew D MD

The American journal of the medical sciences 20161003 6

<h4>Background</h4>Pediatric perioperative cardiac arrests are rare events that require rapid, skilled and coordinated efforts to optimize outcomes. We developed an assessment tool for assessing clinician performance during perioperative critical events termed Anesthesia-centric Pediatric Advanced Life Support (A-PALS). Here, we describe the development and evaluation of the A-PALS scoring instrument.<h4>Methods</h4>A group of raters scored videos of a perioperative team managing simulated event ...[more]

PMID: 28641713

Similar Datasets

Project description:IntroductionThe influence of non-technical skills training on resuscitation performance in low-resource settings is unknown. This study investigates combining the Vital Anaesthesia Simulation Training Course with Advanced Cardiac Life Support training on resuscitation performance in Rwanda.MethodsParticipants in this mixed method study are members of resuscitation teams in three district hospitals in Rwanda. The intervention was participation in a 2-day Advanced Cardiac Life Support course followed by the 3-day Vital Anaesthesia Simulation Training Course. Quantitative primary endpoints were time to initiation of cardiopulmonary resuscitation, time to epinephrine administration, and time to defibrillation. Qualitative data on workplace implementation were gathered during focus groups held 3-months post-intervention.ResultsForty-seven participants were recruited. Quantitative data showed a statistically significant decrease in time to cardiopulmonary resuscitation, epinephrine administration, and defibrillation from pre- to post-Advanced Cardiac Life Support, with times of [43.3 (49.7) seconds] versus [16.5 (20) sec], p = <0.001; [137.3 (108.9) sec] versus [51.3 (37.9)], p = <0.001; and [218.5 (105.8) sec] versus [110.8 (87.1) sec], p = <0.001; respectively. These improvements were maintained following the Vital Anaesthesia Simulation Training Course, and at 3-month retention testing. Qualitative analysis highlighted five key themes: ability to initiate cardiopulmonary resuscitation; team coordination for task allocation; empowerment; desire for training and mentorship; and advocacy for system improvement.ConclusionA modified 2-day Advanced Cardiac Life Support course improved resuscitation time indicators with retention 3-months later. Combining the Vital Anaesthesia Simulation Training Course and Advanced Cardiac Life Support led to better team coordination, empowerment to act, and advocacy for system improvement. This pairing of courses has promise for improving Advanced Cardiac Life Support skills amongst healthcare workers in low-resource settings.ClinicalTrials.gov Identifier: NCT05278884.

Project description:BackgroundSerious games enrich simulation-based health care trainings and improve knowledge, skills, and self-confidence of learners while entertaining them.ObjectiveA platform which can combine performance data from a basic life support (BLS) serious game app and hands-on data based on the same scoring system is not available in the market. The aim of this study was to create such a platform and investigate whether performance evaluation of BLS trainings would be more objective compared to conventional Objective Structured Clinical Examination (OSCE) examinations if these evaluations were carried out with the platform which combines OSCE scoring criteria with sensor data retrieved from the simulator's sensors.MethodsParticipants were 25 volunteers (11 men [44.0%] and 14 [56.0] women) among Ac?badem Mehmet Ali Ayd?nlar University students without prior knowledge of the BLS protocol. A serious game module has been created for teaching learners the European Resuscitation Council Basic Life Support 2015 protocol. A second module called the hands-on module was designed for educators. This module includes a checklist used for BLS OSCE examinations and can retrieve sensor data such as compression depth, compression frequency, and ventilation volume from the manikin (CPR Lilly; 3B Scientific GmbH) via Bluetooth. Data retrieved from the sensors of the manikin enable educators to evaluate learners in a more objective way. Performance data retrieved from the serious gaming module have been combined with the results of the hands-on module. Data acquired from the hands-on module have also been compared with the results of conventional OSCE scores of the participants, which were obtained by watching the videos of the same trainings.ResultsParticipants were considered successful in the game if they scored 80/100 or above. Overall, participants scored 80 or above in an average of 1.4 (SD 0.65) trials. The average BLS serious game score was 88.3/100 (SD 5.17) and hands-on average score was 70.7/100 (SD 17.3), whereas the OSCE average score was 84.4/100 (SD 12.9). There was no statistically significant correlation between success on trials (score ?80/100), serious game, hands-on training app, and OSCE scores (Spearman rho test, P>.05). The mean BLS serious game score of the participants was 88.3/100 (SD 5.17), whereas their mean hands-on training app score was 70.7/100 (SD 17.3) and OSCE score was 84.4/100 (SD 12.9).ConclusionsAlthough scoring criteria for OSCE and hands-on training app were identical, OSCE scores were 17% higher than hands-on training app scores. After analyzing the difference of scores between hands-on training app and OSCE, it has been revealed that these differences originate from scoring parameters such as compression depth, compression frequency, and ventilation volume. These data suggest that evaluation of BLS trainings would be more objective if these evaluations were carried out with the modality, which combines visual OSCE scoring criteria with sensor data retrieved from the simulator's sensors.Trial registrationClinicalTrials.gov NCT04533893; https://clinicaltrials.gov/ct2/show/NCT04533893.

Dataset Information

Assessment Tools for Use During Anesthesia-Centric Pediatric Advanced Life Support Training and Evaluation.

Publications

Assessment Tools for Use During Anesthesia-Centric Pediatric Advanced Life Support Training and Evaluation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets