Dataset Information

Reliability of instruments that measure situation awareness, team performance and task performance in a simulation setting with medical students.

ABSTRACT:

Objectives

The assessment of situation awareness (SA), team performance and task performance in a simulation training session requires reliable and feasible measurement techniques. The objectives of this study were to test the Airways-Breathing-Circulation-Disability-Exposure (ABCDE) checklist and the Team Emergency Assessment Measure (TEAM) for inter-rater reliability, as well as the application of Situation Awareness Global Assessment Technique (SAGAT) for feasibility and internal consistency.

Design

Methodological approach.

Setting

Data collection during team training using full-scale simulation at a university clinical training centre. The video-recorded scenarios were rated independently by four raters.

Participants

55 medical students aged 22-40 years in their fourth year of medical studies, during the clerkship in anaesthesiology and critical care medicine, formed 23 different teams. All students answered the SAGAT questionnaires, and of these students, 24 answered the follow-up postsimulation questionnaire (PSQ). TEAM and ABCDE were scored by four professionals.

Measures

The ABCDE and TEAM were tested for inter-rater reliability. The feasibility of SAGAT was tested using PSQ. SAGAT was tested for internal consistency both at an individual level (SAGAT) and a team level (Team Situation Awareness Global Assessment Technique (TSAGAT)).

Results

The intraclass correlation was 0.54/0.83 (single/average measurements) for TEAM and 0.55/0.83 for ABCDE. According to the PSQ, the items in SAGAT were rated as relevant to the scenario by 96% of the participants. Cronbach's alpha for SAGAT/TSAGAT for the two scenarios was 0.80/0.83 vs 0.62/0.76, and normed ?² was 1.72 vs 1.62.

Conclusion

Task performance, team performance and SA could be purposefully measured, and the reliability of the measurements was good.

SUBMITTER: Hultin M

PROVIDER: S-EPMC6747650 | biostudies-literature | 2019 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reliability of instruments that measure situation awareness, team performance and task performance in a simulation setting with medical students.

Hultin Magnus M Jonsson Karin K Härgestam Maria M Lindkvist Marie M Brulin Christine C

BMJ open 20190912 9

<h4>Objectives</h4>The assessment of situation awareness (SA), team performance and task performance in a simulation training session requires reliable and feasible measurement techniques. The objectives of this study were to test the Airways-Breathing-Circulation-Disability-Exposure (ABCDE) checklist and the Team Emergency Assessment Measure (TEAM) for inter-rater reliability, as well as the application of Situation Awareness Global Assessment Technique (SAGAT) for feasibility and internal cons ...[more]

PMID: 31515425

Similar Datasets

Project description:BackgroundWhen working in complex environments with critically ill patients, team performance is influenced by situation awareness in teams. Moreover, improved situation awareness in the teams will probably improve team and task performance. The aim of this study is to evaluate an educational programme on situation awareness for interprofessional teams at the intensive care units using team and task performance as outcomes.MethodTwenty interprofessional teams from the northern part of Sweden participated in this randomized controlled intervention study conducted in situ in two intensive care units. The study was based on three cases (cases 0, 1 and 2) with patients in a critical situation. The intervention group (n = 11) participated in a two-hour educational programme in situation awareness, including theory, practice, and reflection, while the control group (n = 9) performed the training without education in situation awareness. The outcomes were team performance (TEAM instrument), task performance (ABCDE checklist) and situation awareness (Situation Awareness Global Assessment Technique (SAGAT)). Generalized estimating equation were used to analyse the changes from case 0 to case 2, and from case 1 to case 2.ResultsEducation in situation awareness in the intervention group improved TEAM leadership (p = 0.003), TEAM task management (p = 0.018) and TEAM total (p = 0.030) when comparing cases 1 and 2; these significant improvements were not found in the control group. No significant differences were observed in the SAGAT or the ABCDE checklist.ConclusionsThis intervention study shows that a 2-h education in situation awareness improved parts of team performance in an acute care situation. Team leadership and task management improved in the intervention group, which may indicate that the one or several of the components in situation awareness (perception, comprehension and projection) were improved. However, in the present study this potential increase in situation awareness was not detected with SAGAT. Further research is needed to evaluate how educational programs can be used to increase situation awareness in interprofessional ICU teams and to establish which components that are essential in these programs.Trial registrationThis randomized controlled trial was not registered as it does not report the results of health outcomes after a health care intervention on human participants.

Project description:BackgroundMany training curricula were introduced to deal with the challenges that minimally invasive surgery (MIS) presents to the surgeon. Situational awareness (SA) is the ability to process information effectively. It depends on general cognitive abilities and can be divided into three steps: perceiving cues, linking cues to knowledge and understanding their relevance, and predicting possible outcomes. Good SA is crucial to predict and avoid complications and respond efficiently. This study aimed to introduce the concept of SA into laparoscopic training.MethodsThis is a prospective, randomized, controlled study conducted at the MIS Training Center of Heidelberg University Hospital. Video sessions showing the steps of the laparoscopic cholecystectomy (LC) were used for cognitive training. The intervention group trained SA with interposed questions inserted into the video clips. The identical video clips, without questions, were presented to the control group. Performance was assessed with validated scores such as the Objective Structured Assessment of Technical Skills (OSATS) during LC.Results72 participants were enrolled of which 61 were included in the statistical analysis. The SA-group performed LC significantly better (OSATS-Score SA: 67.0 ± 11.5 versus control: 59.1 ± 14.0, p value = 0.034) and with less errors (error score SA: 3.5 ± 1.9 versus control: 4.7 ± 2.0, p value = 0.027). No difference in the time taken to complete the procedure was found. The benefit assessment analysis showed no difference between the groups in terms of perceived learning effect, concentration, or expediency. However, most of the control group indicated retrospectively that they believed they would have benefitted from the intervention.ConclusionThis study suggests that video-based SA training for laparoscopic novices has a positive impact on performance and error rate. SA training should thus be included as one aspect besides simulation and real cases in a multimodal curriculum to improve the efficiency of laparoscopic surgical skills training.

Dataset Information

Reliability of instruments that measure situation awareness, team performance and task performance in a simulation setting with medical students.

Objectives

Design

Setting

Participants

Measures

Results

Conclusion

Publications

Reliability of instruments that measure situation awareness, team performance and task performance in a simulation setting with medical students.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets