Dataset Information

Reliability of instruments that measure situation awareness, team performance and task performance in a simulation setting with medical students.

ABSTRACT:

Objectives

The assessment of situation awareness (SA), team performance and task performance in a simulation training session requires reliable and feasible measurement techniques. The objectives of this study were to test the Airways-Breathing-Circulation-Disability-Exposure (ABCDE) checklist and the Team Emergency Assessment Measure (TEAM) for inter-rater reliability, as well as the application of Situation Awareness Global Assessment Technique (SAGAT) for feasibility and internal consistency.

Design

Methodological approach.

Setting

Data collection during team training using full-scale simulation at a university clinical training centre. The video-recorded scenarios were rated independently by four raters.

Participants

55 medical students aged 22-40 years in their fourth year of medical studies, during the clerkship in anaesthesiology and critical care medicine, formed 23 different teams. All students answered the SAGAT questionnaires, and of these students, 24 answered the follow-up postsimulation questionnaire (PSQ). TEAM and ABCDE were scored by four professionals.

Measures

The ABCDE and TEAM were tested for inter-rater reliability. The feasibility of SAGAT was tested using PSQ. SAGAT was tested for internal consistency both at an individual level (SAGAT) and a team level (Team Situation Awareness Global Assessment Technique (TSAGAT)).

Results

The intraclass correlation was 0.54/0.83 (single/average measurements) for TEAM and 0.55/0.83 for ABCDE. According to the PSQ, the items in SAGAT were rated as relevant to the scenario by 96% of the participants. Cronbach's alpha for SAGAT/TSAGAT for the two scenarios was 0.80/0.83 vs 0.62/0.76, and normed ?² was 1.72 vs 1.62.

Conclusion

Task performance, team performance and SA could be purposefully measured, and the reliability of the measurements was good.

SUBMITTER: Hultin M

PROVIDER: S-EPMC6747650 | biostudies-literature | 2019 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reliability of instruments that measure situation awareness, team performance and task performance in a simulation setting with medical students.

Hultin Magnus M Jonsson Karin K Härgestam Maria M Lindkvist Marie M Brulin Christine C

BMJ open 20190912 9

<h4>Objectives</h4>The assessment of situation awareness (SA), team performance and task performance in a simulation training session requires reliable and feasible measurement techniques. The objectives of this study were to test the Airways-Breathing-Circulation-Disability-Exposure (ABCDE) checklist and the Team Emergency Assessment Measure (TEAM) for inter-rater reliability, as well as the application of Situation Awareness Global Assessment Technique (SAGAT) for feasibility and internal cons ...[more]

PMID: 31515425

Similar Datasets

Project description:BackgroundWhen working in complex environments with critically ill patients, team performance is influenced by situation awareness in teams. Moreover, improved situation awareness in the teams will probably improve team and task performance. The aim of this study is to evaluate an educational programme on situation awareness for interprofessional teams at the intensive care units using team and task performance as outcomes.MethodTwenty interprofessional teams from the northern part of Sweden participated in this randomized controlled intervention study conducted in situ in two intensive care units. The study was based on three cases (cases 0, 1 and 2) with patients in a critical situation. The intervention group (n = 11) participated in a two-hour educational programme in situation awareness, including theory, practice, and reflection, while the control group (n = 9) performed the training without education in situation awareness. The outcomes were team performance (TEAM instrument), task performance (ABCDE checklist) and situation awareness (Situation Awareness Global Assessment Technique (SAGAT)). Generalized estimating equation were used to analyse the changes from case 0 to case 2, and from case 1 to case 2.ResultsEducation in situation awareness in the intervention group improved TEAM leadership (p = 0.003), TEAM task management (p = 0.018) and TEAM total (p = 0.030) when comparing cases 1 and 2; these significant improvements were not found in the control group. No significant differences were observed in the SAGAT or the ABCDE checklist.ConclusionsThis intervention study shows that a 2-h education in situation awareness improved parts of team performance in an acute care situation. Team leadership and task management improved in the intervention group, which may indicate that the one or several of the components in situation awareness (perception, comprehension and projection) were improved. However, in the present study this potential increase in situation awareness was not detected with SAGAT. Further research is needed to evaluate how educational programs can be used to increase situation awareness in interprofessional ICU teams and to establish which components that are essential in these programs.Trial registrationThis randomized controlled trial was not registered as it does not report the results of health outcomes after a health care intervention on human participants.

Dataset Information

Reliability of instruments that measure situation awareness, team performance and task performance in a simulation setting with medical students.

Objectives

Design

Setting

Participants

Measures

Results

Conclusion

Publications

Reliability of instruments that measure situation awareness, team performance and task performance in a simulation setting with medical students.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure