Dataset Information

The reliability and usability of the Anesthesiologists' Non-Technical Skills (ANTS) system in simulation research.

ABSTRACT: Background:Non-technical skills (NTS) such as leadership and team work are important in providing good quality of care. One system to assess physicians' NTS is the Anesthesiologists' Non-Technical Skills (ANTS) system. The present study evaluates the ANTS system on the interrater reliability and usability for research purposes. Methods:Ten anesthesiologists and 20 anesthesiology residents performed two resuscitation scenarios (with and without the presence of distractors) in a simulation room with a full-scale patient simulator. The scenarios were videotaped. Two independent raters rated the NTS of the anesthesiologists using the ANTS system. The intraclass correlation coefficients (ICC) were calculated to determine the interrater reliability of both the total NTS score and the measured differences between the two scenarios. The raters filled out a questionnaire to obtain insights in the usability of the ANTS system for research purposes. Results:The ICC for the total score of the NTS was substantial (0.683), and the ICC of the elements varied between 0.371 for assessing capabilities and 0.670 for providing and maintaining standards. The intraclass correlation coefficient of measuring differences was fair (0.502). The raters judged the usability as good. Conclusions:The ANTS system was reliable for the total score and usable to measure physicians' NTS in a research setting. However, there was variation between the reliability of the elements. We recommend that if the ANTS is used for research, a pilot study should determine elements not applicable or observable in the scenario of interest; these elements should be excluded from the study.

SUBMITTER: Zwaan L

PROVIDER: S-EPMC5806494 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The reliability and usability of the Anesthesiologists' Non-Technical Skills (ANTS) system in simulation research.

Zwaan Laura L Tjon Soei Len Lian L Wagner Cordula C van Groeningen Dick D Kolenbrander Mark M Krage Ralf R

Advances in simulation (London, England) 20160608

<h4>Background</h4>Non-technical skills (NTS) such as leadership and team work are important in providing good quality of care. One system to assess physicians' NTS is the Anesthesiologists' Non-Technical Skills (ANTS) system. The present study evaluates the ANTS system on the interrater reliability and usability for research purposes.<h4>Methods</h4>Ten anesthesiologists and 20 anesthesiology residents performed two resuscitation scenarios (with and without the presence of distractors) in a sim ...[more]

PMID: 29449987

Similar Datasets

Project description:BACKGROUND:Non-technical skills (NTS), such as communication and professionalism, contribute to the safe and effective completion of procedures. NTS training has previously been shown to improve surgical performance. Moreover, increases in NTS have been associated with improved clinical endoscopic performance. Despite this evidence, NTS training has not been tested as an intervention in endoscopy. OBJECTIVE:The aim of this study is to evaluate the effectiveness of a simulation-based training (SBT) curriculum of NTS on novice endoscopists' performance of clinical colonoscopy. METHODS:Novice endoscopists were randomized to 2 groups. The control group received 4 hours of interactive didactic sessions on colonoscopy theory and 6 hours of SBT. Hours 5 and 6 of the SBT were integrated scenarios, wherein participants interacted with a standardized patient and nurse, while performing a colonoscopy on the virtual reality (VR) simulator. The NTS (intervention) group received the same teaching sessions but the last hour was focused on NTS teaching. The NTS group also reviewed a checklist of tasks relevant to NTS concepts prior to each integrated scenario case and was provided with dedicated feedback on their NTS performance during the integrated scenario practice. All participants were assessed at baseline, immediately after training, and 4 to 6 weeks post-training. The primary outcome measure is colonoscopy-specific performance in the clinical setting. RESULTS:In total, 42 novice endoscopists completed the study. Data collection and analysis is ongoing. We anticipate completion of all assessments by August 2017. Data analysis, manuscript writing, and subsequent submission for publication is expected to be completed by December 2017. CONCLUSIONS:Results from this study may inform the implementation of NTS training into postgraduate gastrointestinal curricula. NTS curricula may improve attitudes towards patient safety and self-reflection among trainees. Moreover, enhanced NTS may lead to superior clinical performance and outcomes in colonoscopy. TRIAL REGISTRATION:Clinicaltrial.gov NCT02877420; https://www.clinicaltrials.gov/ct2/show/NCT02877420 (Archived by WebCite at http://www.webcitation.org/6rw94ubXX NCT02877420).

Project description:BackgroundNon-technical skills (NTS) are essential for safe surgical practice as they impact workflow and patient outcomes. Observational tools to measure operating room (OR) teams' NTS have been introduced. However, there are none that account for the specific teamwork challenges introduced by robotic-assisted surgery (RAS). We set out to develop and content-validate a tool to assess multidisciplinary NTS in RAS.MethodologyStepwise, multi-method procedure. Observations in different surgical departments and a scoping literature review were first used to compile a set of RAS-specific teamwork behaviours. This list was refined and expert validated using a Delphi consensus approach consisting of qualitative interviews and a quantitative survey. Then, RAS-specific behaviours were merged with a well-established assessment tool on OR teamwork (NOTECHS II). Finally, the new tool-RAS-NOTECHS-was applied in standardized observations of real-world procedures to test its reliability (inter-rater agreement via intra-class correlations).ResultsOur scoping review revealed 5242 articles, of which 21 were included based on pre-established inclusion criteria. We elicited 16 RAS-specific behaviours from the literature base. These were synthesized with further 18 behavioural markers (obtained from 12 OR-observations) into a list of 26 behavioural markers. This list was reviewed by seven RAS experts and condensed to 15 expert-validated RAS-specific behavioural markers which were then merged into NOTECHS II. For five observations of urologic RAS procedures (duration: 13 h and 41 min), inter-rater agreement for identification of behavioural markers was strong. Agreement of RAS-NOTECHS scores indicated moderate to strong agreement.ConclusionsRAS-NOTECHS is the first observational tool for multidisciplinary NTS in RAS. In preliminary application, it has been shown to be reliable. Since RAS is rapidly increasing and challenges for effective and safe teamwork remain at the forefront of quality and safety of surgical care, RAS-NOTECHS may contribute to training and improvement efforts in technology-facilitated surgeries.

Project description:IntroductionThe high incidence of unsafe anaesthetic care leads to adverse events and increases the burden on patient safety. An important reason for unsafe anaesthesia care is the lack of non-technical skills (NTS), which are defined as personal cognitive, social or interpersonal skills, among anaesthetists. The anaesthetists' NTS (ANTS) behavioural marker system has been widely used to evaluate and improve anaesthetists' behavioural performance to ensure patient safety. This protocol describes a planned systematic review aiming to determine the validity and reliability of the ANTS behavioural marker system and its application as a tool for the training and assessment of ANTS and for improving patient safety.Methods and analysisThis systematic review follows the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocol. Studies that applied the ANTS behavioural marker system in a meaningful way, including using the ANTS behavioural marker system to guide data collection, analysis, coding, measurement, and/or reporting, which have been published in peer-reviewed journals, will be eligible. A citation search strategy will be employed. We will search Scopus and Web of Science for publications from 2002 to May 2022, which cite the three original ANTS behavioural marker system publications by Fletcher et al. We will also search the references of the relevant reviews for additional eligible studies. For each study, two authors will independently screen papers to determine eligibility and will extract the data. The quality of the included studies will be assessed using the Joanna Briggs Institute (JBI) Critical Appraisal Checklists. A framework analysis approach that consists of five steps-familiarisation, identifying a thematic data extraction framework, indexing, charting, mapping and interpretation-will be used to synthesise and report the data.Ethics and disseminationEthics approval is not required for this study. The findings will be disseminated primarily through peer-reviewed publications and conference presentations.Prospero registration numberCRD42022297773.

Dataset Information

The reliability and usability of the Anesthesiologists' Non-Technical Skills (ANTS) system in simulation research.

Publications

The reliability and usability of the Anesthesiologists' Non-Technical Skills (ANTS) system in simulation research.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets