Dataset Information

Simulation-Based Assessment of Critical Care "Front-Line" Providers.

ABSTRACT: OBJECTIVES:Develop a standardized simulation method to assess clinical skills of ICU providers. DESIGN:Simulation assessment. SETTING:Simulation laboratory. SUBJECTS:Residents, Critical Care Medicine fellows, acute care nurse practitioner students. INTERVENTIONS:Performance scoring in scenarios from multiple Critical Care Medicine competency domains. MEASUREMENTS AND MAIN RESULTS:Three-hundred eighty-four performances by 48 participants were scored using checklists (% correct) and holistic "global" ratings (1 [unprepared] to 9 [expert]). One-hundred eighty were scored by two raters. Mean checklist and global scores (± SD) ranged from 65.0% (± 16.3%) to 84.5% (± 17.3%) and 4.7 (± 1.4) to 7.2 (± 1.2). Checklist and global scores for Critical Care Medicine fellows and senior acute care nurse practitioner students (Experienced group, n = 26) were significantly higher than those for the Novice acute care nurse practitioner students (Novice group, n = 14) (75.6% ± 15.6% vs 68.8% ± 21.0% and 6.1?±?1.6 vs 5.4?±?1.5, respectively; p < 0.05). Residents (Intermediate group, n = 8) scored between the two (75.4% ± 18.3% and 5.7?±?1.7). 38.5% of the Experienced group scored in the top quartile for mean global score, compared with 12.5% of the Intermediate and 7.1% of the Novice groups. Conversely, 50% of the Novice group scored in the lower quartile (< 5.3), compared with 37.5% of the Intermediate and 11.5% of the Experienced groups. Psychometric analyses yielded discrimination values greater than 0.3 for most scenarios and reliability for the eight-scenario assessments of 0.51 and 0.60, with interrater reliability of 0.71 and 0.75, for checklist and global scoring, respectively. CONCLUSIONS:The simulation assessments yielded reasonably reliable measures of Critical Care Medicine decision-making skills. Despite a wide range of performance, those with more ICU training and experience performed better, providing evidence to support the validity of the scores. Simulation-based assessments may ultimately prove useful to determine readiness to assume decision-making roles in the ICU.

SUBMITTER: Boyle WA

PROVIDER: S-EPMC5953781 | biostudies-literature | 2018 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Simulation-Based Assessment of Critical Care "Front-Line" Providers.

Boyle Walter A WA Murray David J DJ Beyatte Mary Beth MB Knittel Justin G JG Kerby Paul W PW Woodhouse Julie J Boulet John R JR

Critical care medicine 20180601 6

<h4>Objectives</h4>Develop a standardized simulation method to assess clinical skills of ICU providers.<h4>Design</h4>Simulation assessment.<h4>Setting</h4>Simulation laboratory.<h4>Subjects</h4>Residents, Critical Care Medicine fellows, acute care nurse practitioner students.<h4>Interventions</h4>Performance scoring in scenarios from multiple Critical Care Medicine competency domains.<h4>Measurements and main results</h4>Three-hundred eighty-four performances by 48 participants were scored usin ...[more]

PMID: 29521715

Similar Datasets

Project description:BackgroundMass chemical exposure emergencies are infrequent but can cause injury, illness, or loss of life for large numbers of victims. These emergencies can stretch and challenge the available resources of healthcare systems within the community. Political unrest in the Middle East, including chemical terrorist attacks against civilians in Syria and increasing chemical industry accidents, have highlighted the lack of hospital preparedness for chemical incidents in the region. This study aimed to evaluate the effectiveness of a course designed to empower frontline healthcare providers involved in mass casualty incidents with the basic knowledge and essential operational skills for mass chemical exposure incidents in Saudi Arabia.MethodsA mixed-methods approach was used to develop a blended learning, simulation enhanced, competency-based course for major chemical incidents for front line healthcare providers. The course was designed by experts from different disciplines (disaster medicine, poisoning / toxicology, and Hazard Material Threat - HAZMAT team) in four stages. The course was piloted over five days at the Officers Club of the Ministry of Interior (Riyadh, Saudi Arabia). The 41 participants were from different government health discipline sectors in the country. Pre- and post-tests were used to assess learner knowledge while debriefing sessions after the decontamination triage session and simulation-enhanced exercises were used for team performance assessment.ResultsThe overall knowledge scores were significantly higher in the post-test (69.47%) than the pre-test (46.3%). All four knowledge domains also had significant differences between pre- and post-test results. There were no differences in the pre and post-test scores for healthcare providers from the different health disciplines. A one-year post-event survey demonstrated that participants were satisfied with their knowledge retention. Interestingly, 38.3% had the opportunity to put this knowledge into practice in relation to mass chemical exposure incidents.ConclusionDelivering a foundation level competency-based blended learning course with enhanced simulation training in major chemical incidents for front line healthcare providers may improve their knowledge and skills in response to such incidents. This in turn can improve the level of national preparedness and staff availability and make a crucial difference in reducing the health impacts among victims.

Project description:BackgroundPrimary care in remote communities in northern Canada is delivered primarily by nurses who receive clinical support from physicians in regional centres and the patient transportation system. To improve continuity, quality and access to care in remote northern communities, it is important to understand the perspectives of front-line providers and the complex challenges they face.ObjectiveTo design and implement a survey of primary care providers to identify issues relating to inter-professional communication, clinical support and patient evacuation.MethodsIn collaboration with the territorial government and regional health authority partners, we developed a 21-item self-administered questionnaire survey, which could be completed online. The survey was sent to 218 physicians and nurses who were employed in the Northwest Territories (NWT) at the time of the survey and were involved in sending patients out of the community and/or receiving patients. The survey also contained an open-ended question at the end seeking comments regarding primary health care.ResultsThe overall low response rate of 39% among nurses and 19% among physicians threatens the validity of the quantitative results. The majority of providers were satisfied with their ability to communicate with other providers in a timely manner, their freedom to make clinical decisions and their overall experience practicing in the NWT. The patient transfer system appears to work from both the sender and receiver perspectives. However, a common theme reported by nurses was that physicians providing clinical advice, especially short-term locums, were not familiar with the local situation, whilst physicians at the receiving end remarked that the clinical information provided to them often lacked clarity.ConclusionsImportant lessons were learnt from the pilot study, especially in better engagement of providers in planning and dissemination. The questionnaire design and the online method of delivery were acceptable. Although important issues were identified, a larger definitive survey is needed to investigate them in the future.

Project description:Background: Each year, 13-26 million newborn babies require help to breathe at birth. Healthcare professionals (HCPs) who provide neonatal resuscitative care must be frequently evaluated to maintain and improve the quality of healthcare delivered. While simulation-based competence assessment is preferred, resource constraints hinder uptake. We aimed to examine if the RETAIN simulation-based boardgame can be used to assess HCPs' neonatal resuscitation knowledge. Method: Twenty neonatal HCPs (19 females) from the Royal Alexandra Hospital (Edmonton, Canada) were recruited. First, they completed an open-answer written test of one neonatal resuscitation scenario. Then, they completed one neonatal resuscitation scenario of difficulty comparable to that of the open-answer written test, but this time using the RETAIN board game. In the RETAIN board game (https://playretain.com, RETAIN Labs Medical Inc, Edmonton, Canada), players perform simulated neonatal resuscitation scenarios based on real-life cases, using action cards, and equipment pieces. Sessions were video-recorded and scored using Neonatal Resuscitation Program 2015 guidelines. Data are reported as mean (standard deviation) for normally distributed continuous variables, and as median (interquartile range) for non-normal continuous variables. Results: Participants consisted of the following HCPs: 8 nurses, 4 respiratory therapists, 4 nurse practitioners, and 4 neonatal fellows with median (IQR) 10.5(3-17) years of clinical experience. Overall mean (SD) Open-answer test and Game Performance was 8.6(2.1) out of 16 possible points (53%) and 29(3.2) out of 40 possible points (74%), respectively. Out of the 10 actions shared between the open-answer test and game scenario, performance on the open-answer test was mean (SD) 7.2(1.3) (72%) and game performance was mean (SD) 8.8(1.4) (88%) (V = 17, p < 0.01). Conclusion: RETAIN may provide an enjoyable and standardized alternative toward summative assessment of neonatal resuscitation providers. RETAIN may be used to improve more frequent and ubiquitous uptake of simulation-based competence assessment in healthcare settings.

Dataset Information

Simulation-Based Assessment of Critical Care "Front-Line" Providers.

Publications

Simulation-Based Assessment of Critical Care "Front-Line" Providers.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets