Dataset Information

A Novel Scenario-Based Interview Tool to Evaluate Nontechnical Skills and Competencies in Global Health Delivery.

ABSTRACT:

Background?

Despite rapid growth in the number of physicians and academic institutions entering the field of global health, there are few tools that inform global health curricula and assess physician readiness for this field.

Objective?

To address this gap, we describe the development and pilot testing of a new tool to assess nontechnical competencies and values in global health. Competencies assessed include systems-based practice, interpersonal and cross-cultural communication, professionalism and self-care, patient care, mentoring, teaching, management, and personal motivation and experience.

Methods?

The Global Health Delivery Competency Assessment Tool presents 15 case vignettes and open-ended questions related to situations a global health practitioner might encounter, and grades the quality of responses on a 6-point ordinal scale. We interviewed 17 of 18 possible global health residents (94%), matched with 17 residents not training in global health, for a total of 34 interviews. A second reviewer independently scored recordings of 13 interviews for reliability.

Results?

Pilot testing indicated a high degree of discriminant validity, as measured by the instrument's ability to distinguish between residents who were and were not enrolled in a global health program (P?Conclusions?The tool has potential applicability to a variety of academic and programmatic activities, including evaluation of candidates for global health positions and evaluating the success of training programs in equipping practitioners for entry into this field.

SUBMITTER: Wroe EB

PROVIDER: S-EPMC5559242 | biostudies-literature | 2017 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Novel Scenario-Based Interview Tool to Evaluate Nontechnical Skills and Competencies in Global Health Delivery.

Wroe Emily B EB McBain Ryan K RK Michaelis Annie A Dunbar Elizabeth L EL Hirschhorn Lisa R LR Cancedda Corrado C

Journal of graduate medical education 20170801 4

<h4>Background</h4>Despite rapid growth in the number of physicians and academic institutions entering the field of global health, there are few tools that inform global health curricula and assess physician readiness for this field.<h4>Objective</h4>To address this gap, we describe the development and pilot testing of a new tool to assess nontechnical competencies and values in global health. Competencies assessed include systems-based practice, interpersonal and cross-cultural communication, p ...[more]

PMID: 28824760

Similar Datasets

Project description:BackgroundAlthough battlefield first aid (BFA) training shares many common features with civilian training, such as the need to address technical skills and nontechnical skills (NTSs), it is more highly scenario-dependent. Studies into extended reality show clear benefits in medical training; however, the training effects of extended reality on NTSs, including teamwork and decision-making in BFA, have not been fully proven.ObjectiveThe current study aimed to create and test a scenario-based, mixed-reality platform suitable for training NTSs in BFA.MethodsFirst, using next-generation modeling technology and an animation synchronization system, a 10-person offensive battle drill was established. Decision-making training software addressing basic principles of tactical combat casualty care was constructed and integrated into the scenarios with Unreal Engine 4 (Epic Games). Large-space teamwork and virtual interaction systems that made sense in the proposed platform were developed. Unreal Engine 4 and software engineering technology were used to combine modules to establish a mixed-reality BFA training platform. A total of 20 Grade 4 medical students were recruited to accept BFA training with the platform. Pretraining and posttraining tests were carried out in 2 forms to evaluate the training effectiveness: one was knowledge acquisition regarding the NTS and the other was a real-world, scenario-based test. In addition, the students were asked to rate their agreement with a series of survey items on a 5-point Likert scale.ResultsA battlefield geographic environment, tactical scenarios, scenario-based decision software, large-space teamwork, and virtual interaction system modules were successfully developed and combined to establish the mixed-reality training platform for BFA. The posttraining score of the students' knowledge acquisition was significantly higher than that of pretraining (t=-12.114; P≤.001). Furthermore, the NTS score and the total score that the students obtained in the real-world test were significantly higher than those before training (t=-17.756 and t=-21.354, respectively; P≤.001). However, there was no significant difference between the scores of technical skills that the students obtained before and after training. A posttraining survey revealed that the students found the platform helpful in improving NTSs for BFA, and they were confident in applying BFA skills after training. However, most trainees thought that the platform was not helpful for improving the technical skills of BFA, and 45% (9/20) of the trainees were not satisfied with the simulation effect.ConclusionsA scenario-based, mixed-reality platform was constructed in this study. In this platform, interaction of the movement of multiple players in a large space and the interaction of decision-making by the trainees between the real world and the virtual world were accomplished. The platform could improve the NTSs of BFA. Future works, including improvement of the simulation effects and development of a training platform that could effectively improve both the technical skills and NTSs of BFA, will be carried out.

Project description:IntroductionHealthcare data analytics is a methodological approach to the systematic analysis of health data, and it provides opportunities for healthcare professionals to improve health system management, patient engagement, budgeting, planning and performing evidence-based decision-making. Literature suggests that certain skills and/or competencies for health professionals working with big data in health care would be required. A review of the skills and competencies in health data analytics required by health professionals is needed to support the development or re-engineering of curriculum for health professionals to ensure they develop the abilities to make evidence-based decisions that ultimately can lead to the effective and efficient functioning of a healthcare system.MethodsUsing Arksey and O'Malley's framework, this study will review literature published in English from January 2012 to December 2022. The database search includes Academic Search Complete, CINAHL, and MEDLINE via EBSCOhost, PubMed, Science Direct, Scopus, and Taylor and Francis. The reference lists of key studies will be searched to identify additional appropriate studies to include. The review will be conducted using an inclusion and exclusion criteria. Iterative processes will be involved at the various stages of search strategy piloting, screening and data extraction. Articles will be reviewed through a two-step process (title and abstract, and full-text review) by at least two reviewers. Data will be described quantitatively and/or qualitatively and presented in diagrams and tables.Ethics and disseminationEthical clearance has been received, and strict protocol measures will be followed to ensure the data reported is of quality and relevant to the review purpose. The results will be disseminated through a peer-reviewed scientific journal, presentation at national and/or international conferences, and other platforms such as social media (eg, LinkedIn, Twitter), and relevant stakeholders.

Project description:BackgroundEffective communication is a crucial component of radiology resident training, and many different aspects need to be explored when teaching and evaluating communication skills. To ensure that radiology residents' communication skill levels can be measured accurately, a standardized evaluation tool has been introduced. In twenty hospitals in Beijing, simulation videos have been developed as a way to assess the communication skills of radiology residents during their certification exams, to minimize evaluating biases. This study aims to assess the performance of a simulation video model in evaluating communications skills compared to the standard patient model.MethodsThis is a retrospective observational study. The performance of standard patient and simulation video models was evaluated through an eight-year examination of communication skills in radiology residents. From 2014 to 2021, communications skill tests were administered to 1003 radiology residents in 20 hospitals in Beijing. The standardized patient (SP) model was applied in 2014, and simulation videos were used from 2015 to 2021. The difficulty and discrimination radio of the tests were evaluated. The subjective survey for candidates on two models of communication skills evaluation was performed and analyzed.ResultsThe simulation video model evaluation demonstrated stable difficulty (ranging from 0.92 to 0.98) and discrimination ratio (ranging from 0.37 to 0.49), except for minor exceptions of discrimination in 2019 (0.58) and 2020 (0.20). Furthermore, the Kruskal-Wallis H test revealed no significant differences in average scores between 2016 (93.9 ± 4.6) and 2018 (94.5 ± 4.2), 2016 and 2019 (97.3 ± 3.9), 2017 (97.0 ± 5.6) and 2019, 2017 and 2020 (97.7 ± 4.7), as well as 2019 and 2020 exams (all p ≥ 0.05). In addition, candidates who responded to the survey preferred the simulation video model (with a 77.2% response rate), with 62.7% choosing it over the SP model for communication skills evaluation.ConclusionThe simulation video demonstrated a stable and better acceptable construct for assessing radiology residents' communication skills.

Dataset Information

A Novel Scenario-Based Interview Tool to Evaluate Nontechnical Skills and Competencies in Global Health Delivery.

Background?

Objective?

Methods?

Results?

Publications

A Novel Scenario-Based Interview Tool to Evaluate Nontechnical Skills and Competencies in Global Health Delivery.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets