Dataset Information

Adapting the Admissions Interview During COVID-19: A Comparison of In-Person and Video-Based Interview Validity Evidence.

ABSTRACT: COVID-19 physical distancing limited many medical schools' abilities to conduct in-person interviews for the 2020 admissions cycle. The University of Toronto Temerty Faculty of Medicine was already in the midst of its interview process, with two-thirds of applicants having completed the in-person modified personal interview (MPI). As the university and surrounding region was shut down, the shift was made in the middle of the application cycle to a semi-synchronous video-based MPI interview (vMPI) approach. U of T undertook the development, deployment, and evaluation of the 2 approaches mid-admissions cycle. Existing resources and tools were used to create a tailored interview process with the assistance of applicants. The vMPI was similar in content and process to the MPI: a 4-station interview with each station mapped to attributes relevant to medical school success. Instead of live interviews, applicants recorded 5-minute responses to questions for each station using their own hardware. These responses were later assessed by raters asynchronously. Out of 627 applicants, 232 applicants completed the vMPI. Validity evidence was generated for the vMPI and compared to the MPI on the internal structure, relationship to other variables, and consequential validity, including applicant and interviewer acceptability. Overall, the vMPI demonstrated similar reliability and factor structure to the MPI. Like the MPI, applicant performance was predicted by non-academic screening tools but not academic measures. Applicants' acceptability of the vMPI was positive. Most interviewers found the vMPI to be acceptable and reported confidence in their ratings. Continuing physical distancing concerns will require multiple options for admissions committees to select medical students. The vMPI is an example of a customized approach that schools can implement and may have advantages for selection beyond the COVID-19 pandemic. Future evaluation will examine additional validity evidence for the tool.

SUBMITTER: Kulasegaram K

PROVIDER: S-EPMC8779599 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Evidence-based interventions that are being delivered in real-world settings are adapted to enhance the external validity of these interventions. The purpose of this study was to examine multiple intervention adaptations made during pre-implementation, implementation, maintenance, and evolution phases of human immunodeficiency virus HIV prevention technology transfer. We examined two important categories of adaptations -- modifications to key characteristics, such as activities or delivery methods of interventions and reinvention of the interventions including addition and deletion of core elements.Study participants were thirty-four community-based organization staff who were implementing evidence-based interventions in Los Angeles, California. Participants were interviewed twice and interviews were professionally transcribed. Transcriptions were coded by two coders with good inter-rater reliability (kappa coefficient = 0.73). Sixty-two open-ended codes for adaptation activities, which were linked to 229 transcript segments, were categorized as modifications of key characteristics or reinvention.Participants described activities considered modifications to key characteristics and reinvention of evidence-based interventions during pre-implementation, implementation, and maintenance phases. None of the participants reported accessing technical assistance or guidance when reinventing their interventions. Staff executed many of the recommended steps for sound adaptation of these interventions for new populations and settings.Staff reported modifying and reinventing interventions when translating HIV prevention programs into practice. Targeted technical assistance for formative evaluation should be focused on the pre-implementation phase during which frequent modifications occur. Continuous or repeated measurements of fidelity are recommended. Increased technical assistance and guidance are needed to ensure that reinventions are evaluated and consistent with the aims of the original interventions. Providing strategic technical assistance and written guidance can facilitate effective HIV prevention technology transfer of evidence-based interventions.

Project description:BackgroundThe coronavirus disease (COVID-19) pandemic has disrupted medical education for trainees of all levels. Although telesimulation was initially used to train in resource-limited environments, it may be a reasonable alternative for replicating authentic patient experiences for medical students during the COVID-19 pandemic. It is unclear whether a more passive approach through telesimulation training is as effective as traditional in-person simulation training.ObjectiveOur aim was to evaluate the effectiveness of in-person versus remote simulation training on learners' comfort with managing critical care scenarios.MethodsThis was a prospective observational cohort study assessing the impact of an in-person versus remote simulation course on volunteer fourth-year medical students from February to April 2021 at the University of California San Diego School of Medicine. Precourse and postcourse surveys were performed anonymously using an online secure resource.ResultsIn the in-person learners, there was statistically significant improvement in learner comfort across all technical, behavioral, and cognitive domains. In remote learners, there was a trend toward improvement in self-reported comfort across technical and cognitive domains in the telesimulation course. However, the only statistically significant improvement in postcourse surveys of telesimulation learners, compared with baseline, was in running codes. Regardless of the training modality, the students had a positive experience with the critical care simulation course, ranking it, on average, 9.6 out of 10 (9.9 in in-person simulation vs. 9.3 in telesimulation; P = 0.06).ConclusionWe demonstrated that implementation of a telesimulation-based simulation course focusing on critical care cases is feasible and well received by trainees. Although a telesimulation-based simulation course may not be as effective for remote learners as active in-person participants, our study provided evidence that there was still a trend toward improving provider readiness across technical and cognitive domains when approaching critical care cases.

Dataset Information

Adapting the Admissions Interview During COVID-19: A Comparison of In-Person and Video-Based Interview Validity Evidence.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets