Dataset Information

Validity evidence for the Hamburg multiple mini-interview.

ABSTRACT: Multiple mini-interviews (MMI) become increasingly popular for the selection of medical students. In this work, we examine the validity evidence for the Hamburg MMI.We conducted three follow-up studies for the 2014 cohort of applicants to medical school over the course of two years. We calculated Spearman's rank correlation (?) between MMI results and (1) emotional intelligence measured by the Trait Emotional Intelligence Questionnaire (TEIQue-SF) and the Situational Test of Emotion Management (STEM), (2) supervisors' and practice team members' evaluations of psychosocial competencies and suitability for the medical profession after a one-week 1:1 teaching in a general practice (GP) and (3) objective structured clinical examination (OSCE) scores.There were no significant correlations between MMI results and the TEIQue-SF (??=?.07, p?>?.05) or the STEM (??=?.05, p?>?.05). MMI results could significantly predict GP evaluations of psychosocial competencies (??=?.32, p?

SUBMITTER: Knorr M

PROVIDER: S-EPMC5950198 | biostudies-other | 2018 May

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Validity evidence for the Hamburg multiple mini-interview.

Knorr Mirjana M Schwibbe Anja A Ehrhardt Maren M Lackamp Janina J Zimmermann Stefan S Hampe Wolfgang W

BMC medical education 20180514 1

<h4>Background</h4>Multiple mini-interviews (MMI) become increasingly popular for the selection of medical students. In this work, we examine the validity evidence for the Hamburg MMI.<h4>Methods</h4>We conducted three follow-up studies for the 2014 cohort of applicants to medical school over the course of two years. We calculated Spearman's rank correlation (ρ) between MMI results and (1) emotional intelligence measured by the Trait Emotional Intelligence Questionnaire (TEIQue-SF) and the Situa ...[more]

PMID: 29754583

Similar Datasets

Project description:COVID-19 physical distancing limited many medical schools' abilities to conduct in-person interviews for the 2020 admissions cycle. The University of Toronto (U of T) Temerty Faculty of Medicine was already in the midst of its interview process, with two-thirds of applicants having completed the in-person modified personal interview (MPI). As the university and surrounding region were shut down, the shift was made in the middle of the application cycle to a semisynchronous video-based MPI interview (vMPI) approach. U of T undertook the development, deployment, and evaluation of the 2 approaches mid-admissions cycle. Existing resources and tools were used to create a tailored interview process with the assistance of applicants. The vMPI was similar in content and process to the MPI: a 4-station interview with each station mapped to attributes relevant to medical school success. Instead of live interviews, applicants recorded 5-minute responses to questions for each station using their own hardware. These responses were later assessed by raters asynchronously. Out of 627 applicants, 232 applicants completed the vMPI. Validity evidence was generated for the vMPI and compared with the MPI on the internal structure, relationship to other variables, and consequential validity, including applicant and interviewer acceptability. Overall, the vMPI demonstrated similar reliability and factor structure to the MPI. As with the MPI, applicant performance was predicted by nonacademic screening tools but not academic measures. Applicants' acceptance of the vMPI was positive. Most interviewers found the vMPI to be acceptable and reported confidence in their ratings. Continuing physical distancing concerns will require multiple options for admissions committees to select medical students. The vMPI is an example of a customized approach that schools can implement and may have advantages for selection beyond the COVID-19 pandemic. Future evaluation will examine additional validity evidence for the tool.

Project description:BackgroundStandardized patients (SPs) are essential stakeholders in the multiple mini interviews (MMIs) that are increasingly used to assess medical school applicants' interpersonal skills. However, there is little evidence for their inclusion in the development of instruments.ObjectiveThis study aimed to describe the process and evaluate the impact of having SPs co-design and cocreate a global measurement question that assesses medical school applicants' readiness for medical school and acceptance status.MethodsThis study used an exploratory, sequential, and mixed methods study design. First, we evaluated the initial MMI program and determined the next quality improvement steps. Second, we held a collaborative workshop with SPs to codevelop the assessment question and response options. Third, we evaluated the created question and the additional MMI rubric items through statistical tests based on 1084 applicants' data from 3 cohorts of applicants starting in the 2018-2019 academic year. The internal reliability of the MMI was measured using a Cronbach α test, and its prediction of admission status was tested using a forward stepwise binary logistic regression.ResultsProgram evaluation indicated the need for an additional quantitative question to assess applicant readiness for medical school. In total, 3 simulation specialists, 2 researchers, and 21 SPs participated in a workshop leading to a final global assessment question and responses. The Cronbach α's were >0.8 overall and in each cohort year. The final stepwise logistic model for all cohorts combined was statistically significant (P<.001), explained 9.2% (R2) of the variance in acceptance status, and correctly classified 65.5% (637/972) of cases. The final model consisted of 3 variables: empathy, rank of readiness, and opening the encounter.ConclusionsThe collaborative nature of this project between stakeholders, including nonacademics and researchers, was vital for the success of this project. The SP-created question had a significant impact on the final model predicting acceptance to medical school. This finding indicates that SPs bring a critical perspective that can improve the process of evaluating medical school applicants.

Project description:IntroductionThe Multiple Mini Interview (MMI) demonstrates efficacy and superiority over traditional medical interviews in assessing non-cognitive domains during the recruitment of medical undergraduates. At Universiti Malaysia Sabah (UMS), a five-station MMI was piloted in 2019, featuring a mix of three examiner-driven stations (assessing professionalism, ethics, and motivation to study medicine), and two roleplayer-driven stations (assessing empathy and science communication specifically, and communication skills in general).Methods260 candidates were grouped into two separate geographical groups - urban and suburban/rural. Descriptive analysis, skewness and kurtosis were performed for normality assessment, whereas Cronbach's alpha, McDonald's omega, and Greatest lower bound assessed internal consistency. For validity measures, correlations were calculated between scores for separate stations, overall scores, urban and suburban/rural status. Also, exploratory factor analysis was performed on the five stations as validity measures. Difficulty and discrimination indices were calculated as quality measures. Qualitative analysis was performed on "red flag" comments detailing grossly unsuitable candidates.ResultsRoleplayer-driven stations yielded more red flags than examiner-driven stations. The three examiner-driven stations were significantly and moderately correlated (rho between 0.602 and 0.609, p < 0.001). The Empathy roleplayer-driven station was not correlated with two examiner-driven stations and only weakly correlated with the Ethics examiner-driven and the Science Communication roleplayer-driven station. Factor analysis suggests a three-factor model. The two roleplayer-driven stations stood as independent factors, and the three examiner-driven stations coalescing as one factor provided the best explanatory model. Quality measures suggest all five stations had suitable discriminatory properties (all >0.530), whereas the stations were distributed equally in difficulty index.ConclusionThe UMS MMI has identified specific skillsets that may be in short supply in our incoming medical students. Also, it illustrates the yawning gap between academic knowledge and 'translational' scientific knowledge and communication skills.

Project description:BackgroundMini-fluid challenge is a well tested and effective tool to predict fluid responsiveness under various clinical conditions. However, mini-fluid challenge has never been tested in patients with end-stage liver disease. This study investigated whether infusion of 150 ml albumin 5% can predict fluid responsiveness in cirrhotic patients following liver transplant.MethodsFifty patients receiving living donor liver transplant were included in the analysis. Mini-fluid challenge composed of 150 ml of albumin 5% administered over 1 min in three consecutive 50-ml fluid boluses. An additional 350 ml was then infused at a constant rate over 15 min (for a total of 500 ml). Stroke volume (SV) was measured as the product of the subaortic velocity time integral (VTI) and left ventricular outflow tract (LVOT) area. Fluid responsiveness was defined as an increase in SV by ≥15% after the infusion.ResultsFifty patients were enrolled in the study. Fourteen patients were classified with Child A, 15 patients with Child B, and 21 patients with Child C cirrhosis. Thirty four patients were fluid responders and 16 patients were fluid non-responders. After 150 ml of albumin 5%, the SV increased significantly in our cohort. The area under receiver operating curve (AUROC) was 0.7 (95% confidence interval [CI] 0.5-0.8, P = 0.005). In subgroup analysis, the SV increased significantly after mini fluid challenge in the Child A group (P = 0.017) but not Child B or C groups (P = 0.3 and 0.29, respectively). The AUROC for mini-fluid challenge in the Child A group was 0.86 (95% confidence interval [CI] 0.6-0.9, P = 0.0004), while mini-fluid challenge failed to discriminate between responders and non-responders in Child B and C groups.ConclusionA mini-fluid challenge of 150 ml albumin 5% can predict fluid responsiveness in liver transplant patients with fair sensitivity and specifiicty. Subgroup analyis revealed that minifluid challenge can predict fluid responsiveness in patients with Child A cirrhosis but not patients with Child B or C cirrhosis.Trial registrationNCT03396159 . (Prospective registered). Initial registration date was 10/01/2018.

Dataset Information

Validity evidence for the Hamburg multiple mini-interview.

Publications

Validity evidence for the Hamburg multiple mini-interview.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets