Dataset Information

Interviewers' Experiences with Two Multiple Mini-Interview Scoring Methods Used for Admission to a Master of Physical Therapy Programme.

ABSTRACT: Purpose: To describe participants' attitudes, beliefs, and experiences with the use of two methods of scoring the Multiple Mini-Interview (MMI) for admission to a Master of Physical Therapy program: a rank-based scoring system (RBS; used from 2007 to 2013) and a criterion-based scoring system (CBS; tested in 2014). The MMI uses short independent assessments to obtain an aggregate score of candidates' professionalism and interpersonal skills, based on behavioural questions within scenarios that assess one attribute at a time. Method: This qualitative descriptive inquiry sought to capture the experiences of 18 MMI interviewers primarily through semi-structured interviews. Interviews were transcribed verbatim, and the data were analyzed using thematic analysis. The results were validated by theoretical and investigator triangulation and member checking. Results: One major theme, scoring systems, and two sub-themes, CBS and RBS, emerged across all data. Participants unanimously agreed that CBS is a more fair and objective way to score candidates' interviews. Conclusions: CBS was well accepted by participants, and the majority preferred it over RBS. Participants felt that CBS presented a more accurate depiction of candidates.

SUBMITTER: van der Spuy I

PROVIDER: S-EPMC5125486 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Interviewers' Experiences with Two Multiple Mini-Interview Scoring Methods Used for Admission to a Master of Physical Therapy Programme.

van der Spuy Ina I Busch Angela A Bidonde Julia J

Physiotherapy Canada. Physiotherapie Canada 20160101 2

<b><i>Purpose:</i></b> To describe participants' attitudes, beliefs, and experiences with the use of two methods of scoring the Multiple Mini-Interview (MMI) for admission to a Master of Physical Therapy program: a rank-based scoring system (RBS; used from 2007 to 2013) and a criterion-based scoring system (CBS; tested in 2014). The MMI uses short independent assessments to obtain an aggregate score of candidates' professionalism and interpersonal skills, based on behavioural questions within sc ...[more]

PMID: 27909365

Similar Datasets

Project description:To compare the short-term and long-term effectiveness of human papillomavirus (HPV) tests in Norwegian Cervical Cancer Screening Programme (NCCSP).Nationwide register-based prospective follow-up study.In 2005, the NCCSP implemented HPV testing in follow-up of unsatisfactory, atypical squamous cells of undetermined significance (ASC-US) and low-grade squamous intraepithelial lesion (LSIL) cytology.19 065 women with repeat cytology and HPV test after unsatisfactory ASC-US or LSIL screening result in 2005-2009.Through individual registry linkages we observed how women were treated in the regular medical care.We estimated cumulative incidence of cervical intraepithelial neoplasia grade 2 or worse (CIN2+) in 6 months and 3 years after repeat cytology and HPV test. Patients diagnosed with CIN2+ in 6 months and 3 years were assessed for initial HPV positivity.5392 had ASC-US/LSIL and 13 673 had normal/unsatisfactory repeat cytology; for HPV detection 4715 used AMPLICOR HPV Test (Roche Diagnostics, Basel, Switzerland), 9162 Hybrid Capture 2 (HC2) High-Risk HPV DNA Test (QIAGEN, Gaithersburg, Maryland, USA) and 5188 PreTect HPV-Proofer (NorChip, Klokkarstua, Norway). Among those with ASC-US/LSIL repeat cytology, 3-year risk of CIN2+ was 15-fold in Amplicor/HC2-positives compared with Amplicor/HC2-negatives and sevenfold in Proofer-positives compared with Proofer-negatives; a 3-year risk of CIN2+ was 2.1% (95% CI 0.7% to 3.4%) in Amplicor-negatives and 7.2% (95% CI 5.4% to 8.9%) in Proofer-negatives. Close to 100% of patients with CIN2+ diagnosed within 6 months tested positive to HPV (all methods). Considering all patients diagnosed with CIN2+ in 3-year follow-up, 97% were initially positive in the Amplicor group and more than 94% in the HC2 group, compared with less than 80% in the Proofer group.While the long-term evaluation of new screening routines showed a good overall performance of triage-HPV DNA testing, the management of HPV-negative women with persistent ASC-US/LSIL was suboptimal.

Project description:BackgroundStandardized patients (SPs) are essential stakeholders in the multiple mini interviews (MMIs) that are increasingly used to assess medical school applicants' interpersonal skills. However, there is little evidence for their inclusion in the development of instruments.ObjectiveThis study aimed to describe the process and evaluate the impact of having SPs co-design and cocreate a global measurement question that assesses medical school applicants' readiness for medical school and acceptance status.MethodsThis study used an exploratory, sequential, and mixed methods study design. First, we evaluated the initial MMI program and determined the next quality improvement steps. Second, we held a collaborative workshop with SPs to codevelop the assessment question and response options. Third, we evaluated the created question and the additional MMI rubric items through statistical tests based on 1084 applicants' data from 3 cohorts of applicants starting in the 2018-2019 academic year. The internal reliability of the MMI was measured using a Cronbach α test, and its prediction of admission status was tested using a forward stepwise binary logistic regression.ResultsProgram evaluation indicated the need for an additional quantitative question to assess applicant readiness for medical school. In total, 3 simulation specialists, 2 researchers, and 21 SPs participated in a workshop leading to a final global assessment question and responses. The Cronbach α's were >0.8 overall and in each cohort year. The final stepwise logistic model for all cohorts combined was statistically significant (P<.001), explained 9.2% (R2) of the variance in acceptance status, and correctly classified 65.5% (637/972) of cases. The final model consisted of 3 variables: empathy, rank of readiness, and opening the encounter.ConclusionsThe collaborative nature of this project between stakeholders, including nonacademics and researchers, was vital for the success of this project. The SP-created question had a significant impact on the final model predicting acceptance to medical school. This finding indicates that SPs bring a critical perspective that can improve the process of evaluating medical school applicants.

Dataset Information

Interviewers' Experiences with Two Multiple Mini-Interview Scoring Methods Used for Admission to a Master of Physical Therapy Programme.

Publications

Interviewers' Experiences with Two Multiple Mini-Interview Scoring Methods Used for Admission to a Master of Physical Therapy Programme.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets