Validity evidence for the Hamburg multiple mini-interview.
Ontology highlight
ABSTRACT:
SUBMITTER: Knorr M
PROVIDER: S-EPMC5950198 | biostudies-other | 2018 May
REPOSITORIES: biostudies-other
Publications
Validity evidence for the Hamburg multiple mini-interview.
Knorr Mirjana M Schwibbe Anja A Ehrhardt Maren M Lackamp Janina J Zimmermann Stefan S Hampe Wolfgang W
BMC medical education 20180514 1
<h4>Background</h4>Multiple mini-interviews (MMI) become increasingly popular for the selection of medical students. In this work, we examine the validity evidence for the Hamburg MMI.<h4>Methods</h4>We conducted three follow-up studies for the 2014 cohort of applicants to medical school over the course of two years. We calculated Spearman's rank correlation (ρ) between MMI results and (1) emotional intelligence measured by the Trait Emotional Intelligence Questionnaire (TEIQue-SF) and the Situa ...[more]
Similar Datasets
Project description:COVID-19 physical distancing limited many medical schools' abilities to conduct in-person interviews for the 2020 admissions cycle. The University of Toronto Temerty Faculty of Medicine was already in the midst of its interview process, with two-thirds of applicants having completed the in-person modified personal interview (MPI). As the university and surrounding region was shut down, the shift was made in the middle of the application cycle to a semi-synchronous video-based MPI interview (vMPI) approach. U of T undertook the development, deployment, and evaluation of the 2 approaches mid-admissions cycle. Existing resources and tools were used to create a tailored interview process with the assistance of applicants. The vMPI was similar in content and process to the MPI: a 4-station interview with each station mapped to attributes relevant to medical school success. Instead of live interviews, applicants recorded 5-minute responses to questions for each station using their own hardware. These responses were later assessed by raters asynchronously. Out of 627 applicants, 232 applicants completed the vMPI. Validity evidence was generated for the vMPI and compared to the MPI on the internal structure, relationship to other variables, and consequential validity, including applicant and interviewer acceptability. Overall, the vMPI demonstrated similar reliability and factor structure to the MPI. Like the MPI, applicant performance was predicted by non-academic screening tools but not academic measures. Applicants' acceptability of the vMPI was positive. Most interviewers found the vMPI to be acceptable and reported confidence in their ratings. Continuing physical distancing concerns will require multiple options for admissions committees to select medical students. The vMPI is an example of a customized approach that schools can implement and may have advantages for selection beyond the COVID-19 pandemic. Future evaluation will examine additional validity evidence for the tool.
| S-EPMC8779599 | biostudies-literature
Project description:The syndrome of anabolic-androgenic steroid (AAS) dependence, though well recognized, remains poorly studied. In this preliminary psychometric study, American and British investigators separately administered a structured diagnostic interview module, based on recently proposed criteria for AAS dependence, to 42 male AAS users in Middlesbrough, England. Another investigator, blinded to the diagnostic interview findings, assessed self-reported symptoms of "muscle-dysmorphia"; effects of AAS on various aspects of functioning; and maximum proportion of annual income spent on AAS. We also assessed demographic measures, history of other substance use, and performance on a hypothetical AAS-purchasing task. The interview module yielded very good interrater reliability (kappa = 0.76 and overall intraclass correlation = 0.79) and strong internal consistency (Cronbach's alpha = 0.77-0.87). Men diagnosed as AAS-dependent, when compared to nondependent men, reported significantly earlier onset of AAS use, longer duration and higher maximum doses of AAS used, more frequent use of other performance-enhancing drugs, and a somewhat larger maximum percentage of income spent on AAS. Dependent users also "bought" more AAS in the hypothetical purchase task, but rated significantly more negatively the effects of AAS on their mental health-findings all suggesting that the diagnosis of AAS dependence shows construct validity. As a group, AAS users showed high preoccupation with muscular appearance, but dependence per se was not significantly associated with this measure-suggesting that the diagnosis of AAS dependence shows some evidence of discriminant validity. Collectively, these findings suggest that AAS dependence may be diagnosed reliably, with preliminary evidence for construct and discriminant validity.
| S-EPMC2913447 | biostudies-literature
Project description:BACKGROUND: There is a need for psychiatric assessment instruments that enable reliable diagnoses in persons with hearing loss who have sign language as their primary language. The objective of this study was to assess the validity of the Norwegian Sign Language (NSL) version of the Mini International Neuropsychiatric Interview (MINI). METHODS: The MINI was translated into NSL. Forty-one signing patients consecutively referred to two specialised psychiatric units were assessed with a diagnostic interview by clinical experts and with the MINI. Inter-rater reliability was assessed with Cohen's kappa and "observed agreement". RESULTS: There was 65% agreement between MINI diagnoses and clinical expert diagnoses. Kappa values indicated fair to moderate agreement, and observed agreement was above 76% for all diagnoses. The MINI diagnosed more co-morbid conditions than did the clinical expert interview (mean diagnoses: 1.9 versus 1.2). Kappa values indicated moderate to substantial agreement, and "observed agreement" was above 88%. CONCLUSION: The NSL version performs similarly to other MINI versions and demonstrates adequate reliability and validity as a diagnostic instrument for assessing mental disorders in persons who have sign language as their primary and preferred language.
| S-EPMC4060880 | biostudies-other
Project description:Purpose: To describe participants' attitudes, beliefs, and experiences with the use of two methods of scoring the Multiple Mini-Interview (MMI) for admission to a Master of Physical Therapy program: a rank-based scoring system (RBS; used from 2007 to 2013) and a criterion-based scoring system (CBS; tested in 2014). The MMI uses short independent assessments to obtain an aggregate score of candidates' professionalism and interpersonal skills, based on behavioural questions within scenarios that assess one attribute at a time. Method: This qualitative descriptive inquiry sought to capture the experiences of 18 MMI interviewers primarily through semi-structured interviews. Interviews were transcribed verbatim, and the data were analyzed using thematic analysis. The results were validated by theoretical and investigator triangulation and member checking. Results: One major theme, scoring systems, and two sub-themes, CBS and RBS, emerged across all data. Participants unanimously agreed that CBS is a more fair and objective way to score candidates' interviews. Conclusions: CBS was well accepted by participants, and the majority preferred it over RBS. Participants felt that CBS presented a more accurate depiction of candidates.
| S-EPMC5125486 | biostudies-literature
Project description:BackgroundThere is a need for brief screening methods for psychiatric disorders in clinical practice. This study assesses the validity and accuracy of a brief self-report screening questionnaire, the Web Screening Questionnaire (WSQ), in detecting psychiatric disorders in a study group comprising the general population and psychiatric outpatients aged 18 years and older.ObjectiveThe aim of this study was to investigate whether the WSQ is an adequate test to screen for the presence of depressive and anxiety disorders in clinical practice.MethodsParticipants were 1292 adults (1117 subjects from the general population and 175 psychiatric outpatients), aged 18 to 65 years. The discriminant characteristics of the WSQ were examined in relation to the ("gold standard") Mini-International Neuropsychiatric Interview-Plus (MINI-Plus) disorders, by means of sensitivity, specificity, area under the curve (AUC), and positive and negative predictive values (PPVs, NPVs).ResultsThe specificity of the WSQ to individually detect depressive disorders, anxiety disorders, and alcohol abuse or dependence ranged from 0.89 to 0.97 for most disorders, with the exception of post-traumatic stress disorder (0.52) and specific phobia (0.73). The sensitivity values ranged from 0.67 to 1.00, with the exception of depressive disorder (0.56) and alcohol abuse or dependence (0.56). Given the low prevalence of separate disorders in the general population sample, NPVs were extremely high across disorders (?0.97), whereas PPVs were of poor strength (range 0.02-0.33).ConclusionsIn this study group, the WSQ was a relatively good screening tool to identify individuals without a depressive or anxiety disorder, as it accurately identified those unlikely to suffer from these disorders (except for post-traumatic stress disorders and specific phobias). However, in case of a positive WSQ screening result, further diagnostic procedures are required.
| S-EPMC5596296 | biostudies-literature
Project description:IntroductionThe Multiple Mini Interview (MMI) demonstrates efficacy and superiority over traditional medical interviews in assessing non-cognitive domains during the recruitment of medical undergraduates. At Universiti Malaysia Sabah (UMS), a five-station MMI was piloted in 2019, featuring a mix of three examiner-driven stations (assessing professionalism, ethics, and motivation to study medicine), and two roleplayer-driven stations (assessing empathy and science communication specifically, and communication skills in general).Methods260 candidates were grouped into two separate geographical groups - urban and suburban/rural. Descriptive analysis, skewness and kurtosis were performed for normality assessment, whereas Cronbach's alpha, McDonald's omega, and Greatest lower bound assessed internal consistency. For validity measures, correlations were calculated between scores for separate stations, overall scores, urban and suburban/rural status. Also, exploratory factor analysis was performed on the five stations as validity measures. Difficulty and discrimination indices were calculated as quality measures. Qualitative analysis was performed on "red flag" comments detailing grossly unsuitable candidates.ResultsRoleplayer-driven stations yielded more red flags than examiner-driven stations. The three examiner-driven stations were significantly and moderately correlated (rho between 0.602 and 0.609, p < 0.001). The Empathy roleplayer-driven station was not correlated with two examiner-driven stations and only weakly correlated with the Ethics examiner-driven and the Science Communication roleplayer-driven station. Factor analysis suggests a three-factor model. The two roleplayer-driven stations stood as independent factors, and the three examiner-driven stations coalescing as one factor provided the best explanatory model. Quality measures suggest all five stations had suitable discriminatory properties (all >0.530), whereas the stations were distributed equally in difficulty index.ConclusionThe UMS MMI has identified specific skillsets that may be in short supply in our incoming medical students. Also, it illustrates the yawning gap between academic knowledge and 'translational' scientific knowledge and communication skills.
| S-EPMC8606876 | biostudies-literature
Project description:BACKGROUND:Mini-fluid challenge is a well tested and effective tool to predict fluid responsiveness under various clinical conditions. However, mini-fluid challenge has never been tested in patients with end-stage liver disease. This study investigated whether infusion of 150?ml albumin 5% can predict fluid responsiveness in cirrhotic patients following liver transplant. METHODS:Fifty patients receiving living donor liver transplant were included in the analysis. Mini-fluid challenge composed of 150?ml of albumin 5% administered over 1?min in three consecutive 50-ml fluid boluses. An additional 350?ml was then infused at a constant rate over 15?min (for a total of 500?ml). Stroke volume (SV) was measured as the product of the subaortic velocity time integral (VTI) and left ventricular outflow tract (LVOT) area. Fluid responsiveness was defined as an increase in SV by ?15% after the infusion. RESULTS:Fifty patients were enrolled in the study. Fourteen patients were classified with Child A, 15 patients with Child B, and 21 patients with Child C cirrhosis. Thirty four patients were fluid responders and 16 patients were fluid non-responders. After 150?ml of albumin 5%, the SV increased significantly in our cohort. The area under receiver operating curve (AUROC) was 0.7 (95% confidence interval [CI] 0.5-0.8, P =?0.005). In subgroup analysis, the SV increased significantly after mini fluid challenge in the Child A group (P =?0.017) but not Child B or C groups (P =?0.3 and 0.29, respectively). The AUROC for mini-fluid challenge in the Child A group was 0.86 (95% confidence interval [CI] 0.6-0.9, P =?0.0004), while mini-fluid challenge failed to discriminate between responders and non-responders in Child B and C groups. CONCLUSION:A mini-fluid challenge of 150?ml albumin 5% can predict fluid responsiveness in liver transplant patients with fair sensitivity and specifiicty. Subgroup analyis revealed that minifluid challenge can predict fluid responsiveness in patients with Child A cirrhosis but not patients with Child B or C cirrhosis. TRIAL REGISTRATION:NCT03396159 . (Prospective registered). Initial registration date was 10/01/2018.
| S-EPMC6463636 | biostudies-literature
Project description:Across the globe multiple mini interviews (MMIs) have rapidly replaced the use of panel interviews in the selection of medical students and other health professionals. MMIs typically demonstrate better reliability and validity than panel interviews but there is limited research on whether these different types of interview process measure the same or different constructs. Our research aims to ascertain if MMIs are multidimensional or unidimensional, and whether MMIs conducted at different institutions assess the same or different constructs to each other or to panel interviews.Participants were applicants to medical degrees who were shortlisted for interviews at three different institutions in 2013 (n?=?165) and 2014 (n?=?128). Two institutions used a bespoke MMI developed independently from each other and the third used a panel interview. Stations scores and overall (mean) interview scores were examined.Exploratory principal components analysis and confirmatory factor analysis showed similar results in both years' data, supporting a unidimensional model. The two overall MMI scores were more strongly correlated to each other (r?=?.56 and .64 in 2013 and 2014 respectively) than either were to the panel interview scores (r?=?.07 and .15 in 2013; .39 and .48 in 2014).It appears that both MMIs panel interviews tap a single latent construct, but not the same construct. We suggest that the MMI methodology might allow the measurement of an emergent construct such as adaptability.
| S-EPMC6080397 | biostudies-literature
Project description:BACKGROUND:Complicated grief (CG) has been recently included in the DSM-5, under the term "persistent complex bereavement disorder," as a condition requiring further study. To our knowledge, no psychometric data on any structured clinical interview for CG (SCI-CG) is available to date. In this manuscript, we introduce the SCI-CG, a 31-item "SCID-like" clinician-administered instrument to assess the presence of CG symptoms. METHODS:Participants were 281 treatment-seeking adults with CG (77.9% [n = 219] women, mean age = 52.4, standard deviation [SD] = 17.8) who were assessed with the SCI-CG and measures of depression, posttraumatic stress, anxiety, functional impairment. RESULTS:The SCI-CG exhibited satisfactory internal consistency (? = .78), good test-retest reliability (interclass correlation [ICC] 0.68, 95% CI [0.60-0.75]), and excellent interrater reliability (ICC = 0.95, 95% CI [0.89-0.98]). Exploratory factor analyses revealed that a five-factor structure, explaining 50.3% of the total variance, was the best fit for the data. CONCLUSIONS:The clinician-rated SCI-CG demonstrates good internal consistency, reliability, and convergent validity in treatment-seeking individuals with CG and therefore can be a useful tool to assess CG. Although diagnostic criteria for CG have yet to be adequately validated, the SCI-CG may facilitate this process. The SCI-CG can now be used as a validated instrument in research and clinical practice.
| S-EPMC4565180 | biostudies-literature
Project description:The prevalence of depression in patients with chronic obstructive pulmonary disease (COPD) is associated with a worsening of prognosis. Most studies classify COPD patients as depressive or non-depressive based on symptoms, rather than on a diagnosis using specific tools. Thus, the aim of this study was to determine the impact of depression, as diagnosed by the Mini International Neuropsychiatric Interview Plus (MINI), on functional capacity estimated by the 6-minute walk test (6MWT) and unsupported upper-limb exercise test, and quality of life estimated by Saint George's Respiratory Questionnaire (SGRQ), among patients with COPD.Using the MINI as a diagnostic tool, 22.2 % of all patients (6.6 % of all men and 41.6 % of all women) were diagnosed with depression. No significant differences were found between depressive and non-depressive patients with regard to anthropometric measurements, lung function, functional capacity, or quality of life variables. The best models for the dependent variables representing functional capacity and quality of life revealed that the covariates SGRQTOTAL and gender (R(2) = 16.7 %) were significant in explaining the response variable for functional capacity of the upper limbs. Results also showed that age, monthly income, insomnia, and the results of a 6MWT were significant in explaining overall quality of life (R(2) = 46 %), and that the percentage of the predicted forced expiratory volume in the first second post-bronchodilator and gender were significant in explaining walking distance (R(2) = 22 %). Depression, as diagnosed by the MINI, was not significant in explaining any of the dependent variables.Despite a high prevalence of depression in COPD patients, especially in women, depression, as diagnosed by the MINI, was not correlated with functional capacity tests or quality of life in patients with moderate to very severe COPD in the present study. This suggests that depression identified by this diagnostic test may be more accurate than depression diagnosed by tests that evaluate symptoms, as they may be influenced by the perceptions of the patient in relation to their health.
| S-EPMC4743134 | biostudies-literature