Predictive factors of success at the French National Ranking Examination (NRE): a retrospective study of the student performance from a French medical school.
Ontology highlight
ABSTRACT:
SUBMITTER: Lhuaire M
PROVIDER: S-EPMC6925837 | biostudies-literature | 2019 Dec
REPOSITORIES: biostudies-literature
Publications
Predictive factors of success at the French National Ranking Examination (NRE): a retrospective study of the student performance from a French medical school.
Lhuaire Martin M Dramé Moustapha M Hivelin Mikael M Levasseur Thomas T Maestraggi Quentin Q Hunsinger Vincent V Abrahams Peter P Lantieri Laurent L Sommacale Daniele D
BMC medical education 20191221 1
<h4>Background</h4>The national ranking examination (NRE) marks the end of the second cycle (6th university year) of French medical studies and ranks students allowing them to choose their specialty and city of residency. We studied the potential predictive factors of success at the 2015 NRE by students attending a French School of Medicine.<h4>Methods</h4>From March 2016 to March 2017, a retrospective study of factors associated with the 2015 NRE success was conducted and enrolled 242 students ...[more]
Similar Datasets
Project description:PurposeObjective structured clinical examinations (OSCE) evaluate clinical reasoning, communication skills, and interpersonal behavior during medical education. In France, clinical training has long relied on bedside clinical practice in academic hospitals. The need for a simulated teaching environment has recently emerged, due to the increasing number of students admitted to medical schools, and the necessity of objectively evaluating practical skills. This study aimed at investigating the relationships between OSCE grades and current evaluation modalities.MethodsThree-hundred seventy-nine 4th-year students of University-of-Paris Medical School participated to the first large-scale OSCE at this institution, consisting in three OSCE stations (OSCE#1-3). OSCE#1 and #2 focused on cardiovascular clinical skills and competence, whereas OSCE#3 focused on relational skills while providing explanations before planned cholecystectomy. We investigated correlations of OSCE grades with multiple choice (MCQ)-based written examinations and evaluations of clinical skills and behavior (during hospital traineeships); OSCE grade distribution; and the impact of integrating OSCE grades into the current evaluation in terms of student ranking.ResultsThe competence-oriented OSCE#1 and OSCE#2 grades correlated only with MCQ grades (r = 0.19, P<0.001) or traineeship skill grades (r = 0.17, P = 0.001), respectively, and not with traineeship behavior grades (P>0.75). Conversely, the behavior-oriented OSCE#3 grades correlated with traineeship skill and behavior grades (r = 0.19, P<0.001, and r = 0.12, P = 0.032), but not with MCQ grades (P = 0.09). The dispersion of OSCE grades was wider than for MCQ examinations (P<0.001). When OSCE grades were integrated to the final fourth-year grade with an incremental 10%, 20% or 40% coefficient, an increasing proportion of the 379 students had a ranking variation by ±50 ranks (P<0.001). This ranking change mainly affected students among the mid-50% of ranking.ConclusionThis large-scale French experience showed that OSCE designed to assess a combination of clinical competence and behavioral skills, increases the discriminatory capacity of current evaluations modalities in French medical schools.
| S-EPMC7808634 | biostudies-literature
Project description:The acceptance of students to a medical school places a considerable emphasis on performance in standardized tests and undergraduate grade point average (uGPA). Traditionally, applicants may be judged as a homogeneous population according to simple quantitative thresholds that implicitly assume a linear relationship between scores and academic success. This 'one-size-fits-all' approach ignores the notion that individuals may show distinct patterns of achievement and follow diverse paths to success. In this study, we examined a dataset composed of 53 variables extracted from the admissions application records of 1,088 students matriculating to NYU School of Medicine between the years 2006-2014. We defined training and test groups and applied K-means clustering to search for distinct groups of applicants. Building an optimized logistic regression model, we then tested the predictive value of this clustering for estimating the success of applicants in medical school, aggregating eight performance measures during the subsequent medical school training as a success factor. We found evidence for four distinct clusters of students-we termed 'signatures'-which differ most substantially according to the absolute level of the applicant's uGPA and its trajectory over the course of undergraduate education. The 'risers' signature showed a relatively higher uGPA and also steeper trajectory; the other signatures showed each remaining combination of these two main factors: 'improvers' relatively lower uGPA, steeper trajectory; 'solids' higher uGPA, flatter trajectory; 'statics' both lower uGPA and flatter trajectory. Examining the success index across signatures, we found that the risers and the statics have significantly higher and lower likelihood of quantifiable success in medical school, respectively. We also found that each signature has a unique set of features that correlate with its success in medical school. The big data approach presented here can more sensitively uncover success potential since it takes into account the inherent heterogeneity within the student population.
| S-EPMC6961867 | biostudies-literature
Project description:Objectives: A potential new avenue to address the shortage of country doctors is to change the rules for admission to medical school. We therefore study the link between high-school grade point average and prospective physicians' choice to work in rural areas. To further inform the discussion about rules for admission, we also study the effects of other predictors: a measure of students' attitudes towards risk; whether they waited for their place of study (Wartesemester); whether their parents worked as medical doctors; and whether they have some practical experience in the medical sector. Methods: We conducted two internet surveys in 2012 and 2014. In the first survey, the sample comprised 701 students and in the second, 474 students. In both surveys, we asked students for their regional preferences; in the 2014 survey, we additionally asked students for their first, second, and third preferences among a comprehensive set of specializations, including becoming a general practitioner. In both surveys, we asked students for basic demographic information (age and gender), their parents' occupation, a measure of subjective income expectations, a measure of risk attitudes, and their high-school grade point average (Abiturnote), and First National Boards Examination grade (Physikum). In 2014, we additionally asked for waiting periods (Wartesemester) as well as for prior professional experience in the health-care sector. Results: We find that three factors increase the probability of having a preference for working in a rural area significantly, holding constant all other influences: having a medical doctor among the parents, having worse grades in the high-school grade point average, and being more risk averse. Moreover, we find that those willing to work in the countryside have significantly more experience in the medical sector before admission to medical school. Discussion: Our results suggest that a change in the selection process for medical school may increase the supply of country doctors. Instead of focusing on the high-school grade point average, universities could even more intensely screen for study motivation through interviews or by taking into account students' background, extracurricular activities, or waiting periods.
| S-EPMC5327662 | biostudies-other
Project description:Although medical school programs oriented toward postgraduate specialty training have the potential to reduce the duration and cost of medical school for US medical students, success depends on the ability of students to predict their postgraduate specialties. It is clear that first-year choices are poorly predictive, but it is not known when predictions become sufficiently reliable to support specialty-oriented learning programs. We therefore examined the predictive value of specialty preferences expressed at the ends of the first, second and third years of medical school and asked whether concurrent expressions of confidence in choices improved predictive ability. We also investigated the possibility that discrepancies between predicted and actual postgraduate specialty training were related to scores on an examination of knowledge in basic biomedical sciences required for US medical school graduation (the United States Medical Licensing Examination (USLME) Step 1 examination).We calculated positive and negative predictive values (PPV and NPV, respectively) for specialty choices and the sensitivity and specificity of asking for choices for 634 University of Colorado School of Medicine students who trained in 23 accredited residencies from 2011 through 2015. We examined the effect of confidence in first choices in 609 students, and in 334 students, sought an association between USMLE Step 1 scores and switching from postgraduate training specialties predicted at the end of year 2.The PPV of first choices improved from years 1 through 3. NPV was high throughout. PPVs of year 3 first choices ranged from 79% in Anesthesiology to 95% in Psychiatry. Expressions of confidence in first choices did not improve PPV. Sensitivity of asking for first choices increased with time; specificity was consistently high. USLME Step 1 scores were higher for students who ultimately trained in specialties more competitive than first-choice specialties at the end of year 2.Specialty-oriented learning programs during medical school must accommodate students who change career plans. The PPV of specialty first choices improves each year, but even year 3 predictions can be inaccurate with potential loss of students from specialty-specific programs. USMLE Step 1 scores appeared to affect career plans expressed at the end of year 2.
| S-EPMC5845137 | biostudies-literature
Project description:Attitudes towards conflict of interest (COI) and COI policy are shaped during medical school and influence both the education of medical students and their future medical practice. Understanding the current attitudes of medical students and medical school teaching faculty may provide insight into what is taught about COI and COI policy within the 'hidden' medical curriculum. Differences between medical student and medical school teaching faculty perceptions of COI and COI policy have not been compared in detail. The authors surveyed first year medical students and medical school teaching faculty at one academic medical center.The response rate was 98.7% (150/152) for students and 34.2% (69/202) for faculty. Students were less likely than faculty to agree that lecturers should disclose COI to any learners (4.06 vs. 4.31, p = 0.01), but more likely to agree that COI disclosure decreases the presentation of biased material (3.80 vs. 3.21, p < 0.001). Student and faculty responses for all other questions were not different. Many of these responses suggest student and faculty support for stronger COI policy at academic medical centers.Students and faculty perceptions regarding COI and COI policy are largely similar, but differ in terms of the perceived effectiveness of COI disclosure. This study also suggests that medical students and medical school teaching faculty support for stronger COI policy at academic medical centers.
| S-EPMC5504664 | biostudies-other
Project description:PurposeTo examine the variability among medical schools in ranking systems used in medical student performance evaluations (MSPEs).MethodThe authors reviewed MSPEs from U.S. MD-granting medical schools received by the University of California, Irvine emergency medicine and internal medicine residency programs during 2012-2013 and 2014-2015. They recorded whether the school used a ranking system, the type of ranking system used, the size and description of student categories, the location of the ranking statement and category legend, and whether nonranking schools used language suggestive of rank.ResultsOf the 134 medical schools in the study sample, the majority (n = 101; 75%) provided ranks for students in the MSPE. Most of the ranking schools (n = 63; 62%) placed students into named category groups, but the number and size of groups varied. The most common descriptors used for these 63 schools' top, second, third, and lowest groups were "outstanding," "excellent," "very good," and "good," respectively, but each of these terms was used across a broad range of percentile ranks. Student ranks and school category legends were found in various locations. Many of the 33 schools that did not rank students included language suggestive of rank.ConclusionsThere is extensive variation in ranking systems used in MSPEs. Program directors may find it difficult to use MSPEs to compare applicants, which may diminish the MSPE's value in the residency application process and negatively affect high-achieving students. A consistent approach to ranking students would benefit program directors, students, and student affairs officers.
| S-EPMC5937982 | biostudies-literature
Project description:BackgroundThe fourth year of medical school has come under recent scrutiny for its lack of structure, cost- and time-effectiveness, and quality of education it provides. Some have advocated for increasing clinical burden in the fourth year, while others have suggested it be abolished.ObjectiveTo assess the relationship between fourth-year course load and success during internship.MethodsWe reviewed transcripts of 78 internal medicine interns from 2011-2013 and compared the number of intensive courses (defined as subinternships, intensive care, surgical clerkships, and emergency medicine rotations) with multi-source performance evaluations from the internship. We assessed relative risk (RR) and 95% confidence interval (CI) of achieving excellent scores according to the number of intensive courses taken, using generalized estimating equations, adjusting for demographics, US Medical Licensing Examination (USMLE) Step 1 board scores, and other measures of medical school performance.ResultsFor each additional intensive course taken, the RR of obtaining an excellent score per intensive course was 1.05 (95% CI 1.03-1.07, P < .001), whereas the RR per nonintensive course taken was 0.99 (95% CI 0.98-1.00, P = .03). An association of intensive course work with increased risk of excellent performance was seen across multiple clinical competencies, including medical knowledge (RR 1.08, 95% CI 1.04-1.11); patient care (RR 1.07, 95% CI 1.04-1.10); and practice-based learning (RR 1.05, 95% CI 1.03-1.09).ConclusionsFor this single institution's cohort of medical interns, increased exposure to intensive course work during the fourth year of medical school was associated with better clinical evaluations during internship.
| S-EPMC5319629 | biostudies-literature
Project description:OBJECTIVES:The UK Clinical Aptitude Test (UKCAT) previously piloted an assessment of 'online confidence', where candidates were asked to indicate how confident they were with their answers. This study examines the relationship between these ratings, the odds of receiving an offer to study medicine and subsequent undergraduate academic performance. DESIGN:National cohort study. SETTING:UK undergraduate medical selection. PARTICIPANTS:56?785 UKCAT candidates who sat the test between 2013 and 2016 and provided valid responses to the online confidence pilot study. PRIMARY OUTCOME MEASURES:Two measures of 'online confidence' were derived: the well-established 'confidence bias', and; a novel 'confidence judgement' measure, developed using Item Response Theory in order to derive a more sophisticated metric of the ability to evaluate one's own performance on a task. Regression models investigated the relationships between these confidence measures, application success and academic performance. RESULTS:Online confidence was inversely related to cognitive performance. Relative underconfidence was associated with increased odds of receiving an offer to study medicine. For 'confidence bias' this effect was independent of potential confounders (OR 1.48, 1.15 to 1.91, p=0.002). While 'confidence judgement' was also a univariable predictor of application success (OR 1.22, 1.01 to 1.47, p=0.04), it was not an independent predictor. 'Confidence bias', but not 'confidence judgement', predicted the odds of passing the first year of university at the first attempt, independently of cognitive performance, with relative underconfidence positively related to academic success (OR 3.24, 1.08 to 9.72, p=0.04). No non-linear effects were observed, suggesting no 'sweet spot' exists in relation to online confidence and the outcomes studied. CONCLUSIONS:Applicants who either appear underconfident, or are better at judging their own performance on a task, are more likely to receive an offer to study medicine. However, online confidence estimates had limited ability to predict subsequent academic achievement. Moreover, there are practical challenges to evaluating online confidence in high-stakes selection.
| S-EPMC6937070 | biostudies-literature
Project description:BackgroundFormal education surrounding abortion care during pre-clinical years of medical school is limited and will likely decrease with the overturning of Roe v. Wade. This study describes and evaluates the impact of an original abortion didactic session implemented during the pre-clinical years of medical school.MethodsWe implemented a didactic session at the University of California Irvine outlining abortion epidemiology, pregnancy options counseling, standard abortion care, and the current legislative landscape surrounding abortion. The preclinical session also included an interactive, small group case-based discussion. Pre-session and post-session surveys were obtained to evaluate changes in participants' knowledge and attitudes and to collect feedback for future sessions.Results92 matched pre- and post-session surveys were completed and analyzed (response rate 77%). The majority of the respondents identified themselves as more "pro-choice" compared to "pro-life" on the pre-session survey. Results reflected significantly increased comfort discussing abortion care and significantly increased knowledge about abortion prevalence and techniques after the session. Qualitative feedback was overwhelmingly positive and reflected participants' appreciation for the focus on the medical aspects of abortion care as opposed to an ethical discussion.ConclusionsAbortion education targeted to preclinical medical students can be implemented effectively by a medical student cohort with institutional support.
| S-EPMC10266871 | biostudies-literature
Project description:BACKGROUND:Objective structured clinical examinations (OSCEs) are a useful method to evaluate medical students' performance in the clerkship years. OSCEs are designed to assess skills and knowledge in a standardized clinical setting and through use of a preset standard grading sheet, so that clinical knowledge can be evaluated at a high level and in a reproducible way. OBJECTIVE:This study aimed to present our OSCE assessment tool designed specifically for radiology clerkship medical students, which we called the objective structured radiology examination (OSRE), with the intent to advance the assessment of clerkship medical students by providing an objective, structured, reproducible, and low-cost method to evaluate medical students' radiology knowledge and the reproducibility of this assessment tool. METHODS:We designed 9 different OSRE cases for radiology clerkship classes with participating third- and fourth-year medical students. Each examination comprises 1 to 3 images, a clinical scenario, and structured questions, along with a standardized scoring sheet that allows for an objective and low-cost assessment. Each medical student completed 3 of 9 random examination cases during their rotation. To evaluate for reproducibility of our scoring sheet assessment tool, we used 5 examiners to grade the same students. Reproducibility for each case and consistency for each grader were assessed with a two-way mixed effects intraclass correlation coefficient (ICC). An ICC below 0.4 was deemed poor to fair, an ICC of 0.41 to 0.60 was moderate, an ICC of 0.6 to 0.8 was substantial, and an ICC greater than 0.8 was almost perfect. We also assessed the correlation of scores and the students' clinical experience with a linear regression model and compared mean grades between third- and fourth-year students. RESULTS:A total of 181 students (156 third- and 25 fourth-year students) were included in the study for a full academic year. Moreover, 6 of 9 cases demonstrated average ICCs more than 0.6 (substantial correlation), and the average ICCs ranged from 0.36 to 0.80 (P<.001 for all the cases). The average ICC for each grader was more than 0.60 (substantial correlation). The average grade among the third-year students was 11.9 (SD 4.9), compared with 12.8 (SD 5) among the fourth-year students (P=.005). There was no correlation between clinical experience and OSRE grade (-0.02; P=.48), adjusting for the medical school year. CONCLUSIONS:Our OSRE is a reproducible assessment tool with most of our OSRE cases showing substantial correlation, except for 3 cases. No expertise in radiology is needed to grade these examinations using our scoring sheet. There was no correlation between scores and the clinical experience of the medical students tested.
| S-EPMC7240440 | biostudies-literature