Predictive factors of success at the French National Ranking Examination (NRE): a retrospective study of the student performance from a French medical school.
Ontology highlight
ABSTRACT:
SUBMITTER: Lhuaire M
PROVIDER: S-EPMC6925837 | biostudies-literature | 2019 Dec
REPOSITORIES: biostudies-literature
Publications
Predictive factors of success at the French National Ranking Examination (NRE): a retrospective study of the student performance from a French medical school.
Lhuaire Martin M Dramé Moustapha M Hivelin Mikael M Levasseur Thomas T Maestraggi Quentin Q Hunsinger Vincent V Abrahams Peter P Lantieri Laurent L Sommacale Daniele D
BMC medical education 20191221 1
<h4>Background</h4>The national ranking examination (NRE) marks the end of the second cycle (6th university year) of French medical studies and ranks students allowing them to choose their specialty and city of residency. We studied the potential predictive factors of success at the 2015 NRE by students attending a French School of Medicine.<h4>Methods</h4>From March 2016 to March 2017, a retrospective study of factors associated with the 2015 NRE success was conducted and enrolled 242 students ...[more]
Similar Datasets
Project description:PurposeObjective structured clinical examinations (OSCE) evaluate clinical reasoning, communication skills, and interpersonal behavior during medical education. In France, clinical training has long relied on bedside clinical practice in academic hospitals. The need for a simulated teaching environment has recently emerged, due to the increasing number of students admitted to medical schools, and the necessity of objectively evaluating practical skills. This study aimed at investigating the relationships between OSCE grades and current evaluation modalities.MethodsThree-hundred seventy-nine 4th-year students of University-of-Paris Medical School participated to the first large-scale OSCE at this institution, consisting in three OSCE stations (OSCE#1-3). OSCE#1 and #2 focused on cardiovascular clinical skills and competence, whereas OSCE#3 focused on relational skills while providing explanations before planned cholecystectomy. We investigated correlations of OSCE grades with multiple choice (MCQ)-based written examinations and evaluations of clinical skills and behavior (during hospital traineeships); OSCE grade distribution; and the impact of integrating OSCE grades into the current evaluation in terms of student ranking.ResultsThe competence-oriented OSCE#1 and OSCE#2 grades correlated only with MCQ grades (r = 0.19, P<0.001) or traineeship skill grades (r = 0.17, P = 0.001), respectively, and not with traineeship behavior grades (P>0.75). Conversely, the behavior-oriented OSCE#3 grades correlated with traineeship skill and behavior grades (r = 0.19, P<0.001, and r = 0.12, P = 0.032), but not with MCQ grades (P = 0.09). The dispersion of OSCE grades was wider than for MCQ examinations (P<0.001). When OSCE grades were integrated to the final fourth-year grade with an incremental 10%, 20% or 40% coefficient, an increasing proportion of the 379 students had a ranking variation by ±50 ranks (P<0.001). This ranking change mainly affected students among the mid-50% of ranking.ConclusionThis large-scale French experience showed that OSCE designed to assess a combination of clinical competence and behavioral skills, increases the discriminatory capacity of current evaluations modalities in French medical schools.
| S-EPMC7808634 | biostudies-literature
Project description:The acceptance of students to a medical school places a considerable emphasis on performance in standardized tests and undergraduate grade point average (uGPA). Traditionally, applicants may be judged as a homogeneous population according to simple quantitative thresholds that implicitly assume a linear relationship between scores and academic success. This 'one-size-fits-all' approach ignores the notion that individuals may show distinct patterns of achievement and follow diverse paths to success. In this study, we examined a dataset composed of 53 variables extracted from the admissions application records of 1,088 students matriculating to NYU School of Medicine between the years 2006-2014. We defined training and test groups and applied K-means clustering to search for distinct groups of applicants. Building an optimized logistic regression model, we then tested the predictive value of this clustering for estimating the success of applicants in medical school, aggregating eight performance measures during the subsequent medical school training as a success factor. We found evidence for four distinct clusters of students-we termed 'signatures'-which differ most substantially according to the absolute level of the applicant's uGPA and its trajectory over the course of undergraduate education. The 'risers' signature showed a relatively higher uGPA and also steeper trajectory; the other signatures showed each remaining combination of these two main factors: 'improvers' relatively lower uGPA, steeper trajectory; 'solids' higher uGPA, flatter trajectory; 'statics' both lower uGPA and flatter trajectory. Examining the success index across signatures, we found that the risers and the statics have significantly higher and lower likelihood of quantifiable success in medical school, respectively. We also found that each signature has a unique set of features that correlate with its success in medical school. The big data approach presented here can more sensitively uncover success potential since it takes into account the inherent heterogeneity within the student population.
| S-EPMC6961867 | biostudies-literature
Project description:Although medical school programs oriented toward postgraduate specialty training have the potential to reduce the duration and cost of medical school for US medical students, success depends on the ability of students to predict their postgraduate specialties. It is clear that first-year choices are poorly predictive, but it is not known when predictions become sufficiently reliable to support specialty-oriented learning programs. We therefore examined the predictive value of specialty preferences expressed at the ends of the first, second and third years of medical school and asked whether concurrent expressions of confidence in choices improved predictive ability. We also investigated the possibility that discrepancies between predicted and actual postgraduate specialty training were related to scores on an examination of knowledge in basic biomedical sciences required for US medical school graduation (the United States Medical Licensing Examination (USLME) Step 1 examination).We calculated positive and negative predictive values (PPV and NPV, respectively) for specialty choices and the sensitivity and specificity of asking for choices for 634 University of Colorado School of Medicine students who trained in 23 accredited residencies from 2011 through 2015. We examined the effect of confidence in first choices in 609 students, and in 334 students, sought an association between USMLE Step 1 scores and switching from postgraduate training specialties predicted at the end of year 2.The PPV of first choices improved from years 1 through 3. NPV was high throughout. PPVs of year 3 first choices ranged from 79% in Anesthesiology to 95% in Psychiatry. Expressions of confidence in first choices did not improve PPV. Sensitivity of asking for first choices increased with time; specificity was consistently high. USLME Step 1 scores were higher for students who ultimately trained in specialties more competitive than first-choice specialties at the end of year 2.Specialty-oriented learning programs during medical school must accommodate students who change career plans. The PPV of specialty first choices improves each year, but even year 3 predictions can be inaccurate with potential loss of students from specialty-specific programs. USMLE Step 1 scores appeared to affect career plans expressed at the end of year 2.
| S-EPMC5845137 | biostudies-literature
Project description:Objectives: A potential new avenue to address the shortage of country doctors is to change the rules for admission to medical school. We therefore study the link between high-school grade point average and prospective physicians' choice to work in rural areas. To further inform the discussion about rules for admission, we also study the effects of other predictors: a measure of students' attitudes towards risk; whether they waited for their place of study (Wartesemester); whether their parents worked as medical doctors; and whether they have some practical experience in the medical sector. Methods: We conducted two internet surveys in 2012 and 2014. In the first survey, the sample comprised 701 students and in the second, 474 students. In both surveys, we asked students for their regional preferences; in the 2014 survey, we additionally asked students for their first, second, and third preferences among a comprehensive set of specializations, including becoming a general practitioner. In both surveys, we asked students for basic demographic information (age and gender), their parents' occupation, a measure of subjective income expectations, a measure of risk attitudes, and their high-school grade point average (Abiturnote), and First National Boards Examination grade (Physikum). In 2014, we additionally asked for waiting periods (Wartesemester) as well as for prior professional experience in the health-care sector. Results: We find that three factors increase the probability of having a preference for working in a rural area significantly, holding constant all other influences: having a medical doctor among the parents, having worse grades in the high-school grade point average, and being more risk averse. Moreover, we find that those willing to work in the countryside have significantly more experience in the medical sector before admission to medical school. Discussion: Our results suggest that a change in the selection process for medical school may increase the supply of country doctors. Instead of focusing on the high-school grade point average, universities could even more intensely screen for study motivation through interviews or by taking into account students' background, extracurricular activities, or waiting periods.
| S-EPMC5327662 | biostudies-other
Project description:Attitudes towards conflict of interest (COI) and COI policy are shaped during medical school and influence both the education of medical students and their future medical practice. Understanding the current attitudes of medical students and medical school teaching faculty may provide insight into what is taught about COI and COI policy within the 'hidden' medical curriculum. Differences between medical student and medical school teaching faculty perceptions of COI and COI policy have not been compared in detail. The authors surveyed first year medical students and medical school teaching faculty at one academic medical center.The response rate was 98.7% (150/152) for students and 34.2% (69/202) for faculty. Students were less likely than faculty to agree that lecturers should disclose COI to any learners (4.06 vs. 4.31, p = 0.01), but more likely to agree that COI disclosure decreases the presentation of biased material (3.80 vs. 3.21, p < 0.001). Student and faculty responses for all other questions were not different. Many of these responses suggest student and faculty support for stronger COI policy at academic medical centers.Students and faculty perceptions regarding COI and COI policy are largely similar, but differ in terms of the perceived effectiveness of COI disclosure. This study also suggests that medical students and medical school teaching faculty support for stronger COI policy at academic medical centers.
| S-EPMC5504664 | biostudies-other
Project description:To examine the variability among medical schools in ranking systems used in medical student performance evaluations (MSPEs).The authors reviewed MSPEs from U.S. MD-granting medical schools received by the University of California, Irvine emergency medicine and internal medicine residency programs during 2012-2013 and 2014-2015. They recorded whether the school used a ranking system, the type of ranking system used, the size and description of student categories, the location of the ranking statement and category legend, and whether nonranking schools used language suggestive of rank.Of the 134 medical schools in the study sample, the majority (n = 101; 75%) provided ranks for students in the MSPE. Most of the ranking schools (n = 63; 62%) placed students into named category groups, but the number and size of groups varied. The most common descriptors used for these 63 schools' top, second, third, and lowest groups were "outstanding," "excellent," "very good," and "good," respectively, but each of these terms was used across a broad range of percentile ranks. Student ranks and school category legends were found in various locations. Many of the 33 schools that did not rank students included language suggestive of rank.There is extensive variation in ranking systems used in MSPEs. Program directors may find it difficult to use MSPEs to compare applicants, which may diminish the MSPE's value in the residency application process and negatively affect high-achieving students. A consistent approach to ranking students would benefit program directors, students, and student affairs officers.
| S-EPMC5937982 | biostudies-literature
Project description:Background?The fourth year of medical school has come under recent scrutiny for its lack of structure, cost- and time-effectiveness, and quality of education it provides. Some have advocated for increasing clinical burden in the fourth year, while others have suggested it be abolished.Objective?To assess the relationship between fourth-year course load and success during internship.Methods?We reviewed transcripts of 78 internal medicine interns from 2011-2013 and compared the number of intensive courses (defined as subinternships, intensive care, surgical clerkships, and emergency medicine rotations) with multi-source performance evaluations from the internship. We assessed relative risk (RR) and 95% confidence interval (CI) of achieving excellent scores according to the number of intensive courses taken, using generalized estimating equations, adjusting for demographics, US Medical Licensing Examination (USMLE) Step 1 board scores, and other measures of medical school performance.Results?For each additional intensive course taken, the RR of obtaining an excellent score per intensive course was 1.05 (95% CI 1.03-1.07, P?<?.001), whereas the RR per nonintensive course taken was 0.99 (95% CI 0.98-1.00, P?=?.03). An association of intensive course work with increased risk of excellent performance was seen across multiple clinical competencies, including medical knowledge (RR 1.08, 95% CI 1.04-1.11); patient care (RR 1.07, 95% CI 1.04-1.10); and practice-based learning (RR 1.05, 95% CI 1.03-1.09).Conclusions?For this single institution's cohort of medical interns, increased exposure to intensive course work during the fourth year of medical school was associated with better clinical evaluations during internship.
| S-EPMC5319629 | biostudies-literature
Project description:OBJECTIVES:The UK Clinical Aptitude Test (UKCAT) previously piloted an assessment of 'online confidence', where candidates were asked to indicate how confident they were with their answers. This study examines the relationship between these ratings, the odds of receiving an offer to study medicine and subsequent undergraduate academic performance. DESIGN:National cohort study. SETTING:UK undergraduate medical selection. PARTICIPANTS:56?785 UKCAT candidates who sat the test between 2013 and 2016 and provided valid responses to the online confidence pilot study. PRIMARY OUTCOME MEASURES:Two measures of 'online confidence' were derived: the well-established 'confidence bias', and; a novel 'confidence judgement' measure, developed using Item Response Theory in order to derive a more sophisticated metric of the ability to evaluate one's own performance on a task. Regression models investigated the relationships between these confidence measures, application success and academic performance. RESULTS:Online confidence was inversely related to cognitive performance. Relative underconfidence was associated with increased odds of receiving an offer to study medicine. For 'confidence bias' this effect was independent of potential confounders (OR 1.48, 1.15 to 1.91, p=0.002). While 'confidence judgement' was also a univariable predictor of application success (OR 1.22, 1.01 to 1.47, p=0.04), it was not an independent predictor. 'Confidence bias', but not 'confidence judgement', predicted the odds of passing the first year of university at the first attempt, independently of cognitive performance, with relative underconfidence positively related to academic success (OR 3.24, 1.08 to 9.72, p=0.04). No non-linear effects were observed, suggesting no 'sweet spot' exists in relation to online confidence and the outcomes studied. CONCLUSIONS:Applicants who either appear underconfident, or are better at judging their own performance on a task, are more likely to receive an offer to study medicine. However, online confidence estimates had limited ability to predict subsequent academic achievement. Moreover, there are practical challenges to evaluating online confidence in high-stakes selection.
| S-EPMC6937070 | biostudies-literature
Project description:PurposeXavier University School of Medicine adopted an integrated, organ system-based curriculum in January 2013. The present study was aimed at determining students' perceptions of the integrated curriculum and related assessment methods.MethodsThe study was conducted on first- to fourth-semester undergraduate medical students during March 2014. The students were informed of the study and subsequently invited to participate. Focus group discussions were conducted. The curriculum's level of integration, different courses offered, teaching-learning methods employed, and the advantages and concerns relating to the curriculum were noted. The respondents also provided feedback about the assessment methods used. Deductive content analysis was used to analyze the data.ResultsTwenty-two of the 68 students (32.2%) participated in the study. The respondents expressed generally positive opinions. They felt that the curriculum prepared them well for licensing examinations and future practice. Problem-based learning sessions encouraged active learning and group work among students, thus, improving their understanding of the course material. The respondents felt that certain subjects were allocated a larger proportion of time during the sessions, as well as more questions during the integrated assessment. They also expressed an appreciation for medical humanities, and felt that sessions on the appraisal of literature needed modification. Their opinions about assessment of behavior, attitudes, and professionalism varied.ConclusionStudent opinion was positive, overall. Our findings would be of interest to other medical schools that have recently adopted an integrated curriculum or are in the process of doing so.
| S-EPMC4309931 | biostudies-literature
Project description:In response to the rapidly rising number of asylum applications, student-run asylum clinics (SRACs) designed to provide pro bono forensic medical evaluations have emerged at medical schools across the United States. Distinct from traditional student-run clinics in the services they provide and in their operational models, SRACs face a unique set of challenges. This study aims to identify the common challenges in building SRACs and to collect insights to inform a structured approach to collaborative problem-solving. This study gathered data from online surveys and semi-structured phone interviews with representative medical student SRAC leaders. 14 clinics participated in the 2017 online survey, 15 clinics in the 2018 online survey, and eight clinics in the 2018-2019 phone interviews. We identified common challenges in five areas: volunteer recruitment, clinic operations, case demand, institutional support, and leadership. SRACs stand to benefit from ongoing extramural collaborations to overcome shared challenges.
| S-EPMC7576100 | biostudies-literature