Dataset Information

Academic and non-academic predictors of academic performance in medical school: an exploratory cohort study.

ABSTRACT:

Background

Medical schools should also evaluate applicants' non-academic characteristics in the search for successful students and future physicians, but ideal non-academic criteria have not yet been found. We followed two successive generations of medical students at the University of Split School of Medicine (USSM) to assess both academic and non-academic constructs as predictors of academic performance, defined as medical school grade point average (GPA). We also interviewed some of the participants to gain additional insight for future studies.

Methods

We measured study GPA in first and last year, as well as attitudes towards science, motivation, emotional intelligence, self-esteem, and perceived personal incompetence in first year. We also obtained their scores on existing medical school enrollment criteria, the State Graduation Exam (SGE) and high-school GPA. Regression models were constructed for predictors of GPA in the last year of medical school. Four structured pilot interviews were conducted to explore participants' perceptions of necessary traits for medical school and later practice.

Results

Regression analysis showed that only SGE predicted final academic performance in medical school (β=0.35, 95% confidence interval (CI)=0.06-0.64), while none of the non-academic constructs we assessed predicted this outcome of education. The two generations did not significantly differ in any variable except that intrinsic motivation was higher in the generation that enrolled in 2011 (OR=1.47, 95%CI=1.12-1.93, P=0.005).

Discussion

None of the non-academic constructs predicted academic performance in medical school. Their use as selection criteria may not be warranted as they could impact the academic quality of enrolling medical students.

SUBMITTER: Zuljevic MF

PROVIDER: S-EPMC9098375 | biostudies-literature | 2022 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Academic and non-academic predictors of academic performance in medical school: an exploratory cohort study.

Žuljević Marija Franka MF Buljan Ivan I

BMC medical education 20220513 1

<h4>Background</h4>Medical schools should also evaluate applicants' non-academic characteristics in the search for successful students and future physicians, but ideal non-academic criteria have not yet been found. We followed two successive generations of medical students at the University of Split School of Medicine (USSM) to assess both academic and non-academic constructs as predictors of academic performance, defined as medical school grade point average (GPA). We also interviewed some of t ...[more]

PMID: 35562795

Similar Datasets

Project description:OBJECTIVES:Differential attainment in school examinations is one of the barriers to increasing student diversity in medicine. However, studies on the predictive validity of prior academic achievement and educational performance at medical school are contradictory, possibly due to single-site studies or studies which focus only on early years' performance. To address these gaps, we examined the relationship between sociodemographic factors, including school type and average educational performance throughout medical school across a large number of diverse medical programmes. METHODS:This retrospective study analysed data from students who graduated from 33 UK medical schools between 2012 and 2013. We included candidates' demographics, pre-entry grades (adjusted Universities and Colleges Admissions Service tariff scores) preadmission test scores (UK Clinical Aptitude Test (UKCAT) and Graduate Medical School Admissions Test (GAMSAT)) and used the UK Foundation Programme's educational performance measure (EPM) decile as an outcome measure. Logistic regression was used to assess the independent relationship between students' background characteristics and EPM ranking. RESULTS:Students from independent schools had significantly higher mean UKCAT scores (2535.1, SD=209.6) than students from state-funded schools (2506.1, SD=224.0, p<0.001). Similarly, students from independent schools came into medical school with significantly higher mean GAMSAT scores (63.9, SD=6.9) than students from state-funded schools (60.8, SD=7.1, p<0.001). However, students from state-funded schools were almost twice as likely (OR=2.01, 95%?CI 1.49 to 2.73) to finish in the highest rank of the EPM ranking than those who attended independent schools. CONCLUSIONS:This is the first large-scale study to examine directly the relationship between school type and overall performance at medical school. Our findings provide modest supportive evidence that, when students from independent and state schools enter with similar pre-entry grades, once in medical school, students from state-funded schools are likely to outperform students from independent schools. This evidence contributes to discussions around contextualising medical admission.

Project description:ObjectiveQuantify differential attainment by ethnicity in undergraduate medical assessments and evaluate whether institutional efforts to reduce the attainment gap have had impact.DesignObservational cohort study.SettingA single UK MBBS medical programme.ParticipantsPseudonymised data of adults aged ≥18 years enrolled in one of the UK MBBS medical programmes between 2012 and 2018. Ethnicity was self-declared during enrolment as White, Asian, Black, mixed and other.Main outcome measureModule mark (distinction, merit, pass, fail) graded according to a variety of assessments, including single best answer examinations, objective structured clinical examinations and coursework submissions. All modular assessments are graded as a percentage. Logistic regression models were used to calculate relative risk ratio to study the association between ethnicity and attainment gap over a calendar and scholastic year. Models were adjusted for age, gender, social deprivation and scholastic year of study.Results3714 student records were included. In the sample, 2134 students (57%) were non-white. The proportion of non-white students increased from 2007 (49%) to 2018 (70%). Mean age was 18 (IQR 18-21) and 56.6% were females. Higher proportion of non-white students 218 (24.8%) were from more deprived backgrounds versus white 76 (14.8%). Compared with non-white, there were no significant differences in the proportion of students failing assessments. However, white students were more likely to achieve merit (relative risk ratio 1.29 (95% CI 1.08 to 1.45)) or distinction (1.69 (95% CI 1.37 to 2.08)). Differences in attainment gap have remained unchanged over time, and for black students, attainment gap grew between their first and final year of study.ConclusionA similar proportion (97%) of non-white and white students had a passing score, but attainment gap for higher grades persists over years despite widespread efforts in medical schools to diminish the attainment gap linked to ethnicity. Our findings are from a single institution, thus affecting generalisability.

Project description:OBJECTIVES:The UK Clinical Aptitude Test (UKCAT) previously piloted an assessment of 'online confidence', where candidates were asked to indicate how confident they were with their answers. This study examines the relationship between these ratings, the odds of receiving an offer to study medicine and subsequent undergraduate academic performance. DESIGN:National cohort study. SETTING:UK undergraduate medical selection. PARTICIPANTS:56?785 UKCAT candidates who sat the test between 2013 and 2016 and provided valid responses to the online confidence pilot study. PRIMARY OUTCOME MEASURES:Two measures of 'online confidence' were derived: the well-established 'confidence bias', and; a novel 'confidence judgement' measure, developed using Item Response Theory in order to derive a more sophisticated metric of the ability to evaluate one's own performance on a task. Regression models investigated the relationships between these confidence measures, application success and academic performance. RESULTS:Online confidence was inversely related to cognitive performance. Relative underconfidence was associated with increased odds of receiving an offer to study medicine. For 'confidence bias' this effect was independent of potential confounders (OR 1.48, 1.15 to 1.91, p=0.002). While 'confidence judgement' was also a univariable predictor of application success (OR 1.22, 1.01 to 1.47, p=0.04), it was not an independent predictor. 'Confidence bias', but not 'confidence judgement', predicted the odds of passing the first year of university at the first attempt, independently of cognitive performance, with relative underconfidence positively related to academic success (OR 3.24, 1.08 to 9.72, p=0.04). No non-linear effects were observed, suggesting no 'sweet spot' exists in relation to online confidence and the outcomes studied. CONCLUSIONS:Applicants who either appear underconfident, or are better at judging their own performance on a task, are more likely to receive an offer to study medicine. However, online confidence estimates had limited ability to predict subsequent academic achievement. Moreover, there are practical challenges to evaluating online confidence in high-stakes selection.

Project description:BackgroundAlthough used widely, there is limited evidence of the BioMedical Admissions Test's (BMAT) predictive validity and incremental validity over prior educational attainment (PEA). We investigated BMAT's predictive and incremental validity for performance in two undergraduate medical schools, Imperial College School of Medicine (ICSM), UK, and Lee Kong Chian School of Medicine (LKCMedicine), Singapore. Our secondary goal was to compare the evidence collected with published evidence relating to comparable tools.MethodsThis was a retrospective cohort study of four ICSM (1188 students, entering 2010-2013) and three LKCMedicine cohorts (222 students, 2013-2015). We investigated associations between BMAT Section 1 ('Thinking Skills'), Section 2 ('Scientific Knowledge and Applications') and Section 3a ('Writing Task') scores, with written and clinical assessment performance across all programme years. Incremental validity was investigated over PEA (A-levels) in a subset of ICSM students.ResultsWhen BMAT sections were investigated independently, Section 2 scores predicted performance on all written assessments in both institutions with mainly small effect sizes (standardised coefficient ranges: ICSM: 0.08-0.19; LKCMedicine: 0.22-0.36). Section 1 scores predicted Years 5 and 6 written assessment performance at ICSM (0.09-0.14) but nothing at LKCMedicine. Section 3a scores only predicted Year 5 clinical assessment performance at ICSM with a coefficient <0.1. There were no positive associations with standardised coefficients >0.1 between BMAT performance and clinical assessment performance. Multivariable regressions confirmed that Section 2 scores were the most predictive. We found no clear evidence of incremental validity for any BMAT section scores over A-level grades.DiscussionSchools who wish to assess scientific knowledge independently of A-levels may find BMAT Section 2 useful. Comparison with previous studies indicates that, overall, BMAT seems less useful than comparable tools. Larger scale studies are needed. Broader questions regarding why institutions adopt certain admissions tests, including those with little evidence, need consideration.

Project description:BackgroundWhether graduate entrants to medical school perform better academically than undergraduate entrants remains controversial. Differences in the discipline backgrounds of graduates may, at least in part, have accounted for differences in the results of comparative studies reported to date. This study aimed to address the dual issues of whether academic performance and progression rates were different between GE and UG students and the extent to which the discipline background of GE students may underpin any differences observed.MethodsRelative academic performance as well as indicators of student progression (supplementary examinations, repeat years, leave of absence, withdrawal from the programme) were compared between graduate entrants (GE) (N = 410) and both school leaver entrants (SLE) (N = 865) and non-standard entrants (some prior tertiary education) (NSE) (N = 148) who combined for the final 4 yr. of a 6 yr. MBBS undergraduate programme in 8 consecutive cohorts from 2006 to 2013 in Western Australia.ResultsExamination scores were generally at or very close to a distinction grade or higher across all groups. Higher mean examination scores were seen for GE versus both SLE and NSE in the first 2 years with no significant differences in the final 2 years. GE from biological science / science backgrounds (N = 241) or physical science backgrounds (N = 26) performed the same as SLE and NSE throughout the programme. GE with a health / allied health background (N = 91), however, performed better throughout. They also performed better when compared to their GE counterparts from a humanities (N = 32) or a biological science / science background. GE had increased odds of withdrawing when compared to SLE (OR 2.50, 95% CI 1.30, 4.79, P = 0.006), but not compared to NSE. NSE had increased odds of repeating at least one level when compared to either GE (OR 2.74, 95% CI 1.21, 6.21, P = 0.016) or SLE (OR 4.10, 95% CI 1.93, 8.70, P < 0.001). There were no differences by entry category in the odds of sitting at least one supplementary examination during the programme. There was an increase in the odds of taking at least one leave of absence in both SLE (OR 2.55, 95% CI 1.79, 3.63, P < 0.001) and NSE (OR 2.47, 95% CI 1.50, 4.07, P < 0.001) compared to GE.ConclusionsBetter academic performance by GE compared to SLE and NSE was predominantly due to higher scores for GE with a health / allied health background. GE were also less likely to have impeded progress during the course.

Project description:PurposeDuring their early years at medical school, students repeatedly criticize their workload, time constraints and test associated stress. At the same time, depressiveness and anxiety among first and second year medical students are on the rise. We therefore hypothesized that test anxiety may be related to depressiveness and considered cognitive and academic performances as confounders for the former and psychosocial distress for the latter.MethodsA whole class of 200 second year students was invited to participate in the study. Anxiety as a trait, depressiveness, crystallized intelligence, verbal fluency and psychosocial distress were assessed using validated tests and questionnaires. Acute state anxiety and sympathetic stress parameters were measured in real life situations immediately before an oral and a written exam and paired tests were used to compare the individual anxieties at the various time points. Previous academic performances were self-reported, the results of the impending exams were monitored. Finally, correlations were performed to test for interrelatedness between academic performances and the various personal, cognitive and psychosocial factors.ResultsAcute test anxiety did not correlate with depressiveness nor did it correlate with previous nor impending academic performances nor any of the expected confounders on academic performance. However both, depressiveness and test anxiety strongly correlated with the perceived imbalance between efforts spent and rewards received. Moreover, anxiety as a trait not only correlated with acute state anxiety before an exam but was also significantly correlated to the feeling of over-commitment.ConclusionDepressiveness during the early years of medical school seems unrelated to test anxiety and academic performance. Instead, it strongly correlated with the psychosocial distress emanating from attending medical school and points at a perceived imbalance between efforts spent and rewards received.

Dataset Information

Academic and non-academic predictors of academic performance in medical school: an exploratory cohort study.

Background

Methods

Results

Discussion

Publications

Academic and non-academic predictors of academic performance in medical school: an exploratory cohort study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets