Dataset Information

Is the admission test for a course in medicine a good predictor of academic performance? A case-control experience at the school of medicine of Turin.

ABSTRACT: The usefulness of university admission tests to medical schools has been discussed in recent years. In the academic year 2014-15 in Italy, several students who failed the admission test appealed to the regional administrative court ('Tribunale Amministrativo Regionale'-TAR) requesting to be included, despite their test results, and all were admitted to their respective courses. The existence of this population of students generated a control group, in order to evaluate the predictive capacity of the admission test. The aim of the present work is to discuss the ability of university admission tests to predict subsequent academic success.The study involved 683 students who enrolled onto the first year of the degree course in medicine in the academic year 2014-15 at the University of Turin (Molinette and San Luigi Gonzaga colleges). The students were separated into two categories: those who passed the admission test (n1=531) and those who did not pass the admission test but won their appeal in the TAR (n2=152).The validity of the admission test was analysed using specificity, sensitivity, positive and negative likelihood ratios (LH+, LH-), receiver operating characteristic (ROC) curves, area under the ROC curve (AUC), and relative (95% CI).The results showed that the admission test appeared to be a good tool for predicting the academic performances in the first year of the course (AUC=0.70, 95%?CI 0.64 to 0.76). Moreover, some subject areas seemed to have a greater discriminating capacity than others. In general, students who obtained a high score in scientific questions were more likely to obtain the required standards during the first year (LH+ 1.22, 95% CI 1.14 to 1.25).Based on a consistent statistical approach, our study seems to confirm the ability of the admission test to predict academic success in the first year at the school of medicine of Turin.

SUBMITTER: Migliaretti G

PROVIDER: S-EPMC5719312 | biostudies-literature | 2017 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Is the admission test for a course in medicine a good predictor of academic performance? A case-control experience at the school of medicine of Turin.

Migliaretti Giuseppe G Bozzaro Salvatore S Siliquini Roberta R Stura Ilaria I Costa Giuseppe G Cavallo Franco F

BMJ open 20171201 11

<h4>Objectives</h4>The usefulness of university admission tests to medical schools has been discussed in recent years. In the academic year 2014-15 in Italy, several students who failed the admission test appealed to the regional administrative court ('Tribunale Amministrativo Regionale'-TAR) requesting to be included, despite their test results, and all were admitted to their respective courses. The existence of this population of students generated a control group, in order to evaluate the pre ...[more]

PMID: 29196480

Similar Datasets

Project description:BackgroundThe UMAT is widely used for selection into undergraduate medical and dental courses in Australia and New Zealand (NZ). It tests aptitudes thought to be especially relevant to medical studies and consists of 3 sections - logical reasoning and problem solving (UMAT-1), understanding people (UMAT-2) and non-verbal reasoning (UMAT-3). A substantial proportion of all candidates re-sit the UMAT. Re-sitting raises the issue as to what might be the precise magnitude and determinants of any practice effects on the UMAT and their implications for equity in subsequent selection processes.MethodsBetween 2000 and 2012, 158,909 UMAT assessments were completed. From these, 135,833 cases were identified where a candidate had sat once or more during that period with 117,505 cases (86.5%) having sat once, 14,739 having sat twice (10.9%), 2,752 thrice (2%) and 837, 4 or more times (0.6%). Subsequent analyses determined predictors of multiple re-sits as well as the magnitude and socio-demographic determinants of any practice effects.ResultsIncreased likelihood of re-sitting the UMAT twice or more was predicted by being male, of younger age, being from a non-English language speaking background and being from NZ and for Australian candidates, being urban rather than rurally based. For those who sat at least twice, the total UMAT score between a first and second attempt improved by 10.7 ± 0.2 percentiles, UMAT-1 by 8.3 ± 0.2 percentiles, UMAT-2 by 8.3 ± 0.2 percentiles and UMAT-3 by 7.7 ± 0.2 percentiles. An increase in total UMAT percentile score on re-testing was predicted by a lower initial score and being a candidate from NZ rather than from Australia while a decrease was related to increased length of time since initially sitting the test, older age and non-English language background.ConclusionsRe-sitting the UMAT augments performance in each of its components together with the total UMAT percentile score. Whether this increase represents just an improvement in performance or an improvement in understanding of the variables and therefore competence needs to be further defined. If only the former, then practice effects may be introducing inequity in student selection for medical or dental schools in Australia or NZ.

Project description:The school-leaving GPA and the time since completion of secondary education are the major criteria for admission to German medical schools. However, the predictive value of the school-leaving grade and the admission delay have not been thoroughly examined since the amendment of the Medical Licensing Regulations and the introduction of reformed curricula in 2002. Detailed information on the prognosis of the different admission groups is also missing.To examine the predictive values of the school-leaving grade and the age at enrolment for academic performance and continuity throughout the reformed medical course.The study includes the central admission groups "GPA-best" and "delayed admission" as well as the primary and secondary local admission groups of three consecutive cohorts. The relationship between the criteria academic performance and continuity and the predictors school-leaving GPA, enrolment age, and admission group affiliation were examined up to the beginning of the final clerkship year.The academic performance and the prolongation of the pre-clinical part of undergraduate training were significantly related to the school-leaving GPA. Conversely, the dropout rate was related to age at enrolment. The students of the GPA-best group and the primary local admission group performed best and had the lowest dropout rates. The students of the delayed admission group and secondary local admission group performed significantly worse. More than 20% of these students dropped out within the pre-clinical course, half of them due to poor academic performance. However, the academic performance of all of the admission groups was highly variable and only about 35% of the students of each group reached the final clerkship year within the regular time.The school-leaving grade and age appear to have different prognostic implications for academic performance and continuity. Both factors have consequences for the delayed admission group. The academic prognosis of the secondary local admission group is as problematic as that of the delayed admission group. Additional admission instruments would be necessary, in order to recognise potentially able applicants independently of their school-leaving grade and to avoid the secondary admission procedure.

Project description:BACKGROUND: Knowledge in natural sciences generally predicts study performance in the first two years of the medical curriculum. In order to reduce delay and dropout in the preclinical years, Hamburg Medical School decided to develop a natural science test (HAM-Nat) for student selection. In the present study, two different approaches to scale construction are presented: a unidimensional scale and a scale composed of three subject specific dimensions. Their psychometric properties and relations to academic success are compared. METHODS: 334 first year medical students of the 2006 cohort responded to 52 multiple choice items from biology, physics, and chemistry. For the construction of scales we generated two random subsamples, one for development and one for validation. In the development sample, unidimensional item sets were extracted from the item pool by means of weighted least squares (WLS) factor analysis, and subsequently fitted to the Rasch model. In the validation sample, the scales were subjected to confirmatory factor analysis and, again, Rasch modelling. The outcome measure was academic success after two years. RESULTS: Although the correlational structure within the item set is weak, a unidimensional scale could be fitted to the Rasch model. However, psychometric properties of this scale deteriorated in the validation sample. A model with three highly correlated subject specific factors performed better. All summary scales predicted academic success with an odds ratio of about 2.0. Prediction was independent of high school grades and there was a slight tendency for prediction to be better in females than in males. CONCLUSIONS: A model separating biology, physics, and chemistry into different Rasch scales seems to be more suitable for item bank development than a unidimensional model, even when these scales are highly correlated and enter into a global score. When such a combination scale is used to select the upper quartile of applicants, the proportion of successful completion of the curriculum after two years is expected to rise substantially.

Project description:OBJECTIVES:The number of women entering medicine has increased significantly, yet women are still under-represented at senior levels in academic medicine. To support the gender equality action plan at one School of Medicine, this study sought to (1) identify the range of viewpoints held by staff on how to address gender inequality and (2) identify attitudinal barriers to change. DESIGN:Q methodology. 50 potential interventions representing good practice or positive action, and addressing cultural, organisational and individual barriers to gender equality, were ranked by participants according to their perception of priority. SETTING:The School of Medicine at the University of Leeds, UK. PARTICIPANTS:Fifty-five staff members were purposively sampled to represent gender and academic pay grade. RESULTS:Principal components analysis identified six competing viewpoints on how to address gender inequality. Four viewpoints favoured positive action interventions: (1) support careers of women with childcare commitments, (2) support progression of women into leadership roles rather than focus on women with children, (3) support careers of all women rather than just those aiming for leadership, and (4) drive change via high-level financial and strategic initiatives. Two viewpoints favoured good practice with no specific focus on women by (5) recognising merit irrespective of gender and (6) improving existing career development practice. No viewpoint was strongly associated with gender, pay grade or role; however, latent class analysis identified that female staff were more likely than male to prioritise the setting of equality targets. Attitudinal barriers to the setting of targets and other positive action initiatives were identified, and it was clear that not all staff supported positive action approaches. CONCLUSIONS:The findings and the approach have utility for those involved in gender equality work in other medical and academic institutions. However, the impact of such initiatives needs to be evaluated in the longer term.

Project description:PURPOSE:During their early years at medical school, students repeatedly criticize their workload, time constraints and test associated stress. At the same time, depressiveness and anxiety among first and second year medical students are on the rise. We therefore hypothesized that test anxiety may be related to depressiveness and considered cognitive and academic performances as confounders for the former and psychosocial distress for the latter. METHODS:A whole class of 200 second year students was invited to participate in the study. Anxiety as a trait, depressiveness, crystallized intelligence, verbal fluency and psychosocial distress were assessed using validated tests and questionnaires. Acute state anxiety and sympathetic stress parameters were measured in real life situations immediately before an oral and a written exam and paired tests were used to compare the individual anxieties at the various time points. Previous academic performances were self-reported, the results of the impending exams were monitored. Finally, correlations were performed to test for interrelatedness between academic performances and the various personal, cognitive and psychosocial factors. RESULTS:Acute test anxiety did not correlate with depressiveness nor did it correlate with previous nor impending academic performances nor any of the expected confounders on academic performance. However both, depressiveness and test anxiety strongly correlated with the perceived imbalance between efforts spent and rewards received. Moreover, anxiety as a trait not only correlated with acute state anxiety before an exam but was also significantly correlated to the feeling of over-commitment. CONCLUSION:Depressiveness during the early years of medical school seems unrelated to test anxiety and academic performance. Instead, it strongly correlated with the psychosocial distress emanating from attending medical school and points at a perceived imbalance between efforts spent and rewards received.

Dataset Information

Is the admission test for a course in medicine a good predictor of academic performance? A case-control experience at the school of medicine of Turin.

Publications

Is the admission test for a course in medicine a good predictor of academic performance? A case-control experience at the school of medicine of Turin.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure