Dataset Information

Comparison of A level and UKCAT performance in students applying to UK medical and dental schools in 2006: cohort study.

ABSTRACT:

Objectives

To determine whether the UK Clinical Aptitude Test (UKCAT) adds value to the selection process for school leaver applicants to medical and dental school, and in particular whether UKCAT can reduce the socioeconomic bias known to affect A levels.

Design

Cohort study

Setting

Applicants to 23 UK medical and dental schools in 2006.

Participants

9884 applicants who took the UKCAT in the UK and who achieved at least three passes at A level in their school leaving examinations (53% of all applicants).

Main outcome measures

Independent predictors of obtaining at least AAB at A level and UKCAT scores at or above the 30th centile for the cohort, for the subsections and the entire test.

Results

Independent predictors of obtaining at least AAB at A level were white ethnicity (odds ratio 1.58, 95% confidence interval 1.41 to 1.77), professional or managerial background (1.39, 1.22 to 1.59), and independent or grammar schooling (2.26, 2.02 to 2.52) (all P<0.001). Independent predictors of achieving UKCAT scores at or above the 30th centile for the whole test were male sex (odd ratio 1.48, 1.32 to 1.66), white ethnicity (2.17, 1.94 to 2.43), professional or managerial background (1.34, 1.17 to 1.54), and independent or grammar schooling (1.91, 1.70 to 2.14) (all P<0.001). One major limitation of the study was that socioeconomic status was not volunteered by approximately 30% of the applicants. Those who withheld socioeconomic status data were significantly different from those who provided that information, which may have caused bias in the analysis.

Conclusions

UKCAT was introduced with a high expectation of increasing the diversity and fairness in selection for UK medical and dental schools. This study of a major subgroup of applicants in the first year of operation suggests that it has an inherent favourable bias to men and students from a higher socioeconomic class or independent or grammar schools. However, it does provide a reasonable proxy for A levels in the selection process.

SUBMITTER: James D

PROVIDER: S-EPMC2824099 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:The United Kingdom Clinical Aptitude Test (UKCAT) is an aptitude test used since 2006 within selection processes of a consortium of UK medical and dental schools. Since 2006, student numbers have increased in medical training and schools now have an increased focus on widening access. A growing evidence base has emerged around medical student selection (Patterson et al., Med Educ 50:36-60, 2016) leading to changes in practice. However, whilst some papers describe local selection processes, there has been no overview of trends in selection processes over time across Universities. This study reports on how the use of the UKCAT in medical student selection has changed and comments on other changes in selection processes. METHODS:Telephone interviews were conducted annually with UKCAT Consortium medical schools. Use of the UKCAT was categorised and data analysed to identify trends over time. RESULTS:The number of schools using the UKCAT to select applicants for interview has risen, with cognitive test results contributing significantly to outcomes at this stage at many universities. Where schools use different weighted criteria (Factor Method), the UKCAT has largely replaced the use of personal statements. Use of the test at offer stage has also increased; the most significant use being to discriminate between applicants at a decision borderline. A growing number of schools are using the UKCAT Situational Judgement Test (SJT) in selection. In 2018, all but seven (out of 26) schools made some adjustment to selection processes for widening access applicants. Multiple Mini Interviews (MMIs) are now used by the majority of schools. Whilst medical student numbers have increased over this time, the ratio of applicants to places has fallen. The probability of applicants being invited to interview or receiving an offer has increased. CONCLUSIONS:More medical schools are using the UKCAT in undergraduate selection processes in an increasing number of ways and with increasing weight compared with 2007. It has replaced the use of personal statements in all but a few Consortium medical schools. An increased focus on academic attainment and the UKCAT across medical schools may be leading to the need for schools to interview and make offers to more applicants.

Project description:ObjectivesFor the first time, this systematic review provides a summary of the literature exploring the relationship between performance in the UK Clinical Aptitude Test (UKCAT) and assessments in undergraduate medical and dental training.DesignIn accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis, relevant studies were identified through systematic literature searches. Electronic searches were carried out on EBSCO, EMBASE, Educational Resources Information Centre, SCOPUS, Web of Knowledge. Studies which included the predictive validity of selection criteria including some element of the UKCAT were considered.Results22 papers were identified for inclusion in the study. Four studies describe outcomes from dental programmes with limited results reported. 18 studies reported on relationships between the UKCAT and performance in undergraduate medical training. Of these, 15 studies reported relationships between the UKCAT cognitive tests and undergraduate medical assessments. Weak relationships (r=0.00-0.29) were observed in 14 of these studies; four studies reported some moderate relationships (r=0.30-0.49). The strongest relationships with performance in medical school were observed for the UKCAT total score and the verbal reasoning subtest. Relationships with knowledge-based assessments scores were higher than those for assessments of skills as the outcome. Relationships observed in small (single and double centre studies) were larger than those observed in multicentre studies.ConclusionThe results indicate that UKCAT scores predict performance in medical school assessments. The relationship is generally weak, although noticeably stronger for both the UKCAT total score and the verbal reasoning subtest. There is some evidence that UKCAT continues to predict performance throughout medical school. We recommend more optimal approaches to future studies. This assessment of existing evidence should assist medical/dental schools in their evaluation of selection processes.

Project description:BackgroundWorkforce planning is a central issue for service provision and has consequences for medical education. Much work has been examined the career intentions, career preferences and career destinations of UK medical graduates but there is little published about medical students career intentions. How soon do medical students formulate careers intentions? How much do these intentions and preferences change during medical school? If they do change, what are the determining factors? Our aim was to compare medical students' career preferences upon entry into and exit from undergraduate medical degree programmes.MethodsThis was a cross-sectional questionnaire survey. Two cohorts [2009-10, 2010-11] of first and final year medical students at the four Scottish graduating medical schools took part in career preference questionnaire surveys. Questions were asked about demographic factors, career preferences and influencing factors.ResultsThe response rate was 80.9% [2682/3285]. Significant differences were found across the four schools, most obviously in terms of student origin [Scotland, rest of UK or overseas], age group, and specialty preferences in Year 1 and Year 5. Year 1 and Year 5 students' specialty preferences also differed within each school and, while there were some common patterns, each medical school had a different profile of students' career preferences on exit. When the analysis was adjusted for demographic and job-related preferences, specialty preferences differed by gender, and wish for work-life balance and intellectual satisfaction.ConclusionsThis is the first multi-centre study exploring students' career preferences and preference influences upon entry into and exit from undergraduate medical degree programmes. We found various factors influenced career preference, confirming prior findings. What this study adds is that, while acknowledging student intake differs by medical school, medical school itself seems to influence career preference. Comparisons across medical school populations must therefore control for differences in input [the students] as well as context and process [the medical school] when looking at output [e.g., performance]. A robust, longitudinal study is required to explore how medical students' career preferences change as they progress through medical school and training to understand the influence of the learning environment on training choice and outcomes.

Project description:BackgroundThe UK General Medical Council has emphasized the lack of evidence on whether graduates from different UK medical schools perform differently in their clinical careers. Here we assess the performance of UK graduates who have taken MRCP(UK) Part 1 and Part 2, which are multiple-choice assessments, and PACES, an assessment using real and simulated patients of clinical examination skills and communication skills, and we explore the reasons for the differences between medical schools.MethodWe perform a retrospective analysis of the performance of 5827 doctors graduating in UK medical schools taking the Part 1, Part 2 or PACES for the first time between 2003/2 and 2005/3, and 22453 candidates taking Part 1 from 1989/1 to 2005/3.ResultsGraduates of UK medical schools performed differently in the MRCP(UK) examination between 2003/2 and 2005/3. Part 1 and 2 performance of Oxford, Cambridge and Newcastle-upon-Tyne graduates was significantly better than average, and the performance of Liverpool, Dundee, Belfast and Aberdeen graduates was significantly worse than average. In the PACES (clinical) examination, Oxford graduates performed significantly above average, and Dundee, Liverpool and London graduates significantly below average. About 60% of medical school variance was explained by differences in pre-admission qualifications, although the remaining variance was still significant, with graduates from Leicester, Oxford, Birmingham, Newcastle-upon-Tyne and London overperforming at Part 1, and graduates from Southampton, Dundee, Aberdeen, Liverpool and Belfast underperforming relative to pre-admission qualifications. The ranking of schools at Part 1 in 2003/2 to 2005/3 correlated 0.723, 0.654, 0.618 and 0.493 with performance in 1999-2001, 1996-1998, 1993-1995 and 1989-1992, respectively.ConclusionCandidates from different UK medical schools perform differently in all three parts of the MRCP(UK) examination, with the ordering consistent across the parts of the exam and with the differences in Part 1 performance being consistent from 1989 to 2005. Although pre-admission qualifications explained some of the medical school variance, the remaining differences do not seem to result from career preference or other selection biases, and are presumed to result from unmeasured differences in ability at entry to the medical school or to differences between medical schools in teaching focus, content and approaches. Exploration of causal mechanisms would be enhanced by results from a national medical qualifying examination.

Project description:BackgroundLinks between the demanding nature of studies in the health sciences, students' personality traits and psychological distress have been well-established. While considerable amount of work has been done in medicine, evidence from the dental education arena is sparse and data from Latin America are lacking. The authors conducted a large-scale investigation of psychological distress among dental students in Colombia and sought to determine its curriculum and student-level correlates.MethodsThe Spanish version of the Derogatis' Symptoms Checklist Revised (SCL-90-R) was administered to all students officially registered and attending classes or clinics in 17 dental schools in 4 geographic districts of Colombia between January and April 2012. Additional information was collected on participants' socio-demographic information and first career choice, as well as school's characteristics such as class size. The Global Severity Index (GSI) score, a measure of overall psychological distress, served as the primary analytical endpoint. Analyses relied on multilevel mixed-effects linear and log-binomial regression, accounting for study design and sample characteristics.ResultsA total of 5700 dental students completed the survey, a response rate of 67%. Pronounced gradients were noted in the association between socio-economic status and psychological distress, with students in higher strata reporting fewer problems. After adjustment for all important covariates, there was an evident pattern of increasing psychological distress corresponding to the transition from the didactic, to the preclinical and clinical phases of training, with few differences between male and female students. Independent of other factors, reliance on own funds for education and having dentistry as the first career choice were associated with lower psychological distress.ConclusionsLevels of psychological distress correlated with students' socio-economic and study-level characteristics. Above and beyond the influence of person-level factors, variations in levels of distress paralleled specific transitional stages of the 5-year dental curriculum, providing opportunities for targeted interventions.

Project description:BACKGROUND:Empathy is paramount in the doctor-patient relationship being a comprehensive and multidimensional concept. Self-ratings of empathy change across the years of medical education only when the Jefferson Scale of Physicians Empathy is used, with a worrying decrease being found throughout the years in Medicine Schools. As there are only few studies on the factors influencing medical student's empathy, particularly of the curricular model, this study aimed to compare the levels of empathy of medicine students of two Schools with different curricular models in central Portugal, the Faculty of Medicine - University of Coimbra (FMUC) and the Faculty of Health Sciences - University of Beira Interior (FCS-UBI). METHODS:Cross-sectional observational study with the Jefferson Scale of Physician Empathy - students' Portuguese version (JSPE - spv) to 1st, 3rd and 6th year students of the 2017/2018 academic year with descriptive and inferential statistical analysis (p?<?0.05). RESULTS:Size representative sample of 795 students. Higher total empathy score (TES) (p?=?0.008) and "Perspective taking" (p?=?0.001) in FCS-UBI were found. JSPE-TES was higher in FCS-UBI, 3rd year (p?=?0.038). Higher FCS-UBI "Perspective taking" in the 1st year (p?=?0.030) and 6th year (p?=?0.044), for "Compassionate care" in the 3rd (p?=?0.019) and for "Standing in the patient's shoes" in the 1st year (p?=?0.018) and in FMUC for "Compassionate care" in the 1st year (p?=?0.037) and the "Standing in the patient's shoes" in year 3 (p?=?0.002) were found. Higher levels of empathy were found in FCS-UBI female students, for JSPE-TES (p?=?0.045) and "Perspective taking" (p?=?0.001). CONCLUSION:Higher empathy levels in FCS-UBI were found, with different results in the third year suggesting influence of the medical course teaching characteristics between the two Medicine schools, student's empathy levels being higher when earlier and more intense contact with patients accompanied by skilled tutors was developed.