Dataset Information

Can personal qualities of medical students predict in-course examination success and professional behaviour? An exploratory prospective cohort study.

ABSTRACT:

Background

Over two-thirds of UK medical schools are augmenting their selection procedures for medical students by using the United Kingdom Clinical Aptitude Test (UKCAT), which employs tests of cognitive and non-cognitive personal qualities, but clear evidence of the tests' predictive validity is lacking. This study explores whether academic performance and professional behaviours that are important in a health professional context can be predicted by these measures, when taken before or very early in the medical course.

Methods

This prospective cohort study follows the progress of the entire student cohort who entered Hull York Medical School in September 2007, having taken the UKCAT cognitive tests in 2006 and the non-cognitive tests a year later. This paper reports on the students' first and second academic years of study. The main outcome measures were regular, repeated tutor assessment of individual students' interpersonal skills and professional behaviour, and annual examination performance in the three domains of recall and application of knowledge, evaluation of data, and communication and practical clinical skills. The relationships between non-cognitive test scores, cognitive test scores, tutor assessments and examination results were explored using the Pearson product-moment correlations for each group of data; the data for students obtaining the top and bottom 20% of the summative examination results were compared using Analysis of Variance.

Results

Personal qualities measured by non-cognitive tests showed a number of statistically significant relationships with ratings of behaviour made by tutors, with performance in each year's objective structured clinical examinations (OSCEs), and with themed written summative examination marks in each year. Cognitive ability scores were also significantly related to each year's examination results, but seldom to professional behaviours. The top 20% of examination achievers could be differentiated from the bottom 20% on both non-cognitive and cognitive measures.

Conclusions

This study shows numerous significant relationships between both cognitive and non-cognitive test scores, academic examination scores and indicators of professional behaviours in medical students. This suggests that measurement of non-cognitive personal qualities in applicants to medical school could make a useful contribution to selection and admission decisions. Further research is required in larger representative groups, and with more refined predictor measures and behavioural assessment methods, to establish beyond doubt the incremental validity of such measures over conventional cognitive assessments.

SUBMITTER: Adam J

PROVIDER: S-EPMC3473297 | biostudies-literature | 2012 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Can personal qualities of medical students predict in-course examination success and professional behaviour? An exploratory prospective cohort study.

Adam Jane J Bore Miles M McKendree Jean J Munro Don D Powis David D

BMC medical education 20120808

<h4>Background</h4>Over two-thirds of UK medical schools are augmenting their selection procedures for medical students by using the United Kingdom Clinical Aptitude Test (UKCAT), which employs tests of cognitive and non-cognitive personal qualities, but clear evidence of the tests' predictive validity is lacking. This study explores whether academic performance and professional behaviours that are important in a health professional context can be predicted by these measures, when taken before o ...[more]

PMID: 22873571

Similar Datasets

Project description:Group living has been proposed to yield benefits that enhance fitness above the level that would be achieved through living as solitary individuals. Dominance hierarchies occur commonly in these social assemblages, and result, by definition, in resources not being evenly distributed between group members. Determinants of rank within a dominance hierarchy can be associated with morphological characteristics, previous experience of the individual, or personality traits such as exploration tendencies. The purpose of this study was to investigate whether greater exploration and positive responses to novel objects in homing pigeons (Columba livia) measured under laboratory conditions were associated with (i) greater initial exploration of the local area around the home loft during spontaneous exploration flights (SEF), (ii) faster and more efficient homing flights when released from further afield, and (iii) whether the traits of greater exploration and more positive responses to novel objects were more likely to be exhibited by the more dominant individuals within the group. There was no relationship between laboratory-based novel object exploration and position within the dominance hierarchy. Pigeons that were neophobic under laboratory conditions did not explore the local area during SEF opportunities. When released from sites further from home, neophobic pigeons took longer routes to home compared to those birds that had not exhibited neophobic traits under laboratory conditions, and had spontaneously explored to a greater extent. The lack of exploration in the neophobic birds is likely to have resulted in the increased costs of homing following release: unfamiliarity with the landscape likely led to the greater distances travelled and less efficient routes taken. Birds that demonstrated a lack of neophobia were not the dominant individuals inside the loft, and thus would have less access to resources such as food and potentially mates. However, a lack of neophobia makes the subordinate position possible, because subordinate birds that incur high travel costs would become calorie restricted and lose condition. Our results address emerging questions linking individual variation in behaviour with energetics and fitness consequences.This article is part of the themed issue 'Physiological determinants of social behaviour in animals'.

Project description:BackgroundMulticentre randomised trials provide some of the key evidence underpinning healthcare practice around the world. They are also hard work and generally expensive. Some of this work and expense are devoted to sites that fail to recruit as many participants as expected. Methods to identify sites that will recruit to target would be helpful.MethodsWe asked trial managers at the Centre for Healthcare Randomised Trials (CHaRT), University of Aberdeen to predict whether a site would recruit to target. Predictions were made after a site initiation visit and were collected on a form comprising a simple 'Yes/No' prediction and a reason for the prediction. We did not provide guidance as to what trial managers might want to think about when making predictions. After a minimum of eight months of recruitment at each site for which a prediction had been made, all trial mangers in CHaRT were invited to a group discussion where predictions were presented together with sites' actual recruitment performance over that period. Individual trial managers reflected on their predictions and there was a general discussion about predicting site recruitment. The prediction reasons from the forms and the content of the group discussion were used to identify features linked to correct predictions of recruitment failure.ResultsTen trial managers made predictions for 56 site visits recruiting to eight trials. Trial managers' sensitivity was 82% and their specificity was 32%, correctly identifying 65% of sites that would hit their recruitment target and 54% of those that did not. Eight 'red flags' for recruitment failure were identified: previous poor site performance; slow approvals process; strong staff/patient preferences; the site recruitment target; the trial protocol and its implementation at the site; lack of staff engagement; lack of research experience among site staff; and busy site staff. We used these red flags to develop a guided prediction form.ConclusionsTrial managers' unguided recruitment predictions were not bad but were not good enough for decision-making. We have developed a modified prediction form that includes eight flags to consider before making a prediction. We encourage anyone interested in contributing to its evaluation to contact us.

Dataset Information

Can personal qualities of medical students predict in-course examination success and professional behaviour? An exploratory prospective cohort study.

Background

Methods

Results

Conclusions

Publications

Can personal qualities of medical students predict in-course examination success and professional behaviour? An exploratory prospective cohort study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets