Dataset Information

An evaluation of the performance in the UK Royal College of Anaesthetists primary examination by UK medical school and gender.

ABSTRACT:

Background

There has been comparatively little consideration of the impact that the changes to undergraduate curricula might have on postgraduate academic performance. This study compares the performance of graduates by UK medical school and gender in the Multiple Choice Question (MCQ) section of the first part of the Fellowship of the Royal College of Anaesthetists (FRCA) examination.

Methods

Data from each sitting of the MCQ section of the primary FRCA examination from June 1999 to May 2008 were analysed for performance by medical school and gender.

Results

There were 4983 attempts at the MCQ part of the examination by 3303 graduates from the 19 United Kingdom medical schools. Using the standardised overall mark minus the pass mark graduates from five medical schools performed significantly better than the mean for the group and five schools performed significantly worse than the mean for the group. Males performed significantly better than females in all aspects of the MCQ - physiology, mean difference = 3.0% (95% CI 2.3, 3.7), p < 0.001; pharmacology, mean difference = 1.7% (95% CI 1.0, 2.3), p < 0.001; physics with clinical measurement, mean difference = 3.5% (95% CI 2.8, 4.1), p < 0.001; overall mark, mean difference = 2.7% (95% CI 2.1, 3.3), p < 0.001; and standardised overall mark minus the pass mark, mean difference = 2.5% (95% CI 1.9, 3.1), p < 0.001. Graduates from three medical schools that have undergone the change from Traditional to Problem Based Learning curricula did not show any change in performance in any aspects of the MCQ pre and post curriculum change.

Conclusion

Graduates from each of the medical schools in the UK do show differences in performance in the MCQ section of the primary FRCA, but significant curriculum change does not lead to deterioration in post graduate examination performance. Whilst females now outnumber males taking the MCQ, they are not performing as well as the males.

SUBMITTER: Bowhay AR

PROVIDER: S-EPMC2707380 | biostudies-literature | 2009 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

An evaluation of the performance in the UK Royal College of Anaesthetists primary examination by UK medical school and gender.

Bowhay Andrew R AR Watmough Simon D SD

BMC medical education 20090629

<h4>Background</h4>There has been comparatively little consideration of the impact that the changes to undergraduate curricula might have on postgraduate academic performance. This study compares the performance of graduates by UK medical school and gender in the Multiple Choice Question (MCQ) section of the first part of the Fellowship of the Royal College of Anaesthetists (FRCA) examination.<h4>Methods</h4>Data from each sitting of the MCQ section of the primary FRCA examination from June 1999 ...[more]

PMID: 19563655

Similar Datasets

Project description:ObjectivesThe knowledge, skills and behaviours required of new UK medical graduates are the same but how these are achieved differs given medical schools vary in their mission, curricula and pedagogy. Medical school differences seem to influence performance on postgraduate assessments. To date, the relationship between medical schools, course types and performance at the Membership of the Royal Colleges of Surgeons examination (MRCS) has not been investigated. Understanding this relationship is vital to achieving alignment across undergraduate and postgraduate training, learning and assessment values.Design and participantsA retrospective longitudinal cohort study of UK medical graduates who attempted MRCS Part A (n=9730) and MRCS Part B (n=4645) between 2007 and 2017, using individual-level linked sociodemographic and prior academic attainment data from the UK Medical Education Database.MethodsWe studied MRCS performance across all UK medical schools and examined relationships between potential predictors and MRCS performance using χ2 analysis. Multivariate logistic regression models identified independent predictors of MRCS success at first attempt.ResultsMRCS pass rates differed significantly between individual medical schools (p<0.001) but not after adjusting for prior A-Level performance. Candidates from courses other than those described as problem-based learning (PBL) were 53% more likely to pass MRCS Part A (OR 1.53 (95% CI 1.25 to 1.87) and 54% more likely to pass Part B (OR 1.54 (1.05 to 2.25)) at first attempt after adjusting for prior academic performance. Attending a Standard-Entry 5-year medicine programme, having no prior degree and attending a Russell Group university were independent predictors of MRCS success in regression models (p<0.05).ConclusionsThere are significant differences in MRCS performance between medical schools. However, this variation is largely due to individual factors such as academic ability, rather than medical school factors. This study also highlights group level attainment differences that warrant further investigation to ensure equity within medical training.

Project description:The scale of the COVID-19 pandemic means that a significant number of patients who have previously been infected with SARS-CoV-2 will require surgery. Given the potential for multisystem involvement, timing of surgery needs to be carefully considered to plan for safe surgery. This consensus statement uses evidence from a systematic review and expert opinion to highlight key principles in the timing of surgery. Shared decision-making regarding timing of surgery after SARS-CoV-2 infection must account for severity of the initial infection; ongoing symptoms of COVID-19; comorbid and functional status; clinical priority and risk of disease progression; and complexity of surgery. For the protection of staff, other patients and the public, planned surgery should not be considered during the period that a patient may be infectious. Precautions should be undertaken to prevent pre- and peri-operative infection, especially in higher risk patients. Elective surgery should not be scheduled within 7 weeks of a diagnosis of SARS-CoV-2 infection unless the risks of deferring surgery outweigh the risk of postoperative morbidity or mortality associated with COVID-19. SARS-CoV-2 causes either transient or asymptomatic disease for most patients, who require no additional precautions beyond a 7-week delay, but those who have persistent symptoms or have been hospitalised require special attention. Patients with persistent symptoms of COVID-19 are at increased risk of postoperative morbidity and mortality even after 7 weeks. The time before surgery should be used for functional assessment, prehabilitation and multidisciplinary optimisation. Vaccination several weeks before surgery will reduce risk to patients and might lessen the risk of nosocomial SARS-CoV-2 infection of other patients and staff. National vaccine committees should consider whether such patients can be prioritised for vaccination. As further data emerge, these recommendations may need to be revised, but the principles presented should be considered to ensure safety of patients, the public and staff.

Project description:ObjectivesInternational medical graduates (IMGs) perform less well in national postgraduate licensing examinations compared with UK graduates, even in computer-marked multiple-choice licensing examinations. We aimed to investigate thought processes of candidates answering multiple- choice questions, considering possible reasons for differential attainment between IMGs and UK graduates.DesignWe employed a semistructured qualitative design using cognitive interviews. Systematic grounded theory was used to analyse data from 'think aloud' interviews of general practitioner specialty trainees (GPSTs) while answering up to 15 live questions from the UK Membership of the Royal College of General Practitioners Applied Knowledge Test (AKT).SettingEast Midlands, UK.Participants21 GPSTs including 13IMGs and 8 UK-trained doctors.OutcomesPerceptions of participants on how they answered AKT questions together with strategies used or difficulties experienced.ResultsWe interviewed 21 GPSTs (8 female, 13 male, 13 IMGs, 14 from black and minority ethnic groups, age 24-64 years) in years 1-3 of training between January and April 2017. Four themes were identified. 'Theoretical versus real-life clinical experience': participants reported difficulties recalling information and responding to questions from theoretical learning compared with clinical exposure; rote learning helped some IMGs recall rare disease patterns. Recency, frequency, opportunity and relevance: participants reported greater difficulty answering questions not recently studied, less frequently encountered or perceived as less relevant. Competence versus insight: some participants were over optimistic about their performance despite answering incorrectly. Cultural barriers: for IMGs included differences in undergraduate experience, lack of familiarity with UK guidelines and language barriers which overlapped with the other themes.ConclusionsThe difficulties we identified in candidates when answering AKT questions may be addressed through training. IMGs face additional difficulties which impede examination success due to differences in educational experience, content familiarity and language, which are also potentially amenable to additional training support.

Project description:ObjectiveQuantify differential attainment by ethnicity in undergraduate medical assessments and evaluate whether institutional efforts to reduce the attainment gap have had impact.DesignObservational cohort study.SettingA single UK MBBS medical programme.ParticipantsPseudonymised data of adults aged ≥18 years enrolled in one of the UK MBBS medical programmes between 2012 and 2018. Ethnicity was self-declared during enrolment as White, Asian, Black, mixed and other.Main outcome measureModule mark (distinction, merit, pass, fail) graded according to a variety of assessments, including single best answer examinations, objective structured clinical examinations and coursework submissions. All modular assessments are graded as a percentage. Logistic regression models were used to calculate relative risk ratio to study the association between ethnicity and attainment gap over a calendar and scholastic year. Models were adjusted for age, gender, social deprivation and scholastic year of study.Results3714 student records were included. In the sample, 2134 students (57%) were non-white. The proportion of non-white students increased from 2007 (49%) to 2018 (70%). Mean age was 18 (IQR 18-21) and 56.6% were females. Higher proportion of non-white students 218 (24.8%) were from more deprived backgrounds versus white 76 (14.8%). Compared with non-white, there were no significant differences in the proportion of students failing assessments. However, white students were more likely to achieve merit (relative risk ratio 1.29 (95% CI 1.08 to 1.45)) or distinction (1.69 (95% CI 1.37 to 2.08)). Differences in attainment gap have remained unchanged over time, and for black students, attainment gap grew between their first and final year of study.ConclusionA similar proportion (97%) of non-white and white students had a passing score, but attainment gap for higher grades persists over years despite widespread efforts in medical schools to diminish the attainment gap linked to ethnicity. Our findings are from a single institution, thus affecting generalisability.

Project description:AimsUK guidance was recently developed for the treatment of anal cancer using intensity-modulated radiotherapy (IMRT). We audited the current use of radiotherapy in UK cancer centres for the treatment of anal cancer against such guidance. We describe the acute toxicity of IMRT in comparison with patient population in the audit treated with two-phase conformal radiotherapy and the previous published data from two-phase conformal radiotherapy, in the UK ACT2 trial.Materials and methodsA Royal College of Radiologists' prospective national audit of patients treated with radiotherapy in UK cancer centres was carried out over a 6 month period between February and July 2015.ResultsTwo hundred and forty-two cases were received from 40/56 cancer centres (71%). In total, 231 (95%) underwent full dose radiotherapy with prophylactic nodal irradiation. Of these, 180 (78%) received IMRT or equivalent, 52 (22%) two-phase conformal (ACT2) technique. The number of interruptions in radiotherapy treatment in the ACT2 trial was 15%. Interruptions were noted in 7% (95% confidence interval 0-14%) of courses receiving two-phase conformal and 4% (95% confidence interval 1-7%) of those receiving IMRT. The percentage of patients completing the planned radiotherapy dose, irrelevant of gaps, was 90% (95% confidence interval 82-98%) and 96% (95% confidence interval 93-99%), in two-phase conformal and IMRT respectively. The toxicity reported in the ACT2 trial, in patients receiving two-phase conformal in the audit and in patients receiving IMRT in the audit was: any toxic effect 71%, 54%, 48%, non-haematological 62%, 49%, 40% and haematological 26%, 13%, 18%, respectively.ConclusionsIMRT implementation for anal cancer is well underway in the UK with most patients receiving IMRT delivery, although its usage is not yet universal. This audit confirms that IMRT results in reduced acute toxicity and minimised treatment interruptions in comparison with previous two-phase conformal techniques.

Project description:ImportanceFirst-generation (FG) medical students remain underrepresented in medicine despite ongoing national efforts to increase diversity; understanding the challenges faced by this student population is essential to building holistic policies, practices, and learning environments that promote professional actualization. Although FG students have been extensively studied in the undergraduate literature, there is little research investigating how FG students experience medical education or opportunities for educators to intervene.ObjectiveTo explore challenges that FG students experience in undergraduate medical education and identify opportunities to improve foundational FG support.Design, setting, and participantsThis qualitative study was conducted using an online platform with 37 FG students enrolled in 27 US medical schools. An interprofessional team of medical educators and trainees conducted semistructured interviews from November 2021 through April 2022. Participants were recruited using a medical student listserv. Data were analyzed from April to November 2022.Main outcomes and measuresAfter conducting a preliminary analysis using open coding, a codebook was created and used in a thematic analysis; the codebook used a combination of deductive and inductive coding.ResultsAmong the 37 students recruited for this study, 21 (56.8%) were female; 23 (62.2%) were in the clinical phase of training; 1 (2.7%) was American Indian or Alaska Native, 7 (18.9%) were Hispanic, Latino, or of Spanish origin, 8 (21.6%) were non-Hispanic Asian or Asian American, 9 (24.3%) were non-Hispanic Black or African American, and 23 (32.4%) were non-Hispanic White; mean (SD) age was 27.3 (2.8) years. Participants described 4 major themes: (1) isolation and exclusion related to being a newcomer to medicine; (2) difficulty with access to basic resources (eg, food, rent, transportation) as well as educational (eg, books); (3) overall lack of faculty or institutional support to address these challenges; and (4) a sense of needing to rely on grit and resilience to survive.Conclusions and relevanceAlthough grit and resilience are desirable traits, results of this study suggest that FG medical students face increased adversity with inadequate institutional support, which forces them to excessively rely on grit and resilience as survival (rather than educational) strategies. By applying the holistic model often used in admissions to the postmatriculation educational process, targeted and flexible initiatives can be created for FG students so that all students, regardless of background, can achieve robust professional actualization.

Project description:BackgroundFailure rates in postgraduate examinations are often high and many candidates therefore retake examinations on several or even many times. Little, however, is known about how candidates perform across those multiple attempts. A key theoretical question to be resolved is whether candidates pass at a resit because they have got better, having acquired more knowledge or skills, or whether they have got lucky, chance helping them to get over the pass mark. In the UK, the issue of resits has become of particular interest since the General Medical Council issued a consultation and is considering limiting the number of attempts candidates may make at examinations.MethodsSince 1999 the examination for Membership of the Royal Colleges of Physicians of the United Kingdom (MRCP(UK)) has imposed no limit on the number of attempts candidates can make at its Part 1, Part 2 or PACES (Clinical) examination. The present study examined the performance of candidates on the examinations from 2002/2003 to 2010, during which time the examination structure has been stable. Data were available for 70,856 attempts at Part 1 by 39,335 candidates, 37,654 attempts at Part 2 by 23,637 candidates and 40,303 attempts at PACES by 21,270 candidates, with the maximum number of attempts being 26, 21 and 14, respectively. The results were analyzed using multilevel modelling, fitting negative exponential growth curves to individual candidate performance.ResultsThe number of candidates taking the assessment falls exponentially at each attempt. Performance improves across attempts, with evidence in the Part 1 examination that candidates are still improving up to the tenth attempt, with a similar improvement up to the fourth attempt in Part 2 and the sixth attempt at PACES. Random effects modelling shows that candidates begin at a starting level, with performance increasing by a smaller amount at each attempt, with evidence of a maximum, asymptotic level for candidates, and candidates showing variation in starting level, rate of improvement and maximum level. Modelling longitudinal performance across the three diets (sittings) shows that the starting level at Part 1 predicts starting level at both Part 2 and PACES, and the rate of improvement at Part 1 also predicts the starting level at Part 2 and PACES.ConclusionCandidates continue to show evidence of true improvement in performance up to at least the tenth attempt at MRCP(UK) Part 1, although there are individual differences in the starting level, the rate of improvement and the maximum level that can be achieved. Such findings provide little support for arguments that candidates should only be allowed a fixed number of attempts at an examination. However, unlimited numbers of attempts are also difficult to justify because of the inevitable and ever increasing role that luck must play with increasing numbers of resits, so that the issue of multiple attempts might be better addressed by tackling the difficult question of how a pass mark should increase with each attempt at an exam.

Dataset Information

An evaluation of the performance in the UK Royal College of Anaesthetists primary examination by UK medical school and gender.

Background

Methods

Results

Conclusion

Publications

An evaluation of the performance in the UK Royal College of Anaesthetists primary examination by UK medical school and gender.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets