Dataset Information

Selecting doctors for postgraduate training in paediatrics using a competency based assessment centre.

ABSTRACT: The design and implementation of an assessment centre in the South Yorkshire and South Humberside deanery for selecting doctors into postgraduate training in paediatric medicine is described. Eleven competency domains were identified in the job analysis. An assessment centre comprising of four exercises was implemented to assess candidates. There were modest relationships between candidates' performance on the various assessment centre exercises. Outcomes based on interview performance were related to, but not the same as, outcomes based on the combined results of the three other assessment centre exercises. Candidates perceived the assessment centre to be a fair selection method. It is concluded that an assessment centre approach to SHO recruitment is feasible and provides a greater breadth and depth of information about candidates than does a structured interview.

SUBMITTER: Randall R

PROVIDER: S-EPMC2082751 | biostudies-literature | 2006 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Selecting doctors for postgraduate training in paediatrics using a competency based assessment centre.

Randall R R Davies H H Patterson F F Farrell K K

Archives of disease in childhood 20060501 5

The design and implementation of an assessment centre in the South Yorkshire and South Humberside deanery for selecting doctors into postgraduate training in paediatric medicine is described. Eleven competency domains were identified in the job analysis. An assessment centre comprising of four exercises was implemented to assess candidates. There were modest relationships between candidates' performance on the various assessment centre exercises. Outcomes based on interview performance were rela ...[more]

PMID: 16632675

Similar Datasets

Project description:Competency-based education (CBE) has transformed medical training during the last decades. In Flanders (Belgium), multiple competency frameworks are being used concurrently guiding paediatric postgraduate CBE. This study aimed to merge these frameworks into an integrated competency framework for postgraduate paediatric training. In a first phase, these frameworks were scrutinized and merged into one using the Canadian Medical Education Directives for Specialists (CanMEDS) framework as a comprehensive basis. Thereafter, the resulting unified competency framework was validated using a Delphi study with three consecutive rounds. All competencies (n = 95) were scored as relevant in the first round, and twelve competencies were adjusted in the second round. After the third round, all competencies were validated for inclusion. Nevertheless, differences in the setting in which a paediatrician may work make it difficult to apply a general framework, as not all competencies are equally relevant, applicable, or suitable for evaluation in every clinical setting. These challenges call for a clear description of the competencies to guide curriculum planning, and to provide a fitting workplace context and learning opportunities.Conclusion: A competency framework for paediatric post-graduate training was developed by combining three existing frameworks, and was validated through a Delphi study. This competency framework can be used in setting the goals for workplace learning during paediatric training. What is Known: •Benefits of competency-based education and its underlying competency frameworks have been described in the literature. •A single and comprehensive competency framework can facilitate training, assessment, and certification. What is New: •Three existing frameworks were merged into one integrated framework for paediatric postgraduate education, which was then adjusted and approved by an expert panel. •Differences in the working environment might explain how relevant a competency is perceived.

Project description:BACKGROUND:Improved training approaches have the potential to overcome barriers to the use of postpartum intrauterine devices (PPIUDs) in Pakistan, including a shortage of female providers who are able to insert the device. This study assessed the effectiveness and acceptability of a competency-based onsite training approach that employed a newly developed anatomic model (the Mama-U) to train doctors and midwives on postpartum family planning (PPFP) and the insertion of PPIUDs. METHODS:An observational, mixed methods study conducted training evaluations and knowledge and skills assessments with 11 trainers and 88 doctors and midwives who participated in eight PPIUD training sessions. Two months later, follow-up interviews and clinical assessments were conducted with 20 providers, and interviews and a focus group discussion were conducted with 85 married women who received a PPIUD from a trained provider. RESULTS:The training significantly improved provider knowledge (p <?0.001), and follow-up assessments showed that clinical skills were retained for at least two months post-training. After training, 81.8% of providers were confident in their ability to provide PPIUD services, and midwives and doctors had similar PPIUD insertion skills. However, midwives were more likely than doctors to meet all 10 key requirements during PPIUD counseling sessions (63.9% versus 13.3%, p =?0.004). Providers found the Mama-U model to be a useful tool for client counseling as well as training and skills practice, and clients agreed. Trainers identified the low cost, light weight, and portability of the Mama-U model as advantages over the conventional training model and noted that its abstract shape reduced embarrassment among trainers, providers, and clients. CONCLUSIONS:Competency-based training with the Mama-U model can improve the quality of PPIUD counseling and PPIUD insertion services and has the potential to extend PPFP/PPIUD service delivery to midwives working in rural Pakistan. The portable, low-cost Mama-U permits onsite, on-the-job PPIUD insertion training that is tailored to the local setting; it is also well suited for the continuing practice that providers need to maintain their skills. Further research is needed to confirm the usefulness and cost-effectiveness of the Mama-U at scale and in other settings.

Project description:Fairness is a critical component of defensible assessment. Candidates should perform according to ability without influence from background characteristics such as ethnicity or sex. However, performance differs by candidate background in many assessment environments. Many potential causes of such differences exist, and examinations must be routinely analysed to ensure they do not present inappropriate progression barriers for any candidate group. By analysing the individual questions of an examination through techniques such as Differential Item Functioning (DIF), we can test whether a subset of unfair questions explains group-level differences. Such items can then be revised or removed.We used DIF to investigate fairness for 13,694 candidates sitting a major international summative postgraduate examination in internal medicine. We compared (a) ethnically white UK graduates against ethnically non-white UK graduates and (b) male UK graduates against female UK graduates. DIF was used to test 2773 questions across 14 sittings.Across 2773 questions eight (0.29%) showed notable DIF after correcting for multiple comparisons: seven medium effects and one large effect. Blinded analysis of these questions by a panel of clinician assessors identified no plausible explanations for the differences. These questions were removed from the question bank and we present them here to share knowledge of questions with DIF. These questions did not significantly impact the overall performance of the cohort. Group-level differences in performance between the groups we studied in this examination cannot be explained by a subset of unfair questions.DIF helps explore fairness in assessment at the question level. This is especially important in high-stakes assessment where a small number of unfair questions may adversely impact the passing rates of some groups. However, very few questions exhibited notable DIF so differences in passing rates for the groups we studied cannot be explained by unfairness at the question level.

Project description:BackgroundThe principle of workplace based assessment (WBA) is to assess trainees at work with feedback integrated into the program simultaneously. A student driven WBA model was introduced and perception evaluation of this teaching method was done subsequently by taking feedback from the faculty as well as the postgraduate trainees (PGs) of a residency program.MethodsDescriptive multimethod study was conducted. A WBA program was designed for PGs in Chemical Pathology on Moodle and forms utilized were case-based discussion (CBD), direct observation of practical skills (DOPS) and evaluation of clinical events (ECE). Consented assessors and PGs were trained on WBA through a workshop. Pretest and posttest to assess PGs knowledge before and after WBA were conducted. Every time a WBA form was filled, perception of PGs and assessors towards WBA, time taken to conduct single WBA and feedback were recorded. Faculty and PGs qualitative feedback on perception of WBA was taken via interviews. WBA tools data and qualitative feedback were used to evaluate the acceptability and feasibility of the new tools.ResultsSix eligible PGs and seventeen assessors participated in this study. A total of 79 CBDs (assessors n = 7 and PGs n = 6), 12 ECEs (assessors n = 6 and PGs n = 5), and 20 DOPS (assessors n = 6 and PGs n = 6) were documented. PGs average pretest score was 55.6%, which was improved to 96.4% in posttest; p value< 0.05. Scores of annual assessment before and after implementation of WBA also showed significant improvement, p value 0.039, Overall mean time taken to evaluate PG's was 12.6 ± 9.9 min and feedback time 9.2 ± 7.4 min. Mean WBA process satisfaction of assessors and PGs on Likert scale of 1 to 10 was 8 ± 1 and 8.3 ± 0.8 respectively.ConclusionBoth assessors and fellows were satisfied with introduction and implementation of WBA. It gave the fellows opportunity to interact with assessors more often and learn from their rich experience. Gain in knowledge of PGs was identified from the statistically significant improvement in PGs' assessment scores after WBA implementation.

Dataset Information

Selecting doctors for postgraduate training in paediatrics using a competency based assessment centre.

Publications

Selecting doctors for postgraduate training in paediatrics using a competency based assessment centre.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets