Examining the educational impact of the mini-CEX: a randomised controlled study.
Ontology highlight
ABSTRACT: Background
The purpose of this study is to evaluate the mini-Clinical Evaluation Exercise (mini-CEX) as a formative assessment tool among undergraduate medical students, in terms of student perceptions, effects on direct observation and feedback, and educational impact.Methods
Cluster randomised study of 38 fifth-year medical students during a 16-week clinical placement. Hospitals were randomised to provide a minimum of 8 mini-CEXs per student (intervention arm) or continue with ad-hoc feedback (control arm). After finishing their clinical placement, students completed an Objective Structured Clinical Examination (OSCE), a written test and a survey.Results
All participants in the intervention group completed the pre-planned number of assessments, and 60% found them to be useful during their clinical placement. Overall, there were no statistically significant differences between groups in reported quantity or quality of direct observation and feedback. Observed mean scores were marginally higher on the OSCE and written test in the intervention group, but not statistically significant.Conclusions
There is considerable potential in assessing medical students during clinical placements and routine practice, but the educational impact of formative assessments remains mostly unknown. This study contributes with a robust study design, and may serve as a basis for future research.
SUBMITTER: Martinsen SSS
PROVIDER: S-EPMC8061047 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:IntroductionMini Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) are used as formative assessments worldwide. Since an up-to-date comprehensive synthesis of the educational impact of Mini-CEX and DOPS is lacking, we performed a systematic review. Moreover, as the educational impact might be influenced by characteristics of the setting in which Mini-CEX and DOPS take place or their implementation status, we additionally investigated these potential influences.MethodsWe searched Scopus, Web of Science, and Ovid, including All Ovid Journals, Embase, ERIC, Ovid MEDLINE(R), and PsycINFO, for original research articles investigating the educational impact of Mini-CEX and DOPS on undergraduate and postgraduate trainees from all health professions, published in English or German from 1995 to 2016. Educational impact was operationalized and classified using Barr's adaptation of Kirkpatrick's four-level model. Where applicable, outcomes were pooled in meta-analyses, separately for Mini-CEX and DOPS. To examine potential influences, we used Fisher's exact test for count data.ResultsWe identified 26 articles demonstrating heterogeneous effects of Mini-CEX and DOPS on learners' reactions (Kirkpatrick Level 1) and positive effects of Mini-CEX and DOPS on trainees' performance (Kirkpatrick Level 2b; Mini-CEX: standardized mean difference (SMD) = 0.26, p = 0.014; DOPS: SMD = 3.33, p<0.001). No studies were found on higher Kirkpatrick levels. Regarding potential influences, we found two implementation characteristics, "quality" and "participant responsiveness", to be associated with the educational impact.ConclusionsDespite the limited evidence, the meta-analyses demonstrated positive effects of Mini-CEX and DOPS on trainee performance. Additionally, we revealed implementation characteristics to be associated with the educational impact. Hence, we assume that considering implementation characteristics could increase the educational impact of Mini-CEX and DOPS.
| S-EPMC5986126 | biostudies-literature
Project description:Mini-CEX scores assess resident competence. Rater training might improve mini-CEX score interrater reliability, but evidence is lacking.Evaluate a rater training workshop using interrater reliability and accuracy.Randomized trial (immediate versus delayed workshop) and single-group pre/post study (randomized groups combined).Academic medical center.Fifty-two internal medicine clinic preceptors (31 randomized and 21 additional workshop attendees).The workshop included rater error training, performance dimension training, behavioral observation training, and frame of reference training using lecture, video, and facilitated discussion. Delayed group received no intervention until after posttest.Mini-CEX ratings at baseline (just before workshop for workshop group), and four weeks later using videotaped resident-patient encounters; mini-CEX ratings of live resident-patient encounters one year preceding and one year following the workshop; rater confidence using mini-CEX.Among 31 randomized participants, interrater reliabilities in the delayed group (baseline intraclass correlation coefficient [ICC] 0.43, follow-up 0.53) and workshop group (baseline 0.40, follow-up 0.43) were not significantly different (p = 0.19). Mean ratings were similar at baseline (delayed 4.9 [95% confidence interval 4.6-5.2], workshop 4.8 [4.5-5.1]) and follow-up (delayed 5.4 [5.0-5.7], workshop 5.3 [5.0-5.6]; p = 0.88 for interaction). For the entire cohort, rater confidence (1 = not confident, 6 = very confident) improved from mean (SD) 3.8 (1.4) to 4.4 (1.0), p = 0.018. Interrater reliability for ratings of live encounters (entire cohort) was higher after the workshop (ICC 0.34) than before (ICC 0.18) but the standard error of measurement was similar for both periods.Rater training did not improve interrater reliability or accuracy of mini-CEX scores.clinicaltrials.gov identifier NCT00667940
| S-EPMC2607488 | biostudies-literature
Project description:ObjectivesThe formative aspect of the mini-clinical evaluation exercise (mini-CEX) in postgraduate medical workplace-based assessment is intended to afford opportunities for active learning. Yet, there is little understanding of the perceived relationship between the mini-CEX and how trainees self-regulate their learning. Our objective was to explore trainees' perceptions of their mini-CEX experiences from a learning perspective, using Zimmerman's self-regulated learning theoretical framework as an interpretive lens.DesignQualitative, using semi-structured interviews conducted in 2017. The interviews were analysed thematically.SettingGeriatric medicine training.ParticipantsPurposive sampling was employed to recruit geriatric medicine trainees in Melbourne, Australia. Twelve advanced trainees participated in the interviews.ResultsFour themes were found with a cyclical inter-relationship between three of these themes: namely, goal setting, task translation and perceived outcome. These themes reflect the phases of the self-regulated learning framework. Each phase was influenced by the fourth theme, supervisor co-regulation. Goal setting had motivational properties that had significant impact on the later phases of the cycle. A 'tick box' goal aligned with an opportunistic approach and poorer perceived educational outcomes. Participants reported that external feedback following assessment was critical for their self-evaluation, affective responses and perceived outcomes.ConclusionsTrainees perceived the performance of a mini-CEX as a complex, inter-related cyclical process, influenced at all stages by the supervisor. Based on our trainee perspectives of the mini-CEX, we conclude that supervisor engagement is essential to support trainees to individually regulate their learning in the clinical environment.
| S-EPMC6538085 | biostudies-literature
Project description:BackgroundCultural differences might challenge the acceptance of the implementation of assessment formats that are developed in other countries. Acceptance of assessment formats is essential for its effectiveness; therefore, we explored the views of students and specialists on the practicality and impact on learning of these formats. This study was conducted to explore Indonesian students' and specialists' appreciation of the implementation of the Mini-Clinical Evaluation Exercise (Mini-CEX) in Indonesian clerkships.MethodsThis study was conducted at the Universitas Gadjah Mada, Indonesia. Participants were 52 students and 21 specialists in neurology and 78 students and 50 specialists in internal medicine. They were asked to complete a 19-item questionnaire that covered the characteristics of the mini-CEX such as its practicality, and the impact on learning and professional development. We used a Mann-Whitney U test to analyse the data.ResultsIn total, 124 students (46 from neurology and 78 from internal medicine) and 38 specialists (13 from neurology and 25 from internal medicine) participated in this study. Students and specialists were positive about the practicality of the mini-CEX and the impact of this assessment format on learning and on professional development. The Mann-Whitney U test showed that there were no significant differences between students' and specialists' opinions on the mini-CEX, except for 2 items: specialists' appreciation of direct observation (mean rank = 93.16) was statistically significantly higher than students' appreciation of it (mean rank = 77.93; z = 2.065; p < 0.05), but students' appreciation of the item that students' past mini-CEX results affected their recent mini-CEX outcomes (mean rank = 85.29) was significantly higher than specialists' appreciation of it (mean rank = 69.12; z = 2140; p < 0.05).ConclusionStudents and specialists were positive about the mini-CEX in Indonesian clerkships, although it was developed and validated in another culture. We found only small differences between their appreciations, which could be explained by the patterns of specialist-student interaction in Indonesian culture as large power distance and low individualism country.
| S-EPMC7206730 | biostudies-literature
Project description:Therapeutic education is expanding in the management of Alzheimer's disease (AD) patients. Several studies have revealed a positive impact of therapeutic educational programmes on the caregiver's burden and/or quality of life. However, to date, no study has evaluated its impact on the quality of life of the AD patient.The THERAD study (THerapeutic Education in Alzheimer's Disease) is a 12-month randomised controlled trial that started in January 2013. This paper describes the study protocol. THERAD plans to enroll 170 dyads (AD patient and caregiver) on the basis of the following criteria: patient at a mild to moderately severe stage of AD, living at home, receiving support from a family caregiver. The main outcome is the patient's quality of life assessed by the Logsdon QoL-AD scale at 2 months, reported by the caregiver. The study is being led by geriatricians trained in therapeutic education at Toulouse University Hospital in France. To date, 107 caregiver/patient dyads have been recruited.This is the first trial designed to assess the specific impact of a therapeutic educational programme on the AD patient's quality of life. The final results will be available in 2015.[ClinicalTrials.gov: NCT01796314] Registered 19 February 2013.
| S-EPMC4255540 | biostudies-literature
Project description:BackgroundLaboratory services have a central role in supporting screening, diagnosis, and management of patients. The increase in chronic disease management in primary care for conditions such as diabetes mellitus requires regular monitoring of patients' biochemical parameters. This process offers a route for improving the quality of care that patients receive by using test results as a vehicle for delivering educational messages as well as the test result itself.AimTo develop and evaluate the effectiveness of a quality improvement initiative to improve the care of patients with diabetes using test report reminders.DesignA programme of four cluster randomised controlled trials within one population of general practices.ParticipantsGeneral practices in Newcastle-upon-Tyne, UK.InterventionBrief educational messages added to paper and electronic general practice laboratory test reports introduced over two phases. Phase One messages, attached to Haemoglobin A1c (HbA1c) reports, targeted glycaemic and cholesterol control. Phase Two messages, attached to albumin:creatinine ratio (ACR) reports, targeted blood pressure (BP) control and foot inspection.OutcomesGeneral practice mean levels of HbA1c and cholesterol (Phase One) and diastolic and systolic BP and proportions of patients having undergone foot inspections (Phase Two); number of tests requested.
| S-EPMC1973073 | biostudies-literature
Project description:BackgroundClinical pharmacists must have a complex combination of academic knowledge and practical experience that integrates all aspects of practice. Taiwan's Ministry of Health and Welfare in 2007 launched the Postgraduate Year (PGY) training program to increase the standard of pharmaceutical care. This study aims to develop a pharmacist-specific Chinese-language Mini-Clinical Evaluation Exercise (Mini-CEX) to evaluate the professional development of postgraduate year trainees.MethodThe specialized Mini-CEX was developed based on the core competencies of pharmacists, published literature, and expert opinion. A pilot test and evaluator workshop were held prior to the administration of the main test. Fifty-three samples were recruited. The main study was conducted at two regional teaching hospitals and a medical center teaching hospital in Taiwan between February and June 2012. The results were analyzed with the kappa statistic (inter-rater reliability) and descriptive statistics, while the Kruskal-Wallis test was used to examine the PGY trainees' Mini-CEX scores based on their performances.ResultsTrainees who had recently completed PGY programs (C-PGY) and 2nd year PGY trainees (PGY2) earned excellent scores, while the 1st year PGY trainees (PGY1) earned satisfactory scores in overall performance. C-PGY and PGY2 trainees also performed significantly better than PGY1 trainees in the organization and efficiency domain, and the communication skills domain.ConclusionThis study demonstrates the feasibility of using the newly developed pharmacist-specific Chinese-language version of the Mini-CEX instrument to evaluate the core competencies of PGY trainees in clinical settings.
| S-EPMC6530012 | biostudies-literature
Project description:A randomised controlled trial was undertaken to assess the effectiveness of a hospital Palliative Care Team (PCT) on physical symptoms and health-related quality of life (HRQoL); patient, family carer and primary care professional reported satisfaction with care; and health service resource use. The full package of advice and support provided by a multidisciplinary specialist PCT ('full-PCT') was compared with limited telephone advice ('telephone-PCT', the control group) in the setting of a teaching hospital trust in the SW of England. The trial recruited 261 out of 684 new inpatient referrals; 175 were allocated to 'full-PCT', 86 to 'telephone-PCT' (2 : 1 randomisation); with 191 (73%) being assessed at 1 week. There were highly significant improvements in symptoms, HRQoL, mood and 'emotional bother' in 'full-PCT' at 1 week, maintained over the 4-week follow-up. A smaller effect was seen in 'telephone-PCT'; there were no significant differences between the groups. Satisfaction with care in both groups was high and there was no significant difference between them. These data reflect a high standard of care of patients dying of cancer and other chronic diseases in an acute hospital environment, but do not demonstrate a difference between the two models of service delivery of specialist palliative care.
| S-EPMC2364271 | biostudies-other
Project description:ObjectiveTo construct a scientific and systematic competency evaluation tool for master of nursing specialists (MNS) and to provide a reference for the training, assessment and competency evaluation of MNS.MethodsA first draft of the indicators for assessing MNS core competencies was developed on the basis of published research and group discussions. Between June and December 2020, the indicators were revised using two rounds of the Delphi expert consultation method, with questionnaires completed by 16 experts from five provinces in China.ResultsThe valid retrieval rate of the two questionnaires was 100.00%, and the coefficient of expert authority was 0.931. The Kendall's concordance coefficients of the two rounds of questionnaires were 0.136 (p<0.05) and 0.147 (p<0.05), respectively. Consensus was reached on the seven dimensions and 52 items of the MNS competency assessment instrument. The instrument dimensions included nurse‒patient communication (9 items), health assessment (7 items), clinical decision-making (8 items), operational skills (7 items), health promotion (6 items), humanistic care (9 items) and organisational effectiveness (6 items).ConclusionsThe MNS competency assessment tool constructed in this study is focused and highly credible. The findings can be used as a guide for the training, assessment and competence evaluation of MNS in the future.
| S-EPMC10961558 | biostudies-literature
Project description:The mini clinical evaluation exercise (mini-CEX)-a tool used to assess student-patient encounters-is increasingly being applied as a learning device to foster clinical competencies. Although the importance of eliciting self-assessment for learning is widely acknowledged, little is known about the validity of self-assessed mini-CEX scores. The aims of this study were (1) to explore the variability of medical students' self-assessed mini-CEX scores, and to compare them with the scores obtained from their clinical supervisors, and (2) to ascertain whether learners' self-assessed mini-CEX scores represent a global dimension of clinical competence or discrete clinical skills.In year 4, medical students conducted one to three mini-CEX per clerkship in gynaecology, internal medicine, paediatrics, psychiatry and surgery. Students and clinical supervisors rated the students' performance on a 10-point scale (1?=?great need for improvement; 10?=?little need for improvement) in the six domains history taking, physical examination, counselling, clinical judgement, organisation/efficiency and professionalism as well as in overall performance. Correlations between students' self-ratings and ratings from clinical supervisors were calculated (Pearson's correlation coefficient) based on averaged scores per domain and overall. To investigate the dimensionality of the mini-CEX domain scores, we performed factor analyses using linear mixed models that accounted for the multilevel structure of the data.A total of 1773 mini-CEX from 164 students were analysed. Mean scores for the six domains ranged from 7.5 to 8.3 (student ratings) and from 8.8 to 9.3 (supervisor ratings). Correlations between the ratings of students and supervisors for the different domains varied between r =?0.29 and 0.51 (all p <?0.0001). Mini-CEX domain scores revealed a single-factor solution for both students' and supervisors' ratings, with high loadings of all six domains between 0.58 and 0.83 (students) and 0.58 and 0.84 (supervisors).These findings put a question mark on the validity of mini-CEX domain scores for formative purposes, as neither the scores obtained from students nor those obtained from clinical supervisors unravelled specific strengths and weaknesses of individual students' clinical competence.
| S-EPMC5941409 | biostudies-literature