Dataset Information

How students and specialists appreciate the mini-clinical evaluation exercise (mini-CEX) in Indonesian clerkships.

ABSTRACT:

Background

Cultural differences might challenge the acceptance of the implementation of assessment formats that are developed in other countries. Acceptance of assessment formats is essential for its effectiveness; therefore, we explored the views of students and specialists on the practicality and impact on learning of these formats. This study was conducted to explore Indonesian students' and specialists' appreciation of the implementation of the Mini-Clinical Evaluation Exercise (Mini-CEX) in Indonesian clerkships.

Methods

This study was conducted at the Universitas Gadjah Mada, Indonesia. Participants were 52 students and 21 specialists in neurology and 78 students and 50 specialists in internal medicine. They were asked to complete a 19-item questionnaire that covered the characteristics of the mini-CEX such as its practicality, and the impact on learning and professional development. We used a Mann-Whitney U test to analyse the data.

Results

In total, 124 students (46 from neurology and 78 from internal medicine) and 38 specialists (13 from neurology and 25 from internal medicine) participated in this study. Students and specialists were positive about the practicality of the mini-CEX and the impact of this assessment format on learning and on professional development. The Mann-Whitney U test showed that there were no significant differences between students' and specialists' opinions on the mini-CEX, except for 2 items: specialists' appreciation of direct observation (mean rank?=?93.16) was statistically significantly higher than students' appreciation of it (mean rank?=?77.93; z?=?2.065; p?ConclusionStudents and specialists were positive about the mini-CEX in Indonesian clerkships, although it was developed and validated in another culture. We found only small differences between their appreciations, which could be explained by the patterns of specialist-student interaction in Indonesian culture as large power distance and low individualism country.

SUBMITTER: Suhoyo Y

PROVIDER: S-EPMC7206730 | biostudies-literature | 2020 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

How students and specialists appreciate the mini-clinical evaluation exercise (mini-CEX) in Indonesian clerkships.

Suhoyo Yoyo Y Schönrock-Adema Johanna J Emilia Ova O Kuks Jan B M JBM Cohen-Schotanus Janke J

BMC medical education 20200508 1

<h4>Background</h4>Cultural differences might challenge the acceptance of the implementation of assessment formats that are developed in other countries. Acceptance of assessment formats is essential for its effectiveness; therefore, we explored the views of students and specialists on the practicality and impact on learning of these formats. This study was conducted to explore Indonesian students' and specialists' appreciation of the implementation of the Mini-Clinical Evaluation Exercise (Mini ...[more]

PMID: 32384888

Similar Datasets

Project description:The mini clinical evaluation exercise (mini-CEX)-a tool used to assess student-patient encounters-is increasingly being applied as a learning device to foster clinical competencies. Although the importance of eliciting self-assessment for learning is widely acknowledged, little is known about the validity of self-assessed mini-CEX scores. The aims of this study were (1) to explore the variability of medical students' self-assessed mini-CEX scores, and to compare them with the scores obtained from their clinical supervisors, and (2) to ascertain whether learners' self-assessed mini-CEX scores represent a global dimension of clinical competence or discrete clinical skills.In year 4, medical students conducted one to three mini-CEX per clerkship in gynaecology, internal medicine, paediatrics, psychiatry and surgery. Students and clinical supervisors rated the students' performance on a 10-point scale (1?=?great need for improvement; 10?=?little need for improvement) in the six domains history taking, physical examination, counselling, clinical judgement, organisation/efficiency and professionalism as well as in overall performance. Correlations between students' self-ratings and ratings from clinical supervisors were calculated (Pearson's correlation coefficient) based on averaged scores per domain and overall. To investigate the dimensionality of the mini-CEX domain scores, we performed factor analyses using linear mixed models that accounted for the multilevel structure of the data.A total of 1773 mini-CEX from 164 students were analysed. Mean scores for the six domains ranged from 7.5 to 8.3 (student ratings) and from 8.8 to 9.3 (supervisor ratings). Correlations between the ratings of students and supervisors for the different domains varied between r =?0.29 and 0.51 (all p <?0.0001). Mini-CEX domain scores revealed a single-factor solution for both students' and supervisors' ratings, with high loadings of all six domains between 0.58 and 0.83 (students) and 0.58 and 0.84 (supervisors).These findings put a question mark on the validity of mini-CEX domain scores for formative purposes, as neither the scores obtained from students nor those obtained from clinical supervisors unravelled specific strengths and weaknesses of individual students' clinical competence.

Project description:BackgroundThe mini-CEX is a valid and reliable method to assess the clinical competencies of trainees. Its data could be useful for educators to redesign curriculum as a process of quality improvement. The aim of this study was to evaluate a mini-CEX assessment program in our internal medicine residency training. We investigated the impact of mini-CEX workshops as a faculty development program on the acquisition of cognitive knowledge and the difference of practice behaviors among faculty members used the mini-CEX to assess residents' performance at work.MethodsWe designed an observational, two-phase study. In the faculty development program, we started a mini-CEX workshop for trainers in 2010, and the short-term outcome of the program was evaluated by comparing the pretest and posttest results to demonstrate the improvement in cognitive knowledge on mini-CEX. From September 2010 to August 2011, we implemented a monthly mini-CEX assessment program in our internal medicine residency training. The data of these mini-CEX assessment forms were collected and analyzed.ResultsIn the group of 49 mini-CEX workshop attendees, there was a statistically significant improvement in cognitive knowledge by comparing the pretest and posttest results (67.35?±?15.25 versus 81.22?±?10.34, p?<?0.001). Among the 863 clinical encounters of mini-CEX, which involved 97 residents and 139 evaluators, 229 (26.5%), 326 (37.8%), and 308 (35.7%) evaluations were completed by the first-year, second-year, and third- year residents separately. We found a statistically significant interaction between level of training and score in dimensions of mini-CEX. The scores in all dimensions measured were better for senior residents. Participation in mini-CEX workshops as a faculty development program strengthened the adherence of trainers to the principles of mini-CEX as a formative assessment in regard to provision of feedback. However, a deficiency in engaging residents' reflection was found.ConclusionsFaculty development is a prerequisite to train evaluators in order to implement a successful mini-CEX assessment program. We demonstrated the effectiveness of our mini-CEX workshops in terms of knowledge acquisition and enhancement of giving feedback when the faculty members used the tool. Further programs on providing effective feedback should be conducted to increase the impact of the mini-CEX as a formative assessment.

Project description:INTRODUCTION:Mini Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) are used as formative assessments worldwide. Since an up-to-date comprehensive synthesis of the educational impact of Mini-CEX and DOPS is lacking, we performed a systematic review. Moreover, as the educational impact might be influenced by characteristics of the setting in which Mini-CEX and DOPS take place or their implementation status, we additionally investigated these potential influences. METHODS:We searched Scopus, Web of Science, and Ovid, including All Ovid Journals, Embase, ERIC, Ovid MEDLINE(R), and PsycINFO, for original research articles investigating the educational impact of Mini-CEX and DOPS on undergraduate and postgraduate trainees from all health professions, published in English or German from 1995 to 2016. Educational impact was operationalized and classified using Barr's adaptation of Kirkpatrick's four-level model. Where applicable, outcomes were pooled in meta-analyses, separately for Mini-CEX and DOPS. To examine potential influences, we used Fisher's exact test for count data. RESULTS:We identified 26 articles demonstrating heterogeneous effects of Mini-CEX and DOPS on learners' reactions (Kirkpatrick Level 1) and positive effects of Mini-CEX and DOPS on trainees' performance (Kirkpatrick Level 2b; Mini-CEX: standardized mean difference (SMD) = 0.26, p = 0.014; DOPS: SMD = 3.33, p<0.001). No studies were found on higher Kirkpatrick levels. Regarding potential influences, we found two implementation characteristics, "quality" and "participant responsiveness", to be associated with the educational impact. CONCLUSIONS:Despite the limited evidence, the meta-analyses demonstrated positive effects of Mini-CEX and DOPS on trainee performance. Additionally, we revealed implementation characteristics to be associated with the educational impact. Hence, we assume that considering implementation characteristics could increase the educational impact of Mini-CEX and DOPS.

Dataset Information

How students and specialists appreciate the mini-clinical evaluation exercise (mini-CEX) in Indonesian clerkships.

Background

Methods

Results

Publications

How students and specialists appreciate the mini-clinical evaluation exercise (mini-CEX) in Indonesian clerkships.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets