Impact of video feedback system on medical students' perception of their clinical performance assessment.
Ontology highlight
ABSTRACT: Background
Providing feedback on student performance in the clinical performance assessment (CPA) is meaningful in that it helps students understand their strengths and weaknesses. This study compared students' perception of their CPA scores before and after providing personalized video feedback.Methods
Two identical online surveys of Year 1 medical students (N?=?103) that had undergone CPA were conducted to evaluate students' perceptions about their CPA scores before and after video feedback. Students were given their test scores with assessment analysis reports immediately after completing the CPA. Top-scored students from each station agreed to provide their video-recorded performance to the rest of the students.Results
After comparing their performance video and top-scored video at each station, medical students were more aware of their CPA total score, clinical performance examination (CPX) total score, score of each CPX station, section score for the CPX station, history taking section score, physical examination section score, and doctor-patient relationship section score. Moreover, students became more convinced of their own weaknesses from their history taking and patient education section after viewing video feedback than before.Conclusion
The use of the video feedback system might help students recognize their CPA results and identify their strengths and weaknesses.
SUBMITTER: Kam BS
PROVIDER: S-EPMC6615181 | biostudies-literature | 2019 Jul
REPOSITORIES: biostudies-literature
Publications
Impact of video feedback system on medical students' perception of their clinical performance assessment.
Kam Bee Sung BS Yune So Jung SJ Lee Sang Yeoup SY Im Sun Ju SJ Baek Sun Yong SY
BMC medical education 20190708 1
<h4>Background</h4>Providing feedback on student performance in the clinical performance assessment (CPA) is meaningful in that it helps students understand their strengths and weaknesses. This study compared students' perception of their CPA scores before and after providing personalized video feedback.<h4>Methods</h4>Two identical online surveys of Year 1 medical students (N = 103) that had undergone CPA were conducted to evaluate students' perceptions about their CPA scores before and after v ...[more]
Similar Datasets
Project description:In self-directed learning environments, students must monitor and assess their learning progress themselves. Formative assessments play a central role as instructional tools to train students in these self-assessment skills. Key to the effectiveness of a formative assessment as a training instrument is the degree of student involvement in the design and implementation of the formative assessment used to train them. Five characteristics are essential to secure a sufficient level of student involvement: (1) congruence (i.e., the tasks of a formative assessment must reflect the instructional content), (2) authenticity (i.e., the tasks of a formative assessment should be related to students' background and study context), (3) consultation (i.e., students should have a say in how their answers are evaluated based on which criteria), (4) transparency (i.e., no "mystery items"-the wording of the items must clearly addresses the targeted content), and (5) accommodation (i.e., all students should have the same chance to complete the items of a formative assessment). These five characteristics of student involvement were used to evaluate the quality of formative assessments that are employed to train undergraduates in a medical school in self-assessment skills. Different from extant approaches that typically rely on instructors' judgments to infer the degree of student involvement, this study uses a paradigm in higher educational research asking students directly about their perceptions of an instructional tool. Thus, here, students had to rate their level of involvement in the design and implementation of the formative assessments used to train them. A total of 140 medical students participated in the study. Multivariate statistical methods were used to analyze the data. The majority of medical students appreciate the use of formative assessments to teach them self-directed learning skills; but the results also show that there is still room for increasing student involvement-especially, for minority students.
| S-EPMC8368904 | biostudies-literature
Project description:BackgroundUse of podcasts has several advantages in medical education. Podcasts can be of different types based on their length: short (1-5 min), moderate (6-15 min) and long (>15 min) duration. Short-duration podcasts are unique since they can deliver high-yield information in a short time. The perceptions of medical students towards short-duration podcasts are not well understood and this study aimed to analyze the same. An exploratory analysis of students' podcast usage and performance in summative assessments was also undertaken.MethodsFirst-year medical students (N = 94) participated in the study. Eight audiovisual podcasts, each ≤3 min duration (3-MinuTe Lessons; 3MTLs) were developed for two topics in biochemistry. The podcasts were made available for students after didactic lectures on the topics. Feedback was collected from students about their perceptions to 3MTLs using a self-reported questionnaire. The scores of students in summative assessments were compared based on their usage of 3MTLs.ResultsFeedback revealed that 3MTLs were well received by students as a useful and convenient supplementary tool. Students used 3MTLs for topic review, to get an overview, as well as for quick revision and felt that 3MTLs were helpful in improving their understanding of the topic, clarify concepts and focus on important points and in turn, in preparation for assessments. A significant proportion (49%) felt that 3-min duration was optimal while, an equal proportion suggested an increase in the duration to 5 min with more information. The overall mean scores in assessments were not different between students based on 3MTLs usage. The pairwise comparisons revealed better scores amongst students who used 3MTLs for both topics.ConclusionOverall, short-duration podcasts were perceived by students as useful supplementary learning tools that aided them for revision and in preparation for assessments.
| S-EPMC5604391 | biostudies-literature
Project description:Background & Objective:Feedback has been identified as one of the key strategies for learning in the outcome-based curriculum. Students are more interested in their grades paying little attention to the feedback, may not understand the importance of feedback and its effect on their performance because of their perception, and beliefs. Non-constructive feedback will not result in the improvement of the students' performance. This study aims to explore; student's perception of useful feedback; the purpose of feedback and believes about written feedback. Methods:This analytical cross-sectional study was conducted from November 2017 to January 2018 at Majmaah University. Students studying in clinical phase were recruited. Data were collected from 121 students by self-structured questionnaire using complete enumeration sampling method. Results:Majority of the students (45.5%) disagreed that the feedback should always contain marks; (49.6%) commented that the tutor did not provide enough constructive feedback. While we ask the purpose of feedback (62.8%), agree with two-way nature of feedback, and it is helpful to find there expected performance. Almost two third (67.8%) of the students believe that limited feedback is the reason for frustration and they did not receive comments for improvement. Conclusions:Students are aware of the purpose of feedback. Senior students give more value to feedback and in the opinion that feedback provides useful suggestions for future improvement and limited feedback is the reason for frustration. The results highlight the need for more structured feedback mechanism, and there is a need for faculty engagement in training to fill the existing gapes to create an effective educational alliance.
| S-EPMC6041542 | biostudies-literature
Project description:We aimed to determine whether it was feasible to assess medical students as they completed a virtual sub-internship. Six students (out of 31 who completed an in-person sub-internship) participated in a 2-week virtual sub-internship, caring for patients remotely. Residents and attendings assessed those 6 students in 15 domains using the same assessment measures from the in-person sub-internship. Raters marked “unable to assess” in 75/390 responses (19%) for the virtual sub-internship versus 88/3,405 (2.6%) for the in-person sub-internship (P=0.01), most frequently for the virtual sub-internship in the domains of the physical examination (21, 81%), rapport with patients (18, 69%), and compassion (11, 42%). Students received complete assessments in most areas. Scores were higher for the in-person than the virtual sub-internship (4.67 vs. 4.45, P<0.01) for students who completed both. Students uniformly rated the virtual clerkship positively. Students can be assessed in many domains in the context of a virtual sub-internship.
| S-EPMC8289686 | biostudies-literature
Project description:BackgroundFeedback is essential in a self-regulated learning environment such as medical education. When feedback channels are widely spread, the need arises for a system of integrating this information in a single platform. This article reports on the design and initial testing of a feedback tool for medical students at Charité-Universitätsmedizin, Berlin, a large teaching hospital. Following a needs analysis, we designed and programmed a feedback tool in a user-centered approach. The resulting interface was evaluated prior to release with usability testing and again post release using quantitative/qualitative questionnaires.ResultsThe tool we created is a browser application for use on desktop or mobile devices. Students log in to see a dashboard of "cards" featuring summaries of assessment results, a portal for the documentation of acquired practical skills, and an overview of their progress along their course. Users see their cohort's average for each format. Learning analytics rank students' strengths by subject. The interface is characterized by colourful and simple graphics. In its initial form, the tool has been rated positively overall by students. During testing, the high task completion rate (78%) and low overall number of non-critical errors indicated good usability, while the quantitative data (system usability scoring) also indicates high ease of use. The source code for the tool is open-source and can be adapted by other medical faculties.ConclusionsThe results suggest that the implemented tool LevelUp is well-accepted by students. It therefore holds promise for improved, digitalized integrated feedback about students' learning progress. Our aim is that LevelUp will help medical students to keep track of their study progress and reflect on their skills. Further development will integrate users' recommendations for additional features as well as optimizing data flow.
| S-EPMC8220763 | biostudies-literature
Project description:BackgroundSelf-explanation without feedback has been shown to improve medical students' diagnostic reasoning. While feedback is generally seen as beneficial for learning, available evidence of the value of its combination with self-explanation is conflicting. This study investigated the effect on medical students' diagnostic performance of adding immediate or delayed content-feedback to self-explanation while solving cases.MethodsNinety-four 3rd-year students from a Canadian medical school were randomly assigned to three experimental conditions (immediate-feedback, delayed-feedback, control). In the learning phase, all students solved four clinical cases by giving i) the most likely diagnosis, ii) two main arguments supporting this diagnosis, and iii) two plausible alternative diagnoses, while using self-explanation. The immediate-feedback group was given the correct diagnosis after each case; delayed-feedback group received the correct diagnoses only after the four cases; control group received no feedback. One week later, all students solved four near-transfer (i.e., same final diagnosis as the learning cases but different scenarios) and four far-transfer cases (i.e., different final diagnosis from the learning cases and different scenarios) by answering the same three questions. Students' diagnostic accuracy (score for the response to the first question only) and diagnostic performance (combined score of responses to the three questions) scores were assessed in each phase. Four one-way ANOVAs were performed on each of the two scores for near and far-transfer cases.ResultsThere was a significant effect of experimental condition on diagnostic accuracy on near-transfer cases (p < .05). The immediate-feedback and delayed-feedback groups performed equally well, both better than control (respectively, mean = 90.73, standard deviation =10.69; mean = 89.92, standard deviation = 13.85; mean = 82.03, standard deviation = 17.66). The experimental conditions did not significantly differ on far-transfer cases.ConclusionsProviding feedback to students in the form of the correct diagnosis after using self-explanation with clinical cases is potentially beneficial to improve their diagnostic accuracy but this effect is limited to similar cases. Further studies should explore how more elaborated feedback combined with self-explanation may impact students' diagnostic performance on different cases.
| S-EPMC6558772 | biostudies-literature
Project description:BACKGROUND:Fecal microbiota transplantation (FMT) has become an emergent method in the therapy of several intestinal diseases, mainly in Clostridium difficile recurrence. The training of FMT in medical schools is at its beginning and in countries where FMT is only occasionally carried out, it is important to know the perception of medical students on FMT. METHODS:We undertook a survey of 3rd year medical students not exposed to official academic information on FMT in order to find out their knowledge, beliefs and attitude toward FMT. A number of 80 students were asked to fill a dedicated online questionnaire. RESULTS:52 out of 80 third year medical students anonymously filled the questionnaire (65% response rate). 34% of respondents reported to have at least a medium level of knowledge regarding FMT. The top indication for FMT identified by 76.9% was C. difficile infection; however, 60% believed FMT to be a promising therapy for a high number of conditions and while almost all respondents (98.1%) would recommend it, 88.4% would explore other options first. Colonoscopy was considered the optimal method of delivery by 42.3%. Only 39% of participants believed that patients would accept FMT, however 71% considered that a more socially acceptable name for the procedure and anonymous donors would increase acceptance rate. The risk of transmitting a disease undetected by donor stool screening procedures to the recipient was the most worrying side effect considered by 75% of respondents. 54% believed that more research is required for FMT to enter clinical practice and 55.7% of respondents would enroll patients in controlled clinical trials. CONCLUSIONS:Medical students not exposed to educational information on FMT seem to be somewhat well informed about this method and would recommend it to their patients. Students, however, need to know more on the indications of FMT.
| S-EPMC6788000 | biostudies-literature
Project description:BackgroundSocial media has become an integral part in the life of every individual in the 21st century. Social media addiction in the younger age group is a major problem. The objective of this study was to find a correlation between academic performance and social media use.MethodsThis was a cross-sectional questionnaire-based study conducted in a medical school over a period of 3 months (Nov 2018-Jan 2019), where 400 medical undergraduates who use social media participated in the study. Data collected from the questionnaire included the academic performance in terms of university examination marks, the duration of social media use per day and the social media addiction score. Data correlation was done using the Pearson's correlation factor.Results41.5% of students used social media for upto 3 h per day. Whatsapp (98.25%) and Youtube (91.75%) were the most commonly used social media applications. 73.5% used social media to read health-related news, 71.5% used it to complete assignments and more than 50% used it for seminar preparation, test preparation and research-related purposes. Academic performance of female students was better than male students. There was a significantly higher use of social media among academically low-performing medical students compared with high-performing medical students. There was a weak negative correlation between academic performance and social media usage and a strong positive correlation between social media usage and the social media addiction score.ConclusionsSocial media has a negative impact on the academic performance of 21st-century undergraduate medical students.
| S-EPMC7873710 | biostudies-literature
Project description:BackgroundAlthough simulation-based assessment (SBA) is being implemented in numerous medical education systems, it is still rarely used for undergraduate medical students in France. Objective structured clinical examinations (OSCEs) will be integrated into the national medical curriculum in 2021. In 2016 and 2017, we created a mannequin SBA to validate medical students' technical and psychometric skills during their emergency medicine and paediatric placements. The aim of our study was to determine medical students' perceptions of SBA.MethodsWe followed the grounded theory framework to conduct a qualitative study. A total of 215 students participated in either a paediatric or an emergency medicine simulation-based course with a final assessment. Among the 215 participants, we randomly selected forty students to constitute the focus groups. In the end, 30 students were interviewed. Data were coded and analysed by two independent investigators within the activity theory framework.ResultsThe analyses found four consensual themes. First, the students perceived that success in the SBA provided them with self-confidence and willingness to participate in their hospital placements (1). They considered SBA to have high face validity (2), and they reported changes in their practice after its implementation (3). Nevertheless, they found that SBA did not help with their final high-stakes assessments (4). They discussed three other themes without reaching consensus: stress, equity, and the structure of SBA. After an analysis with activity theory, we found that students' perceptions of SBA underlined the contradictions between two systems of training: hospital and medical. We hypothesise that a specific role and place for SBA should be defined between these two activity systems.ConclusionThe students perceived that SBA would increase self-confidence in their hospital placements and emphasise the general skills required in their future professional environment. However, they also reported that the assessment method might be biased and stressful. Our results concerning a preimplementation mannequin SBA and OSCE could provide valuable insight for new programme design and aid in improving existing programmes. Indeed, SBA seems to have a role and place between hospital placements and medical schools.
| S-EPMC8605506 | biostudies-literature
Project description:Objectives:The Emergency Medicine Milestone Project, a framework for assessing competencies, has been used as a method of providing focused resident feedback. However, the emergency medicine milestones do not include specific objective data about resident clinical efficiency and productivity, and studies have shown that milestone-based feedback does not improve resident satisfaction with the feedback process. We examined whether providing performance metric reports to resident physicians improves their satisfaction with the feedback process and their clinical performance. Methods:We conducted a three-phase stepped-wedge randomized pilot study of emergency medicine residents at a single, urban academic site. In phase 1, all residents received traditional feedback; in phase 2, residents were randomized to receive traditional feedback (control group) or traditional feedback with performance metric reports (intervention group); and in phase 3, all residents received monthly performance metric reports and traditional feedback. To assess resident satisfaction with the feedback process, surveys using 6-point Likert scales were administered at each study phase and analyzed using two-sample t-tests. Analysis of variance in repeated measures was performed to compare impact of feedback on resident clinical performance, specifically patient treatment time (PTT) and patient visits per hour. Results:Forty-one residents participated in the trial of which 21 were randomized to the intervention group and 20 in the control group. Ninety percent of residents liked receiving the report and 74% believed that it better prepared them for expectations of becoming an attending physician. Additionally, residents randomized to the intervention group reported higher satisfaction (p = 0.01) with the quality of the feedback compared to residents in the control group. However, receiving performance metric reports, regardless of study phase or postgraduate year status, did not affect clinical performance, specifically PTT (183 minutes vs. 177 minutes, p = 0.34) or patients visits per hour (0.99 vs. 1.04, p = 0.46). Conclusions:While feedback with performance metric reports did not improve resident clinical performance, resident physicians were more satisfied with the feedback process, and a majority of residents expressed liking the reports and felt that it better prepared them to become attending physicians. Residency training programs could consider augmenting feedback with performance metric reports to aide in the transition from resident to attending physician.
| S-EPMC6795364 | biostudies-literature