Dataset Information

Reflective and feedback performances on Thai medical students' patient history-taking skills.

ABSTRACT:

Background

Reflective practice (RP) plays a crucial role in encouraging learners to think critically and consciously about their performances. Providing constructive feedback can further enhance RP. But non-Western learners might face different learning barriers compared to learners in the West, where RP originated.

Methods

In this retrospective study, we assessed RP and feedback performances on Thai medical students' patient history-taking skills. We applied RP and peer feedback, along with feedback from the instructors, during the history-taking sessions of the ten-week introduction course for fourth-year medical students. Twelve history-taking sessions were used for the analysis. Two instructors assessed students' reflective performance and categorised them into one of the six stages of Gibbs' reflective cycle; their feedback performances were analysed using Pendleton's model. We investigated the correlations between students' overall grade point average (GPAX) and patient history-taking scores on the Objective Structured Clinical Examination (OSCE). Students' opinions of the RP teaching method were also collected.

Results

All (n?=?48) students participated in our study. The students' mean age was 21.2?±?0.5?years. The majority of the students were female (64.6%). The data indicated that 33 and 4% of the participants were categorised into the evaluation stage and action plan stage of Gibbs' reflective cycle, respectively. In addition, 22 and 15% of the participants were able to state what their peers did well and suggest how peers could improve their skills, respectively. All students passed the minimum passing level of four history-taking OSCE stations. Participants agreed that RP was a useful tool (mean 9.0, SD 0.1), which enhanced their thought processes (mean 8.4, SD 0.2) and future performances (mean 8.2, SD 0.2). However, there was no correlation between the students' highest Gibbs' reflection levels and their history-taking OSCE scores.

Conclusions

RP, together with feedback, proved to be a useful technique to help fourth-year Thai medical students improve their reflection skills, enhance their medical knowledge, and improve patient history-taking skills. Further study with longer monitoring is required to further explore negative and positive influential factors affecting students' achievement of better reflection performances.

SUBMITTER: Tawanwongsri W

PROVIDER: S-EPMC6518691 | biostudies-literature | 2019 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reflective and feedback performances on Thai medical students' patient history-taking skills.

Tawanwongsri Weeratian W Phenwan Tharin T

BMC medical education 20190514 1

<h4>Background</h4>Reflective practice (RP) plays a crucial role in encouraging learners to think critically and consciously about their performances. Providing constructive feedback can further enhance RP. But non-Western learners might face different learning barriers compared to learners in the West, where RP originated.<h4>Methods</h4>In this retrospective study, we assessed RP and feedback performances on Thai medical students' patient history-taking skills. We applied RP and peer feedback, ...[more]

PMID: 31088550

Similar Datasets

Project description:BackgroundThe use of feedback has been integral to medical student learning, but rigorous evidence to evaluate its education effect is limited, especially in the role of patient feedback in clinical teaching and practice improvement. The aim of the Patient Teaching Associate (PTA) Feedback Study was to evaluate whether additional written consumer feedback on patient satisfaction improved consultation skills among medical students and whether multisource feedback (MSF) improved student performance.MethodsIn this single site, double-blinded randomised controlled trial, 71 eligible medical students from two universities in their first clinical year were allocated to intervention or control and followed up for one semester. They participated in five simulated student-led consultations in a teaching clinic with patient volunteers living with chronic illness. Students in the intervention group received additional written feedback on patient satisfaction combined with guided self-reflection. The control group received usual immediate formative multisource feedback from tutors, patients and peers. Student characteristics, baseline patient-rated satisfaction scores and tutor-rated consultation skills were measured.ResultsFollow-up assessments were complete in 70 students attending the MSF program. At the final consultation episodes, both groups improved patient-rated rapport (P = 0.002), tutor-rated patient-centeredness and tutor-rated overall consultation skills (P = 0.01). The intervention group showed significantly better tutor-rated patient-centeredness (P = 0.003) comparing with the control group. Distress relief, communication comfort, rapport reported by patients and tutor-rated clinical skills did not differ significantly between the two groups.ConclusionsThe innovative multisource feedback program effectively improved consultation skills in medical students. Structured written consumer feedback combined with guided student reflection further improved patient-centred practice and effectively enhanced the benefit of an MSF model. This strategy might provide a valuable adjunct to communication skills education for medical students.Trial registrationAustralian New Zealand Clinical Trials Registry Number ACTRN12613001055796 .

Project description:BackgroundLearning through a 360° virtual reality (VR) or 2D video represents an alternative way to learn a complex medical education task. However, there is currently no consensus on how best to assess the effects of different learning materials on cognitive load estimates, heart rate variability (HRV), outcomes, and experience in learning history taking and physical examination (H&P) skills.ObjectiveThe aim of this study was to investigate how learning materials (ie, VR or 2D video) impact learning outcomes and experience through changes in cognitive load estimates and HRV for learning H&P skills.MethodsThis pilot system-design study included 32 undergraduate medical students at an academic teaching hospital. The students were randomly assigned, with a 1:1 allocation, to a 360° VR video group or a 2D video group, matched by age, sex, and cognitive style. The contents of both videos were different with regard to visual angle and self-determination. Learning outcomes were evaluated using the Milestone reporting form. Subjective and objective cognitive loads were estimated using the Paas Cognitive Load Scale, the National Aeronautics and Space Administration Task Load Index, and secondary-task reaction time. Cardiac autonomic function was assessed using HRV measurements. Learning experience was assessed using the AttrakDiff2 questionnaire and qualitative feedback. Statistical significance was accepted at a two-sided P value of <.01.ResultsAll 32 participants received the intended intervention. The sample consisted of 20 (63%) males and 12 (38%) females, with a median age of 24 (IQR 23-25) years. The 360° VR video group seemed to have a higher Milestone level than the 2D video group (P=.04). The reaction time at the 10th minute in the 360° VR video group was significantly higher than that in the 2D video group (P<.001). Multiple logistic regression models of the overall cohort showed that the 360° VR video module was independently and positively associated with a reaction time at the 10th minute of ≥3.6 seconds (exp B=18.8, 95% CI 3.2-110.8; P=.001) and a Milestone level of ≥3 (exp B=15.0, 95% CI 2.3-99.6; P=.005). However, a reaction time at the 10th minute of ≥3.6 seconds was not related to a Milestone level of ≥3. A low-frequency to high-frequency ratio between the 5th and 10th minute of ≥1.43 seemed to be inversely associated with a hedonic stimulation score of ≥2.0 (exp B=0.14, 95% CI 0.03-0.68; P=.015) after adjusting for video module. The main qualitative feedback indicated that the 360° VR video module was fun but caused mild dizziness, whereas the 2D video module was easy to follow but tedious.ConclusionsOur preliminary results showed that 360° VR video learning may be associated with a better Milestone level than 2D video learning, and that this did not seem to be related to cognitive load estimates or HRV indexes in the novice learners. Of note, an increase in sympathovagal balance may have been associated with a lower hedonic stimulation score, which may have met the learners' needs and prompted learning through the different video modules.Trial registrationClinicalTrials.gov NCT03501641; https://clinicaltrials.gov/ct2/show/NCT03501641.

Project description:BackgroundAlthough history taking is fundamental for diagnosing medical conditions, teaching and providing feedback on the skill can be challenging due to resource constraints. Virtual simulated patients and web-based chatbots have thus emerged as educational tools, with recent advancements in artificial intelligence (AI) such as large language models (LLMs) enhancing their realism and potential to provide feedback.ObjectiveIn our study, we aimed to evaluate the effectiveness of a Generative Pretrained Transformer (GPT) 4 model to provide structured feedback on medical students' performance in history taking with a simulated patient.MethodsWe conducted a prospective study involving medical students performing history taking with a GPT-powered chatbot. To that end, we designed a chatbot to simulate patients' responses and provide immediate feedback on the comprehensiveness of the students' history taking. Students' interactions with the chatbot were analyzed, and feedback from the chatbot was compared with feedback from a human rater. We measured interrater reliability and performed a descriptive analysis to assess the quality of feedback.ResultsMost of the study's participants were in their third year of medical school. A total of 1894 question-answer pairs from 106 conversations were included in our analysis. GPT-4's role-play and responses were medically plausible in more than 99% of cases. Interrater reliability between GPT-4 and the human rater showed "almost perfect" agreement (Cohen κ=0.832). Less agreement (κ<0.6) detected for 8 out of 45 feedback categories highlighted topics about which the model's assessments were overly specific or diverged from human judgement.ConclusionsThe GPT model was effective in providing structured feedback on history-taking dialogs provided by medical students. Although we unraveled some limitations regarding the specificity of feedback for certain feedback categories, the overall high agreement with human raters suggests that LLMs can be a valuable tool for medical education. Our findings, thus, advocate the careful integration of AI-driven feedback mechanisms in medical training and highlight important aspects when LLMs are used in that context.

Dataset Information

Reflective and feedback performances on Thai medical students' patient history-taking skills.

Background

Methods

Results

Conclusions

Publications

Reflective and feedback performances on Thai medical students' patient history-taking skills.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets