Dataset Information

Comparison of Assessment by a Virtual Patient and by Clinician-Educators of Medical Students' History-Taking Skills: Exploratory Descriptive Study.

ABSTRACT: BACKGROUND:A virtual patient (VP) can be a useful tool to foster the development of medical history-taking skills without the inherent constraints of the bedside setting. Although VPs hold the promise of contributing to the development of students' skills, documenting and assessing skills acquired through a VP is a challenge. OBJECTIVE:We propose a framework for the automated assessment of medical history taking within a VP software and then test this framework by comparing VP scores with the judgment of 10 clinician-educators (CEs). METHODS:We built upon 4 domains of medical history taking to be assessed (breadth, depth, logical sequence, and interviewing technique), adapting these to be implemented into a specific VP environment. A total of 10 CEs watched the screen recordings of 3 students to assess their performance first globally and then for each of the 4 domains. RESULTS:The scores provided by the VPs were slightly higher but comparable with those given by the CEs for global performance and for depth, logical sequence, and interviewing technique. For breadth, the VP scores were higher for 2 of the 3 students compared with the CE scores. CONCLUSIONS:Findings suggest that the VP assessment gives results akin to those that would be generated by CEs. Developing a model for what constitutes good history-taking performance in specific contexts may provide insights into how CEs generally think about assessment.

SUBMITTER: Setrakian J

PROVIDER: S-EPMC7099396 | biostudies-literature | 2020 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Comparison of Assessment by a Virtual Patient and by Clinician-Educators of Medical Students' History-Taking Skills: Exploratory Descriptive Study.

Setrakian Jean J Gauthier Geneviève G Bergeron Linda L Chamberland Martine M St-Onge Christina C

JMIR medical education 20200312 1

<h4>Background</h4>A virtual patient (VP) can be a useful tool to foster the development of medical history-taking skills without the inherent constraints of the bedside setting. Although VPs hold the promise of contributing to the development of students' skills, documenting and assessing skills acquired through a VP is a challenge.<h4>Objective</h4>We propose a framework for the automated assessment of medical history taking within a VP software and then test this framework by comparing VP sco ...[more]

PMID: 32163036

Similar Datasets

Project description:BackgroundReflective practice (RP) plays a crucial role in encouraging learners to think critically and consciously about their performances. Providing constructive feedback can further enhance RP. But non-Western learners might face different learning barriers compared to learners in the West, where RP originated.MethodsIn this retrospective study, we assessed RP and feedback performances on Thai medical students' patient history-taking skills. We applied RP and peer feedback, along with feedback from the instructors, during the history-taking sessions of the ten-week introduction course for fourth-year medical students. Twelve history-taking sessions were used for the analysis. Two instructors assessed students' reflective performance and categorised them into one of the six stages of Gibbs' reflective cycle; their feedback performances were analysed using Pendleton's model. We investigated the correlations between students' overall grade point average (GPAX) and patient history-taking scores on the Objective Structured Clinical Examination (OSCE). Students' opinions of the RP teaching method were also collected.ResultsAll (n = 48) students participated in our study. The students' mean age was 21.2 ± 0.5 years. The majority of the students were female (64.6%). The data indicated that 33 and 4% of the participants were categorised into the evaluation stage and action plan stage of Gibbs' reflective cycle, respectively. In addition, 22 and 15% of the participants were able to state what their peers did well and suggest how peers could improve their skills, respectively. All students passed the minimum passing level of four history-taking OSCE stations. Participants agreed that RP was a useful tool (mean 9.0, SD 0.1), which enhanced their thought processes (mean 8.4, SD 0.2) and future performances (mean 8.2, SD 0.2). However, there was no correlation between the students' highest Gibbs' reflection levels and their history-taking OSCE scores.ConclusionsRP, together with feedback, proved to be a useful technique to help fourth-year Thai medical students improve their reflection skills, enhance their medical knowledge, and improve patient history-taking skills. Further study with longer monitoring is required to further explore negative and positive influential factors affecting students' achievement of better reflection performances.

Project description:BackgroundLearning through a 360° virtual reality (VR) or 2D video represents an alternative way to learn a complex medical education task. However, there is currently no consensus on how best to assess the effects of different learning materials on cognitive load estimates, heart rate variability (HRV), outcomes, and experience in learning history taking and physical examination (H&P) skills.ObjectiveThe aim of this study was to investigate how learning materials (ie, VR or 2D video) impact learning outcomes and experience through changes in cognitive load estimates and HRV for learning H&P skills.MethodsThis pilot system-design study included 32 undergraduate medical students at an academic teaching hospital. The students were randomly assigned, with a 1:1 allocation, to a 360° VR video group or a 2D video group, matched by age, sex, and cognitive style. The contents of both videos were different with regard to visual angle and self-determination. Learning outcomes were evaluated using the Milestone reporting form. Subjective and objective cognitive loads were estimated using the Paas Cognitive Load Scale, the National Aeronautics and Space Administration Task Load Index, and secondary-task reaction time. Cardiac autonomic function was assessed using HRV measurements. Learning experience was assessed using the AttrakDiff2 questionnaire and qualitative feedback. Statistical significance was accepted at a two-sided P value of <.01.ResultsAll 32 participants received the intended intervention. The sample consisted of 20 (63%) males and 12 (38%) females, with a median age of 24 (IQR 23-25) years. The 360° VR video group seemed to have a higher Milestone level than the 2D video group (P=.04). The reaction time at the 10th minute in the 360° VR video group was significantly higher than that in the 2D video group (P<.001). Multiple logistic regression models of the overall cohort showed that the 360° VR video module was independently and positively associated with a reaction time at the 10th minute of ≥3.6 seconds (exp B=18.8, 95% CI 3.2-110.8; P=.001) and a Milestone level of ≥3 (exp B=15.0, 95% CI 2.3-99.6; P=.005). However, a reaction time at the 10th minute of ≥3.6 seconds was not related to a Milestone level of ≥3. A low-frequency to high-frequency ratio between the 5th and 10th minute of ≥1.43 seemed to be inversely associated with a hedonic stimulation score of ≥2.0 (exp B=0.14, 95% CI 0.03-0.68; P=.015) after adjusting for video module. The main qualitative feedback indicated that the 360° VR video module was fun but caused mild dizziness, whereas the 2D video module was easy to follow but tedious.ConclusionsOur preliminary results showed that 360° VR video learning may be associated with a better Milestone level than 2D video learning, and that this did not seem to be related to cognitive load estimates or HRV indexes in the novice learners. Of note, an increase in sympathovagal balance may have been associated with a lower hedonic stimulation score, which may have met the learners' needs and prompted learning through the different video modules.Trial registrationClinicalTrials.gov NCT03501641; https://clinicaltrials.gov/ct2/show/NCT03501641.

Project description:ObjectivesThis study investigates the effectiveness of a virtual format of an advanced communication skills observed structured clinical examination (OSCE) for senior medical students in comparison to an in-person format. The study also examines the emotional support students experience in the virtual setting. Our analysis was based on quantitative data collected through objective checklists and post-OSCE survey results.MethodsThe virtual OSCE was a revision of an earlier in-person formative advanced communication skills OSCE for fourth-year medical students. Student performances were assessed by self and peers using objective checklists-the modified Master Interview Rating Scale (mMIRS) and Communication Behavior Checklist (CBC). The mMIRS measured interview process such as avoiding jargon and demonstrating empathy. The CBC examined interview content which included tasks specific to the content of the case. The OSCE was followed by a faculty-led debrief and quantitative survey. The virtual OSCE was conducted in 2021, and the results of the checklists and survey were compared with those collected from two earlier in-person OSCEs.ResultsEighty-three students participated in the virtual OSCE. There was no difference in mMIRS scores between the virtual and in-person OSCE. Overall CBC scores were lower in the virtual OSCE compared to in-person (p < 0.05). Sixty-seven out of 83 (80.7%) students completed the post-OSCE survey. There were no differences between the virtual and in-person OSCE in terms of educational value, whether the OSCE would change the way participants talk to patients, and preparedness to have serious conversations with patients. All respondents somewhat or strongly agreed with feeling emotionally supported during the virtual OSCE.ConclusionThe virtual format was a suitable alternative to an in-person, formative, advanced communication skills OSCE for medical students. The virtual OSCE was educationally effective and was met with student satisfaction and a sense of emotional support. Future virtual iterations must ensure adequate instruction on interview content.

Dataset Information

Comparison of Assessment by a Virtual Patient and by Clinician-Educators of Medical Students' History-Taking Skills: Exploratory Descriptive Study.

Publications

Comparison of Assessment by a Virtual Patient and by Clinician-Educators of Medical Students' History-Taking Skills: Exploratory Descriptive Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets