Dataset Information

Medical students' patterns of using ChatGPT as a feedback tool and perceptions of ChatGPT in a Leadership and Communication course in Korea: a cross-sectional study.

ABSTRACT:

Purpose

This study aimed to analyze patterns of using ChatGPT before and after group activities and to explore medical students' perceptions of ChatGPT as a feedback tool in the classroom.

Methods

The study included 99 2nd-year pre-medical students who participated in a "Leadership and Communication" course from March to June 2023. Students engaged in both individual and group activities related to negotiation strategies. ChatGPT was used to provide feedback on their solutions. A survey was administered to assess students' perceptions of ChatGPT's feedback, its use in the classroom, and the strengths and challenges of ChatGPT from May 17 to 19, 2023.

Results

The students responded by indicating that ChatGPT's feedback was helpful, and revised and resubmitted their group answers in various ways after receiving feedback. The majority of respondents expressed agreement with the use of ChatGPT during class. The most common response concerning the appropriate context of using ChatGPT's feedback was "after the first round of discussion, for revisions." There was a significant difference in satisfaction with ChatGPT's feedback, including correctness, usefulness, and ethics, depending on whether or not ChatGPT was used during class, but there was no significant difference according to gender or whether students had previous experience with ChatGPT. The strongest advantages were "providing answers to questions" and "summarizing information," and the worst disadvantage was "producing information without supporting evidence."

Conclusion

The students were aware of the advantages and disadvantages of ChatGPT, and they had a positive attitude toward using ChatGPT in the classroom.

SUBMITTER: Park J

PROVIDER: S-EPMC10725745 | biostudies-literature | 2023

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Medical students' patterns of using ChatGPT as a feedback tool and perceptions of ChatGPT in a Leadership and Communication course in Korea: a cross-sectional study.

Park Janghee J

Journal of educational evaluation for health professions 20231110

<h4>Purpose</h4>This study aimed to analyze patterns of using ChatGPT before and after group activities and to explore medical students' perceptions of ChatGPT as a feedback tool in the classroom.<h4>Methods</h4>The study included 99 2nd-year pre-medical students who participated in a "Leadership and Communication" course from March to June 2023. Students engaged in both individual and group activities related to negotiation strategies. ChatGPT was used to provide feedback on their solutions. A ...[more]

PMID: 38096895

Similar Datasets

Project description:BackgroundText-generating artificial intelligence (AI) such as ChatGPT offers many opportunities and challenges in medical education. Acquiring practical skills necessary for using AI in a clinical context is crucial, especially for medical education.ObjectiveThis explorative study aimed to investigate the feasibility of integrating ChatGPT into teaching units and to evaluate the course and the importance of AI-related competencies for medical students. Since a possible application of ChatGPT in the medical field could be the generation of information for patients, we further investigated how such information is perceived by students in terms of persuasiveness and quality.MethodsChatGPT was integrated into 3 different teaching units of a blended learning course for medical students. Using a mixed methods approach, quantitative and qualitative data were collected. As baseline data, we assessed students' characteristics, including their openness to digital innovation. The students evaluated the integration of ChatGPT into the course and shared their thoughts regarding the future of text-generating AI in medical education. The course was evaluated based on the Kirkpatrick Model, with satisfaction, learning progress, and applicable knowledge considered as key assessment levels. In ChatGPT-integrating teaching units, students evaluated videos featuring information for patients regarding their persuasiveness on treatment expectations in a self-experience experiment and critically reviewed information for patients written using ChatGPT 3.5 based on different prompts.ResultsA total of 52 medical students participated in the study. The comprehensive evaluation of the course revealed elevated levels of satisfaction, learning progress, and applicability specifically in relation to the ChatGPT-integrating teaching units. Furthermore, all evaluation levels demonstrated an association with each other. Higher openness to digital innovation was associated with higher satisfaction and, to a lesser extent, with higher applicability. AI-related competencies in other courses of the medical curriculum were perceived as highly important by medical students. Qualitative analysis highlighted potential use cases of ChatGPT in teaching and learning. In ChatGPT-integrating teaching units, students rated information for patients generated using a basic ChatGPT prompt as "moderate" in terms of comprehensibility, patient safety, and the correct application of communication rules taught during the course. The students' ratings were considerably improved using an extended prompt. The same text, however, showed the smallest increase in treatment expectations when compared with information provided by humans (patient, clinician, and expert) via videos.ConclusionsThis study offers valuable insights into integrating the development of AI competencies into a blended learning course. Integration of ChatGPT enhanced learning experiences for medical students.

Project description:In the model medical curriculum HannibaL at Hannover Medical School (MHH, Hannover, Germany), communication skills in taking case histories and disclosing diagnoses (breaking bad news) are assessed through an objective structured clinical examination (OSCE). This is part of the examinations which at the MHH represent the equivalent to the First Part of the Medical Examinations. The second year doctor-patient communication course preparing for these examinations was evaluated during the 2009/10 academic year.Using questionnaires specific to the learning objectives, learning needs were assessed, pre-post comparisons of self-assessed competencies were performed and key teaching methods were evaluated (5-point Likert scales, "5"=fully agree). At T0 (start of the course) 267 students participated (response rate: 93.7%), of which 180 filled out the T1 questionnaire during the last session of the course (67.4%). Within-subject analyses of variance and paired t-tests were conducted.The highest learning needs were found for the "to show how"-items regarding history taking and disclosing diagnoses (M=4.4). The T1-T0 comparisons showed the greatest improvements for history taking ("to know how": mean difference = +1.7, "to show how": +1.8, p<.0001 as with all tests) and the "to know how"-item regarding the disclosure of diagnoses (+1.6), followed by the "to show how"-items on disclosing a diagnosis (+1.4), shared decision making (+1.2), self-assessing one's own strengths/weaknesses (+1.0) and confidently approaching new patients (+0.7). Students with T0 values of 1 or 2 on the respective scales improved on average by 2.2 points across all items, students with the value of 3 by 1.1, and from 4 or 5 by 0.1. Methodically, the use of simulated patients was rated the most helpful (M=4.8, 87% with the scale value 5). This doctor-patient communication course is associated with substantial improvements regarding all key learning objectives. Regarding methods, the deployed simulated patients (2-4 per 10-student-course group in 3 of the 7 course sessions, respectively) were rated the most helpful. The present evaluation calls for both further development of the doctor-patient communication curriculum at the MHH and joint activities across medical schools, which are discussed at the end of the paper.

Dataset Information

Medical students' patterns of using ChatGPT as a feedback tool and perceptions of ChatGPT in a Leadership and Communication course in Korea: a cross-sectional study.

Purpose

Methods

Results

Conclusion

Publications

Medical students' patterns of using ChatGPT as a feedback tool and perceptions of ChatGPT in a Leadership and Communication course in Korea: a cross-sectional study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets