Recognizing Reflection: Computer-Assisted Analysis of First Year Medical Students' Reflective Writing.
Ontology highlight
ABSTRACT: Background
Reflective writing is used throughout medical education to help students navigate their transformation into medical professionals. Assessment of reflective writing, however, is challenging; each available methodology of assessment has distinct advantages and disadvantages. We tested if combining two independent assessment mechanisms-a faculty-designed rubric and Academic Writing Analytics (AWA), an automated technique-could be used together to form a more robust form of evaluation.Methods
We obtained reflective essays written by first year medical students as part of a clinical skills course. Faculty scored essays using a rubric designed to evaluate Integration, Depth, and Writing. The same essays were subjected to AWA analysis, which counted the number of reflective phrases indicative of Context, Challenge, or Change.Results
Faculty scored the essays uniformly high, indicating that most students met the standard for reflection as described by the rubric. AWA identified over 1400 instances of reflective behavior within the essays, and there was significant variability in how often different types of reflective phrases were used by individual students.Conclusions
While data from faculty assessment or AWA alone is sufficient to evaluate reflective essays, combining these methods offer a richer and more valuable understanding of the student's reflection.
SUBMITTER: Hanlon CD
PROVIDER: S-EPMC8368857 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundAt the Medical University of Vienna, most information for students is available only online. In 2005, an e-learning project was initiated and there are plans to introduce a learning management system. In this study, we estimate the level of students' computer skills, the number of students having difficulty with e-learning, and the number of students opposed to e-learning.MethodsThe study was conducted in an introductory course on computer-based and web-based training (CBT/WBT). Students were asked to fill out a questionnaire online that covered a wide range of relevant attitudes and experiences.ResultsWhile the great majority of students possess sufficient computer skills and acknowledge the advantages of interactive and multimedia-enhanced learning material, a small percentage lacks basic computer skills and/or is very skeptical about e-learning. There is also a consistently significant albeit weak gender difference in available computer infrastructure and Internet access. As for student attitudes toward e-learning, we found that age, computer use, and previous exposure to computers are more important than gender. A sizable number of students, 12% of the total, make little or no use of existing e-learning offerings.ConclusionMany students would benefit from a basic introduction to computers and to the relevant computer-based resources of the university. Given to the wide range of computer skills among students, a single computer course for all students would not be useful nor would it be accepted. Special measures should be taken to prevent students who lack computer skills from being disadvantaged or from developing computer-hostile attitudes.
| S-EPMC1534040 | biostudies-literature
Project description:BackgroundThe use of computer assisted learning (CAL) has enhanced undergraduate medical education. CAL improves performance at examinations, develops problem solving skills and increases student satisfaction. The study evaluates computer literacy among first year medical students in Sri Lanka.MethodsThe study was conducted at Faculty of Medicine, University of Colombo, Sri Lanka between August-September 2008. First year medical students (n = 190) were invited for the study. Data on computer literacy and associated factors were collected by an expert-validated pre-tested self-administered questionnaire. Computer literacy was evaluated by testing knowledge on 6 domains; common software packages, operating systems, database management and the usage of internet and E-mail. A linear regression was conducted using total score for computer literacy as the continuous dependant variable and other independent covariates.ResultsSample size-181 (Response rate-95.3%), 49.7% were Males. Majority of the students (77.3%) owned a computer (Males-74.4%, Females-80.2%). Students have gained their present computer knowledge by; a formal training programme (64.1%), self learning (63.0%) or by peer learning (49.2%). The students used computers for predominately; word processing (95.6%), entertainment (95.0%), web browsing (80.1%) and preparing presentations (76.8%). Majority of the students (75.7%) expressed their willingness for a formal computer training programme at the faculty.Mean score for the computer literacy questionnaire was 48.4 ± 20.3, with no significant gender difference (Males-47.8 ± 21.1, Females-48.9 ± 19.6). There were 47.9% students that had a score less than 50% for the computer literacy questionnaire. Students from Colombo district, Western Province and Student owning a computer had a significantly higher mean score in comparison to other students (p < 0.001). In the linear regression analysis, formal computer training was the strongest predictor of computer literacy (? = 13.034), followed by using internet facility, being from Western province, using computers for Web browsing and computer programming, computer ownership and doing IT (Information Technology) as a subject in GCE (A/L) examination.ConclusionSri Lankan medical undergraduates had a low-intermediate level of computer literacy. There is a need to improve computer literacy, by increasing computer training in schools, or by introducing computer training in the initial stages of the undergraduate programme. These two options require improvement in infrastructure and other resources.
| S-EPMC3517310 | biostudies-literature
Project description:BackgroundReflective writing (RW) allows physicians to step back, review their thoughts, goals and actions and recognise how their perspectives, motives and emotions impact their conduct. RW also helps physicians consolidate their learning and boosts their professional and personal development. In the absence of a consistent approach and amidst growing threats to RW's place in medical training, a review of theories of RW in medical education and a review to map regnant practices, programs and assessment methods are proposed.MethodsA Systematic Evidence-Based Approach guided Systematic Scoping Review (SSR in SEBA) was adopted to guide and structure the two concurrent reviews. Independent searches were carried out on publications featured between 1st January 2000 and 30th June 2022 in PubMed, Embase, PsychINFO, CINAHL, ERIC, ASSIA, Scopus, Google Scholar, OpenGrey, GreyLit and ProQuest. The Split Approach saw the included articles analysed separately using thematic and content analysis. Like pieces of a jigsaw puzzle, the Jigsaw Perspective combined the themes and categories identified from both reviews. The Funnelling Process saw the themes/categories created compared with the tabulated summaries. The final domains which emerged structured the discussion that followed.ResultsA total of 33,076 abstracts were reviewed, 1826 full-text articles were appraised and 199 articles were included and analysed. The domains identified were theories and models, current methods, benefits and shortcomings, and recommendations.ConclusionsThis SSR in SEBA suggests that a structured approach to RW shapes the physician's belief system, guides their practice and nurtures their professional identity formation. In advancing a theoretical concept of RW, this SSR in SEBA proffers new insight into the process of RW, and the need for longitudinal, personalised feedback and support.
| S-EPMC9830881 | biostudies-literature
Project description: Not available
| S-EPMC11312873 | biostudies-literature
Project description:BACKGROUND: Reflective practice is a desirable trait in physicians, yet there is little information about how it is taught to or learned by medical students. The purpose of this study was to determine whether an online Evidence Based Medicine (EBM) exercise with a face-to-face debriefing session would prompt third year medical students to reflect on their current skills and lead them to further reflection on clinical decision making in the future. METHODS: All third year medical students at the University Of Maryland School Of Medicine who completed their pediatrics clerkship between 7/1/09 and 2/11/11 were required to complete the EBM exercise. Following completion each student received a personal report (Learning Profile) of their responses and attended a one hour large group debriefing session. Student responses to a survey following the debriefing sessions were analyzed using a post-test survey design with a single experimental cohort. RESULTS: Ninety-five percent of students completing the debriefing survey indicated that the debriefing session helped them better understand their learning profiles; 68% stated that their profiles allowed them to evaluate themselves and their decisions. Sixty-three percent noted that participating in the exercise and the debrief would lead them to either learn more about EBM and use EBM more in the future or reflect more on their own decision making. CONCLUSIONS: The EBM exercise was a successful way to introduce the concept of reflective practice to third year medical students, and the graphic Learning Profiles were effective instigators of discussion and reflection.
| S-EPMC4132283 | biostudies-other
Project description:PurposeMedical schools are increasingly aware of the ways in which physician empathy can have a profound impact on patients' lives and have developed humanities initiatives to address this concern. Reflective writing in particular is more commonly promoted in medical curricula, but there is limited research on the impact of reflective writing on medical student empathy levels. It aims to find the emotional effects of reflective writing interventions on medical and healthcare students by systemic review.MethodsTwo investigators independently reviewed educational publications for critical analysis. This review focused systematically on quantitative papers that measure the impact of reflective writing on empathy.ResultsOf the 1,032 studies found on Medline and CINAHL, only 8 used quantitative measures pre- and postwritten reflection to measure any impact on empathy outcomes. The outcomes measured included impact of reflective writing exercises on student wellness, aptitude, and/or clinical skills. Of these studies, a significant change in student empathy was observed in 100% of the studies, demonstrating a significant change in outcomes.ConclusionAlthough the lack of homogeneity in outcome measurement in the literature limits possible conclusion from this review, the overwhelmingly positive reporting of outcomes suggests that reflective writing should be considered in any medical curriculum.
| S-EPMC4309942 | biostudies-literature
Project description:PurposeThe study evaluated medical students' familiarity with information literacy and informatics during the health sciences library orientation.MethodsA survey was fielded at the start of the 2013 school year.ResultsSeventy-two of 77 students (94%) completed the survey. Over one-half (57%) expected to use library research materials and services. About half (43%) expected to use library physical space. Students preferred accessing biomedical research on laptops and learning via online-asynchronous modes.ConclusionsThe library identified areas for service development and outreach to medical students and academic departments.
| S-EPMC4613382 | biostudies-literature
Project description:PurposeDeliberate reflection on initial diagnosis has been found to repair diagnostic errors. We investigated the effectiveness of teaching students to use deliberate reflection on future cases and whether their usage would depend on their perception of case difficulty.MethodOne-hundred-nineteen medical students solved cases either with deliberate-reflection or without instructions to reflect. One week later, all participants solved six cases, each with two equally likely diagnoses, but some symptoms in the case were associated with only one of the diagnoses (discriminating features). Participants provided one diagnosis and subsequently wrote down everything they remembered from it. After the first three cases, they were told that the next three would be difficult cases. Reflection was measured by the proportion of discriminating features recalled (overall; related to their provided diagnosis; related to alternative diagnosis).ResultsThe deliberate-reflection condition recalled more features for the alternative diagnosis than the control condition (p = .013) regardless of described difficulty. They also recalled more features related to their provided diagnosis on the first three cases (p = .004), but on the last three cases (described as difficult), there was no difference.ConclusionLearning deliberate reflection helped students engage in more reflective reasoning when solving future cases.
| S-EPMC10841076 | biostudies-literature
Project description:Species recognition is a crucial component for many types of biological studies. To that end, broadly trained students must be able to accurately identify many different types of organisms. Courses that focus on learning the names of different species traditionally rely on preserved specimens viewed during class or laboratory time. Unfortunately, reliance on preserved specimens comes with many challenges in providing students with an optimal learning experience. The curriculum activity described here uses a modified PowerPoint file (species-recognition program-SRP) as a means of helping students learn to recognize and identify fishes based on subtle visual cues. Our results indicate that students were better able to identify fish species when using the SRP as a learning approach than when using preserved specimens. We suggest that the SRP approach to species recognition is an effective, viable alternative or supplement to preserved specimens that can be easily implemented in any course that emphasizes species identification. Information and materials are provided to enable instructors to create their own species-recognition programs. Journal of Microbiology & Biology Education.
| S-EPMC4858363 | biostudies-literature
Project description:IntroductionRecently, stories depicting social injustices and inequities have gripped the US, leading to protests and other demonstrations of student activism. In response to current events, students at Weill Cornell Medical College identified the need for more diversity inclusion components in the newly developed medical school curriculum. Thus, we developed a student-initiated, student-run elective, Community Perspectives in Medicine, which provides a forum for first-year medical students to interact, and have open discussions, with members of communities most impacted by social and health inequities.MethodsDuring five weekly 2-hour sessions, representatives of different community-based organizations (CBOs) speak with 15 first-year medical students. Invited CBOs represent diverse populations, including LGBT, chronic illness, disabilities, religion, and immigrant health. For each session's first hour, a second-year student facilitates a semistructured interview of the CBO guests focusing on health disparities within their community, challenges experienced with the medical system, and what they wish doctors did differently. Students are encouraged to ask questions, often resulting in a rich dialogue. The session's second part is a debriefing by the student facilitator over a relaxed dinner (without CBO guests).ResultsFourteen of the16 enrolled students attended all five sessions and completed the course evaluation. Satisfaction with the course was high, as 93% of students enrolled rated the course as excellent. The course format, content, and diversity of speakers were rated as excellent by 79%, 86%, and 93%, respectively. Similarly, 71% of students believed there to be excellent applicability to medical practice, and 100% of students thought the timing during first year was excellent.DiscussionWe emphasize the importance of a partnership between CBOs and medical students, thus increasing students' cultural awareness as well as formally involving traditionally disenfranchised communities in medical education. Our project's unique format of safe-space discussion forums and session debriefings enhances critical thinking. Though used with multiple CBOs as an elective, our model can be easily adapted for one session on a specific health disparity.
| S-EPMC6440428 | biostudies-literature