Dataset Information

Feedback after OSCE: A comparison of face to face versus an enhanced written feedback.

ABSTRACT:

Background

The Objective Structured Clinical Exam (OSCE) is a useful means of generating meaningful feedback. OSCE feedback may be in various forms (written, face to face and audio or video recordings). Studies on OSCE feedback are uncommon, especially involving Asian medical students.

Methods

We compared two methods of OSCE feedback delivered to fourth year medical students in Malaysia: (i) Face to face (FTF) immediate feedback (semester one) (ii) Individualised enhanced written (EW) feedback containing detailed scores in each domain, examiners' free text comments and the marking rubric (semester two). Both methods were evaluated by students and staff examiners, and students' responses were compared against their OSCE performance.

Results

Of the 116 students who sat for both formative OSCEs, 82.8% (n=96) and 86.2% (n=100) responded to the first and second survey respectively. Most students were comfortable to receive feedback (91.3% in FTF, 96% in EW) with EW feedback associated with higher comfort levels (p=0.022). Distress affected a small number with no differences between either method (13.5% in FTF, 10% in EW, p=0.316). Most students perceived both types of feedback improved their performance (89.6% in FTF, 95% in EW); this perception was significantly stronger for EW feedback (p=0.008). Students who preferred EW feedback had lower OSCE scores compared to those preferring FTF feedback (mean scores ± SD: 43.8 ± 5.3 in EW, 47.2 ± 6.5 in FTF, p=0.049). Students ranked the "marking rubric" to be the most valuable aspect of the EW feedback. Tutors felt both methods of feedback were equally beneficial. Few examiners felt they needed training (21.4% in FTF, 15% in EW) but students perceived this need for tutors' training differently (53.1% in FTF, 46% in EW) CONCLUSION: Whilst both methods of OSCE feedback were highly valued, students preferred to receive EW feedback and felt it was more beneficial. Learning cultures of Malaysian students may have influenced this view. Information provided in EW feedback should be tailored accordingly to provide meaningful feedback in OSCE exams.

SUBMITTER: Ngim CF

PROVIDER: S-EPMC7992790 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:With the current funding climate and need for advancements in implementation science, there is a growing demand for grantsmanship workshops to increase the quality and rigor of proposals. A group-based implementation science-focused grantsmanship workshop, the Implementation Development Workshop (IDW), is one methodology to address this need. This manuscript provides an overview of the IDW structure, format, and findings regarding its utility.The IDW methodology allows researchers to vet projects in the proposal stage in a structured format with a facilitator and two types of expert participants: presenters and attendees. The presenter uses a one-page handout and verbal presentation to present their proposal and questions. The facilitator elicits feedback from attendees using a format designed to maximize the number of unique points made. After each IDW, participants completed an anonymous survey assessing perceptions of the IDW. Presenters completed a funding survey measuring grant submission and funding success. Qualitative interviews were conducted with a subset of participants who participated in both delivery formats. Mixed method analyses were performed to evaluate the effectiveness and acceptability of the IDW and compare the delivery formats. Of those who participated in an IDW (N = 72), 40 participated in face-to-face only, 16 in virtual only, and 16 in both formats. Thirty-eight (face-to-face n = 12, 35 % response rate; virtual n = 26, 66.7 % response rate) responded to the surveys and seven (15.3 % response rate), who had attended both formats, completed an interview. Of 36 total presenters, 17 (face-to-face n = 12, 42.9 % response rate; virtual n = 5, 62.9 % response rate) responded to the funding survey. Mixed method analyses indicated that the IDW was effective for collaboration and growth, effective for enhancing success in obtaining grants, and acceptable. A third (35.3 %) of presenters ultimately received funding for their proposal, and more than 80 % of those who presented indicated they would present again in the future. The IDW structure and facilitation process were found to be acceptable, with both formats rated as equally strong.The IDW presents an acceptable and successful methodology for increasing competitiveness of implementation science grant proposals.

Project description:BackgroundTailored, web-assisted interventions can reach many smokers. Content from other smokers (peers) through crowdsourcing could enhance relevance.PurposeTo evaluate whether peers can generate tailored messages encouraging other smokers to use a web-assisted tobacco intervention (Decide2Quit.org).MethodsPhase 1: In 2009, smokers wrote messages in response to scenarios for peer advice. These smoker-to-smoker (S2S) messages were coded to identify themes. Phase 2: resulting S2S messages, and comparison expert messages, were then e-mailed to newly registered smokers. In 2012, subsequent Decide2Quit.org visits following S2S or expert-written e-mails were compared.ResultsPhase 1: a total of 39 smokers produced 2886 messages (message themes: attitudes and expectations, improvements in quality of life, seeking help, and behavioral strategies). For not-ready-to-quit scenarios, S2S messages focused more on expectations around a quit attempt and how quitting would change an individual's quality of life. In contrast, for ready-to-quit scenarios, S2S messages focused on behavioral strategies for quitting. Phase 2: In multivariable analysis, S2S messages were more likely to generate a return visit (OR=2.03, 95% CI=1.74, 2.35), compared to expert messages. A significant effect modification of this association was found, by time-from-registration and message codes (both interaction terms p<0.01). In stratified analyses, S2S codes that were related more to "social" and "real-life" aspects of smoking were driving the main association of S2S and increased return visits.ConclusionsS2S peer messages that increased longitudinal engagement in a web-assisted tobacco intervention were successfully collected and delivered. S2S messages expanded beyond the biomedical model to enhance relevance of messages.Trial registrationThis study is registered at www.clinicaltrials.gov NCT00797628 (web-delivered provider intervention for tobacco control [QUIT-PRIMO]) and NCT01108432 (DPBRN Hygienists Internet Quality Improvement in Tobacco Cessation [HiQuit]).

Project description:Conventional face-to-face weight loss and weight control programs are very labor intensive for both the patient and the provider. It is unclear to what extent conventional programs can be (partially) completed by mobile health (mHealth) apps.The aim of this study was to compare the effectiveness of different weight loss programs using a combination of conventional and mobile programs among adults who are overweight (body mass index [BMI]>29 kg/m²).A single-blinded randomized controlled trial among obese adults was performed from September 2015 to March 2016. The study took place in Leuven, Belgium. Of the 102 eligible (BMI >29 kg/m²) adults, 81 (79%) completed the study. The three intervention groups consisted of a conventional face-to-face weight loss program, a weight loss app program (app group), and a partial face-to-face and partial app program (combi group). All intervention groups received the same advice from a dietician and a physical activity coach during a 12-week period. The control group did not receive any information during the same period. Primary outcomes were weight reduction (5% decrease of baseline weight in kg), BMI, metabolic risk factors, dietary pattern, and physical activity.Significant more participants in all three intervention groups lost at least 5% or more of their weight at baseline compared with the control group. No significant difference was found between the combi group and the conventional group. A trend was found that more participants in the combi group lost 5% or more compared with the app group (19%), P=.06. A significant time x group effect was found for BMI and metabolic risk factors, with the control group having the worst results and the combi group being significantly better with regard to BMI compared with the app group. No significant group x time effects were found for the intake of different food and drinks and moderate to vigorous physical activity (MVPA).The results of this study show that a conventional weight loss program could partially be completed with an mHealth program without affecting the effectiveness.Clinicaltrials.gov NCT02595671; https://clinicaltrials.gov/ct2/show/NCT02595671 (Archived by WebCite at http://www.webcitation.org/6w1H0x1Q6).