Dataset Information

Training simulated patients: evaluation of a training approach using self-assessment and peer/tutor feedback to improve performance.

ABSTRACT:

Background

Most medical schools use simulated patients (SPs) for teaching. In this context the authenticity of role play and quality of feedback provided by SPs is of paramount importance. The available literature on SP training mostly addresses instructor led training where the SPs are given direction on their roles. This study focuses on the use of peer and self evaluation as a tool to train SPs.

Methods

SPs at the medical school participated in a staff development and training programme which included a) self-assessment of their performance while observing video-tapes of their role play using a structured guide and b) peer group assessment of their performance under tutor guidance. The pre and post training performance in relation to authenticity of role play and quality of feedback was blindly assessed by students and tutors using a validated instrument and the scores were compared. A focus group discussion and a questionnaire assessed acceptability of the training programme by the SPs.

Results

The post-training performance assessment scores were significantly higher (p < 0.05) than the pre-training scores. The degree of improvement in the quality of feedback provided to students was more when compared to the improvement of role play. The acceptability of the training by the SPs was very satisfactory scoring an average of 7.6 out of 10. The majority of the SPs requested the new method of training to be included in their current training programme as a regular feature.

Conclusion

Use of structured self-reflective and peer-interactive, practice based methods of SP training is recommended to improve SP performance. More studies on these methods of training may further refine SP training and lead to improvement of SP performance which in turn may positively impact medical education.

SUBMITTER: Perera J

PROVIDER: S-EPMC2711071 | biostudies-literature | 2009 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Training simulated patients: evaluation of a training approach using self-assessment and peer/tutor feedback to improve performance.

Perera Jennifer J Perera Joachim J Abdullah Juriah J Lee Nagarajah N

BMC medical education 20090629

<h4>Background</h4>Most medical schools use simulated patients (SPs) for teaching. In this context the authenticity of role play and quality of feedback provided by SPs is of paramount importance. The available literature on SP training mostly addresses instructor led training where the SPs are given direction on their roles. This study focuses on the use of peer and self evaluation as a tool to train SPs.<h4>Methods</h4>SPs at the medical school participated in a staff development and training ...[more]

PMID: 19563621

Similar Datasets

Project description:Peer-assisted learning (PAL)-especially peer tutorials-are gaining momentum in health professions education, particularly in interprofessional education. As little is known about the use of peer tutorials or the preparation of tutors in this context in Germany and in other countries, this study aims to provide an overview of these interventions. A cross-sectional study with a descriptive-exploratory design was conducted. German institutions for health professions education were contacted, and individuals with pedagogical responsibilities were invited to participate in an online survey. The survey was informed by two studies in which seven domains were identified as important. These included facts about the institution, the offer of PAL, the use of tutorials, and the design of tutor training. The survey used mostly closed-ended questions. The questionnaire was completed by n = 100 participants. Overall, n = 46 participants indicated that PAL was offered at their institution. Of these 46 participants, 32 (70%) indicated that uniprofessional PAL was offered, 2 (4%) indicated that interprofessional PAL was offered, and 12 (26%) indicated that both forms of PAL were offered. Peer tutoring was the most common format in both cases (73% for uniprofessional and 64% for interprofessional PAL), and mandatory interventions were mostly used to prepare the tutors. These interventions were held by educators or lecturers and were offered mostly face-to-face as workshops or as discussions. Deepening the tutors' social competencies through training was given high relevance. Regarding content, focus was placed on communication, (self-)reflection, and group management. Eighty-eight participants expressed recommendations for future directions in terms of preparing tutors for interprofessional PAL. Minor differences between the use of uniprofessional and interprofessional PAL and tutor training were found. Nevertheless, implementation strategies varied. In future, preparatory measures for tutors should be more uniformly designed and geared to the specific requirements of uniprofessional and interprofessional learning, and that at best on an empirical basis.

Project description:BackgroundSelf-explanation without feedback has been shown to improve medical students' diagnostic reasoning. While feedback is generally seen as beneficial for learning, available evidence of the value of its combination with self-explanation is conflicting. This study investigated the effect on medical students' diagnostic performance of adding immediate or delayed content-feedback to self-explanation while solving cases.MethodsNinety-four 3rd-year students from a Canadian medical school were randomly assigned to three experimental conditions (immediate-feedback, delayed-feedback, control). In the learning phase, all students solved four clinical cases by giving i) the most likely diagnosis, ii) two main arguments supporting this diagnosis, and iii) two plausible alternative diagnoses, while using self-explanation. The immediate-feedback group was given the correct diagnosis after each case; delayed-feedback group received the correct diagnoses only after the four cases; control group received no feedback. One week later, all students solved four near-transfer (i.e., same final diagnosis as the learning cases but different scenarios) and four far-transfer cases (i.e., different final diagnosis from the learning cases and different scenarios) by answering the same three questions. Students' diagnostic accuracy (score for the response to the first question only) and diagnostic performance (combined score of responses to the three questions) scores were assessed in each phase. Four one-way ANOVAs were performed on each of the two scores for near and far-transfer cases.ResultsThere was a significant effect of experimental condition on diagnostic accuracy on near-transfer cases (p < .05). The immediate-feedback and delayed-feedback groups performed equally well, both better than control (respectively, mean = 90.73, standard deviation =10.69; mean = 89.92, standard deviation = 13.85; mean = 82.03, standard deviation = 17.66). The experimental conditions did not significantly differ on far-transfer cases.ConclusionsProviding feedback to students in the form of the correct diagnosis after using self-explanation with clinical cases is potentially beneficial to improve their diagnostic accuracy but this effect is limited to similar cases. Further studies should explore how more elaborated feedback combined with self-explanation may impact students' diagnostic performance on different cases.

Project description:ObjectiveTo improve the quality of peer leader training, this study developed a theory-based self-management training program for older adult peer leaders with diabetes and assessed its feasibility.BackgroundCurrent self-management programs are designed mainly to be implemented by healthcare professionals, but healthcare staff may not fully perceive the needs and obstacles of older adults in disease management due to a lack of similar illness experience. To target this problem, peer leaders with successful self-management experiences, similar cultural backgrounds and languages, and related illness experiences are trained to guide and mentor peer patients in self-management programs.Study design and methodsThis study was conducted in two stages. In stage 1, a peer leader training program was developed based on experiential learning theory as the framework and self-regulation theory as the activity design strategy. In stage 2, program feasibility was assessed via participants' feedback toward the training program by three indicators: attendance, future willingness to lead the peer-led self-management program, and leadership skills evaluated by a peer leader training assessment tool.ResultsIn this study, peer leaders demonstrated good leadership skills by expressing active willingness to lead self-management programs in the community. Peer leaders' feedback indicated that the program's training content was helpful in preparing peer leaders to guide older adults in learning self-management skills and in improving the abilities and confidence of peer leaders in mentoring self-management.ConclusionFindings in this study showed that peer leader training can impact the effectiveness and success of self-management in older adults with diabetes. Even in a small-scale study, the impact was evident, which demonstrated the feasibility of the program. More large-scale studies on the effectiveness of various peer leader training programs in diverse disciplines are recommended.Clinical trials registryClinicalTrials.gov Identifier: NCT04298424 (the Peer-Led Self-Management Program).

Project description:IntroductionThe Accreditation Council for Graduate Medical Education (ACGME) specifically notes multisource feedback (MSF) as a recommended means of resident assessment in the emergency medicine (EM) Milestones. High-fidelity simulation is an environment wherein residents can receive MSF from various types of healthcare professionals. Previously, the Queen's Simulation Assessment Tool (QSAT) has been validated for faculty to assess residents in five categories: assessment; diagnostic actions; therapeutic actions; interpersonal communication, and overall assessment. We sought to determine whether the QSAT could be used to provide MSF using a standardized simulation case.MethodsProspectively after institutional review board approval, residents from a dual ACGME/osteopathic-approved postgraduate years (PGY) 1-4 EM residency were consented for participation. We developed a standardized resuscitation after overdose case with specific 1-5 Likert anchors used by the QSAT. A PGY 2-4 resident participated in the role of team leader, who completed a QSAT as self-assessment. The team consisted of a PGY-1 peer, an emergency medical services (EMS) provider, and a nurse. Two core faculty were present to administer the simulation case and assess. Demographics were gathered from all participants completing QSATs. We analyzed QSATs by each category and on cumulative score. Hypothesis testing was performed using intraclass correlation coefficients (ICC), with 95% confidence intervals. Interpretation of ICC results was based on previously published definitions.ResultsWe enrolled 34 team leader residents along with 34 nurses. A single PGY-1, a single EMS provider and two faculty were also enrolled. Faculty provided higher cumulative QSAT scores than the other sources of MSF. QSAT scores did not increase with team leader PGY level. ICC for inter-rater reliability for all sources of MSF was 0.754 (0.572-0.867). Removing the self-evaluation scores increased inter-rater reliability to 0.838 (0.733-0.910). There was lesser agreement between faculty and nurse evaluations than from the EMS or peer evaluation.ConclusionIn this single-site cohort using an internally developed simulation case, the QSAT provided MSF with excellent reliability. Self-assessment decreases the reliability of the MSF, and our data suggest self-assessment should not be a component of MSF. Use of the QSAT for MSF may be considered as a source of data for clinical competency committees.

Dataset Information

Training simulated patients: evaluation of a training approach using self-assessment and peer/tutor feedback to improve performance.

Background

Methods

Results

Conclusion

Publications

Training simulated patients: evaluation of a training approach using self-assessment and peer/tutor feedback to improve performance.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets