Dataset Information

The application of the spot the difference teaching method in clinical skills training for residents

ABSTRACT:

Background

Clinical skill training (CST) is indispensable for first-year surgical residents. It can usually be carried out through video-based flipped learning (FL) within a web-based learning environment. However, we found that residents lack the process of reflection, blindly imitating results in losing interest and passion for learning in the traditional teaching pattern. The teaching method of "spot the difference" (SDTM), which is based on the fundamentals of the popular game of "spot the difference," is designed to improve students' participation and reflective learning during skill training. This study aimed to evaluate this novel educational model's short-term and long-term effectiveness for surgical residents in China.

Methods

First-year residents who required a three-month rotation in the head and neck surgery department were recruited to participate in a series of CSTs. They were randomized into SDTM and traditional FL (control) groups. Clinical skill performance was assessed with validated clinical skill scoring criteria. Evaluations were conducted by comparing the scores that contain departmental rotation skill examinations and the first China medical licensing examination (CMLE) performance on practical skills. In addition, two-way subjective evaluations were also implemented as a reference for the training results. Training effects were assessed using t tests, Mann–Whitney–Wilcoxon tests, chi-square tests, and Cohen’ s effect size (d). The Cohen’ s d value was considered to be small (<0.2), medium (0.2-0.8), or large (>0.8).

Results

The SDTM group was significantly superior to the control group in terms of after-department skill examination (t=2.179, p<0.05, d=0.5), taking medical history (t=2.665, p<0.05, d=0.59), and CMLE performance on practical skill (t=2.103, p<0.05, d=0.47). The SDTM members rated the curriculum more highly than the control on the items relating to interestingness and participation (p < 0.05) with large effect sizes (d >0.8). There were no significant differences between the two groups on clinical competence (t=0.819, p=0.415, d=0.18), the first-time pass rate for CMLE (χ2 =1.663, p=0.197, d=0.29), and short-term operational skills improvement (t=1.747, p=0.084, d=0.39).

Conclusions

SDTM may be an effective method for enhancing residents' clinical skills, and the effect is significant both short- and long-term. The improvement effect seemed to be more significant in the peer-involved SDTM than training alone. However, despite positive objective results, SDTM still risks student learning burnout.

Trial registration

ISRCTN registry, ISRCTN10598469, 02/04/2022，retrospectively registered.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12909-022-03612-3.

SUBMITTER: Yang L

PROVIDER: S-EPMC9281025 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:IntroductionThe fast-paced nature of physician assistant (PA) programs warrants an emphasis on high-fidelity, critical care skills training. Generally, manikins or task trainers are used for training and assessing. Soft-preserved cadavers provide a high-fidelity model to teach high-acuity, low-opportunity procedures; however, their effectiveness in PA pre-clinical training is not well understood.ObjectiveThis study compared procedural competency of task trainer and soft-preserved cadaver trained pre-clinical PA (pcPA) students in completing tube thoracostomy, endotracheal intubation, intraosseous infusion, and needle thoracostomy.MethodsA randomized controlled study was conducted with pcPA students (n = 48) at a midwestern program. Participants were randomly assigned to cadaver trained (CT), task trainer (TT), or control group (CG). We assessed procedural competency using skill-specific rubrics and performed qualitative analysis of student comments regarding skill-specific procedural preparedness.ResultsIntervention groups surpassed the control group on all skills. The CT students exhibited significantly higher procedural competency compared to TT-trained students in endotracheal intubation (p = 0.0003) and intraosseous infusion (p = 0.0041). Thematic analysis of student comments revealed pre-training students consistently felt unprepared and lacked confidence to perform needle thoracostomy, tube thoracostomy, and endotracheal intubation. Post-training perceptions, CT/TT, focused on preparedness and confidence. The CT group also consistently described the impact of realistic simulation.ConclusionHigh-fidelity training with soft-preserved cadavers may be the most effective way to prepare pcPA students to perform endotracheal intubation and intraosseous infusion. Student perspectives on procedural preparedness highlight the importance of multidimensional, realistic training methods.Supplementary informationThe online version contains supplementary material available at 10.1007/s40670-022-01575-0.

Project description:BackgroundWorkplace violence is an increasingly significant topic, particularly for staff working in mental health settings. The Centre for Addiction and Mental Health (CAMH), Canada's largest mental health hospital, considers workplace safety a high priority and consequently has mandated staff safety training. For clinical staff, key components of this training are self-protection and team-control skills, which are a last resort when an individual is at an imminent risk of harm to self or others and other interventions are ineffective (eg, verbal de-escalation). For the past 20 years, CAMH's training-as-usual (TAU) has been based on a 3D approach (description, demonstration, and doing), but without any competency-based assessment. Recent staff reports indicate that the acquisition and retention of these skills may be problematic and that staff are not always confident in their ability to effectively address workplace violence. The current literature lacks studies that evaluate how staff are trained to acquire these physical skills and consequently provides no recommendations or best practice guidelines. To address these gaps described by the staff and in the literature, we have used an evidence-based approach from the field of applied behavior analysis known as behavioral skills training (BST), which requires trainees to actively execute targeted skills through instruction, modeling, practice, and feedback loop. As part of this method, competency checklists of skills are used with direct observation to determine successful mastery.ObjectiveOur objectives are to evaluate the effectiveness of BST versus TAU in terms of staff confidence; their competence in self-protection and team-control physical skills; their level of mastery (predefined as 80% competence) in these skills; and their confidence, competency, and mastery at 1 month posttraining.MethodsWe are using a pragmatic randomized controlled trial design. New staff registering for their mandatory safety training are randomly assigned to sessions which are, in turn, randomly assigned to either the BST or TAU conditions. Attendees are informed and consented into the study at the beginning of training. Differences between those consenting and those not consenting in terms of role and department are tracked to flag potential biases.ResultsThis study was internally funded and commenced in January 2021 after receiving ethics approval. As of May 2022, data collection is complete; half of the baseline, posttraining, and 1-month videotapes have been rated, and three-fourths of the interrater reliability checks have been completed. The analysis is expected to begin in late summer 2022 with results submitted for publication by fall 2022.ConclusionsThe findings from this study are expected to contribute to both the medical education literature as well as to the field of applied behavioral analysis where randomized controlled trial designs are rare. More practically, the results are also expected to inform the continuing development of our institutional staff safety training program.International registered report identifier (irrid)DERR1-10.2196/39672.