Dataset Information

The application of the spot the difference teaching method in clinical skills training for residents

ABSTRACT:

Background

Clinical skill training (CST) is indispensable for first-year surgical residents. It can usually be carried out through video-based flipped learning (FL) within a web-based learning environment. However, we found that residents lack the process of reflection, blindly imitating results in losing interest and passion for learning in the traditional teaching pattern. The teaching method of "spot the difference" (SDTM), which is based on the fundamentals of the popular game of "spot the difference," is designed to improve students' participation and reflective learning during skill training. This study aimed to evaluate this novel educational model's short-term and long-term effectiveness for surgical residents in China.

Methods

First-year residents who required a three-month rotation in the head and neck surgery department were recruited to participate in a series of CSTs. They were randomized into SDTM and traditional FL (control) groups. Clinical skill performance was assessed with validated clinical skill scoring criteria. Evaluations were conducted by comparing the scores that contain departmental rotation skill examinations and the first China medical licensing examination (CMLE) performance on practical skills. In addition, two-way subjective evaluations were also implemented as a reference for the training results. Training effects were assessed using t tests, Mann–Whitney–Wilcoxon tests, chi-square tests, and Cohen’ s effect size (d). The Cohen’ s d value was considered to be small (<0.2), medium (0.2-0.8), or large (>0.8).

Results

The SDTM group was significantly superior to the control group in terms of after-department skill examination (t=2.179, p<0.05, d=0.5), taking medical history (t=2.665, p<0.05, d=0.59), and CMLE performance on practical skill (t=2.103, p<0.05, d=0.47). The SDTM members rated the curriculum more highly than the control on the items relating to interestingness and participation (p < 0.05) with large effect sizes (d >0.8). There were no significant differences between the two groups on clinical competence (t=0.819, p=0.415, d=0.18), the first-time pass rate for CMLE (χ2 =1.663, p=0.197, d=0.29), and short-term operational skills improvement (t=1.747, p=0.084, d=0.39).

Conclusions

SDTM may be an effective method for enhancing residents' clinical skills, and the effect is significant both short- and long-term. The improvement effect seemed to be more significant in the peer-involved SDTM than training alone. However, despite positive objective results, SDTM still risks student learning burnout.

Trial registration

ISRCTN registry, ISRCTN10598469, 02/04/2022，retrospectively registered.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12909-022-03612-3.

SUBMITTER: Yang L

PROVIDER: S-EPMC9281025 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundWorkplace violence is an increasingly significant topic, particularly for staff working in mental health settings. The Centre for Addiction and Mental Health (CAMH), Canada's largest mental health hospital, considers workplace safety a high priority and consequently has mandated staff safety training. For clinical staff, key components of this training are self-protection and team-control skills, which are a last resort when an individual is at an imminent risk of harm to self or others and other interventions are ineffective (eg, verbal de-escalation). For the past 20 years, CAMH's training-as-usual (TAU) has been based on a 3D approach (description, demonstration, and doing), but without any competency-based assessment. Recent staff reports indicate that the acquisition and retention of these skills may be problematic and that staff are not always confident in their ability to effectively address workplace violence. The current literature lacks studies that evaluate how staff are trained to acquire these physical skills and consequently provides no recommendations or best practice guidelines. To address these gaps described by the staff and in the literature, we have used an evidence-based approach from the field of applied behavior analysis known as behavioral skills training (BST), which requires trainees to actively execute targeted skills through instruction, modeling, practice, and feedback loop. As part of this method, competency checklists of skills are used with direct observation to determine successful mastery.ObjectiveOur objectives are to evaluate the effectiveness of BST versus TAU in terms of staff confidence; their competence in self-protection and team-control physical skills; their level of mastery (predefined as 80% competence) in these skills; and their confidence, competency, and mastery at 1 month posttraining.MethodsWe are using a pragmatic randomized controlled trial design. New staff registering for their mandatory safety training are randomly assigned to sessions which are, in turn, randomly assigned to either the BST or TAU conditions. Attendees are informed and consented into the study at the beginning of training. Differences between those consenting and those not consenting in terms of role and department are tracked to flag potential biases.ResultsThis study was internally funded and commenced in January 2021 after receiving ethics approval. As of May 2022, data collection is complete; half of the baseline, posttraining, and 1-month videotapes have been rated, and three-fourths of the interrater reliability checks have been completed. The analysis is expected to begin in late summer 2022 with results submitted for publication by fall 2022.ConclusionsThe findings from this study are expected to contribute to both the medical education literature as well as to the field of applied behavioral analysis where randomized controlled trial designs are rare. More practically, the results are also expected to inform the continuing development of our institutional staff safety training program.International registered report identifier (irrid)DERR1-10.2196/39672.