Dataset Information

Testing a videogame intervention to recalibrate physician heuristics in trauma triage: study protocol for a randomized controlled trial.

ABSTRACT: Between 30 and 40 % of patients with severe injuries receive treatment at non-trauma centers (under-triage), largely because of physician decision making. Existing interventions to improve triage by physicians ignore the role that intuition (heuristics) plays in these decisions. One such heuristic is to form an initial impression based on representativeness (how typical does a patient appear of one with severe injuries). We created a video game (Night Shift) to recalibrate physician's representativeness heuristic in trauma triage.We developed Night Shift in collaboration with emergency medicine physicians, trauma surgeons, behavioral scientists, and game designers. Players take on the persona of Andy Jordan, an emergency medicine physician, who accepts a new job in a small town. Through a series of cases that go awry, they gain experience with the contextual cues that distinguish patients with minor and severe injuries (based on the theory of analogical encoding) and receive emotionally-laden feedback on their performance (based on the theory of narrative engagement). The planned study will compare the effect of Night Shift with that of an educational program on physician triage decisions and on physician heuristics. Psychological theory predicts that cognitive load increases reliance on heuristics, thereby increasing the under-triage rate when heuristics are poorly calibrated. We will randomize physicians (n?=?366) either to play the game or to review an educational program, and will assess performance using a validated virtual simulation. The validated simulation includes both control and cognitive load conditions. We will compare rates of under-triage after exposure to the two interventions (primary outcome) and will compare the effect of cognitive load on physicians' under-triage rates (secondary outcome). We hypothesize that: a) physicians exposed to Night Shift will have lower rates of under-triage compared to those exposed to the educational program, and b) cognitive load will not degrade triage performance among physicians exposed to Night Shift as much as it will among those exposed to the educational program.Serious games offer a new approach to the problem of poorly-calibrated heuristics in trauma triage. The results of this trial will contribute to the understanding of physician quality improvement and the efficacy of video games as behavioral interventions.clinicaltrials.gov; NCT02857348 ; August 2, 2016.

SUBMITTER: Mohan D

PROVIDER: S-EPMC5106806 | biostudies-literature | 2016 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Testing a videogame intervention to recalibrate physician heuristics in trauma triage: study protocol for a randomized controlled trial.

Mohan Deepika D Rosengart Matthew R MR Fischhoff Baruch B Angus Derek C DC Farris Coreen C Yealy Donald M DM Wallace David J DJ Barnato Amber E AE

BMC emergency medicine 20161111 1

<h4>Background</h4>Between 30 and 40 % of patients with severe injuries receive treatment at non-trauma centers (under-triage), largely because of physician decision making. Existing interventions to improve triage by physicians ignore the role that intuition (heuristics) plays in these decisions. One such heuristic is to form an initial impression based on representativeness (how typical does a patient appear of one with severe injuries). We created a video game (Night Shift) to recalibrate phy ...[more]

PMID: 27835981

Similar Datasets

Project description:ImportanceDiagnostic errors made during triage at nontrauma centers contribute to preventable morbidity and mortality after injury.ObjectiveTo test the feasibility, acceptability, and preliminary effect of a novel deliberate practice intervention to improve diagnostic reasoning in trauma triage.Design, setting, and participantsThis pilot randomized clinical trial was conducted online in a national convenience sample of 72 emergency physicians between January 1 and March 31, 2022, without follow-up.InterventionsParticipants were randomly assigned to receive either usual care (ie, passive control) or a deliberate practice intervention, consisting of 3 weekly, 30-minute, video-conferenced sessions during which physicians played a customized, theory-based video game while being observed by content experts (coaches) who provided immediate, personalized feedback on diagnostic reasoning.Main outcomes and measuresUsing the Proctor framework of outcomes for implementation research, the feasibility, fidelity, acceptability, adoption, and appropriateness of the intervention was assessed by reviewing videos of the coaching sessions and conducting debriefing interviews with participants. A validated online simulation was used to assess the intervention's effect on behavior, and triage among control and intervention physicians was compared using mixed-effects logistic regression. Implementation outcomes were analyzed using an intention-to-treat approach, but participants who did not use the simulation were excluded from the efficacy analysis.ResultsThe study enrolled 72 physicians (mean [SD] age, 43.3 [9.4] years; 44 men [61%]) but limited registration of physicians in the intervention group to 30 because of the availability of the coaches. Physicians worked in 20 states; 62 (86%) were board certified in emergency medicine. The intervention was delivered with high fidelity, with 28 of 30 physicians (93%) completing 3 coaching sessions and with coaches delivering 95% of session components (642 of 674). A total of 21 of 36 physicians (58%) in the control group participated in outcome assessment; 28 of 30 physicians (93%) in the intervention group participated in semistructured interviews, and 26 of 30 physicians (87%) in the intervention group participated in outcome assessment. Most physicians in the intervention group (93% [26 of 28]) described the sessions as entertaining and valuable; most (88% [22 of 25]) affirmed the intention to adopt the principles discussed. Suggestions for refinement included providing more time with the coach and addressing contextual barriers to triage. During the simulation, the triage decisions of physicians in the intervention group were more likely to adhere to clinical practice guidelines than those in the control group (odds ratio; 13.8, 95% CI, 2.8-69.6; P = .001).Conclusions and relevanceIn this pilot randomized clinical trial, coaching was feasible and acceptable and had a large effect on simulated trauma triage decisions, setting the stage for a phase 3 trial.Trial registrationClinicalTrials.gov Identifier: NCT05168579.

Project description:To determine whether a behavioral intervention delivered through a video game can improve the appropriateness of trauma triage decisions in the emergency department of non-trauma centers.Randomized clinical trial.Online intervention in national sample of emergency medicine physicians who make triage decisions at US hospitals.368 emergency medicine physicians primarily working at non-trauma centers. A random sample (n=200) of those with primary outcome data was reassessed at six months.Physicians were randomized in a 1:1 ratio to one hour of exposure to an adventure video game (Night Shift) or apps based on traditional didactic education (myATLS and Trauma Life Support MCQ Review), both on iPads. Night Shift was developed to recalibrate the process of using pattern recognition to recognize moderate-severe injuries (representativeness heuristics) through the use of stories to promote behavior change (narrative engagement). Physicians were randomized with a 2×2 factorial design to intervention (game v traditional education apps) and then to the experimental condition under which they completed the outcome assessment tool (low v high cognitive load). Blinding could not be maintained after allocation but group assignment was masked during the analysis phase.Outcomes of a virtual simulation that included 10 cases; in four of these the patients had severe injuries. Participants completed the simulation within four weeks of their intervention. Decisions to admit, discharge, or transfer were measured. The proportion of patients under-triaged (patients with severe injuries not transferred to a trauma center) was calculated then (primary outcome) and again six months later, with a different set of cases (primary outcome of follow-up study). The secondary outcome was effect of cognitive load on under-triage.149 (81%) physicians in the game arm and 148 (80%) in the traditional education arm completed the trial. Of these, 64/100 (64%) and 58/100 (58%), respectively, completed reassessment at six months. The mean age was 40 (SD 8.9), 283 (96%) were trained in emergency medicine, and 207 (70%) were ATLS (advanced trauma life support) certified. Physicians exposed to the game under-triaged fewer severely injured patients than those exposed to didactic education (316/596 (0.53) v 377/592 (0.64), estimated difference 0.11, 95% confidence interval 0.05 to 0.16; P<0.001). Cognitive load did not influence under-triage (161/308 (0.53) v 155/288 (0.54) in the game arm; 197/300 (0.66) v 180/292 (0.62) in the traditional educational apps arm; P=0.66). At six months, physicians exposed to the game remained less likely to under-triage patients (146/256 (0.57) v 172/232 (0.74), estimated difference 0.17, 0.09 to 0.25; P<0.001). No physician reported side effects. The sample might not reflect all emergency medicine physicians, and a small set of cases was used to assess performance.Compared with apps based on traditional didactic education, exposure of physicians to a theoretically grounded video game improved triage decision making in a validated virtual simulation. Though the observed effect was large, the wide confidence intervals include the possibility of a small benefit, and the real world efficacy of this intervention remains uncertain.clinicaltrials.gov; NCT02857348 (initial study)/NCT03138304 (follow-up).

Project description:BackgroundNon-compliance with clinical practice guidelines in trauma remains common, in part because physicians make diagnostic errors when triaging injured patients. Deliberate practice, purposeful participation in a training task under the oversight of a coach, effectively changes behavior in procedural domains of medicine but has rarely been used to improve diagnostic skill. We plan a pilot parallel randomized trial to test the feasibility, acceptability, and preliminary effect of a novel deliberate practice intervention to reduce physician diagnostic errors in trauma triage.MethodsWe will randomize a national convenience sample of physicians who work at non-trauma centers (n = 60) in a 1:1 ratio to a deliberate practice intervention or to a passive control. We will use a customized, theory-based serious video game as the basis of our training task, selected based on its behavior change techniques and game mechanics, along with a coaching manual to standardize the fidelity of the intervention delivery. The intervention consists of three 30-min sessions with content experts (coaches), conducted remotely, during which physicians (trainees) play the game and receive feedback on their diagnostic processes. We will assess (a) the fidelity with which the intervention is delivered by reviewing video recordings of the coaching sessions; (b) the acceptability of the intervention through surveys and semi-structured interviews, and (c) the effect of the intervention by comparing the performance of trainees and a control group of physicians on a validated virtual simulation. We hypothesize that trainees will make ≥ 25% fewer diagnostic errors on the simulation than control physicians, a large effect size. We additionally hypothesize that ≥ 90% of trainees will receive their intervention as planned.ConclusionsThe results of the trial will inform the decision to proceed with a future hybrid effectiveness-implementation trial of the intervention. It will also provide a deeper understanding of the challenges of using deliberate practice to modify the diagnostic skill of physicians.Trial registrationClinical trials.gov ( NCT05168579 ); 23 December 2021.

Project description:BackgroundOppositional defiant disorder (ODD) is a major mental health concern and highly prevalent among children living in poverty-impacted communities. Despite that treatments for ODD are among the most effective, few children living in poverty receive these services due to substantial barriers to access, as well as difficulties in the uptake and sustained adoption of evidence-based practices (EBPs) in community settings. The purpose of this study is to examine implementation processes that impact uptake of an evidence-based practice for childhood ODD, and the impact of a Clinic Implementation Team (CIT)-driven structured adaptation to enhance its fit within the public mental health clinic setting.Methods/designThis study, a Hybrid Type II effectiveness-implementation research trial, blends clinical effectiveness and implementation research methods to examine the impact of the 4Rs and 2Ss Multiple Family Group (MFG) intervention, family level mediators of child outcomes, clinic/provider-level mediators of implementation, and the impact of CITs on uptake and long-term utilization of this model. All New York City public outpatient mental health clinics have been invited to participate. A sampling procedure that included randomization at the agency level and a sub-study to examine the impact of clinic choice upon outcomes yielded a distribution of clinics across three study conditions. Quantitative data measuring child outcomes, organizational factors and implementation fidelity will be collected from caregivers and providers at baseline, 8, and 16 weeks from baseline, and 6 months from treatment completion. The expected participation is 134 clinics, 268 providers, and 2688 caregiver/child dyads. We will use mediation analysis with a multi-level Structural Equation Modeling (SEM) (MSEM including family level variables, provider variables, and clinic variables), as well as mediation tests to examine study hypotheses.DiscussionThe aim of the study is to generate knowledge about effectiveness and mediating factors in the treatment of ODDs in children in the context of family functioning, and to propose an innovative approach to the adaptation and implementation of new treatment interventions within clinic settings. The proposed CIT adaptation and implementation model has the potential to enhance implementation and sustainability, and ultimately increase the extent to which effective interventions are available and can impact children and families in need of services for serious behavior problems.Trial registrationClinicalTrials.gov, ID: NCT02715414 . Registered on 3 March 2016.

Project description:Background: Mechanical thrombectomy (MT) can improve the outcomes of patients with large vessel occlusion (LVO), but a minority of patients with LVO are treated and there are disparities in timely access to MT. In part, this is because in most regions, including Alabama, the emergency medical service (EMS) transports all patients with suspected stroke, regardless of severity, to the nearest stroke center. Consequently, patients with LVO may experience delayed arrival at stroke centers with MT capability and worse outcomes. Alabama's trauma communications center (TCC) coordinates EMS transport of trauma patients by trauma severity and regional hospital capability. Our aims are to develop a severity-based stroke triage (SBST) care model based on Alabama's trauma system, compare the effectiveness of this care pathway to current stroke triage in Alabama for improving broad, equitable, and timely access to MT, and explore stakeholder perceptions of the intervention's feasibility, appropriateness, and acceptability. Methods: This is a hybrid type 1 effectiveness-implementation study with a multi-phase mixed methods sequential design and an embedded observational stepped wedge cluster trial. We will extend TCC guided stroke severity assessment to all EMS regions in Alabama; conduct stakeholder interviews and focus groups to aid in development of region and hospital specific prehospital and inter-facility stroke triage plans for patients with suspected LVO; implement a phased rollout of TCC Coordinated SBST across Alabama's six EMS regions; and conduct stakeholder surveys and interviews to assess context-specific perceptions of the intervention. The primary outcome is the change in proportion of prehospital stroke system patients with suspected LVO who are treated with MT before and after implementation of TCC Coordinated SBST. Secondary outcomes include change in broad public health impact before and after implementation and stakeholder perceptions of the intervention's feasibility, appropriateness, and acceptability using a mixed methods approach. With 1200 to 1300 total observations over 36 months, we have 80% power to detect a 15% improvement in the primary endpoint. Discussion: This project, if successful, can demonstrate how the trauma system infrastructure can serve as the basis for a more integrated and effective system of emergency stroke care.

Dataset Information

Testing a videogame intervention to recalibrate physician heuristics in trauma triage: study protocol for a randomized controlled trial.

Publications

Testing a videogame intervention to recalibrate physician heuristics in trauma triage: study protocol for a randomized controlled trial.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets