Dataset Information

Does Preexisting Practice Modify How Video Games Recalibrate Physician Heuristics in Trauma Triage?

ABSTRACT: BACKGROUND:A majority of severely injured patients fail to receive care at trauma centers (undertriage), in part, because of physician judgment. We previously developed two educational video games that reduced physicians' undertriage compared with control in two clinical trials. In this secondary analysis, we investigated heterogeneity of treatment effect of the interventions by assessing physicians' preexisting practice patterns in claims data. We hypothesized that physicians with high preexisting undertriage would benefit most from game-based training. METHODS:Using Medicare claims records from 2010 to 2015, we measured physicians' preexisting triage practices before their participation in one of two trials conducted in 2016 and 2017. We categorized physicians as having received game-based training versus control and noted their postintervention simulation triage performance in the trials. We used multivariable linear regression models to assess the heterogeneity of game-based training effect among physicians with high and low preexisting undertriage. RESULTS:Of the 394 eligible physicians from our trials, we identified 275 (70%) with claims for Medicare fee-for-service beneficiaries suffering severe injury between 2010 and 2015. On average, the physicians were 44 y old (SD 8.4) with 12 y (SD 8.2) of experience. We found significant interaction between preexisting practice and intervention efficacy (P = 0.04). Physicians with high undertriage before enrollment improved significantly with game-based training compared with the control (46% versus 63%, P < 0.001). Those with low preexisting undertriage did not (58% versus 56%, P = 0.76). CONCLUSIONS:Using claims-based data, we found heterogeneity of treatment effect of interventions designed to recalibrate physician heuristics. Physicians with high preexisting undertriage benefited most from game-based training.

SUBMITTER: Kulkarni SS

PROVIDER: S-EPMC6913034 | biostudies-literature | 2019 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Does Preexisting Practice Modify How Video Games Recalibrate Physician Heuristics in Trauma Triage?

Kulkarni Shreyus S SS Barnato Amber E AE Rosengart Matthew R MR Fischhoff Baruch B Angus Derek C DC Yealy Donald M DM Wallace David J DJ Mohan Deepika D

The Journal of surgical research 20190506

<h4>Background</h4>A majority of severely injured patients fail to receive care at trauma centers (undertriage), in part, because of physician judgment. We previously developed two educational video games that reduced physicians' undertriage compared with control in two clinical trials. In this secondary analysis, we investigated heterogeneity of treatment effect of the interventions by assessing physicians' preexisting practice patterns in claims data. We hypothesized that physicians with high ...[more]

PMID: 31071605

Similar Datasets

Project description:Between 30 and 40 % of patients with severe injuries receive treatment at non-trauma centers (under-triage), largely because of physician decision making. Existing interventions to improve triage by physicians ignore the role that intuition (heuristics) plays in these decisions. One such heuristic is to form an initial impression based on representativeness (how typical does a patient appear of one with severe injuries). We created a video game (Night Shift) to recalibrate physician's representativeness heuristic in trauma triage.We developed Night Shift in collaboration with emergency medicine physicians, trauma surgeons, behavioral scientists, and game designers. Players take on the persona of Andy Jordan, an emergency medicine physician, who accepts a new job in a small town. Through a series of cases that go awry, they gain experience with the contextual cues that distinguish patients with minor and severe injuries (based on the theory of analogical encoding) and receive emotionally-laden feedback on their performance (based on the theory of narrative engagement). The planned study will compare the effect of Night Shift with that of an educational program on physician triage decisions and on physician heuristics. Psychological theory predicts that cognitive load increases reliance on heuristics, thereby increasing the under-triage rate when heuristics are poorly calibrated. We will randomize physicians (n?=?366) either to play the game or to review an educational program, and will assess performance using a validated virtual simulation. The validated simulation includes both control and cognitive load conditions. We will compare rates of under-triage after exposure to the two interventions (primary outcome) and will compare the effect of cognitive load on physicians' under-triage rates (secondary outcome). We hypothesize that: a) physicians exposed to Night Shift will have lower rates of under-triage compared to those exposed to the educational program, and b) cognitive load will not degrade triage performance among physicians exposed to Night Shift as much as it will among those exposed to the educational program.Serious games offer a new approach to the problem of poorly-calibrated heuristics in trauma triage. The results of this trial will contribute to the understanding of physician quality improvement and the efficacy of video games as behavioral interventions.clinicaltrials.gov; NCT02857348 ; August 2, 2016.

Project description:To determine whether a behavioral intervention delivered through a video game can improve the appropriateness of trauma triage decisions in the emergency department of non-trauma centers.Randomized clinical trial.Online intervention in national sample of emergency medicine physicians who make triage decisions at US hospitals.368 emergency medicine physicians primarily working at non-trauma centers. A random sample (n=200) of those with primary outcome data was reassessed at six months.Physicians were randomized in a 1:1 ratio to one hour of exposure to an adventure video game (Night Shift) or apps based on traditional didactic education (myATLS and Trauma Life Support MCQ Review), both on iPads. Night Shift was developed to recalibrate the process of using pattern recognition to recognize moderate-severe injuries (representativeness heuristics) through the use of stories to promote behavior change (narrative engagement). Physicians were randomized with a 2×2 factorial design to intervention (game v traditional education apps) and then to the experimental condition under which they completed the outcome assessment tool (low v high cognitive load). Blinding could not be maintained after allocation but group assignment was masked during the analysis phase.Outcomes of a virtual simulation that included 10 cases; in four of these the patients had severe injuries. Participants completed the simulation within four weeks of their intervention. Decisions to admit, discharge, or transfer were measured. The proportion of patients under-triaged (patients with severe injuries not transferred to a trauma center) was calculated then (primary outcome) and again six months later, with a different set of cases (primary outcome of follow-up study). The secondary outcome was effect of cognitive load on under-triage.149 (81%) physicians in the game arm and 148 (80%) in the traditional education arm completed the trial. Of these, 64/100 (64%) and 58/100 (58%), respectively, completed reassessment at six months. The mean age was 40 (SD 8.9), 283 (96%) were trained in emergency medicine, and 207 (70%) were ATLS (advanced trauma life support) certified. Physicians exposed to the game under-triaged fewer severely injured patients than those exposed to didactic education (316/596 (0.53) v 377/592 (0.64), estimated difference 0.11, 95% confidence interval 0.05 to 0.16; P<0.001). Cognitive load did not influence under-triage (161/308 (0.53) v 155/288 (0.54) in the game arm; 197/300 (0.66) v 180/292 (0.62) in the traditional educational apps arm; P=0.66). At six months, physicians exposed to the game remained less likely to under-triage patients (146/256 (0.57) v 172/232 (0.74), estimated difference 0.17, 0.09 to 0.25; P<0.001). No physician reported side effects. The sample might not reflect all emergency medicine physicians, and a small set of cases was used to assess performance.Compared with apps based on traditional didactic education, exposure of physicians to a theoretically grounded video game improved triage decision making in a validated virtual simulation. Though the observed effect was large, the wide confidence intervals include the possibility of a small benefit, and the real world efficacy of this intervention remains uncertain.clinicaltrials.gov; NCT02857348 (initial study)/NCT03138304 (follow-up).

Project description:ImportanceDiagnostic errors made during triage at nontrauma centers contribute to preventable morbidity and mortality after injury.ObjectiveTo test the feasibility, acceptability, and preliminary effect of a novel deliberate practice intervention to improve diagnostic reasoning in trauma triage.Design, setting, and participantsThis pilot randomized clinical trial was conducted online in a national convenience sample of 72 emergency physicians between January 1 and March 31, 2022, without follow-up.InterventionsParticipants were randomly assigned to receive either usual care (ie, passive control) or a deliberate practice intervention, consisting of 3 weekly, 30-minute, video-conferenced sessions during which physicians played a customized, theory-based video game while being observed by content experts (coaches) who provided immediate, personalized feedback on diagnostic reasoning.Main outcomes and measuresUsing the Proctor framework of outcomes for implementation research, the feasibility, fidelity, acceptability, adoption, and appropriateness of the intervention was assessed by reviewing videos of the coaching sessions and conducting debriefing interviews with participants. A validated online simulation was used to assess the intervention's effect on behavior, and triage among control and intervention physicians was compared using mixed-effects logistic regression. Implementation outcomes were analyzed using an intention-to-treat approach, but participants who did not use the simulation were excluded from the efficacy analysis.ResultsThe study enrolled 72 physicians (mean [SD] age, 43.3 [9.4] years; 44 men [61%]) but limited registration of physicians in the intervention group to 30 because of the availability of the coaches. Physicians worked in 20 states; 62 (86%) were board certified in emergency medicine. The intervention was delivered with high fidelity, with 28 of 30 physicians (93%) completing 3 coaching sessions and with coaches delivering 95% of session components (642 of 674). A total of 21 of 36 physicians (58%) in the control group participated in outcome assessment; 28 of 30 physicians (93%) in the intervention group participated in semistructured interviews, and 26 of 30 physicians (87%) in the intervention group participated in outcome assessment. Most physicians in the intervention group (93% [26 of 28]) described the sessions as entertaining and valuable; most (88% [22 of 25]) affirmed the intention to adopt the principles discussed. Suggestions for refinement included providing more time with the coach and addressing contextual barriers to triage. During the simulation, the triage decisions of physicians in the intervention group were more likely to adhere to clinical practice guidelines than those in the control group (odds ratio; 13.8, 95% CI, 2.8-69.6; P = .001).Conclusions and relevanceIn this pilot randomized clinical trial, coaching was feasible and acceptable and had a large effect on simulated trauma triage decisions, setting the stage for a phase 3 trial.Trial registrationClinicalTrials.gov Identifier: NCT05168579.

Dataset Information

Does Preexisting Practice Modify How Video Games Recalibrate Physician Heuristics in Trauma Triage?

Publications

Does Preexisting Practice Modify How Video Games Recalibrate Physician Heuristics in Trauma Triage?

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets