Trial of a Video Game Intervention to Recalibrate Physician Heuristics: A Followup Study

The objective of this study is to measure the duration of two different types of interventions to change physician decision making in trauma triage: a video game and an educational program.

Treatment at trauma centers improves outcomes for patients with moderate-to-severe injuries. Accordingly, professional organizations, state authorities, and the federal government have endorsed the systematic triage and transfer of these patients to trauma centers either directly from the field or after evaluation at a non-trauma center. Nonetheless, between 30 to 40% of patients with moderate-to-severe injuries still only receive treatment at non-trauma centers, so-called under-triage. Most of this under-triage occurs because of physician decisions (rather than first-responder decisions). Existing efforts to change physician decision making focus primarily on knowledge of clinical practice guidelines and attitudes towards the guidelines. These strategies ignores the growing consensus that decision making reflects both knowledge as well as intuitive judgments (heuristics). Heuristics, mental short cuts based on pattern recognition, drive the majority of decision making. The investigators developed an adventure video game (Night Shift) to serve as a novel method of recalibrating physician heuristics in trauma triage and compared its efficacy with a standard educational program. This study is designed to measure the degradation of the treatment effect.

Night Shift is an adventure video game with the transformational goal of teaching physicians key characteristics of patients with non-representative severe injuries - injuries classified by the American College of Surgeons as life-threatening or critical but that do not fit the archetype of injuries typically requiring treatment at a trauma center. Players take on the persona of Andy Jordan, a young emergency physician who moves home after the disappearance of his estranged grandfather (Robert Jordan) and takes up a job in the local Emergency Department (ED). In the preamble, players learn they have two explicit objectives. First, they must diagnose and treat patients who present to their ED. Second they must solve the mystery of Robert's disappearance: was he murdered or has he simply chosen to disappear?

The educational module consists of two separate apps, both commercially available. myATLS includes a review of each chapter of the Advanced Trauma Life Support (ATLS) textbook, a series of videos demonstrating common trauma procedures, and clinical resources including checklists for use at the bedside. Trauma Life Support MCQ Review includes 550 multiple-choice questions with correct answers and explanations. The investigators will ask physicians to review the myATLS app and then complete questions in the Trauma Life Support MCQ Review, spending at least 1 hour on the combined tasks.

Night Shift is an adventure video game with the transformational goal of teaching physicians key characteristics of patients with non-representative severe injuries - injuries classified by the American College of Surgeons as life-threatening or critical but that do not fit the archetype of injuries typically requiring treatment at a trauma center.

Two commercially available applications designed to teach physicians the trauma triage guidelines disseminated by the American College of Surgeons.

Physicians in both arms of the study will be asked to complete an outcome assessment tool - a virtual simulation - six months after completion of their intervention. The virtual simulation replicates the environment of the ED. Physicians have to manage 10 patients that appear concurrently, while also responding to a series of audio-visual distractors. Specifically, they must provide information on whether they will admit, transfer, or discharge the patients home. The investigators will calculate an under-triage rate for each physician (the number of simulated patients with severe injuries not transferred to a trauma center), will summarize the under-triage rate by group (Night Shift v. educational control), and will assess the difference in those rates.

We will categorize severely injured patients on the virtual simulation (the outcome assessment tool) as having representative or non-representative injuries. We will summarize the undertriage rate of representative/non-representative injuries by intervention, and will compare the difference in those rates between groups.

We will compare the undertriage rate of physicians the first and second time they complete the virtual simulation (time zero = initial enrollment; time one = six months post intervention). We will compare the difference in the undertriage rates by intervention.

Inclusion Criteria: Physicians who care for adult patients in the Emergency Department. Physicians who work at a non-trauma center. Physicians who work at a Level III/IV trauma center. Exclusion Criteria: Physicians who work only at a Level I/II trauma center. Physicians who do not practice in the US.

Researchers may contact the PI for access to deidentified participant data. It will be released conditional on IRB approval.

Mohan D, Farris C, Fischhoff B, Rosengart MR, Angus DC, Yealy DM, Wallace DJ, Barnato AE. Efficacy of educational video game versus traditional educational apps at improving physician decision making in trauma triage: randomized controlled trial. BMJ. 2017 Dec 12;359:j5416. doi: 10.1136/bmj.j5416.