eHealth Partnered Evaluation Initiative - Evaluation of the Initial Deployment of VA's Annie Texting System (AnnieEval)

eHealth Partnered Evaluation Initiative - Evaluation of the Initial Deployment of VA's Annie Texting System

Conduct a rigorous formative evaluation of the initial deployment of the Annie texting system across several pilot test sites and from these findings, develop and test an augmented implementation strategy to facilitate more rapid adoption of Annie across VA.

The investigators examined patient and provider experiences with VA's automated text messaging system, named "Annie". The investigators aimed to describe early experiences using Annie and subsequently pilot and evaluate an augmented implementation strategy to improve implementation of the system. Then, seven new facilities implemented Annie. The investigators focused on specialty clinics serving patients with hepatitis-C virus (HCV). Working in collaboration with clinical team members and other Office of Connected Care stakeholders, the investigators developed a texting protocol for Veterans with HCV that included motivational messages, medication and lab appointment reminders. This protocol was made available to the seven new facilities. Four facilities were randomized to serve as intervention sites to receive augmented implementation strategy. These facilities had regular facilitation calls, a site visit to assist with implementation, and were given the toolkit, in addition to receiving usual implementation assistance, described below. An additional three comparison sites received usual implementation of Annie only, which involves an orientation/training meeting and the option of attending twice-monthly Annie clinical adoption calls run by the Office of Connected Care. Two control sites did not receive Annie. The investigators conducted a mixed-methods evaluation including pre and post patient and provider surveys and semi-structured interviews, medical chart abstraction, and process measure analysis. The investigators collected data on patient and clinician experiences with the Annie system, including usability, clinical workflow fit, and clinical benefits such as improved HCV medication adherence and rates of appropriately timed lab tests.

Four facilities were randomized to serve as intervention sites and receive our augmented implementation strategy. These facilities had regular facilitation calls, a site visit to assist with implementation, and were given the toolkit, in addition to receiving usual implementation assistance. An additional three comparison sites received usual implementation of Annie only, which involves an orientation/training meeting and the option of attending twice-monthly Annie clinical adoption calls run by the Office of Connected Care. Two control sites did not receive Annie.

Patients received the Annie text messaging system for patient self-management of HCV treatment including medication, lab, and appointment reminders, and motivational messages.

Annie text messaging system for patient self-management of HCV treatment including medication, lab, and appointment reminders, and motivational messages.

Three comparison sites received usual implementation of the automated text messaging system "Annie" only, which involves an orientation/training meeting and the option of attending twice-monthly Annie clinical adoption calls

Four facilities received the automated text messaging system "Annie" and our augmented implementation strategy. These facilities had regular facilitation calls, a site visit to assist with implementation, and were given the toolkit, in addition to receiving usual implementation assistance

The primary goal of the automated text messaging system is to improve patient self-management. As such, we measured illness perception and patient activation using a validated instrument adapted for HCV (Fisher L, Glasgow RE, Mullan JT, Skaff MM, Polonsky WH. Development of a brief diabetes distress screening instrument. Ann Fam Med 2008;6(3):246-252). The item "Feeling that I am failing with my HCV treatment" represents patient perceptions about their ability to take medications as prescribed and reflects concerns about failing HCV treatment.

Inclusion Criteria: Starting HCV treatment at a VA clinic Have access/ability to text messaging Exclusion Criteria: Not being treating for HCV No access/ability to use a cell phone

Yakovchenko V, McInnes DK, Petrakis BA, Gillespie C, Lipschitz JM, McCullough MB, Richardson L, Vetter B, Hogan TP. Implementing Automated Text Messaging for Patient Self-management in the Veterans Health Administration: Qualitative Study Applying the Nonadoption, Abandonment, Scale-up, Spread, and Sustainability Framework. JMIR Mhealth Uhealth. 2021 Nov 15;9(11):e31037. doi: 10.2196/31037.

Yakovchenko V, Hogan TP, Houston TK, Richardson L, Lipschitz J, Petrakis BA, Gillespie C, McInnes DK. Automated Text Messaging With Patients in Department of Veterans Affairs Specialty Clinics: Cluster Randomized Trial. J Med Internet Res. 2019 Aug 4;21(8):e14750. doi: 10.2196/14750.