Dataset Information

Metrics for Outpatient Portal Use Based on Log File Analysis: Algorithm Development.

ABSTRACT:

Background

Web-based outpatient portals help patients engage in the management of their health by allowing them to access their medical information, schedule appointments, track their medications, and communicate with their physicians and care team members. Initial studies have shown that portal adoption positively affects health outcomes; however, early studies typically relied on survey data. Using data from health portal applications, we conducted systematic assessments of patients' use of an outpatient portal to examine how patients engage with the tool.

Objective

This study aimed to document the functionality of an outpatient portal in the context of outpatient care by mining portal usage data and to provide insights into how patients use this tool.

Methods

Using audit log files from the outpatient portal associated with the electronic health record system implemented at a large multihospital academic medical center, we investigated the behavioral traces of a study population of 2607 patients who used the portal between July 2015 and February 2019. Patient portal use was defined as having an active account and having accessed any portal function more than once during the study time frame.

Results

Through our analysis of audit log file data of the number and type of user interactions, we developed a taxonomy of functions and actions and computed analytic metrics, including frequency and comprehensiveness of use. We additionally documented the computational steps required to diagnose artifactual data and arrive at valid usage metrics. Of the 2607 patients in our sample, 2511 were active users of the patients portal where the median number of sessions was 94 (IQR 207). Function use was comprehensive at the patient level, while each session was instead limited to the use of one specific function. Only 17.45% (78,787/451,762) of the sessions were linked to activities involving more than one portal function.

Conclusions

In discussing the full methodological choices made in our analysis, we hope to promote the replicability of our study at other institutions and contribute to the establishment of best practices that can facilitate the adoption of behavioral metrics that enable the measurement of patient engagement based on the outpatient portal use.

SUBMITTER: Di Tosto G

PROVIDER: S-EPMC7320309 | biostudies-literature | 2020 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Metrics for Outpatient Portal Use Based on Log File Analysis: Algorithm Development.

Di Tosto Gennaro G McAlearney Ann Scheck AS Fareed Naleef N Huerta Timothy R TR

Journal of medical Internet research 20200612 6

<h4>Background</h4>Web-based outpatient portals help patients engage in the management of their health by allowing them to access their medical information, schedule appointments, track their medications, and communicate with their physicians and care team members. Initial studies have shown that portal adoption positively affects health outcomes; however, early studies typically relied on survey data. Using data from health portal applications, we conducted systematic assessments of patients' u ...[more]

PMID: 32530435

Similar Datasets

Project description:BACKGROUND:Inpatient portals (IPPs) have the potential to increase patient engagement and satisfaction with their health care. An IPP provides a hospitalized patient with similar functions to those found in outpatient portals, including the ability to view vital signs, laboratory results, and medication information; schedule appointments; and communicate with their providers. However, IPPs may offer additional functions such as meal planning, real-time messaging with the inpatient care team, daily schedules, and access to educational materials relevant to their specific condition. In practice, IPPs have been developed as websites and tablet apps, with hospitals providing the required technology as a component of care during the patient's stay. OBJECTIVE:This study aimed to describe how inpatients are using IPPs at the first academic medical center to implement a system-wide IPP and document the challenges and choices associated with this analytic process. METHODS:We analyzed the audit log files of IPP users hospitalized between January 2014 and January 2016. Data regarding the date/time and duration of interactions with each of the MyChart Bedside modules (eg, view lab results or medications and patient schedule) and activities (eg, messaging the provider and viewing educational videos) were captured as part of the system audit logs. The development of a construct to describe the length of time associated with a single coherent use of the tool-which we call a session-provides a foundational unit of analysis. We defined frequency as the number of sessions a patient has during a given provision day. We defined comprehensiveness in terms of the percentage of functions that an individual uses during a given provision day. RESULTS:The analytic process presented data challenges such as length of stay and tablet-provisioning factors. This study presents data visualizations to illustrate a series of data-cleaning issues. In the presence of these robust approaches to data cleaning, we present the baseline usage patterns associated with our patient panel. In addition to frequency and comprehensiveness, we present considerations of median data to mitigate the effect of outliers. CONCLUSIONS:Although other studies have published usage data associated with IPPs, most have not explicated the challenges and choices associated with the analytic approach deployed within each study. Our intent in this study was to be somewhat exhaustive in this area, in part, because replicability requires common metrics. Our hope is that future researchers in this area will avail themselves of these perspectives to engage in critical assessment moving forward.

Project description:BackgroundThe decision to use patient portals can be influenced by multiple factors, including individuals' perceptions of the tool, which are based on both their personal skills and experiences. Prior experience with one type of portal may make individuals more comfortable with using newer portal technologies. Experienced outpatient portal users in particular may have confidence in their ability to use inpatient portals that have similar functionality. In practice, the use of both outpatient and inpatient portal technologies can provide patients with continuity of access to their health information across care settings, but the influence of one type of portal use on the use of other portals has not been studied.ObjectiveThis study aims to understand how patients' use of an inpatient portal is influenced by outpatient portal use.MethodsThis study included patients from an academic medical center who were provided access to an inpatient portal during their hospital stays between 2016 and 2018 (N=1571). We analyzed inpatient portal log files to investigate how inpatient portal use varied by using 3 categories of outpatient portal users: prior users, new users, and nonusers.ResultsCompared with prior users (695/1571, 44.24%) of an outpatient portal, new users (214/1571, 13.62%) had higher use of a select set of inpatient portal functions (messaging function: incidence rate ratio [IRR] 1.33, 95% CI 1.06-1.67; function that provides access to the outpatient portal through the inpatient portal: IRR 1.34, 95% CI 1.13-1.58). Nonusers (662/1571, 42.14%), compared with prior users, had lower overall inpatient portal use (all active functions: IRR 0.68, 95% CI 0.60-0.78) and lower use of specific functions, which included the function to review vitals and laboratory results (IRR 0.51, 95% CI 0.36-0.73) and the function to access the outpatient portal (IRR 0.53, 95% CI 0.45-0.62). In comparison with prior users, nonusers also had lower odds of being comprehensive users (defined as using 8 or more unique portal functions; odds ratio [OR] 0.57, 95% CI 0.45-0.73) or composite users (defined as comprehensive users who initiated a 75th or greater percentile of portal sessions) of the inpatient portal (OR 0.42, 95% CI 0.29-0.60).ConclusionsPatients' use of an inpatient portal during their hospital stay appeared to be influenced by a combination of factors, including prior outpatient portal use. For new users, hospitalization itself, a major event that can motivate behavioral changes, may have influenced portal use. In contrast, nonusers might have lower self-efficacy in their ability to use technology to manage their health, contributing to their lower portal use. Understanding the relationship between the use of outpatient and inpatient portals can help direct targeted implementation strategies that encourage individuals to use these tools to better manage their health across care settings.

Project description:A model based on a specific phantom, called QuAArC, has been designed for the evaluation of planning and verification systems of complex radiotherapy treatments, such as volumetric modulated arc therapy (VMAT). This model uses the high accuracy provided by the Monte Carlo (MC) simulation of log files and allows the experimental feedback from the high spatial resolution of films hosted in QuAArC. This cylindrical phantom was specifically designed to host films rolled at different radial distances able to take into account the entrance fluence and the 3D dose distribution. Ionization chamber measurements are also included in the feedback process for absolute dose considerations. In this way, automated MC simulation of treatment log files is implemented to calculate the actual delivery geometries, while the monitor units are experimentally adjusted to reconstruct the dose-volume histogram (DVH) on the patient CT. Prostate and head and neck clinical cases, previously planned with Monaco and Pinnacle treatment planning systems and verified with two different commercial systems (Delta4 and COMPASS), were selected in order to test operational feasibility of the proposed model. The proper operation of the feedback procedure was proved through the achieved high agreement between reconstructed dose distributions and the film measurements (global gamma passing rates > 90% for the 2%/2 mm criteria). The necessary discretization level of the log file for dose calculation and the potential mismatching between calculated control points and detection grid in the verification process were discussed. Besides the effect of dose calculation accuracy of the analytic algorithm implemented in treatment planning systems for a dynamic technique, it was discussed the importance of the detection density level and its location in VMAT specific phantom to obtain a more reliable DVH in the patient CT. The proposed model also showed enough robustness and efficiency to be considered as a pre-treatment VMAT verification system.

Dataset Information

Metrics for Outpatient Portal Use Based on Log File Analysis: Algorithm Development.

Background

Objective

Methods

Results

Conclusions

Publications

Metrics for Outpatient Portal Use Based on Log File Analysis: Algorithm Development.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets