Dataset Information

Measuring Collaboration Through Concurrent Electronic Health Record Usage: Network Analysis Study.

ABSTRACT:

Background

Collaboration is vital within health care institutions, and it allows for the effective use of collective health care worker (HCW) expertise. Human-computer interactions involving electronic health records (EHRs) have become pervasive and act as an avenue for quantifying these collaborations using statistical and network analysis methods.

Objective

We aimed to measure HCW collaboration and its characteristics by analyzing concurrent EHR usage.

Methods

By extracting concurrent EHR usage events from audit log data, we defined concurrent sessions. For each HCW, we established a metric called concurrent intensity, which was the proportion of EHR activities in concurrent sessions over all EHR activities. Statistical models were used to test the differences in the concurrent intensity between HCWs. For each patient visit, starting from admission to discharge, we measured concurrent EHR usage across all HCWs, which we called temporal patterns. Again, we applied statistical models to test the differences in temporal patterns of the admission, discharge, and intermediate days of hospital stay between weekdays and weekends. Network analysis was leveraged to measure collaborative relationships among HCWs. We surveyed experts to determine if they could distinguish collaborative relationships between high and low likelihood categories derived from concurrent EHR usage. Clustering was used to aggregate concurrent activities to describe concurrent sessions. We gathered 4 months of EHR audit log data from a large academic medical center's neonatal intensive care unit (NICU) to validate the effectiveness of our framework.

Results

There was a significant difference (P<.001) in the concurrent intensity (proportion of concurrent activities: ranging from mean 0.07, 95% CI 0.06-0.08, to mean 0.36, 95% CI 0.18-0.54; proportion of time spent on concurrent activities: ranging from mean 0.32, 95% CI 0.20-0.44, to mean 0.76, 95% CI 0.51-1.00) between the top 13 HCW specialties who had the largest amount of time spent in EHRs. Temporal patterns between weekday and weekend periods were significantly different on admission (number of concurrent intervals per hour: 11.60 vs 0.54; P<.001) and discharge days (4.72 vs 1.54; P<.001), but not during intermediate days of hospital stay. Neonatal nurses, fellows, frontline providers, neonatologists, consultants, respiratory therapists, and ancillary and support staff had collaborative relationships. NICU professionals could distinguish high likelihood collaborative relationships from low ones at significant rates (3.54, 95% CI 3.31-4.37 vs 2.64, 95% CI 2.46-3.29; P<.001). We identified 50 clusters of concurrent activities. Over 87% of concurrent sessions could be described by a single cluster, with the remaining 13% of sessions comprising multiple clusters.

Conclusions

Leveraging concurrent EHR usage workflow through audit logs to analyze HCW collaboration may improve our understanding of collaborative patient care. HCW collaboration using EHRs could potentially influence the quality of patient care, discharge timeliness, and clinician workload, stress, or burnout.

SUBMITTER: Li P

PROVIDER: S-EPMC8449299 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Interdisciplinary research collaboration is needed to perform transformative science and accelerate innovation. The Science of Team Science strives to investigate, evaluate, and foster team science, including institutional policies that may promote or hinder collaborative interdisciplinary research and the resources and infrastructure needed to promote team science within and across institutions. Social network analysis (SNA) has emerged as a useful method to measure interdisciplinary science through the evaluation of several types of collaboration networks, including co-authorship networks. Likewise, research administrators are responsible for conducting rigorous evaluation of policies and initiatives. Within this paper, we present a case study using SNA to evaluate inter-programmatic collaboration (evidenced by co-authoring scientific papers) from 2007-2014 among scientists who are members of four formal research programs at an NCI-designated Cancer Center, the Markey Cancer Center (MCC) at the University of Kentucky. We evaluate change in network descriptives over time and implement separable temporal exponential-family random graph models (STERGMs) to estimate the effect of author and network variables on the tendency to form a co-authorship tie. We measure the diversity of the articles published over time (Blau's Index) to understand whether the changes in the co-authorship network are reflected in the diversity of articles published by research members. Over the 8-year period, we found increased inter-programmatic collaboration among research members as evidenced by co-authorship of published scientific papers. Over time, MCC Members collaborated more with others outside of their research program and outside their initial dense co-authorship groups, however tie formation continues to be driven by co-authoring with individuals of the same research program and academic department. Papers increased in diversity over time on all measures with the exception of author gender. This inter-programmatic research was fostered by policy changes in cancer center administration encouraging interdisciplinary research through both informal (e.g., annual retreats, seminar series) and formal (e.g., requiring investigators from more than two research programs on applications for pilot funding) means. Within this cancer center, interdisciplinary co-authorship increased over time as policies encouraging this collaboration were implemented. Yet, there is room for improvement in creating more interdisciplinary and diverse ties between research program members.

Project description:OBJECTIVE:Data in electronic health records (EHRs) is being increasingly leveraged for secondary uses, ranging from biomedical association studies to comparative effectiveness. To perform studies at scale and transfer knowledge from one institution to another in a meaningful way, we need to harmonize the phenotypes in such systems. Traditionally, this has been accomplished through expert specification of phenotypes via standardized terminologies, such as billing codes. However, this approach may be biased by the experience and expectations of the experts, as well as the vocabulary used to describe such patients. The goal of this work is to develop a data-driven strategy to (1) infer phenotypic topics within patient populations and (2) assess the degree to which such topics facilitate a mapping across populations in disparate healthcare systems. METHODS:We adapt a generative topic modeling strategy, based on latent Dirichlet allocation, to infer phenotypic topics. We utilize a variance analysis to assess the projection of a patient population from one healthcare system onto the topics learned from another system. The consistency of learned phenotypic topics was evaluated using (1) the similarity of topics, (2) the stability of a patient population across topics, and (3) the transferability of a topic across sites. We evaluated our approaches using four months of inpatient data from two geographically distinct healthcare systems: (1) Northwestern Memorial Hospital (NMH) and (2) Vanderbilt University Medical Center (VUMC). RESULTS:The method learned 25 phenotypic topics from each healthcare system. The average cosine similarity between matched topics across the two sites was 0.39, a remarkably high value given the very high dimensionality of the feature space. The average stability of VUMC and NMH patients across the topics of two sites was 0.988 and 0.812, respectively, as measured by the Pearson correlation coefficient. Also the VUMC and NMH topics have smaller variance of characterizing patient population of two sites than standard clinical terminologies (e.g., ICD9), suggesting they may be more reliably transferred across hospital systems. CONCLUSIONS:Phenotypic topics learned from EHR data can be more stable and transferable than billing codes for characterizing the general status of a patient population. This suggests that EHR-based research may be able to leverage such phenotypic topics as variables when pooling patient populations in predictive models.