Dataset Information

Quality of Hospital Electronic Health Record (EHR) Data Based on the International Consortium for Health Outcomes Measurement (ICHOM) in Heart Failure: Pilot Data Quality Assessment Study.

ABSTRACT:

Background

There is increasing recognition that health care providers need to focus attention, and be judged against, the impact they have on the health outcomes experienced by patients. The measurement of health outcomes as a routine part of clinical documentation is probably the only scalable way of collecting outcomes evidence, since secondary data collection is expensive and error-prone. However, there is uncertainty about whether routinely collected clinical data within electronic health record (EHR) systems includes the data most relevant to measuring and comparing outcomes and if those items are collected to a good enough data quality to be relied upon for outcomes assessment, since several studies have pointed out significant issues regarding EHR data availability and quality.

Objective

In this paper, we first describe a practical approach to data quality assessment of health outcomes, based on a literature review of existing frameworks for quality assessment of health data and multistakeholder consultation. Adopting this approach, we performed a pilot study on a subset of 21 International Consortium for Health Outcomes Measurement (ICHOM) outcomes data items from patients with congestive heart failure.

Methods

All available registries compatible with the diagnosis of heart failure within an EHR data repository of a general hospital (142,345 visits and 12,503 patients) were extracted and mapped to the ICHOM format. We focused our pilot assessment on 5 commonly used data quality dimensions: completeness, correctness, consistency, uniqueness, and temporal stability.

Results

We found high scores (>95%) for the consistency, completeness, and uniqueness dimensions. Temporal stability analyses showed some changes over time in the reported use of medication to treat heart failure, as well as in the recording of past medical conditions. Finally, the investigation of data correctness suggested several issues concerning the characterization of missing data values. Many of these issues appear to be introduced while mapping the IMASIS-2 relational database contents to the ICHOM format, as the latter requires a level of detail that is not explicitly available in the coded data of an EHR.

Conclusions

Overall, results of this pilot study revealed good data quality for the subset of heart failure outcomes collected at the Hospital del Mar. Nevertheless, some important data errors were identified that were caused by fundamentally different data collection practices in routine clinical care versus research, for which the ICHOM standard set was originally developed. To truly examine to what extent hospitals today are able to routinely collect the evidence of their success in achieving good health outcomes, future research would benefit from performing more extensive data quality assessments, including all data items from the ICHOM standards set and across multiple hospitals.

SUBMITTER: Aerts H

PROVIDER: S-EPMC8374665 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundWith increased specialization of health care services and high levels of patient mobility, accessing health care services across multiple hospitals or clinics has become very common for diagnosis and treatment, particularly for patients with chronic diseases such as cancer. With informed knowledge of a patient's history, physicians can make prompt clinical decisions for smarter, safer, and more efficient care. However, due to the privacy and high sensitivity of electronic health records (EHR), most EHR data sharing still happens through fax or mail due to the lack of systematic infrastructure support for secure, trustable health data sharing, which can also cause major delays in patient care.ObjectiveOur goal was to develop a system that will facilitate secure, trustable management, sharing, and aggregation of EHR data. Our patient-centric system allows patients to manage their own health records across multiple hospitals. The system will ensure patient privacy protection and guarantee security with respect to the requirements for health care data management, including the access control policy specified by the patient.MethodsWe propose a permissioned blockchain-based system for EHR data sharing and integration. Each hospital will provide a blockchain node integrated with its own EHR system to form the blockchain network. A web-based interface will be used for patients and doctors to initiate EHR sharing transactions. We take a hybrid data management approach, where only management metadata will be stored on the chain. Actual EHR data, on the other hand, will be encrypted and stored off-chain in Health Insurance Portability and Accountability Act-compliant cloud-based storage. The system uses public key infrastructure-based asymmetric encryption and digital signatures to secure shared EHR data.ResultsIn collaboration with Stony Brook University Hospital, we developed ACTION-EHR, a system for patient-centric, blockchain-based EHR data sharing and management for patient care, in particular radiation treatment for cancer. The prototype was built on Hyperledger Fabric, an open-source, permissioned blockchain framework. Data sharing transactions were implemented using chaincode and exposed as representational state transfer application programming interfaces used for the web portal for patients and users. The HL7 Fast Healthcare Interoperability Resources standard was adopted to represent shared EHR data, making it easy to interface with hospital EHR systems and integrate a patient's EHR data. We tested the system in a distributed environment at Stony Brook University using deidentified patient data.ConclusionsWe studied and developed the critical technology components to enable patient-centric, blockchain-based EHR sharing to support cancer care. The prototype demonstrated the feasibility of our approach as well as some of the major challenges. The next step will be a pilot study with health care providers in both the United States and Switzerland. Our work provides an exemplar testbed to build next-generation EHR sharing infrastructures.

Project description:AimsUnderstanding atypical forms of diabetes (AD) may advance precision medicine, but methods to identify such patients are needed. We propose an electronic health record (EHR)-based algorithmic approach to identify patients who may have AD, specifically those with insulin-sufficient, non-metabolic diabetes, in order to improve feasibility of identifying these patients through detailed chart review.MethodsPatients with likely T2D were selected using a validated machine-learning (ML) algorithm applied to EHR data. "Typical" T2D cases were removed by excluding individuals with obesity, evidence of dyslipidemia, antibody-positive diabetes, or cystic fibrosis. To filter out likely type 1 diabetes (T1D) cases, we applied six additional "branch algorithms," relying on various clinical characteristics, which resulted in six overlapping cohorts. Diabetes type was classified by manual chart review as atypical, not atypical, or indeterminate due to missing information.ResultsOf 114,975 biobank participants, the algorithms collectively identified 119 (0.1%) potential AD cases, of which 16 (0.014%) were confirmed after expert review. The branch algorithm that excluded T1D based on outpatient insulin use had the highest percentage yield of AD (13 of 27; 48.2% yield). Together, the 16 AD cases had significantly lower BMI and higher HDL than either unselected T1D or T2D cases identified by ML algorithms (P<0.05). Compared to the ML T1D group, the AD group had a significantly higher T2D polygenic score (P<0.01) and lower hemoglobin A1c (P<0.01).ConclusionOur EHR-based algorithms followed by manual chart review identified collectively 16 individuals with AD, representing 0.22% of biobank enrollees with T2D. With a maximum yield of 48% cases after manual chart review, our algorithms have the potential to drastically improve efficiency of AD identification. Recognizing patients with AD may inform on the heterogeneity of T2D and facilitate enrollment in studies like the Rare and Atypical Diabetes Network (RADIANT).

Project description:BackgroundElectronic health record (EHR) transitions are inherently disruptive to healthcare workers who must rapidly learn a new EHR and adapt to altered clinical workflows. Healthcare workers' perceptions of EHR usability and their EHR use patterns following transitions are poorly understood. The Department of Veterans Affairs (VA) is currently replacing its homegrown EHR with a commercial Cerner EHR, presenting a unique opportunity to examine EHR use trends and usability perceptions.ObjectiveTo assess EHR usability and uptake up to 1-year post-transition at the first VA EHR transition site using a novel longitudinal, mixed methods approach.DesignA concurrent mixed methods strategy using EHR use metrics and qualitative interview data.Participants141 clinicians with data from select EHR use metrics in Cerner Lights On Network®. Interviews with 25 healthcare workers in various clinical and administrative roles.ApproachWe assessed changes in total EHR time, documentation time, and order time per patient post-transition. Interview transcripts (n = 90) were coded and analyzed for content specific to EHR usability.Key resultsTotal EHR time, documentation time, and order time all decreased precipitously within the first four months after go-live and demonstrated gradual improvements over 12 months. Interview participants expressed ongoing concerns with the EHR's usability and functionality up to a year after go-live such as tasks taking longer than the old system and inefficiencies related to inadequate training and inherent features of the new system. These sentiments did not seem to reflect the observed improvements in EHR use metrics.ConclusionsThe integration of quantitative and qualitative data yielded a complex picture of EHR usability. Participants described persistent challenges with EHR usability 1 year after go-live contrasting with observed improvements in EHR use metrics. Combining findings across methods can provide a clearer, contextualized understanding of EHR adoption and use patterns during EHR transitions.

Project description:BackgroundThe predominant implementation paradigm of electronic health record (EHR) systems in low- and middle-income countries (LMICs) relies on standalone system installations at facilities. This implementation approach exacerbates the digital divide, with facilities in areas with inadequate electrical and network infrastructure often left behind. Mobile health (mHealth) technologies have been implemented to extend the reach of digital health, but these systems largely add to the problem of siloed patient data, with few seamlessly interoperating with the EHR systems that are now scaled nationally in many LMICs. Robust mHealth applications that effectively extend EHR systems are needed to improve access, improve quality of care, and ameliorate the digital divide.ObjectiveWe report on the development and scaled implementation of mUzima, an mHealth extension of the most broadly deployed EHR system in LMICs (OpenMRS).MethodsThe "Guidelines for reporting of health interventions using mobile phones: mobile (mHealth) evidence reporting assessment (mERA)" checklist was employed to report on the mUzima application. The World Health Organization (WHO) Principles for Digital Development framework was used as a secondary reference framework. Details of mUzima's architecture, core features, functionalities, and its implementation status are provided to highlight elements that can be adapted in other systems.ResultsmUzima is an open-source, highly configurable Android application with robust features including offline management, deduplication, relationship management, security, cohort management, and error resolution, among many others. mUzima allows providers with lower-end Android smartphones (version 4.4 and above) who work remotely to access historical patient data, collect new data, view media, leverage decision support, conduct store-and-forward teleconsultation, and geolocate clients. The application is supported by an active community of developers and users, with feature priorities vetted by the community. mUzima has been implemented nationally in Kenya, is widely used in Rwanda, and is gaining scale in Uganda and Mozambique. It is disease-agnostic, with current use cases in HIV, cancer, chronic disease, and COVID-19 management, among other conditions. mUzima meets all WHO's Principles of Digital Development, and its scaled implementation success has led to its recognition as a digital global public good and its listing in the WHO Digital Health Atlas.ConclusionsGreater emphasis should be placed on mHealth applications that robustly extend reach of EHR systems within resource-limited settings, as opposed to siloed mHealth applications. This is particularly important given that health information exchange infrastructure is yet to mature in many LMICs. The mUzima application demonstrates how this can be done at scale, as evidenced by its adoption across multiple countries and for numerous care domains.

Project description:BACKGROUND:The implementation of an electronic health record (EHR) with structured and standardized recording of patient data can improve data quality and reusability. Whether and how users perceive these advantages may depend on the preimplementation situation. OBJECTIVE:To determine whether the influence of implementing a structured and standardized EHR on perceived EHR use, data quality, and data reuse differed for users working with paper-based records versus a legacy EHR before implementation. METHODS:We used an electronic questionnaire to measure users' perception before implementation (2014), expected change, and perceived change after implementation (2016) on three themes. We included all health care professionals in two university hospitals in the Netherlands. Before jointly implementing the same structured and standardized EHR, one hospital used paper-based records and the other a legacy EHR. We compared perceptions before and after implementation for both centers. Additionally, we compared expected benefit with perceived benefit. RESULTS:We received 7,611 responses (4,537 before and 3,074 after implementation) of which 5,707 (75%) were from professionals reading and recording patient data. A total of 975 (13%) professionals responded to both before and after implementation questionnaires. In the formerly paper-based center staff perceived improvement in all themes after implementation. The legacy EHR center experienced deterioration of perceived EHR use and data reuse, and only one improvement in EHR use. In both centers, for half of the aspects at least 45% of responders experienced results worse than expected preimplementation. CONCLUSION:Our results indicate that the preimplementation recording practice impacts the perceived effect of the implementation of a structured and standardized EHR. For almost half of the respondents the new EHR did not meet their expectations. Especially legacy EHR centers need to investigate the expectations as these might be different and less clear cut than those in paper-based centers. These expectations need to be addressed appropriately to achieve a successful implementation.

Project description:BackgroundPatient-reported outcome (PRO) instruments measure health gains, including changes in health-related quality of life (HRQoL). Previous studies have assessed the reliability and relationship of multiple HRQoL instruments in search of the optimal instrument for feasible measurement of PROs. Although the 15D instrument was shown to have the best sensitivity and construct validity among cardiac patients, it is unknown how well it captures relevant disease-specific information scores compared to instruments included in the International Consortium for Health Outcomes Measurement (ICHOM) standard set. The aim of this study was to investigate whether the disease-specific PRO instruments and a generic HRQoL instrument capture disease related symptoms in coronary artery disease (CAD) patients.MethodsHealth status and HRQoL were assessed with the instruments included in the ICHOM standard set: Seattle Angina Questionnaire short-form (SAQ-7), Rose Dyspnea Scale (RDS), two-item Patient Health Questionnaire (PHQ-2), and with the 15D HRQoL instrument at baseline and 1 year from the treatment in a university hospital setting. Spearman correlation and explanatory factor analysis were used to assess the relationship of baseline scores and 1-year change in scores of 297 patients.ResultsAt baseline, the overall 15D score and SAQ-physical limitation (SAQ-PL), 15D "breathing" and SAQ-PL, as well as "breathing" and RDS showed moderately strong correlations. The factor interpreted to reflect "Breathing-related physical activity", based on high loadings of "breathing", RDS, SAQ-PL, "mobility", "vitality", and "usual activities", explained 19.2% of the total variance. Correlations between 1-year changes in scores were fair. The factor of "Breathing-related physical activity", with significant loading of RDS, SAQ-PL, "breathing, "usual activities", "vitality\", "sexual activity", "mobility", and disease-specific quality of life explained 20.5% of the total variance in 1-year change in scores. The correlation of angina frequency measured by SAQ-7 and the 15D instrument was poor.ConclusionsThe 15D detects dyspnea and depression similarly to RDS and PHQ-2 but not angina similarly to the SAQ-7. This may call for supplementing the 15D instrument with a disease-specific instrument when studying CAD patients.