Dataset Information

Developing electronic health record algorithms that accurately identify patients with juvenile idiopathic arthritis.

ABSTRACT:

Background

The objective of this study was to develop an algorithm that accurately identifies juvenile idiopathic arthritis (JIA) patients in the electronic health record (EHR).

Methods

Algorithms were developed in a de-identified EHR by searching for a priori JIA ICD-9 (International Classification of Diseases, Ninth Revision) and ICD-10-CM (International Classification of Diseases, Tenth Revision, Clinical Modification) codes and JIA-related keywords. Exclusion criteria were selected to remove other autoimmune diseases. A training set of 200 patients was randomly selected from patients containing ≥1 occurrence of a JIA ICD-9 or ICD-10-CM code. Case status was determined by a rheumatology clinic note documenting a JIA diagnosis before age 20. For each algorithm, positive predictive value (PPV), sensitivity, and F-measure were determined using the training set.

Results

We developed 103 algorithms using combinations of ICD codes, keywords, and exclusion criteria. The algorithm requiring 4 or more counts of JIA ICD-9 or ICD-10-CM codes, keywords "enthesitis" and "uveitis", and exclusion of ICD-9 or ICD-10-CM codes for systemic lupus erythematosus, dermatomyositis, polymyositis, and dermatopolymyositis had the highest PPV of 97% in the training set with an F-measure of 87%. There were 1,131 JIA cases returned by this algorithm. We validated the highest performing algorithm in a separate cohort from the training set with a PPV of 92% and an F-measure of 75%.

Conclusion

We developed and validated JIA EHR algorithms with ICD-9 and ICD-10-CM codes to accurately identify a JIA cohort. Three algorithms achieved PPVs of 97%, each with different algorithm criteria, allowing for users to select an algorithm to best fit their research needs.

SUBMITTER: Peterson HM

PROVIDER: S-EPMC9992125 | biostudies-literature | 2023 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Developing electronic health record algorithms that accurately identify patients with juvenile idiopathic arthritis.

Peterson Hannah M HM Vela Kelsi L KL Barnado April A Patrick Anna E AE

Seminars in arthritis and rheumatism 20230118

<h4>Background</h4>The objective of this study was to develop an algorithm that accurately identifies juvenile idiopathic arthritis (JIA) patients in the electronic health record (EHR).<h4>Methods</h4>Algorithms were developed in a de-identified EHR by searching for a priori JIA ICD-9 (International Classification of Diseases, Ninth Revision) and ICD-10-CM (International Classification of Diseases, Tenth Revision, Clinical Modification) codes and JIA-related keywords. Exclusion criteria were sel ...[more]

PMID: 36708593

Similar Datasets

Project description:BACKGROUND:Systemic sclerosis (SSc) is a rare disease with studies limited by small sample sizes. Electronic health records (EHRs) represent a powerful tool to study patients with rare diseases such as SSc, but validated methods are needed. We developed and validated EHR-based algorithms that incorporate billing codes and clinical data to identify SSc patients in the EHR. METHODS:We used a de-identified EHR with over 3 million subjects and identified 1899 potential SSc subjects with at least 1 count of the SSc ICD-9 (710.1) or ICD-10-CM (M34*) codes. We randomly selected 200 as a training set for chart review. A subject was a case if diagnosed with SSc by a rheumatologist, dermatologist, or pulmonologist. We selected the following algorithm components based on clinical knowledge and available data: SSc ICD-9 and ICD-10-CM codes, positive antinuclear antibody (ANA) (titer ≥ 1:80), and a keyword of Raynaud's phenomenon (RP). We performed both rule-based and machine learning techniques for algorithm development. Positive predictive values (PPVs), sensitivities, and F-scores (which account for PPVs and sensitivities) were calculated for the algorithms. RESULTS:PPVs were low for algorithms using only 1 count of the SSc ICD-9 code. As code counts increased, the PPVs increased. PPVs were higher for algorithms using ICD-10-CM codes versus the ICD-9 code. Adding a positive ANA and RP keyword increased the PPVs of algorithms only using ICD billing codes. Algorithms using ≥ 3 or ≥ 4 counts of the SSc ICD-9 or ICD-10-CM codes and ANA positivity had the highest PPV at 100% but a low sensitivity at 50%. The algorithm with the highest F-score of 91% was ≥ 4 counts of the ICD-9 or ICD-10-CM codes with an internally validated PPV of 90%. A machine learning method using random forests yielded an algorithm with a PPV of 84%, sensitivity of 92%, and F-score of 88%. The most important feature was RP keyword. CONCLUSIONS:Algorithms using only ICD-9 codes did not perform well to identify SSc patients. The highest performing algorithms incorporated clinical data with billing codes. EHR-based algorithms can identify SSc patients across a healthcare system, enabling researchers to examine important outcomes.

Project description:ObjectivesTo develop, validate, and implement algorithms to identify diabetic retinopathy (DR) cases and controls from electronic health care records (EHRs).Materials and methodsWe developed and validated electronic health record (EHR)-based algorithms to identify DR cases and individuals with type I or II diabetes without DR (controls) in 3 independent EHR systems: Vanderbilt University Medical Center Synthetic Derivative (VUMC), the VA Northeast Ohio Healthcare System (VANEOHS), and Massachusetts General Brigham (MGB). Cases were required to meet 1 of the following 3 criteria: (1) 2 or more dates with any DR ICD-9/10 code documented in the EHR, (2) at least one affirmative health-factor or EPIC code for DR along with an ICD9/10 code for DR on a different day, or (3) at least one ICD-9/10 code for any DR occurring within 24 hours of an ophthalmology examination. Criteria for controls included affirmative evidence for diabetes as well as an ophthalmology examination.ResultsThe algorithms, developed and evaluated in VUMC through manual chart review, resulted in a positive predictive value (PPV) of 0.93 for cases and negative predictive value (NPV) of 0.91 for controls. Implementation of algorithms yielded similar metrics in VANEOHS (PPV = 0.94; NPV = 0.86) and lower in MGB (PPV = 0.84; NPV = 0.76). In comparison, the algorithm for DR implemented in Phenome-wide association study (PheWAS) in VUMC yielded similar PPV (0.92) but substantially reduced NPV (0.48). Implementation of the algorithms to the Million Veteran Program identified over 62 000 DR cases with genetic data including 14 549 African Americans and 6209 Hispanics with DR.Conclusions/discussionWe demonstrate the robustness of the algorithms at 3 separate healthcare centers, with a minimum PPV of 0.84 and substantially improved NPV than existing automated methods. We strongly encourage independent validation and incorporation of features unique to each EHR to enhance algorithm performance for DR cases and controls.

Project description:BackgroundHaptoglobin (Hp), a liver derived acute phase inflammatory protein (APP), has scarcely been studied in juvenile idiopathic arthritis (JIA). Hp can occur in blood as two isoforms (Hp1 and Hp2) in precursor and mature forms. Routine clinical chemistry immunoturbidimetry does not discern these forms. It is unknown how different forms relate to disease activity in JIA. Our aims were to determine allele frequency and plasma concentrations of different Hp forms at higher versus lower JIA disease activity and compare to other APPs.MethodsPlasma from JIA (n = 77) and healthy (n = 42) children were analyzed for apparent Hp allelic frequency and densitometric concentrations of alpha forms by Western blot (WB). Polymerase chain reaction (PCR) (buffy coat) was performed in a subset to estimate conformity with genetics. At higher versus lower juvenile arthritis disease activity score (JADAS27) (which includes erythrocyte sedimentation rate (ESR)), total mature Hp concentration from WB was compared and correlated against immunoturbidimetry and total protein, albumin, serum amyloid A (SAA) and C-reactive protein (CRP).ResultsAt 300-fold dilution needed to study mature forms in Western blot, precursors were undetectable. Hp2 contributed most signal in most samples. Hp allele frequency was similar in JIA and controls. Both mature forms, taken separately or by sum, declined following treatment, but remained above concentrations of healthy controls, even in a remission subset that achieved JADAS27 < 1. Densitometry correlated with immunoturbidimetry. Hp concentrations correlated with JADAS27, albumin (negatively), CRP and SAA with immunoturbidimetric method correlating strongest to JADAS27 (Spearman R ~ 0.6, p < 0.0001).ConclusionHp allele frequency in JIA is similar to the general population, indicating that children with JIA should have the same possibility as in healthy children to produce preHp2 (zonulin), thought to increase intestinal permeability. Circulating Hp concentrations largely parallel other APPs and ESR; none of these measures correlate very strongly to JADAS27 score but Hp can be measured from capillary sampling which is impossible with ESR.

Dataset Information

Developing electronic health record algorithms that accurately identify patients with juvenile idiopathic arthritis.

Background

Methods

Results

Conclusion

Publications

Developing electronic health record algorithms that accurately identify patients with juvenile idiopathic arthritis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets