Accuracy of ICD-10-CM claims-based definitions for epilepsy and seizure type.
Ontology highlight
ABSTRACT: Objective
To evaluate the accuracy of ICD-10-CM claims-based definitions for epilepsy and classifying seizure types in the outpatient setting.Methods
We reviewed electronic health records (EHR) for a cohort of adults aged 18+ years seen by six neurologists who had an outpatient visit at a level 4 epilepsy center between 01/2019-09/2019. The neurologists used a standardized documentation template to capture the diagnosis of epilepsy (yes/no/unsure), seizure type (focal/generalized/unknown), and seizure frequency in the EHR. Using linked ICD-10-CM codes assigned by the provider, we assessed the accuracy of claims-based definitions for epilepsy, focal seizure type, and generalized seizure type against the reference-standard EHR documentation by estimating sensitivity (Sn), specificity (Sp), positive predictive value (PPV), and negative predictive value (NPV).Results
There were 673 eligible outpatient encounters. After review of EHRs for standardized documentation, an analytic sample consisted of 520 encounters representing 402 unique patients. In the EHR documentation, 93.5 % (n = 486/520) of encounters were with patients with a diagnosis of epilepsy. Of those, 66.0 % (n = 321/486) had ≥1 focal seizure, 41.6 % (n = 202/486) had ≥1 generalized seizure, and 7% (n = 34/486) had ≥1 unknown seizure. An ICD-10-CM definition for epilepsy (i.e., ICD-10 G40.X) achieved Sn = 84.4 % (95 % CI 80.8-87.5%), Sp = 79.4 % (95 % CI 62.1-91.3%), PPV = 98.3 % (95 % CI 96.6-99.3%), and NPV = 26.2 % (95 % CI 18.0-35.8%). The classification of focal vs generalized/unknown seizures achieved Sn = 69.8 % (95 % CI 64.4-74.8%), Sp = 79.4 % (95 % CI 72.4-85.3%), PPV = 86.8 % (95 % CI 82.1-90.7%), and NPV = 57.5 % (95 % CI 50.8-64.0%).Conclusions
Claims-based definitions using groups of ICD-10-CM codes assigned by neurologists in routine outpatient clinic visits at a level 4 epilepsy center performed well in discriminating between patients with and without a diagnosis of epilepsy and between seizure types.
SUBMITTER: Smith JR
PROVIDER: S-EPMC7797939 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundHealthcare administrative claims data hold value for monitoring drug safety and assessing drug effectiveness. The U.S. Food and Drug Administration Biologics Effectiveness and Safety Initiative (BEST) is expanding its analytical capacity by developing claims-based definitions-referred to as algorithms-for populations and outcomes of interest. Acute myocardial infarction (AMI) was of interest due to its potential association with select biologics and the lack of an externally validated International Classification of Diseases, 10th Revision, Clinical Modification (ICD-10-CM) algorithm.ObjectiveDevelop and apply an ICD-10-CM-based algorithm in a U.S. administrative claims database to identify and characterize AMI populations.MethodsA comprehensive literature review was conducted to identify validated AMI algorithms. Building on prior published methodology and consistent application of ICD-9-CM codes, an ICD-10-CM algorithm was developed via forward-backward mapping using General Equivalence Mappings and refined with clinical input. An AMI population was then identified in the IBM® MarketScan® Research Databases and characterized using descriptive statistics.Results and discussionBetween 2014-2017, 2.83-3.16 individuals/1,000 enrollees/year received ≥1 AMI diagnosis in any healthcare setting. The 2015 transition to ICD-10-CM did not result in a substantial change in the proportion of patients identified. Average patient age at first AMI diagnosis was 64.9 years, and 61.4% of individuals were male. Unspecified chest pain, hypertension, and coronary atherosclerosis of native coronary vessel/artery were most commonly reported within one day of AMI diagnosis. Electrocardiograms were the most common medical procedure and beta-blockers were the most commonly ordered cardiac medication in the one day before to 14 days following AMI diagnosis. The mean length of inpatient stay was 5.6 days (median 3 days; standard deviation 7.9 days). Findings from this ICD-10-CM-based AMI study were internally consistent with ICD-9-CM-based findings and externally consistent with ICD-9-CM-based studies, suggesting that this algorithm is ready for validation in future studies.
| S-EPMC8248590 | biostudies-literature
Project description:Community clinics offer potential for timelier outbreak detection and monitoring than emergency departments. However, the accuracy of syndrome definitions used in surveillance has never been evaluated in community settings. This study's objective was to assess the accuracy of syndrome definitions based on diagnostic codes in physician claims for identifying 5 syndromes (fever, gastrointestinal, neurological, rash, and respiratory including influenza-like illness) in community clinics.We selected a random sample of 3,600 community-based primary care physicians who practiced in the fee-for-service system in the province of Quebec, Canada in 2005-2007. We randomly selected 10 visits per physician from their claims, stratifying on syndrome type and presence, diagnosis, and month. Double-blinded chart reviews were conducted by telephone with consenting physicians to obtain information on patient diagnoses for each sampled visit. The sensitivity, specificity, and positive predictive value (PPV) of physician claims were estimated by comparison to chart review.1,098 (30.5%) physicians completed the chart review. A chart entry on the date of the corresponding claim was found for 10,529 (95.9%) visits. The sensitivity of syndrome definitions based on diagnostic codes in physician claims was low, ranging from 0.11 (fever) to 0.44 (respiratory), the specificity was high, and the PPV was moderate to high, ranging from 0.59 (fever) to 0.85 (respiratory). We found that rarely used diagnostic codes had a higher probability of being false-positives, and that more commonly used diagnostic codes had a higher PPV.Future research should identify physician, patient, and encounter characteristics associated with the accuracy of diagnostic codes in physician claims. This would enable public health to improve syndromic surveillance, either by focusing on physician claims whose diagnostic code is more likely to be accurate, or by using all physician claims and weighing each according to the likelihood that its diagnostic code is accurate.
| S-EPMC3025839 | biostudies-other
Project description:ObjectiveAssess the accuracy of ICD-10-CM coding of self-harm injuries and poisonings to identify self-harm events.Materials and methodsIn 7 integrated health systems, records data identified patients reporting frequent suicidal ideation. Records then identified subsequent ICD-10-CM injury and poisoning codes indicating self-harm as well as selected codes in 3 categories where uncoded self-harm events might be found: injuries and poisonings coded as undetermined intent, those coded accidental, and injuries with no coding of intent. For injury and poisoning encounters with diagnoses in those 4 groups, relevant clinical text was extracted from records and assessed by a blinded panel regarding documentation of self-harm intent.ResultsDiagnostic codes selected for review include all codes for self-harm, 43 codes for undetermined intent, 26 codes for accidental intent, and 46 codes for injuries without coding of intent. Clinical text was available for review for 285 events originally coded as self-harm, 85 coded as undetermined intent, 302 coded as accidents, and 438 injury events with no coding of intent. Blinded review of full-text clinical records found documentation of self-harm intent in 254 (89.1%) of those originally coded as self-harm, 24 (28.2%) of those coded as undetermined, 24 (7.9%) of those coded as accidental, and 48 (11.0%) of those without coding of intent.ConclusionsAmong patients at high risk, nearly 90% of injuries and poisonings with ICD-10-CM coding of self-harm have documentation of self-harm intent. Reliance on ICD-10-CM coding of intent to identify self-harm would fail to include a small proportion of true self-harm events.
| S-EPMC9667165 | biostudies-literature
Project description:BACKGROUND:The phecode system was built upon the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) for phenome-wide association studies (PheWAS) using the electronic health record (EHR). OBJECTIVE:The goal of this paper was to develop and perform an initial evaluation of maps from the International Classification of Diseases, 10th Revision (ICD-10) and the International Classification of Diseases, 10th Revision, Clinical Modification (ICD-10-CM) codes to phecodes. METHODS:We mapped ICD-10 and ICD-10-CM codes to phecodes using a number of methods and resources, such as concept relationships and explicit mappings from the Centers for Medicare & Medicaid Services, the Unified Medical Language System, Observational Health Data Sciences and Informatics, Systematized Nomenclature of Medicine-Clinical Terms, and the National Library of Medicine. We assessed the coverage of the maps in two databases: Vanderbilt University Medical Center (VUMC) using ICD-10-CM and the UK Biobank (UKBB) using ICD-10. We assessed the fidelity of the ICD-10-CM map in comparison to the gold-standard ICD-9-CM phecode map by investigating phenotype reproducibility and conducting a PheWAS. RESULTS:We mapped >75% of ICD-10 and ICD-10-CM codes to phecodes. Of the unique codes observed in the UKBB (ICD-10) and VUMC (ICD-10-CM) cohorts, >90% were mapped to phecodes. We observed 70-75% reproducibility for chronic diseases and <10% for an acute disease for phenotypes sourced from the ICD-10-CM phecode map. Using the ICD-9-CM and ICD-10-CM maps, we conducted a PheWAS with a Lipoprotein(a) genetic variant, rs10455872, which replicated two known genotype-phenotype associations with similar effect sizes: coronary atherosclerosis (ICD-9-CM: P<.001; odds ratio (OR) 1.60 [95% CI 1.43-1.80] vs ICD-10-CM: P<.001; OR 1.60 [95% CI 1.43-1.80]) and chronic ischemic heart disease (ICD-9-CM: P<.001; OR 1.56 [95% CI 1.35-1.79] vs ICD-10-CM: P<.001; OR 1.47 [95% CI 1.22-1.77]). CONCLUSIONS:This study introduces the beta versions of ICD-10 and ICD-10-CM to phecode maps that enable researchers to leverage accumulated ICD-10 and ICD-10-CM data for PheWAS in the EHR.
| S-EPMC6911227 | biostudies-literature
Project description:Background:The International Classification of Diseases, Ninth Edition, Clinical Modification (ICD-9-CM) Injury Severity Score (ICISS) is a risk adjustment model when injuries are recorded using ICD-9-CM coding. The trauma mortality prediction model (TMPM-ICD9) provides better calibration and discrimination compared with ICISS and injury severity score (ISS). Though TMPM-ICD9 is statistically rigorous, it is not precise enough mathematically and has the tendency to overestimate injury severity. The purpose of this study is to develop a new ICD-10-CM injury model which estimates injury severities for every injury in the ICD-10-CM lexicon by a combination of rigorous statistical probit models and mathematical properties and improves the prediction accuracy. Methods:We developed an injury mortality prediction (IMP-ICDX) using data of 794,098 patients admitted to 738 hospitals in the National Trauma Data Bank from 2015 to 2016. Empiric measures of severity for each of the trauma ICD-10-CM codes were estimated using a weighted median death probability (WMDP) measurement and then used as the basis for IMP-ICDX. ISS (version 2005) and the single worst injury (SWI) model were re-estimated. The performance of each of these models was compared by using the area under the receiver operating characteristic (AUC), the Hosmer-Lemeshow (HL) statistic, and the Akaike information criterion statistic. Results:IMP-ICDX exhibits significantly better discrimination (AUCIMP-ICDX, 0.893, and 95% confidence interval (CI), 0.887 to 0.898; AUCISS, 0.853, and 95% CI, 0.846 to 0.860; and AUCSWI, 0.886, and 95% CI, 0.881 to 0.892) and calibration (HLIMP-ICDX, 68, and 95% CI, 36 to 98; HLISS, 252, and 95% CI, 191 to 310; and HLSWI, 92, and 95% CI, 53 to 128) compared with ISS and SWI. All models were improved after the extension of age, gender, and injury mechanism, but the augmented IMP-ICDX still dominated ISS and SWI by every performance. Conclusions:The IMP-ICDX has a better discrimination and calibration compared to ISS. Therefore, we believe that IMP-ICDX could be a new viable trauma research assessment method.
| S-EPMC6787998 | biostudies-literature
Project description:ObjectivesThe United States transitioned to the tenth version of the International Classification of Diseases (ICD) system (ICD-10) for mortality coding in 1999 and to the International Classification of Diseases, Clinical Modification and Procedure Coding System (ICD-10-CM/PCS) on October 1, 2015. The purpose of this study was to conduct a narrative literature review to better understand the impact of the implementation of ICD-10/ICD-10-CM/PCS.Materials and methodsWe searched English-language articles in PubMed, Web of Science, and Business Source Complete and reviewed websites of relevant professional associations, government agencies, research groups, and ICD-10 news aggregators to identify literature on the impact of the ICD-10/ICD-10-CM/PCS transition. We used Google to search for additional gray literature and used handsearching of the references of the most on-target articles to help ensure comprehensiveness.ResultsImpact areas reported in the literature include: productivity and staffing, costs, reimbursement, coding accuracy, mapping between ICD versions, morbidity and mortality surveillance, and patient care. With the exception of morbidity and mortality surveillance, quantitative studies describing the actual impact of the ICD-10/ICD-10-CM/PCS implementation were limited and much of the literature was based on the ICD-10-CM/PCS transition rather than the earlier conversion to ICD-10 for mortality coding.DiscussionThis study revealed several gaps in the literature that limit the ability to draw reliable conclusions about the overall impact, positive or negative, of moving to ICD-10/ICD-10-CM/PCS in the United States.ConclusionThese knowledge gaps present an opportunity for future research and knowledge sharing and will be important to consider when planning for ICD-11.
| S-EPMC7309233 | biostudies-literature
Project description:Human papillomavirus vaccine (HPV) impact on cervical precancer (cervical intraepithelial neoplasia grades 2+ [CIN2+]) is observable sooner than impact on cancer. Biopsy-confirmed CIN2+ is not included in most US cancer registries. Billing codes could provide surrogate metrics; however, the International Classification of Diseases, ninth (ICD-9) to tenth (ICD-10) transition disrupts trends. We built, validated, and compared claims-based models to identify CIN2+ events in both ICD eras. A database of Davidson County (Nashville), Tennessee, pathology-confirmed CIN2+ from the HPV Vaccine Impact Monitoring Project (HPV-IMPACT) provided gold standard events. Using Tennessee Medicaid 2008-2017, cervical diagnostic procedures (N = 8549) among Davidson County women aged 18-39 years were randomly split into 60% training and 40% testing sets. Relevant diagnosis, procedure, and screening codes were used to build models from CIN2+ tissue diagnosis codes alone, least absolute shrinkage and selection operator (LASSO), and random forest. Model-classified index events were counted to estimate incident events. HPV-IMPACT identified 983 incident CIN2+ events. Models identified 1007 (LASSO), 1245 (CIN2+ tissue diagnosis codes alone), and 957 (random forest) incident events. LASSO performed well in ICD-9 and ICD-10 eras: 77.3% (95% confidence interval [CI] = 72.5% to 81.5%) vs 81.1% (95% CI = 71.5% to 88.6%) sensitivity, 93.0% (95% CI = 91.9% to 94.0%) vs 90.2% (95% CI = 87.2% to 92.7%) specificity, 61.3% (95% CI = 56.6% to 65.8%) vs 60.3% (95% CI = 51.0% to 69.1%) positive predictive value, 96.6% (95% CI = 95.8% to 97.3%) vs 96.3% (95% CI = 94.1% to 97.8%) negative predictive value, 91.0% (95% CI = 89.9% to 92.1%) vs 88.8% (95% CI = 85.9% to 91.2%) accuracy, and 85.1% (95% CI = 82.9% to 87.4%) vs 85.6% (95% CI = 81.4% to 89.9%) C-indices, respectively; performance did not statistically significantly differ between eras (95% confidence intervals all overlapped). Results confirmed model utility with good performance across both ICD eras for CIN2+ surveillance. Validated claims-based models may be used in future CIN2+ trend analyses to estimate HPV vaccine impact where population-based biopsies are unavailable.
| S-EPMC7853170 | biostudies-literature
Project description:Diagnostic codes are used widely within health care for billing, quality assessment, and to measure clinical outcomes. The US health care system will transition to the International Classification of Diseases, 10th Revision, Clinical Modification (ICD-10-CM), in October 2015. Little is known about how this transition will affect pediatric practices. The objective of this study was to examine how the transition to ICD-10-CM may result in ambiguity of clinical information and financial disruption for pediatricians.Using a statewide data set from Illinois Medicaid specified for pediatricians, 2708 International Classification of Diseases, Ninth Revision, Clinical Modification, diagnosis codes were identified. Diagnosis codes were categorized into 1 of 5 categories: identity, class-to-subclass, subclass-to-class, convoluted, and no translation. The convoluted and high-cost diagnostic codes (n = 636) were analyzed for accuracy and categorized into "information loss," "overlapping categories," "inconsistent," and "consistent." Finally, reimbursement by Medicaid was calculated for each category.Twenty-six percent of pediatric diagnosis codes are convoluted, which represents 21% of Illinois Medicaid pediatric patient encounters and 16% of reimbursement. The diagnosis codes represented by information loss (3.6%), overlapping categories (3.2%), and inconsistent (1.2%) represent 8% of Medicaid pediatric reimbursement.The potential for financial disruption and administrative errors from 8% of reimbursement diagnosis codes necessitates special attention to these codes in preparing for the transition to ICD-10-CM for pediatric practices.
| S-EPMC4531279 | biostudies-literature
Project description:BackgroundWe aimed to estimate the impact of the International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM) coding transition on traumatic injury-related hospitalization trends among young adults across a geographically and demographically diverse group of U.S. states.MethodsInterrupted time series analyses were conducted using statewide inpatient databases from 12 states and including traumatic injury-related hospitalizations in adults aged 19-44?years in 2011-2017. Segmented regression models were used to estimate the impact of the October 2015 coding transition on external cause of injury (ECOI) completeness (percentage of hospitalizations with a documented ECOI code) and on population-level rates of injury-related hospitalizations by nature, intent, mechanism, and severity of injury.ResultsThe transition to ICD-10-CM was associated with a drop in ECOI completion in the transition month (-?3.7%; P?<?.0001), but there was no significant change in the positive trend in ECOI completion from the pre- to post-transition periods. There were significant increases post-transition in the measured rates of hospitalization for traumatic brain injury (TBI), unintentional injury, mild injury (injury severity score (ISS) <?9), and injuries caused by drowning, firearms, machinery, other pedestrian, suffocation, and unspecified mechanism. Conversely, there were significant decreases in October 2015 in the rates of hospitalization for assault, injuries of undetermined intent, injuries of moderate severity (ISS 9-15), and injuries caused by fire/burn, other pedal cyclist, other transportation, natural/environmental, and other specified mechanism. A significant increase in the percentage of hospitalizations classified as resulting from severe injury (ISS?>?15) was observed when the general equivalence mapping maximum severity method for converting ICD-10-CM codes to ICD-9-CM codes was used. State-specific results for the outcomes of ECOI completion and TBI-related hospitalization rates are provided in an online supplement.ConclusionsThe U.S. transition from ICD-9-CM to ICD-10-CM coding led to a significant decrease in ECOI completion and several significant changes in measured rates of injury-related hospitalizations by injury intent, mechanism, nature, and severity. The results of this study can inform the design and analysis of future traumatic injury-related health services research studies that use both ICD-9-CM and ICD-10-CM coded data.Level of evidenceII (Interrupted Time Series).
| S-EPMC7830822 | biostudies-literature
Project description:ObjectiveTo evaluate published algorithms for the identification of epilepsy cases in medical claims data using a unique linked dataset with both clinical and claims data.MethodsUsing data from a large, regional health delivery system, we identified all patients contributing biologic samples to the health system's Biobank (n = 36K). We identified all subjects with at least one diagnosis potentially consistent with epilepsy, for example, epilepsy, convulsions, syncope, or collapse, between 2014 and 2015, or who were seen at the epilepsy clinic (n = 1,217), plus a random sample of subjects with neither claims nor clinic visits (n = 435); we then performed a medical chart review in a random subsample of 1,377 to assess the epilepsy diagnosis status. Using the chart review as the reference standard, we evaluated the test characteristics of six published algorithms.ResultsThe best-performing algorithm used diagnostic and prescription drug data (sensitivity = 70%, 95% confidence interval [CI] 66-73%; specificity = 77%, 95% CI 73-81%; and area under the curve [AUC] = 0.73, 95%CI 0.71-0.76) when applied to patients age 18 years or older. Restricting the sample to adults aged 18-64 years resulted in a mild improvement in accuracy (AUC = 0.75,95%CI 0.73-0.78). Adding information about current antiepileptic drug use to the algorithm increased test performance (AUC = 0.78, 95%CI 0.76-0.80). Other algorithms varied in their included data types and performed worse.SignificanceCurrent approaches for identifying patients with epilepsy in insurance claims have important limitations when applied to the general population. Approaches incorporating a range of information, for example, diagnoses, treatments, and site of care/specialty of physician, improve the performance of identification and could be useful in epilepsy studies using large datasets.
| S-EPMC6592609 | biostudies-literature