Identifying incident Parkinson's disease using administrative diagnostic codes: a validation study.
Ontology highlight
ABSTRACT: Background
Administrative databases that capture diagnostic codes are increasingly being used worldwide for research because they can save time and reduce costs. However, assessing validity is necessary before defining diseases using only diagnostic codes in research applications.Objective
Our objective was to assess the validity of using diagnostic codes to identify incident Parkinson's disease (PD) cases in Olmsted County, Minnesota using an established standard for comparison (1976-2005).Methods
Cases were identified solely using computer programs applied to administrative diagnostic code indexes from the Rochester Epidemiology Project (REP). Two codes >30 days apart or one code on the death certificate constituted PD. The standard was a clinical diagnosis by movement disorders specialists based on medical record review. Validity was assessed using positive predictive value (PPV) and sensitivity. Numbers of incident cases and incidence rates were compared between the two ascertainment methods by sex.Results
The codes only method over-counted the number of incident PD cases by 73% (804 versus 464), and this over-counting generally increased with calendar year. Sensitivity was 80% (95% CI [76%, 84%]) and PPV was 46% (95% CI [34%, 50%]). Disease status misclassification accounted for two-thirds of falsely identified cases, where individuals were found to not have PD (43%) or even parkinsonism (23%) after medical record review. The codes only method also over-estimated the incidence rate time trend for men and women by approximately two-fold.Conclusion
In our context, using administrative diagnostic codes only to identify incident PD cases is not recommended unless more accurate algorithms are developed.
SUBMITTER: Peterson BJ
PROVIDER: S-EPMC8218579 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:PurposeTo assess the accuracy of using diagnostic codes from administrative data to infer treatment indications for antidepressants prescribed in primary care.MethodsValidation study of administrative diagnostic codes for 13 plausible indications for antidepressants compared with physician-documented treatment indications from an indication-based electronic prescribing system in Quebec, Canada. The analysis included all antidepressant prescriptions written by primary care physicians between January 1, 2003 and December 31, 2012 using the electronic prescribing system. Patient prescribed antidepressants were linked to physician claims and hospitalization data to obtain all diagnoses recorded in the past year.ResultsDiagnostic codes had poor sensitivity for all treatment indications, ranging from a high of only 31.2% (95% CI, 26.8%-35.9%) for anxiety/stress disorders to as low as 1.3% (95% CI, 0.0%-5.2%) for sexual dysfunction. Sensitivity was notably worse among older patients and patients with more chronic comorbidities. Physician claims data were a better source of diagnostic codes for antidepressant treatment indications than hospitalization data.ConclusionsAdministrative diagnostic codes are poor proxies for antidepressant treatment indications. Future work should determine whether the use of other variables in administrative data besides diagnostic codes can improve the ability to predict antidepressant treatment indications.
| S-EPMC6220980 | biostudies-literature
Project description:BackgroundMost prevalence estimates of chronic pain are derived from surveys and vary widely, both globally (2%-54%) and in Canada (6.5%-44%). Health administrative data are increasingly used for chronic disease surveillance, but their validity as a source to ascertain chronic pain cases is understudied.AimThe aim of this study was to derive and validate an algorithm to identify cases of chronic pain as a single chronic disease using provincial health administrative data.MethodsA reference standard was developed and applied to the electronic medical records data of a Newfoundland and Labrador general population sample participating in the Canadian Primary Care Sentinel Surveillance Network. Chronic pain algorithms were created from the administrative data of patient populations with chronic pain, and their classification performance was compared to that of the reference standard via statistical tests of selection accuracy.ResultsThe most performant algorithm for chronic pain case ascertainment from the Medical Care Plan Fee-for-Service Physicians Claims File was one anesthesiology encounter ever recording a chronic pain clinic procedure code OR five physician encounter dates recording any pain-related diagnostic code in 5 years with more than 183 days separating at least two encounters. The algorithm demonstrated 0.703 (95% confidence interval [CI], 0.685-0.722) sensitivity, 0.668 (95% CI, 0.657-0.678) specificity, and 0.408 (95% CI, 0.393-0.423) positive predictive value. The chronic pain algorithm selected 37.6% of a Newfoundland and Labrador provincial cohort.ConclusionsA health administrative data algorithm was derived and validated to identify chronic pain cases and estimate disease burden in residents attending fee-for-service physician encounters in Newfoundland and Labrador.
| S-EPMC7967902 | biostudies-literature
Project description:Describe the operating characteristics of a proposed set of revenue center codes to correctly identify ICU stays among hospitalized patients.Retrospective cohort study. We report the operating characteristics of all ICU-related revenue center codes for intensive and coronary care, excluding nursery, intermediate, and incremental care, to identify ICU stays. We use a classification and regression tree model to further refine identification of ICU stays using administrative data. The gold standard for classifying ICU admission was an electronic patient location tracking system.The University of Pennsylvania Health System in Philadelphia, PA, United States.All adult inpatient hospital admissions between July 1, 2013, and June 30, 2015.None.Among 127,680 hospital admissions, the proposed combination of revenue center codes had 94.6% sensitivity (95% CI, 94.3-94.9%) and 96.1% specificity (95% CI, 96.0-96.3%) for correctly identifying hospital admissions with an ICU stay. The classification and regression tree algorithm had 92.3% sensitivity (95% CI, 91.6-93.1%) and 97.4% specificity (95% CI, 97.2-97.6%), with an overall improved accuracy (? = 398; p < 0.001).Use of the proposed combination of revenue center codes has excellent sensitivity and specificity for identifying true ICU admission. A classification and regression tree algorithm with additional administrative variables offers further improvements to accuracy.
| S-EPMC5511059 | biostudies-literature
Project description:Ontario has a single payer provincial health insurance program. Administrative data may provide a potentially robust source of information for post-marketing vaccine studies. Vaccine-specific immunization billing codes were introduced in 2011. Our objective was to validate Ontario's universal health care administrative datasets to assess infant immunization status. Electronic medical record data from the Electronic Medical Record Administrative data Linked Database (EMRALD) was used as the reference standard to calculate performance characteristics of the Ontario Health Insurance Plan (OHIP) database vaccine-specific and general immunization codes for 4 primary infant immunizations: diphtheria, tetanus, acellular pertussis, inactivated polio, Haemophilus influenzae type B (DTaP-IPV-Hib) combination vaccine, pneumococcal conjugate vaccine, measles, mumps, rubella (MMR) vaccine, and meningococcal conjugate serogroup C vaccine. OHIP billing claims had specificity ranging from 81% to 92%, sensitivity 70% to 83%, positive predictive value (PPV) 97% to 99%, and negative predictive value (NPV) 13% to 46% for identifying the various specific vaccines in administrative data. For cohorts vaccinated in the new code introduction phase, using both the vaccine-specific and general codes had higher sensitivity than the vaccine-specific codes alone. In conclusion, immunization billing claims from administrative data in Ontario had high specificity and PPV, moderate sensitivity, and low NPV. This study identifies some of the applications of utilizing administrative data for post-marketing vaccine studies. However, limitations of these data decrease their utility for measuring vaccine coverage and effectiveness. Therefore, the establishment of a comprehensive and linkable immunization registry should be a provincial priority.
| S-EPMC4514409 | biostudies-literature
Project description:PurposeTo our knowledge the reliability of administrative claims codes to report postoperative radical cystectomy complications has not been examined. We compared complications identified by claims data to those abstracted from clinical chart review following radical cystectomy.MethodsWe manually reviewed the charts of 268 patients treated with radical cystectomy between 2014 and 2016 for 30-day complications and queried administrative complication coding using 805 ICD-9/10 codes. Complications were categorized. Using Cohen κ statistics we assessed agreement between the 2 methods of complication reporting for 1 or more postoperative complications overall, categorical complications and complications stratified by the top quartile length of hospital stay and patients who were readmitted.ResultsAt least 1 or more complications were recorded in 122 patients (45.5%) through manual chart review and 80 (29.9%) were recorded via claim coding data with a concordance rate of κ=0.16, indicating weak agreement. Concordance was generally weak for categorical complication rates (range 0.05 to 0.36). However, when examining only the top length of stay quartile, 1 or more complications were reported in 32 patients (65%) by the manual chart review and in 12 (25%) via coding data with a concordance rate of κ=-0.2. Agreement was weak, similar to the total cohort.ConclusionsManual chart review and claim code identification of complications are not highly concordant even when stratified by patients with an extended length of stay, who are known to have more frequent complications. Researchers and administrators should be aware of these differences and exercise caution when interpreting complication reports.
| S-EPMC7864380 | biostudies-literature
Project description:Health care data allow for the study and surveillance of chronic diseases such as diabetes. The objective of this study was to identify and validate optimal algorithms for diabetes cases within health care administrative databases for different research purposes, populations, and data sources.We linked health care administrative databases from Ontario, Canada to a reference standard of primary care electronic medical records (EMRs). We then identified and calculated the performance characteristics of multiple adult diabetes case definitions, using combinations of data sources and time windows.The best algorithm to identify diabetes cases was the presence at any time of one hospitalization or physician claim for diabetes AND either one prescription for an anti-diabetic medication or one physician claim with a diabetes-specific fee code [sensitivity 84.2%, specificity 99.2%, positive predictive value (PPV) 92.5%]. Use of physician claims alone performed almost as well: three physician claims for diabetes within one year was highly specific (sensitivity 79.9%, specificity 99.1%, PPV 91.4%) and one physician claim at any time was highly sensitive (sensitivity 93.6%, specificity 91.9%, PPV 58.5%).This study identifies validated algorithms to capture diabetes cases within health care administrative databases for a range of purposes, populations and data availability. These findings are useful to study trends and outcomes of diabetes using routinely-collected health care data.
| S-EPMC5932874 | biostudies-other
Project description:Community-acquired pneumonia (CAP) remains one of the most common indications for pediatric hospitalization in the United States, and it is frequently the focus of research and quality studies. Use of administrative data is increasingly common for these purposes, although proper validation is required to ensure valid study conclusions.To validate administrative billing data for hospitalizations owing to childhood CAP.Case-control study of 4 tertiary care, freestanding children’s hospitals in the United States.A total of 998 medical records of a 25% random sample of 3646 children discharged in 2010 with at least 1 International Classification of Diseases, 9th Revision, Clinical Modification (ICD-9-CM) code representing possible pneumonia were reviewed. Discharges (matched on date of admission) without a pneumonia-related discharge code were also examined to identify potential missed pneumonia cases. Two reference standards, based on provider diagnosis alone (provider confirmed) or in combination with consistent clinical and radiographic evidence of pneumonia (definite), were used to identify CAP.Twelve ICD-9-CM–based coding strategies, each using a combination of primary or secondary codes representing pneumonia or pneumonia-related complications. Six algorithms excluded children with complex chronic conditions.Sensitivity, specificity, and negative and positive predictive values (NPV and PPV, respectively) of the 12 identification strategies.For provider-confirmed CAP (n?=?680), sensitivity ranged from 60.7% to 99.7%; specificity, 75.7% to 96.4%; PPV, 67.9% to 89.6%; and NPV, 82.6% to 99.8%. For definite CAP (n?=?547), sensitivity ranged from 65.6% to 99.6%; specificity, 68.7% to 93.0%; PPV, 54.6% to 77.9%; and NPV, 87.8% to 99.8%. Unrestricted use of the pneumonia-related codes was inaccurate, although several strategies improved specificity to more than 90% with a variable effect on sensitivity. Excluding children with complex chronic conditions demonstrated the most favorable performance characteristics. Performance of the algorithms was similar across institutions.Administrative data are valuable for studying pediatric CAP hospitalizations. The strategies presented here will aid in the accurate identification of relevant and comparable patient populations for research and performance improvement studies.
| S-EPMC3907952 | biostudies-literature
Project description:BackgroundHealth care administrative database research frequently uses standard medical codes to identify diagnoses or procedures. The aim of this review was to establish the diagnostic accuracy of codes used in administrative data research to identify nontuberculous mycobacterial (NTM) disease, including lung disease (NTMLD).MethodsWe searched Ovid Medline, Embase, Scopus, Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials, and ClinicalTrials.gov from inception to April 2019. We included studies assessing the diagnostic accuracy of International Classification of Diseases, 9th edition, Clinical Modification (ICD-9-CM) diagnosis codes to identify NTM disease and NTMLD. Studies were independently assessed by 2 researchers, and the Quality Assessment of Diagnostic Accuracy Studies 2 tool was used to assess bias and quality.ResultsWe identified 5549 unique citations. Of the 96 full-text articles reviewed, 7 eligible studies of moderate quality (3730 participants) were included in our review. The diagnostic accuracy of ICD-9-CM diagnosis codes to identify NTM disease varied widely across studies, with positive predictive values ranging from 38.2% to 100% and sensitivity ranging from 21% to 93%. For NTMLD, 4 studies reported diagnostic accuracy, with positive predictive values ranging from 57% to 64.6% and sensitivity ranging from 21% to 26.9%.ConclusionsDiagnostic accuracy measures of codes used in health care administrative data to identify patients with NTM varied across studies. Overall the positive predictive value of ICD-9-CM diagnosis codes alone is good, but the sensitivity is low; this method is likely to underestimate case numbers, reflecting the current limitations of coding systems to capture NTM diagnoses.
| S-EPMC8134528 | biostudies-literature
Project description:Community composition within the human microbiome varies across individuals, but it remains unknown if this variation is sufficient to uniquely identify individuals within large populations or stable enough to identify them over time. We investigated this by developing a hitting set-based coding algorithm and applying it to the Human Microbiome Project population. Our approach defined body site-specific metagenomic codes: sets of microbial taxa or genes prioritized to uniquely and stably identify individuals. Codes capturing strain variation in clade-specific marker genes were able to distinguish among 100s of individuals at an initial sampling time point. In comparisons with follow-up samples collected 30-300 d later, ?30% of individuals could still be uniquely pinpointed using metagenomic codes from a typical body site; coincidental (false positive) matches were rare. Codes based on the gut microbiome were exceptionally stable and pinpointed >80% of individuals. The failure of a code to match its owner at a later time point was largely explained by the loss of specific microbial strains (at current limits of detection) and was only weakly associated with the length of the sampling interval. In addition to highlighting patterns of temporal variation in the ecology of the human microbiome, this work demonstrates the feasibility of microbiome-based identifiability-a result with important ethical implications for microbiome study design. The datasets and code used in this work are available for download from huttenhower.sph.harvard.edu/idability.
| S-EPMC4460507 | biostudies-literature
Project description:ObjectiveTo conduct a systematic review of studies reporting on the validity of International Classification of Diseases (ICD) codes for identifying stroke in administrative data.MethodsMEDLINE and EMBASE were searched (inception to February 2015) for studies: (a) Using administrative data to identify stroke; or (b) Evaluating the validity of stroke codes in administrative data; and (c) Reporting validation statistics (sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), or Kappa scores) for stroke, or data sufficient for their calculation. Additional articles were located by hand search (up to February 2015) of original papers. Studies solely evaluating codes for transient ischaemic attack were excluded. Data were extracted by two independent reviewers; article quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies tool.ResultsSeventy-seven studies published from 1976-2015 were included. The sensitivity of ICD-9 430-438/ICD-10 I60-I69 for any cerebrovascular disease was ? 82% in most [? 50%] studies, and specificity and NPV were both ? 95%. The PPV of these codes for any cerebrovascular disease was ? 81% in most studies, while the PPV specifically for acute stroke was ? 68%. In at least 50% of studies, PPVs were ? 93% for subarachnoid haemorrhage (ICD-9 430/ICD-10 I60), 89% for intracerebral haemorrhage (ICD-9 431/ICD-10 I61), and 82% for ischaemic stroke (ICD-9 434/ICD-10 I63 or ICD-9 434&436). For in-hospital deaths, sensitivity was 55%. For cerebrovascular disease or acute stroke as a cause-of-death on death certificates, sensitivity was ? 71% in most studies while PPV was ? 87%.ConclusionsWhile most cases of prevalent cerebrovascular disease can be detected using 430-438/I60-I69 collectively, acute stroke must be defined using more specific codes. Most in-hospital deaths and death certificates with stroke as a cause-of-death correspond to true stroke deaths. Linking vital statistics and hospitalization data may improve the ascertainment of fatal stroke.
| S-EPMC4546158 | biostudies-literature