Dataset Information

Validity of International Classification of Diseases codes in identifying illicit drug use target conditions using medical record data as a reference standard: A systematic review.

ABSTRACT:

Background

The twenty-first century opioid crisis has spurred interest in using International Classification of Diseases (ICD) code algorithms to identify patients using illicit drugs from administrative healthcare data. We conducted a systematic review of studies that validated ICD code algorithms for illicit drug use against a reference standard of medical record data.

Methods

Systematic searches of MEDLINE, EMBASE, PsycINFO, and Web of Science were conducted for studies published between 1980 and 2018 in English, French, Italian, or Spanish. We included validation studies of ICD-9 or ICD-10 code algorithms for an illicit drug use target condition (e.g., illicit drug use, abuse, or dependence (UAD), illicit drug use-related complications) given the sensitivity or specificity was reported or could be calculated. Bias was assessed with the Quality Assessment of Diagnostic Accuracy Studies Version 2 (QUADAS-2) tool.

Results

Six of the 1210 articles identified met the inclusion criteria. For validation studies of broad UAD (n = 4), the specificity was nearly perfect, but the sensitivity ranged from 47% to 83%, with higher sensitivities tending to occur in higher prevalence populations. For validation studies of injection drug use (IDU)-associated infective endocarditis (n = 2), sensitivity and specificity were poor due to the lack of an ICD code for IDU. For all six studies, the risk of bias for the QUADAS-2 "reference standard" and "flow/timing domains" was scored as "unclear" due to insufficient reporting.

Conclusions

Few studies have validated ICD code algorithms for illicit drug use target conditions, and available evidence is challenging to interpret due to inadequate reporting. PROSPERO Registration: CRD42019118401.

SUBMITTER: McGrew KM

PROVIDER: S-EPMC9533471 | biostudies-literature | 2020 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Validity of International Classification of Diseases codes in identifying illicit drug use target conditions using medical record data as a reference standard: A systematic review.

McGrew Kaitlin M KM Homco Juell B JB Garwe Tabitha T Dao Hanh Dung HD Williams Mary B MB Drevets Douglas A DA Jafarzadeh S Reza SR Zhao Yan Daniel YD Carabin Hélène H

Drug and alcohol dependence 20191223

<h4>Background</h4>The twenty-first century opioid crisis has spurred interest in using International Classification of Diseases (ICD) code algorithms to identify patients using illicit drugs from administrative healthcare data. We conducted a systematic review of studies that validated ICD code algorithms for illicit drug use against a reference standard of medical record data.<h4>Methods</h4>Systematic searches of MEDLINE, EMBASE, PsycINFO, and Web of Science were conducted for studies publish ...[more]

PMID: 31982637

Similar Datasets

Project description:BackgroundAdministrative health claims data have been used for research in neuro-ophthalmology, but the validity of International Classification of Diseases (ICD) codes for identifying neuro-ophthalmic conditions is unclear.Evidence acquisitionWe performed a systematic literature review to assess the validity of administrative claims data for identifying patients with neuro-ophthalmic disorders. Two reviewers independently reviewed all eligible full-length articles and used a standardized abstraction form to identify ICD code-based definitions for 9 neuro-ophthalmic conditions and their sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). A quality assessment of eligible studies was also performed.ResultsEleven articles that met criteria for inclusion are as follows: 3 studies of idiopathic intracranial hypertension (PPV 54%-91% and NPV 74%-85%), 2 studies of giant cell arteritis (sensitivity 30%-96% and PPV 94%), 3 studies of optic neuritis (sensitivity 76%-99%, specificity 83%-100%, PPV 25%-100%, and NPV 98%-100%), 1 study of neuromyelitis optica (sensitivity 60%, specificity 100%, PPV 43%-100%, and NPV 98%-100%), 1 study of ocular motor cranial neuropathies (PPV 98%-99%), and 2 studies of myasthenia gravis (sensitivity 53%-97%, specificity 99%-100%, PPV 5%-90%, and NPV 100%). No studies met eligibility criteria for nonarteritic ischemic optic neuropathy, thyroid eye disease, and blepharospasm. Approximately 45.5% provided only one measure of diagnostic accuracy. Complete information about the validation cohorts, inclusion/exclusion criteria, data collection methods, and expertise of those reviewing charts for diagnostic accuracy was missing in 90.9%, 72.7%, 81.8%, and 36.4% of studies, respectively.ConclusionsFew studies have reported the validity of ICD codes for neuro-ophthalmic conditions. The range of diagnostic accuracy for some disorders and study quality varied widely. This should be taken into consideration when interpreting studies of neuro-ophthalmic conditions using administrative claims data.

Project description:BackgroundIntentional and unintentional injuries are a leading cause of death and disability globally. International Classification of Diseases (ICD), Tenth Revision (ICD-10) codes are used to classify injuries in administrative health data and are widely used for health care planning and delivery, research, and policy. However, a systematic review of their overall validity and reliability has not yet been done.ObjectiveTo conduct a systematic review of the validity and reliability of external cause injury ICD-10 codes.MethodsMEDLINE, EMBASE, COCHRANE, and SCOPUS were searched (inception to April 2023) for validity and/or reliability studies of ICD-10 external cause injury codes in all countries for all ages. We examined all available data for external cause injuries and injuries related to specific body regions. Validity was defined by sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). Reliability was defined by inter-rater reliability (IRR), measured by Krippendorff's alpha, Cohen's Kappa, and/or Fleiss' kappa.ResultsTwenty-seven published studies from 2006 to 2023 were included. Across all injuries, the mean outcome values and ranges were sensitivity: 61.6% (35.5%-96.0%), specificity: 91.6% (85.8%-100%), PPV: 74.9% (58.6%-96.5%), NPV: 80.2% (44.6%-94.4%), Cohen's kappa: 0.672 (0.480-0.928), Krippendorff's alpha: 0.453, and Fleiss' kappa: 0.630. Poisoning and hand and wrist injuries had higher mean sensitivity (84.4% and 96.0%, respectively), while self-harm and spinal cord injuries were lower (35.5% and 36.4%, respectively). Transport and pedestrian injuries and hand and wrist injuries had high PPVs (96.5% and 92.0%, respectively). Specificity and NPV were generally high, except for abuse (NPV 44.6%).Conclusions and significanceThe validity and reliability of ICD-10 external cause injury codes vary based on the injury types coded and the outcomes examined, and overall, they only perform moderately well. Future work, potentially utilizing artificial intelligence, may improve the validity and reliability of ICD codes used to document injuries.

Project description:ObjectiveTo examine the validity of the International Classification of Diseases, 10th revision (ICD-10) codes for hyponatraemia in the nationwide population-based Danish National Registry of Patients (DNRP) among inpatients of all ages.DesignPopulation-based validation study.SettingAll somatic hospitals in the North and Central Denmark Regions from 2006 through 2011.ParticipantsPatients of all ages admitted to hospital (n=819 701 individual patients) during the study period. The patient could be included in the study more than once, and our study did not restrict to patients with serum sodium measurements (total of n=2 186 642 hospitalisations).Main outcome measureWe validated ICD-10 discharge diagnoses of hyponatraemia recorded in the DNRP, using serum sodium measurements obtained from the laboratory information systems (LABKA) research database as the gold standard. One sodium value <135 mmol/L measured at any time during hospitalisation confirmed the diagnosis. We estimated sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) for ICD-10 codes for hyponatraemia overall and for cut-off points for increasing hyponatraemia severity.ResultAn ICD-10 code for hyponatraemia was recorded in the DNRP in 5850 of the 2 186 642 hospitalisations identified. According to laboratory measurements, however, hyponatraemia was present in 306 418 (14%) hospitalisations. Sensitivity of hyponatraemia diagnoses was 1.8% (95% CI 1.7% to 1.8%). For sodium values <115 mmol/L, sensitivity was 34.3% (95% CI 32.6% to 35.9%). The overall PPV was 92.5% (95% CI 91.8% to 93.1%) and decreased with increasing hyponatraemia severity. Specificity and NPV were high for all cut-off points (≥99.8% and ≥86.2%, respectively). Patients with hyponatraemia without a corresponding ICD-10 discharge diagnosis were younger and had higher Charlson Comorbidity Index scores than patients with hyponatraemia with a hyponatraemia code in the DNRP.ConclusionsICD-10 codes for hyponatraemia in the DNRP have high specificity but very low sensitivity. Laboratory test results, not discharge diagnoses, should be used to ascertain hyponatraemia.

Project description:Administrative databases are increasingly used in research studies to capture clinical outcomes such as sepsis. This systematic review and meta-analysis examines the accuracy of International Classification of Diseases, 10th revision (ICD-10), codes for identifying sepsis in adult and pediatric patients.Data sourcesWe searched MEDLINE, EMBASE, Web of Science, CENTRAL, Epistemonikos, and McMaster Superfilters from inception to September 7, 2021.Study selectionWe included studies that validated the accuracy of sepsis ICD-10 codes against any reference standard.Data extractionThree authors, working in duplicate, independently extracted data. We conducted meta-analysis using a random effects model to pool sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). We evaluated individual study risk of bias using the Quality Assessment of Diagnostic Accuracy Studies tool and assessed certainty in pooled diagnostic effect measures using the Grading of Recommendations Assessment, Development, and Evaluation framework.Data synthesisThirteen eligible studies were included in the qualitative synthesis and the meta-analysis. Eleven studies used manual chart review as the reference standard, and four studies used registry databases. Only one study evaluated pediatric patients exclusively. Compared with the reference standard of detailed chart review and/or registry databases, the pooled sensitivity for sepsis ICD-10 codes was 35% (95% CI, 22-48, low certainty), whereas the pooled specificity was 98% (95% CI: 98-99, low certainty). The PPV for ICD-10 codes ranged from 9.8% to 100% (median, 72.0%; interquartile range [IQR], 50.0-84.7%). NPV ranged from 54.7% to 99.1% (median, 95.9%; interquartile range, 85.5-98.3%).ConclusionsSepsis is undercoded in administrative databases. Future research is needed to explore if greater consistency in ICD-10 code definitions and enhanced quality measures for ICD-10 coders can improve the coding accuracy of sepsis in large databases.

Dataset Information

Validity of International Classification of Diseases codes in identifying illicit drug use target conditions using medical record data as a reference standard: A systematic review.

Background

Methods

Results

Conclusions

Publications

Validity of International Classification of Diseases codes in identifying illicit drug use target conditions using medical record data as a reference standard: A systematic review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets