Assessing the accuracy of using diagnostic codes from administrative data to infer antidepressant treatment indications: a validation study.
Ontology highlight
ABSTRACT: Purpose
To assess the accuracy of using diagnostic codes from administrative data to infer treatment indications for antidepressants prescribed in primary care.Methods
Validation study of administrative diagnostic codes for 13 plausible indications for antidepressants compared with physician-documented treatment indications from an indication-based electronic prescribing system in Quebec, Canada. The analysis included all antidepressant prescriptions written by primary care physicians between January 1, 2003 and December 31, 2012 using the electronic prescribing system. Patient prescribed antidepressants were linked to physician claims and hospitalization data to obtain all diagnoses recorded in the past year.Results
Diagnostic codes had poor sensitivity for all treatment indications, ranging from a high of only 31.2% (95% CI, 26.8%-35.9%) for anxiety/stress disorders to as low as 1.3% (95% CI, 0.0%-5.2%) for sexual dysfunction. Sensitivity was notably worse among older patients and patients with more chronic comorbidities. Physician claims data were a better source of diagnostic codes for antidepressant treatment indications than hospitalization data.Conclusions
Administrative diagnostic codes are poor proxies for antidepressant treatment indications. Future work should determine whether the use of other variables in administrative data besides diagnostic codes can improve the ability to predict antidepressant treatment indications.
SUBMITTER: Wong J
PROVIDER: S-EPMC6220980 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Ontario has a single payer provincial health insurance program. Administrative data may provide a potentially robust source of information for post-marketing vaccine studies. Vaccine-specific immunization billing codes were introduced in 2011. Our objective was to validate Ontario's universal health care administrative datasets to assess infant immunization status. Electronic medical record data from the Electronic Medical Record Administrative data Linked Database (EMRALD) was used as the reference standard to calculate performance characteristics of the Ontario Health Insurance Plan (OHIP) database vaccine-specific and general immunization codes for 4 primary infant immunizations: diphtheria, tetanus, acellular pertussis, inactivated polio, Haemophilus influenzae type B (DTaP-IPV-Hib) combination vaccine, pneumococcal conjugate vaccine, measles, mumps, rubella (MMR) vaccine, and meningococcal conjugate serogroup C vaccine. OHIP billing claims had specificity ranging from 81% to 92%, sensitivity 70% to 83%, positive predictive value (PPV) 97% to 99%, and negative predictive value (NPV) 13% to 46% for identifying the various specific vaccines in administrative data. For cohorts vaccinated in the new code introduction phase, using both the vaccine-specific and general codes had higher sensitivity than the vaccine-specific codes alone. In conclusion, immunization billing claims from administrative data in Ontario had high specificity and PPV, moderate sensitivity, and low NPV. This study identifies some of the applications of utilizing administrative data for post-marketing vaccine studies. However, limitations of these data decrease their utility for measuring vaccine coverage and effectiveness. Therefore, the establishment of a comprehensive and linkable immunization registry should be a provincial priority.
| S-EPMC4514409 | biostudies-literature
Project description:Administrative databases that capture diagnostic codes are increasingly being used worldwide for research because they can save time and reduce costs. However, assessing validity is necessary before defining diseases using only diagnostic codes in research applications. Our objective was to assess the validity of using diagnostic codes to identify incident Parkinson's disease (PD) cases in Olmsted County, Minnesota using an established standard for comparison (1976-2005). Cases were identified solely using computer programs applied to administrative diagnostic code indexes from the Rochester Epidemiology Project (REP). Two codes >30 days apart or one code on the death certificate constituted PD. The standard was a clinical diagnosis by movement disorders specialists based on medical record review. Validity was assessed using positive predictive value (PPV) and sensitivity. Numbers of incident cases and incidence rates were compared between the two ascertainment methods by sex. The codes only method over-counted the number of incident PD cases by 73% (804 versus 464), and this over-counting generally increased with calendar year. Sensitivity was 80% (95% CI [76%, 84%]) and PPV was 46% (95% CI [34%, 50%]). Disease status misclassification accounted for two-thirds of falsely identified cases, where individuals were found to not have PD (43%) or even parkinsonism (23%) after medical record review. The codes only method also over-estimated the incidence rate time trend for men and women by approximately two-fold. In our context, using administrative diagnostic codes only to identify incident PD cases is not recommended unless more accurate algorithms are developed.
| S-EPMC8218579 | biostudies-literature
Project description:BackgroundAdministrative data can be used to determine optimal management of febrile infants and aid clinical practice guideline development.ObjectiveDetermine the most accurate International Classification of Diseases, Ninth Revision (ICD-9) diagnosis coding strategies for identification of febrile infants.DesignRetrospective cross-sectional study.SettingEight emergency departments in the Pediatric Health Information System.PatientsInfants aged <90 days evaluated between July 1, 2012 and June 30, 2013 were randomly selected for medical record review from 1 of 4 ICD-9 diagnosis code groups: (1) discharge diagnosis of fever, (2) admission diagnosis of fever without discharge diagnosis of fever, (3) discharge diagnosis of serious infection without diagnosis of fever, and (4) no diagnosis of fever or serious infection.ExposureThe ICD-9 diagnosis code groups were compared in 4 case-identification algorithms to a reference standard of fever ≥100.4°F documented in the medical record.MeasurementsAlgorithm predictive accuracy was measured using sensitivity, specificity, and negative and positive predictive values.ResultsAmong 1790 medical records reviewed, 766 (42.8%) infants had fever. Discharge diagnosis of fever demonstrated high specificity (98.2%, 95% confidence interval [CI]: 97.8-98.6) but low sensitivity (53.2%, 95% CI: 50.0-56.4). A case-identification algorithm of admission or discharge diagnosis of fever exhibited higher sensitivity (71.1%, 95% CI: 68.2-74.0), similar specificity (97.7%, 95% CI: 97.3-98.1), and the highest positive predictive value (86.9%, 95% CI: 84.5-89.3).ConclusionsA case-identification strategy that includes admission or discharge diagnosis of fever should be considered for febrile infant studies using administrative data, though underclassification of patients is a potential limitation.
| S-EPMC4715646 | biostudies-literature
Project description:BackgroundAdministrative healthcare databases are useful and inexpensive tools that can provide a comprehensive assessment of the burden of diseases in terms of major outcomes, such as mortality, hospital readmissions, and use of healthcare resources. However, a crucial issue is the reliability of information gathered. The aim of this study was to validate ICD-9 codes for several major cardiovascular conditions, i.e., acute myocardial infarction (AMI), atrial fibrillation/flutter (AF), and heart failure (HF), in order to use them for epidemiological, outcome, and health services research.MethodsData from the centralised administrative database of the Umbria Region (890,000 residents, located in Central Italy) were considered. Patients with a first hospital discharge for AMI, AF/flutter, and HF, between 2012 and 2014, were identified using ICD-9-CM codes in primary position. A sample of cases and non-cases was randomly selected, and the corresponding medical charts reviewed by specifically trained investigators. For each disease, case ascertainment was based on all clinical, laboratory, and instrumental examinations available in medical charts. Sensitivity, specificity, and predictive values with 95% confidence intervals (CIs), were calculated.ResultsWe reviewed 458 medical charts, 128 for AMI, 127 for AF/flutter, 127 for HF, and 76 of non-cases for each condition. Diagnostic accuracy measures of the original discharge diagnosis were as follows. AMI: sensitivity 98% (95% CI, 94-100%), specificity 91% (95% CI, 83-97%), positive predictive value (PPV) 95% (95% CI, 89-98%), negative predictive value (NPV) 97% (95% CI, 91-100%). AF/flutter: sensitivity 95% (95% CI, 90-98%), specificity 95% (95% CI, 87-99%), PPV 97% (95% CI, 92-99%), NPV 92% (95% CI, 84-97%). HF: sensitivity 96% (95% CI, 91-99%), specificity 90% (95% CI, 81-96%), PPV 94% (95% CI, 88-97%), NPV 93% (95% CI, 85-98%).ConclusionThe case ascertainment for AMI, AF and flutter, and HF, showed a high level of accuracy (≥ 90%). The healthcare administrative database of the Umbria Region can be confidently used for epidemiological, outcome, and health services research.
| S-EPMC6613689 | biostudies-literature
Project description:BackgroundHealth care administrative database research frequently uses standard medical codes to identify diagnoses or procedures. The aim of this review was to establish the diagnostic accuracy of codes used in administrative data research to identify nontuberculous mycobacterial (NTM) disease, including lung disease (NTMLD).MethodsWe searched Ovid Medline, Embase, Scopus, Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials, and ClinicalTrials.gov from inception to April 2019. We included studies assessing the diagnostic accuracy of International Classification of Diseases, 9th edition, Clinical Modification (ICD-9-CM) diagnosis codes to identify NTM disease and NTMLD. Studies were independently assessed by 2 researchers, and the Quality Assessment of Diagnostic Accuracy Studies 2 tool was used to assess bias and quality.ResultsWe identified 5549 unique citations. Of the 96 full-text articles reviewed, 7 eligible studies of moderate quality (3730 participants) were included in our review. The diagnostic accuracy of ICD-9-CM diagnosis codes to identify NTM disease varied widely across studies, with positive predictive values ranging from 38.2% to 100% and sensitivity ranging from 21% to 93%. For NTMLD, 4 studies reported diagnostic accuracy, with positive predictive values ranging from 57% to 64.6% and sensitivity ranging from 21% to 26.9%.ConclusionsDiagnostic accuracy measures of codes used in health care administrative data to identify patients with NTM varied across studies. Overall the positive predictive value of ICD-9-CM diagnosis codes alone is good, but the sensitivity is low; this method is likely to underestimate case numbers, reflecting the current limitations of coding systems to capture NTM diagnoses.
| S-EPMC8134528 | biostudies-literature
Project description:Objectives To assess the accuracy of International Classification of Diseases, Ninth Revision - Clinical Modification (ICD-9-CM) codes in identifying subjects with colorectal cancer.DesignA diagnostic accuracy study comparing ICD-9-CM codes (index test) for colorectal cancers with medical chart (as a reference standard). Case ascertainment based on neoplastic lesion(s) within the colon/rectum and histological documentation from a primary or metastatic site positive for colorectal cancer.SettingAdministrative databases from the Umbria region, Azienda Sanitaria Locale (ASL) Napoli 3 Sud (NA) region and Friuli Venezia Giulia (FVG) region.ParticipantsWe randomly selected 130 incident patients from each hospital discharge database, admitted between 2012 and 2014, having colorectal cancer ICD-9 codes located in primary position, and 94 non-cases, that is, patients having a diagnosis of cancer (ICD-9 140-239) other than colorectal cancer in primary position.Outcome measuresSensitivity, specificity and predictive values for 153.x code (colon cancer) and for 154.x code (rectal cancer).ResultsThe positive predictive value (PPV) for colon cancer diagnoses was 80% for Umbria (95%?CI 73% to 87%), 81% for NA (95%?CI 73% to 88%) and 80% for FVG (95%?CI 72% to 87%).The sensitivity ranged from 98% to 99%, while the specificity ranged from 78% to 80% in the three units.For rectal cancer, the PPV was 84% for Umbria (95%?CI 77% to 90%), 80% for NA (95%?CI 72% to 87%) and 81% for FVG (95%?CI 73% to 87%). The sensitivities ranged from 98% to 100%, while the specificity estimates from 79% to 82%.ConclusionsAdministrative databases in Italy can be a valuable tool for cancer surveillance as well as monitoring geographical and temporal variation of cancer practice.
| S-EPMC6042611 | biostudies-literature
Project description:Community-acquired pneumonia (CAP) remains one of the most common indications for pediatric hospitalization in the United States, and it is frequently the focus of research and quality studies. Use of administrative data is increasingly common for these purposes, although proper validation is required to ensure valid study conclusions.To validate administrative billing data for hospitalizations owing to childhood CAP.Case-control study of 4 tertiary care, freestanding children’s hospitals in the United States.A total of 998 medical records of a 25% random sample of 3646 children discharged in 2010 with at least 1 International Classification of Diseases, 9th Revision, Clinical Modification (ICD-9-CM) code representing possible pneumonia were reviewed. Discharges (matched on date of admission) without a pneumonia-related discharge code were also examined to identify potential missed pneumonia cases. Two reference standards, based on provider diagnosis alone (provider confirmed) or in combination with consistent clinical and radiographic evidence of pneumonia (definite), were used to identify CAP.Twelve ICD-9-CM–based coding strategies, each using a combination of primary or secondary codes representing pneumonia or pneumonia-related complications. Six algorithms excluded children with complex chronic conditions.Sensitivity, specificity, and negative and positive predictive values (NPV and PPV, respectively) of the 12 identification strategies.For provider-confirmed CAP (n?=?680), sensitivity ranged from 60.7% to 99.7%; specificity, 75.7% to 96.4%; PPV, 67.9% to 89.6%; and NPV, 82.6% to 99.8%. For definite CAP (n?=?547), sensitivity ranged from 65.6% to 99.6%; specificity, 68.7% to 93.0%; PPV, 54.6% to 77.9%; and NPV, 87.8% to 99.8%. Unrestricted use of the pneumonia-related codes was inaccurate, although several strategies improved specificity to more than 90% with a variable effect on sensitivity. Excluding children with complex chronic conditions demonstrated the most favorable performance characteristics. Performance of the algorithms was similar across institutions.Administrative data are valuable for studying pediatric CAP hospitalizations. The strategies presented here will aid in the accurate identification of relevant and comparable patient populations for research and performance improvement studies.
| S-EPMC3907952 | biostudies-literature
Project description:The decision whether to continue antidepressant use for depression during pregnancy requires weighing maternal and child risks and benefits. Little is known about the effectiveness of antidepressant therapy during pregnancy. The goal of this study is to evaluate whether standard administrative claims data can be used to evaluate the effectiveness of antidepressants.Using prescription and healthcare visit Medicaid claims (2000-2007), we identified 28?493 women with a depression diagnosis and antidepressant fill in the 90?days before their last menstrual period. Antidepressant continuation was defined based on prescription fills during the first trimester. Depression hospitalizations and deliberate self-harm served as measures of the effectiveness of treatment continuation during pregnancy. Propensity score and instrumental variable analyses were used to attempt to account for confounding.Relative to women who discontinued antidepressant therapy, women who continued were more likely to have a depression inpatient stay (odds ratio [OR]?=?2.2, 95% confidence interval [95%CI]: 2.0-2.4) and deliberate self-harm code (OR?=?1.4, 95%CI: 0.7-2.7). Accounting for measured covariates in the propensity score analysis, including age, race, comorbidities, comedications, features of the depression diagnosis, and antidepressant class, led to slightly attenuated estimates (OR?=?2.0, 95%CI: 1.8-2.2; OR?=?1.1, 95%CI: 0.5-2.4). Similar associations were estimated in subgroups with different levels of baseline depression severity. Proposed preference-time, calendar-time-based, and geography-based instruments were unlikely to meet the required conditions for a valid analysis.Our findings suggest that either antidepressant medications do not reduce the risk of depression relapse in pregnant women, or that administrative data alone could not be used to validly estimate the effectiveness of psychotropic medications during pregnancy.
| S-EPMC4822692 | biostudies-literature
Project description:OBJECTIVES:To assess the accuracy of International Classification of Diseases 9th Revision-Clinical Modification (ICD-9-CM) codes in identifying subjects with lung cancer. DESIGN:A cross-sectional diagnostic accuracy study comparing ICD-9-CM 162.x code (index test) in primary position with medical chart (reference standard). Case ascertainment was based on the presence of a primary nodular lesion in the lung and cytological or histological documentation of cancer from a primary or metastatic site. SETTING:Three operative units: administrative databases from Umbria Region (890?000 residents), ASL Napoli 3 Sud (NA) (1 170 000 residents) and Friuli Venezia Giulia (FVG) Region (1 227 000 residents). PARTICIPANTS:Incident subjects with lung cancer (n=386) diagnosed in primary position between 2012 and 2014 and a population of non-cases (n=280). OUTCOME MEASURES:Sensitivity, specificity and positive predictive value (PPV) for 162.x code. RESULTS:130 cases and 94 non-cases were randomly selected from each database and the corresponding medical charts were reviewed. Most of the diagnoses for lung cancer were performed in medical departments.True positive rates were high for all the three units. Sensitivity was 99% (95% CI 95% to 100%) for Umbria, 97% (95% CI 91% to 100%) for NA, and 99% (95% CI 95% to 100%) for FVG. The false positive rates were 24%, 37% and 23% for Umbria, NA and FVG, respectively. PPVs were 79% (73% to 83%)%) for Umbria, 58% (53% to 63%)%) for NA and 79% (73% to 84%)%) for FVG. CONCLUSIONS:Case ascertainment for lung cancer based on imaging or endoscopy associated with histological examination yielded an excellent sensitivity in all the three administrative databases. PPV was moderate for Umbria and FVG but lower for NA.
| S-EPMC5961589 | biostudies-literature
Project description:ObjectivesTo assess the accuracy of International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) codes in identifying patients diagnosed with incident carcinoma in situ and invasive breast cancer in three Italian administrative databases.DesignA diagnostic accuracy study comparing ICD-9-CM codes for carcinoma in situ (233.0) and for invasive breast cancer (174.x) with medical chart (as a reference standard). Case definition: (1) presence of a primary nodular lesion in the breast and (2) cytological or histological documentation of cancer from a primary or metastatic site.SettingAdministrative databases from Umbria Region, Azienda Sanitaria Locale (ASL) Napoli 3 Sud (NA) and Friuli VeneziaGiulia (FVG) Region.ParticipantsWomen with breast carcinoma in situ (n=246) or invasive breast cancer (n=384) diagnosed (in primary position) between 2012 and 2014.Outcome measuresSensitivity and specificity for codes 233.0 and 174.x.ResultsFor invasive breast cancer the sensitivities were 98% (95% CI 93% to 99%) for Umbria, 96% (95% CI 91% to 99%) for NA and 100% (95% CI 97% to 100%) for FVG. Specificities were 90% (95% CI 82% to 95%) for Umbria, 91% (95% CI 83% to 96%) for NA and 91% (95% CI 84% to 96%) for FVG.For carcinoma in situ the sensitivities were 100% (95% CI 93% to 100%) for Umbria, 100% (95% CI 95% to 100%) for NA and 100% (95% CI 96% to 100%) for FVG. Specificities were 98% (95% CI 93% to 100%) for Umbria, 86% (95% CI 78% to 92%) for NA and 90% (95% CI 82% to 95%) for FVG.ConclusionsAdministrative healthcare databases from Umbria, NA and FVG are accurate in identifying hospitalised news cases of carcinoma of the breast. The proposed case definition is a powerful tool to perform research on large populations of newly diagnosed patients with breast cancer.
| S-EPMC6059298 | biostudies-literature