Identifying cases of chronic pain using health administrative data: A validation study.
Ontology highlight
ABSTRACT: Background
Most prevalence estimates of chronic pain are derived from surveys and vary widely, both globally (2%-54%) and in Canada (6.5%-44%). Health administrative data are increasingly used for chronic disease surveillance, but their validity as a source to ascertain chronic pain cases is understudied.Aim
The aim of this study was to derive and validate an algorithm to identify cases of chronic pain as a single chronic disease using provincial health administrative data.Methods
A reference standard was developed and applied to the electronic medical records data of a Newfoundland and Labrador general population sample participating in the Canadian Primary Care Sentinel Surveillance Network. Chronic pain algorithms were created from the administrative data of patient populations with chronic pain, and their classification performance was compared to that of the reference standard via statistical tests of selection accuracy.Results
The most performant algorithm for chronic pain case ascertainment from the Medical Care Plan Fee-for-Service Physicians Claims File was one anesthesiology encounter ever recording a chronic pain clinic procedure code OR five physician encounter dates recording any pain-related diagnostic code in 5 years with more than 183 days separating at least two encounters. The algorithm demonstrated 0.703 (95% confidence interval [CI], 0.685-0.722) sensitivity, 0.668 (95% CI, 0.657-0.678) specificity, and 0.408 (95% CI, 0.393-0.423) positive predictive value. The chronic pain algorithm selected 37.6% of a Newfoundland and Labrador provincial cohort.Conclusions
A health administrative data algorithm was derived and validated to identify chronic pain cases and estimate disease burden in residents attending fee-for-service physician encounters in Newfoundland and Labrador.
SUBMITTER: Foley HE
PROVIDER: S-EPMC7967902 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundHealth care data allow for the study and surveillance of chronic diseases such as diabetes. The objective of this study was to identify and validate optimal algorithms for diabetes cases within health care administrative databases for different research purposes, populations, and data sources.MethodsWe linked health care administrative databases from Ontario, Canada to a reference standard of primary care electronic medical records (EMRs). We then identified and calculated the performance characteristics of multiple adult diabetes case definitions, using combinations of data sources and time windows.ResultsThe best algorithm to identify diabetes cases was the presence at any time of one hospitalization or physician claim for diabetes AND either one prescription for an anti-diabetic medication or one physician claim with a diabetes-specific fee code [sensitivity 84.2%, specificity 99.2%, positive predictive value (PPV) 92.5%]. Use of physician claims alone performed almost as well: three physician claims for diabetes within one year was highly specific (sensitivity 79.9%, specificity 99.1%, PPV 91.4%) and one physician claim at any time was highly sensitive (sensitivity 93.6%, specificity 91.9%, PPV 58.5%).ConclusionsThis study identifies validated algorithms to capture diabetes cases within health care administrative databases for a range of purposes, populations and data availability. These findings are useful to study trends and outcomes of diabetes using routinely-collected health care data.
| S-EPMC5932874 | biostudies-literature
Project description:ObjectiveTo develop a valid algorithm for identifying multiple sclerosis (MS) cases in administrative health claims (AHC) datasets.MethodsWe used 4 AHC datasets from the Veterans Administration (VA), Kaiser Permanente Southern California (KPSC), Manitoba (Canada), and Saskatchewan (Canada). In the VA, KPSC, and Manitoba, we tested the performance of candidate algorithms based on inpatient, outpatient, and disease-modifying therapy (DMT) claims compared to medical records review using sensitivity, specificity, positive and negative predictive values, and interrater reliability (Youden J statistic) both overall and stratified by sex and age. In Saskatchewan, we tested the algorithms in a cohort randomly selected from the general population.ResultsThe preferred algorithm required ≥3 MS-related claims from any combination of inpatient, outpatient, or DMT claims within a 1-year time period; a 2-year time period provided little gain in performance. Algorithms including DMT claims performed better than those that did not. Sensitivity (86.6%-96.0%), specificity (66.7%-99.0%), positive predictive value (95.4%-99.0%), and interrater reliability (Youden J = 0.60-0.92) were generally stable across datasets and across strata. Some variation in performance in the stratified analyses was observed but largely reflected changes in the composition of the strata. In Saskatchewan, the preferred algorithm had a sensitivity of 96%, specificity of 99%, positive predictive value of 99%, and negative predictive value of 96%.ConclusionsThe performance of each algorithm was remarkably consistent across datasets. The preferred algorithm required ≥3 MS-related claims from any combination of inpatient, outpatient, or DMT use within 1 year. We recommend this algorithm as the standard AHC case definition for MS.
| S-EPMC6442008 | biostudies-literature
Project description:Administrative databases that capture diagnostic codes are increasingly being used worldwide for research because they can save time and reduce costs. However, assessing validity is necessary before defining diseases using only diagnostic codes in research applications. Our objective was to assess the validity of using diagnostic codes to identify incident Parkinson's disease (PD) cases in Olmsted County, Minnesota using an established standard for comparison (1976-2005). Cases were identified solely using computer programs applied to administrative diagnostic code indexes from the Rochester Epidemiology Project (REP). Two codes >30 days apart or one code on the death certificate constituted PD. The standard was a clinical diagnosis by movement disorders specialists based on medical record review. Validity was assessed using positive predictive value (PPV) and sensitivity. Numbers of incident cases and incidence rates were compared between the two ascertainment methods by sex. The codes only method over-counted the number of incident PD cases by 73% (804 versus 464), and this over-counting generally increased with calendar year. Sensitivity was 80% (95% CI [76%, 84%]) and PPV was 46% (95% CI [34%, 50%]). Disease status misclassification accounted for two-thirds of falsely identified cases, where individuals were found to not have PD (43%) or even parkinsonism (23%) after medical record review. The codes only method also over-estimated the incidence rate time trend for men and women by approximately two-fold. In our context, using administrative diagnostic codes only to identify incident PD cases is not recommended unless more accurate algorithms are developed.
| S-EPMC8218579 | biostudies-literature
Project description:ObjectivesCase ascertainment algorithms were developed and validated to identify people living with cirrhosis in administrative health data in Manitoba, Canada using primary care electronic medical records (EMR) to define the reference standards.MethodsWe linked provincial administrative health data to primary care EMR data. The validation cohort included 116,675 Manitobans aged >18 years with at least one primary care visit between April 1998 and March 2015. Hospital records, physician billing claims, vital statistics, and prescription drug data were used to develop and test 93 case-finding algorithms. A validated case definition for primary care EMR data was the reference standard. We estimated sensitivity, specificity, positive and negative predictive values (PPV, NPV), Youden's index, area under the receiver operative curve, and their 95% confidence intervals (CIs).ResultsA total of 116,675 people were in the validation cohort. The prevalence of cirrhosis was 1.4% (n = 1593). Algorithm sensitivity estimates ranged from 32.5% (95% CI 32.2-32.8) to 68.3% (95% CI 68.0-68.9) and PPV from 17.4% (95% CI 17.1-17.6) to 23.4% (95% CI 23.1-23.6). Specificity (95.5-98.2) and NPV (approximately 99%) were high for all algorithms. The algorithms had slightly higher sensitivity estimates among men compared with women, and individuals aged ≥45 years compared to those aged 18-44 years.ConclusionCirrhosis algorithms applied to administrative health data had moderate validity when a validated case definition for primary care EMRs was the reference standard. This study provides algorithms for identifying diagnosed cirrhosis cases for population-based research and surveillance studies.
| S-EPMC10946181 | biostudies-literature
Project description:BACKGROUND:Data quality assessment presents a challenge for research using coded administrative health data. The objective of this study is to develop and validate a set of coding association rules for coded diagnostic data. METHODS:We used the Canadian re-abstracted hospital discharge abstract data coded in International Classification of Disease, 10th revision (ICD-10) codes. Association rule mining was conducted on the re-abstracted data in four age groups (0-4, 20-44, 45-64; ? 65) to extract ICD-10 coding association rules at the three-digit (category of diagnosis) and four-digit levels (category of diagnosis with etiology, anatomy, or severity). The rules were reviewed by a panel of 5 physicians and 2 classification specialists using a modified Delphi rating process. We proposed and defined the variance and bias to assess data quality using the rules. RESULTS:After the rule mining process and the panel review, 388 rules at the three-digit level and 275 rules at the four-digit level were developed. Half of the rules were from the age group of ?65. Rules captured meaningful age-specific clinical associations, with rules at the age group of ?65 being more complex and comprehensive than other age groups. The variance and bias can identify rules with high bias and variance in Alberta data and provides directions for quality improvement. CONCLUSIONS:A set of ICD-10 data quality rules were developed and validated by a clinical and classification expert panel. The rules can be used as a tool to assess ICD-coded data, enabling the monitoring and comparison of data quality across institutions, provinces, and countries.
| S-EPMC7183129 | biostudies-literature
Project description:BackgroundLong coronavirus disease (COVID) patients experience persistent symptoms after acute severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection. Healthcare utilization data could provide critical information on the disease burden of long COVID for service planning; however, not all patients are diagnosed or assigned long COVID diagnostic codes. We developed an algorithm to identify individuals with long COVID using population-level health administrative data from British Columbia (BC), Canada.MethodsAn elastic net penalized logistic regression model was developed to identify long COVID patients based on demographic characteristics, pre-existing conditions, COVID-19-related data, and all symptoms/conditions recorded >28-183 days after the COVID-19 symptom onset/reported (index) date of known long COVID patients (n = 2430) and a control group (n = 24 300), selected from all adult COVID-19 cases in BC with an index date on/before October 31, 2021 (n = 168 111). Known long COVID cases were diagnosed in a clinic and/or had the International Classification of Diseases, Tenth Revision, Canada (ICD-10-CA) code for "post COVID-19 condition" in their records.ResultsThe algorithm retained known symptoms/conditions associated with long COVID, demonstrating high sensitivity (86%), specificity (86%), and area under the receiver operator curve (93%). It identified 25 220 (18%) long COVID patients among the remaining 141 381 adult COVID-19 cases, >10 times the number of known cases. Known and predicted long COVID patients had comparable demographic and health-related characteristics.ConclusionsOur algorithm identified long COVID patients with a high level of accuracy. This large cohort of long COVID patients will serve as a platform for robust assessments on the clinical course of long COVID, and provide much needed concrete information for decision-making.
| S-EPMC9780702 | biostudies-literature
Project description:ObjectiveTo develop algorithms to identify patients with advanced heart failure (HF) that can be applied to administrative data.Patients and methodsIn a population-based cohort of all residents of Olmsted County, Minnesota, with greater than or equal to 1 HF billing code 2007-2017 (n=8657), we identified all patients with advanced HF (n=847) by applying the gold standard European Society of Cardiology advanced HF criteria via manual medical review by an HF cardiologist. The advanced HF index date was the date the patient first met all European Society of Cardiology criteria. We subsequently developed candidate algorithms to identify advanced HF using administrative data (billing codes and prescriptions relevant to HF or comorbidities that affect HF outcomes), applied them to the HF cohort, and assessed their ability to identify patients with advanced HF on or after their advanced HF index date.ResultsA single hospitalization for HF or ventricular arrhythmias identified all patients with advanced HF (sensitivity, 100%); however, the positive predictive value (PPV) was low (36.4%). More stringent definitions, including additional hospitalizations and/or other signs of advanced HF (hyponatremia, acute kidney injury, hypotension, or high-dose diuretic use), decreased the sensitivity but improved the specificity and PPV. For example, 2 hospitalizations plus 1 sign of advanced HF had a sensitivity of 72.7%, specificity of 89.8%, and PPV of 60.5%. Negative predictive values were high for all algorithms evaluated.ConclusionAlgorithms using administrative data can identify patients with advanced HF with reasonable performance.
| S-EPMC8968660 | biostudies-literature
Project description:BackgroundHealth administrative data is increasingly being used for chronic disease surveillance. This study explored agreement between administrative and survey data for ascertainment of seven key chronic diseases, using individually linked data from a large population of individuals in Ontario, Canada.MethodsAll adults who completed any one of three cycles of the Canadian Community Health Survey (2001, 2003 or 2005) and agreed to have their responses linked to provincial health administrative data were included. The sample population included 85,549 persons. Previously validated case definitions for myocardial infarction, asthma, diabetes, chronic lung disease, stroke, hypertension and congestive heart failure based on hospital and physician billing codes were used to identify cases in health administrative data and these were compared with self-report of each disease from the survey. Concordance was measured using the Kappa statistic, percent positive and negative agreement and prevalence estimates.ResultsAgreement using the Kappa statistic was good or very good (kappa range: 0.66-0.80) for diabetes and hypertension, moderate for myocardial infarction and asthma and poor or fair (kappa range: 0.29-0.36) for stroke, congestive heart failure and COPD. Prevalence was higher in health administrative data for all diseases except stroke and myocardial infarction. Health Utilities Index scores were higher for cases identified by health administrative data compared with self-reported data for some chronic diseases (acute myocardial infarction, stroke, heart failure), suggesting that administrative data may pick up less severe cases.ConclusionsIn the general population, discordance between self-report and administrative data was large for many chronic diseases, particularly disease with low prevalence, and differences were not easily explained by individual and disease characteristics.
| S-EPMC3557162 | biostudies-literature
Project description:BackgroundThe goal of regionalized perinatal care, specifically levels of maternal care, is to improve maternal outcomes through risk-appropriate obstetric care. Studies of levels of maternal care are limited by current approaches to identify a hospital's level of care, often relying on hospital self-reported data, which is expensive and challenging to collect and validate. The study objective was to develop an empiric approach to determine a hospital's level of maternal care using administrative data reflective of the patient care provided and apply this approach to describe the levels of maternal care available over time.MethodsRetrospective cohort study of mother-infant dyads who delivered in California, Missouri, and Pennsylvania hospitals from 2000 to 2009. Linked mother-infant administrative records with an infant born at 24-44 weeks' gestation and a birth weight of 400-8000 g were included. Using the American College of Obstetricians and Gynecologists and the Society for Maternal Fetal Medicine descriptions of levels of maternal care, four levels were classified based on the appropriate location of care for patients with specific medical or pregnancy conditions. Individual hospitals were assigned a level of maternal care annually based on the volume of patients who delivered reflective of the four classified levels as determined by International Classification of Diseases and Current Procedural Terminology.ResultsBased on the included 6,895,000 mother-infant dyads, the obstetric hospital levels of maternal care I, II, III and IV were identified. High-risk patients more frequently delivered in hospitals with higher level maternal care, accounting for 8.9, 10.9, 13.8, and 16.9% of deliveries in level I, II, III and IV hospitals, respectively. The total number of obstetric hospitals decreased over the study period, while the proportion of hospitals with high-level (level III or IV) maternal care increased. High-level hospitals were located in more densely populated areas.ConclusionIdentification of the level of maternal care, independent of hospital self-reported variables, is feasible using administrative data. This empiric approach, which accounts for changes in hospitals over time, is a valuable framework for perinatal researchers and other stakeholders to inexpensively identify measurable benefits of levels of maternal care and characterize where specific patient populations receive care.
| S-EPMC8171026 | biostudies-literature
Project description:BackgroundTo define a method for identifying neonatal intensive care unit (NICU) admissions using administrative claims data.MethodsThis was a retrospective cohort study using claims from Optum's de-identified Clinformatics® Data Mart Database (CDM) from 2016 -2020. We developed a definition to identify NICU admissions using a list of codes from the International Classification of Diseases, 10th Revision, Clinical Modification (ICD-10-CM), Current Procedural Terminology (CPT), and revenue codes frequently associated with NICU admissions. We compared agreement between codes using Kappa statistics and calculated positive predictive values (PPV) and 95% confidence intervals (CI).ResultsOn average, revenue codes (3.3%) alone identified more NICU hospitalizations compared to CPT codes alone (1.5%), whereas the use of CPT and revenue (8.9%) and CPT or revenue codes (13.7%) captured the most NICU hospitalizations, which aligns with rates of preterm birth. Gestational age alone (4.2%) and birthweight codes alone (2.0%) identified the least number of potential NICU hospitalizations. Setting CPT codes as the standard and revenue codes as the "test,", revenue codes resulted in identifying 86% of NICU admissions (sensitivity) and 97% of non-NICU admissions (specificity).ConclusionsUsing administrative data, we developed a robust definition for identifying neonatal admissions. The identified definition of NICU codes is easily adaptable, repeatable, and flexible for use in other datasets.
| S-EPMC10916318 | biostudies-literature