Dataset Information

Accuracy of syndrome definitions based on diagnoses in physician claims.

ABSTRACT: Community clinics offer potential for timelier outbreak detection and monitoring than emergency departments. However, the accuracy of syndrome definitions used in surveillance has never been evaluated in community settings. This study's objective was to assess the accuracy of syndrome definitions based on diagnostic codes in physician claims for identifying 5 syndromes (fever, gastrointestinal, neurological, rash, and respiratory including influenza-like illness) in community clinics.We selected a random sample of 3,600 community-based primary care physicians who practiced in the fee-for-service system in the province of Quebec, Canada in 2005-2007. We randomly selected 10 visits per physician from their claims, stratifying on syndrome type and presence, diagnosis, and month. Double-blinded chart reviews were conducted by telephone with consenting physicians to obtain information on patient diagnoses for each sampled visit. The sensitivity, specificity, and positive predictive value (PPV) of physician claims were estimated by comparison to chart review.1,098 (30.5%) physicians completed the chart review. A chart entry on the date of the corresponding claim was found for 10,529 (95.9%) visits. The sensitivity of syndrome definitions based on diagnostic codes in physician claims was low, ranging from 0.11 (fever) to 0.44 (respiratory), the specificity was high, and the PPV was moderate to high, ranging from 0.59 (fever) to 0.85 (respiratory). We found that rarely used diagnostic codes had a higher probability of being false-positives, and that more commonly used diagnostic codes had a higher PPV.Future research should identify physician, patient, and encounter characteristics associated with the accuracy of diagnostic codes in physician claims. This would enable public health to improve syndromic surveillance, either by focusing on physician claims whose diagnostic code is more likely to be accurate, or by using all physician claims and weighing each according to the likelihood that its diagnostic code is accurate.

SUBMITTER: Cadieux G

PROVIDER: S-EPMC3025839 | biostudies-other | 2011 Jan

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Accuracy of syndrome definitions based on diagnoses in physician claims.

Cadieux Geneviève G Buckeridge David L DL Jacques André A Libman Michael M Dendukuri Nandini N Tamblyn Robyn R

BMC public health 20110107

<h4>Background</h4>Community clinics offer potential for timelier outbreak detection and monitoring than emergency departments. However, the accuracy of syndrome definitions used in surveillance has never been evaluated in community settings. This study's objective was to assess the accuracy of syndrome definitions based on diagnostic codes in physician claims for identifying 5 syndromes (fever, gastrointestinal, neurological, rash, and respiratory including influenza-like illness) in community ...[more]

PMID: 21211054

Similar Datasets

Project description:ObjectiveTo evaluate the accuracy of ICD-10-CM claims-based definitions for epilepsy and classifying seizure types in the outpatient setting.MethodsWe reviewed electronic health records (EHR) for a cohort of adults aged 18+ years seen by six neurologists who had an outpatient visit at a level 4 epilepsy center between 01/2019-09/2019. The neurologists used a standardized documentation template to capture the diagnosis of epilepsy (yes/no/unsure), seizure type (focal/generalized/unknown), and seizure frequency in the EHR. Using linked ICD-10-CM codes assigned by the provider, we assessed the accuracy of claims-based definitions for epilepsy, focal seizure type, and generalized seizure type against the reference-standard EHR documentation by estimating sensitivity (Sn), specificity (Sp), positive predictive value (PPV), and negative predictive value (NPV).ResultsThere were 673 eligible outpatient encounters. After review of EHRs for standardized documentation, an analytic sample consisted of 520 encounters representing 402 unique patients. In the EHR documentation, 93.5 % (n = 486/520) of encounters were with patients with a diagnosis of epilepsy. Of those, 66.0 % (n = 321/486) had ≥1 focal seizure, 41.6 % (n = 202/486) had ≥1 generalized seizure, and 7% (n = 34/486) had ≥1 unknown seizure. An ICD-10-CM definition for epilepsy (i.e., ICD-10 G40.X) achieved Sn = 84.4 % (95 % CI 80.8-87.5%), Sp = 79.4 % (95 % CI 62.1-91.3%), PPV = 98.3 % (95 % CI 96.6-99.3%), and NPV = 26.2 % (95 % CI 18.0-35.8%). The classification of focal vs generalized/unknown seizures achieved Sn = 69.8 % (95 % CI 64.4-74.8%), Sp = 79.4 % (95 % CI 72.4-85.3%), PPV = 86.8 % (95 % CI 82.1-90.7%), and NPV = 57.5 % (95 % CI 50.8-64.0%).ConclusionsClaims-based definitions using groups of ICD-10-CM codes assigned by neurologists in routine outpatient clinic visits at a level 4 epilepsy center performed well in discriminating between patients with and without a diagnosis of epilepsy and between seizure types.

Project description:Syndromic surveillance systems are plagued by high false-positive rates. In chronic disease monitoring, investigators have identified several factors that predict the accuracy of case definitions based on diagnoses in administrative data, and some have even incorporated these predictors into novel case detection methods, resulting in a significant improvement in case definition accuracy. Based on findings from these studies, we sought to identify physician, patient, encounter, and billing characteristics associated with the positive predictive value (PPV) of case definitions for 5 syndromes (fever, gastrointestinal, neurological, rash, and respiratory (including influenza-like illness)).The study sample comprised 4,330 syndrome-positive visits from the claims of 1,098 randomly-selected physicians working in Quebec, Canada in 2005-2007. For each visit, physician-facilitated chart review was used to assess whether the same syndrome was present in the medical chart (gold standard). We used multivariate logistic regression analyses to estimate the association between claim-chart agreement about the presence of a syndrome and physician, patient, encounter, and billing characteristics.The likelihood of the medical chart agreeing with the physician claim about the presence of a syndrome was higher when the treating physician had billed many visits for the same syndrome recently (ORper 10 visit, 1.05; 95% CI, 1.01-1.08), had a lower workload (ORper 10 claims, 0.93; 95% CI, 0.90-0.97), and when the patient was younger (ORper 5 years of age, 0.96; 95% CI, 0.94-0.97), and less socially deprived (ORmost versus least deprived, 0.76; 95% CI, 0.60-0.95).Many physician, patient, encounter, and billing characteristics associated with the PPV of surveillance case definition are accessible to public health, and could be used to reduce false-positive alerts by surveillance systems, either by focusing on the data most likely to be accurate, or by adjusting the observed data for known biases in diagnosis reporting and performing surveillance using the adjusted values.

Project description:We investigate the influence of three common definitions of the solute/solvent dielectric boundary (DB) on the accuracy of the electrostatic solvation energy ?Gel computed within the Poisson Boltzmann and the generalized Born models of implicit solvation. The test structures include small molecules, peptides and small proteins; explicit solvent ?Gel are used as accuracy reference. For common atomic radii sets BONDI, PARSE (and ZAP9 for small molecules) the use of van der Waals (vdW) DB results, on average, in considerably larger errors in ?Gel than the molecular surface (MS) DB. The optimal probe radius ?w for which the MS DB yields the most accurate ?Gel varies considerably between structure types. The solvent accessible surface (SAS) DB becomes optimal at ?w ~ 0.2 Å (exact value is sensitive to the structure and atomic radii), at which point the average accuracy of ?Gel is comparable to that of the MS-based boundary. The geometric equivalence of SAS to vdW surface based on the same atomic radii uniformly increased by ?w gives the corresponding optimal vdW DB. For small molecules, the optimal vdW DB based on BONDI + 0.2 Å radii can yield ?Gel estimates at least as accurate as those based on the optimal MS DB. Also, in small molecules, pairwise charge-charge interactions computed with the optimal vdW DB are virtually equal to those computed with the MS DB, suggesting that in this case the two boundaries are practically equivalent by the electrostatic energy criteria. In structures other than small molecules, the optimal vdW and MS dielectric boundaries are not equivalent: the respective pairwise electrostatic interactions in the presence of solvent can differ by up to 5 kcal/mol for individual atomic pairs in small proteins, even when the total ?Gel are equal. For small proteins, the average decrease in pairwise electrostatic interactions resulting from the switch from optimal MS to optimal vdW DB definition can be mimicked within the MS DB definition by doubling of the solute dielectric constant. However, the use of the higher interior dielectric does not eliminate the large individual deviations between pairwise interactions computed within the two DB definitions. It is argued that while the MS based definition of the dielectric boundary is more physically correct in some types of practical calculations, the choice is not so clear in some other common scenarios.

Project description:While medical records have detailed information, they are limited in reach to the availability and accessibility of those records. On the other hand, administrative data while limited in scope, have a much further reach in coverage of an entire population. However, few studies have validated the use of administrative data for identifying infections in pediatric populations. Pediatric patients from Ontario, Canada aged <18 years were randomly sampled from the Electronic Medical Record Administrative data Linked Database (EMRALD). Using physician diagnoses from the electronic medical record (EMR) as the reference standard, we determined the criterion validity of physician billing claims in administrative data for identifying infectious disease syndromes from 2012 to 2014. Diagnosis codes were assessed by infection category (respiratory, skin and soft tissue, gastrointestinal, urinary tract and otitis externa) and for all infections combined. Sensitivity analyses assessed the performance if patients had more than one reason to visit the physician. We analysed 2,139 patients and found 33.3% of all visits were for an infection, and respiratory infections accounted for 67.6% of the infections. When we combined all infection categories, sensitivity was 0.74 (95% CI 0.70-0.77), specificity was 0.95 (95% CI 0.93-0.96), positive predictive value (PPV) was 0.87 (95% CI 0.84-0.90), and negative predictive value (NPV) was 0.88 (95% CI 0.86-0.89). For respiratory infections, sensitivity was 0.77 (95% CI 0.73-0.81), specificity was 0.96 (95% CI 0.95-0.97), PPV was 0.85 (95% CI 0.81-0.88), and NPV was 0.94 (95% CI 0.92-0.95). Similar performance was observed for skin and soft tissue, gastrointestinal, urinary tract, and otitis externa infections, but with lower sensitivity. Performance measures were highest when the patient visited the physician with only one health complaint. We found when using linked EMR data as the reference standard, administrative billing codes are reasonably accurate in identifying infections in a pediatric population.

Project description:Study questionIs a higher use of resources by physicians associated with a reduced risk of malpractice claims?MethodsUsing data on nearly all admissions to acute care hospitals in Florida during 2000-09 linked to malpractice history of the attending physician, this study investigated whether physicians in seven specialties with higher average hospital charges in a year were less likely to face an allegation of malpractice in the following year, adjusting for patient characteristics, comorbidities, and diagnosis. To provide clinical context, the study focused on obstetrics, where the choice of caesarean deliveries are suggested to be influenced by defensive medicine, and whether obstetricians with higher adjusted caesarean rates in a year had fewer alleged malpractice incidents the following year.Study answer and limitationsThe data included 24,637 physicians, 154,725 physician years, and 18,352,391 hospital admissions; 4342 malpractice claims were made against physicians (2.8% per physician year). Across specialties, greater average spending by physicians was associated with reduced risk of incurring a malpractice claim. For example, among internists, the probability of experiencing an alleged malpractice incident in the following year ranged from 1.5% (95% confidence interval 1.2% to 1.7%) in the bottom spending fifth ($19,725 (£12,800; €17,400) per hospital admission) to 0.3% (0.2% to 0.5%) in the top fifth ($39,379 per hospital admission). In six of the specialties, a greater use of resources was associated with statistically significantly lower subsequent rates of alleged malpractice incidents. A principal limitation of this study is that information on illness severity was lacking. It is also uncertain whether higher spending is defensively motivated.What this study addsWithin specialty and after adjustment for patient characteristics, higher resource use by physicians is associated with fewer malpractice claims.Funding, competing interests, data sharingThis study was supported by the Office of the Director, National Institutes of Health (grant 1DP5OD017897-01 to ABJ) and National Institute of Aging (R37 AG036791 to JB). The authors have no competing interests or additional data to share.

Dataset Information

Accuracy of syndrome definitions based on diagnoses in physician claims.

Publications

Accuracy of syndrome definitions based on diagnoses in physician claims.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets