Dataset Information

The accuracy of present-on-admission reporting in administrative data.

ABSTRACT:

Objective

To test the accuracy of reporting present-on-admission (POA) and to assess whether POA reporting accuracy differs by hospital characteristics.

Data sources

We performed an audit of POA reporting of secondary diagnoses in 1,059 medical records from 48 California hospitals.

Study design

We used patient discharge data (PDD) to select records with secondary diagnoses that are powerful predictors of mortality and could potentially represent comorbidities or complications among patients who either had a primary procedure of a percutaneous transluminal coronary angioplasty or a primary diagnosis of acute myocardial infarction, community-acquired pneumonia, or congestive heart failure. We modeled the relationship between secondary diagnoses POA reporting accuracy (over-reporting and under-reporting) and hospital characteristics.

Data collection

We created a gold standard from blind reabstraction of the medical records and compared the accuracy of the PDD against the gold standard.

Principal findings

The PDD and gold standard agreed on POA reporting in 74.3 percent of records, with 13.7 percent over-reporting and 11.9 percent under-reporting. For-profit hospitals tended to overcode secondary diagnoses as present on admission (odds ratios [OR] 1.96; 95 percent confidence interval [CI] 1.11, 3.44), whereas teaching hospitals tended to undercode secondary diagnoses as present on admission (OR 2.61; 95 percent CI 1.36, 5.03).

Conclusions

POA reporting of secondary diagnoses is moderately accurate but varies by hospitals. Steps should be taken to improve POA reporting accuracy before using POA in hospital assessments tied to payments.

SUBMITTER: Goldman LE

PROVIDER: S-EPMC3393034 | biostudies-literature | 2011 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The accuracy of present-on-admission reporting in administrative data.

Goldman L Elizabeth LE Chu Philip W PW Osmond Dennis D Bindman Andrew A

Health services research 20110811 6pt1

<h4>Objective</h4>To test the accuracy of reporting present-on-admission (POA) and to assess whether POA reporting accuracy differs by hospital characteristics.<h4>Data sources</h4>We performed an audit of POA reporting of secondary diagnoses in 1,059 medical records from 48 California hospitals.<h4>Study design</h4>We used patient discharge data (PDD) to select records with secondary diagnoses that are powerful predictors of mortality and could potentially represent comorbidities or complicatio ...[more]

PMID: 22092023

Similar Datasets

Project description:BackgroundAdministrative data are often hampered by coding errors, absent data, and the difficulty of distinguishing pre-existing conditions from perioperative complications. We evaluated whether the introduction of the present on admission (POA) indicator improved outcome analysis of carotid endarterectomy (CEA) and carotid angioplasty and stenting (CAS) using administrative data.MethodsState inpatient databases from California (2005-2008), New York (2008), and New Jersey (2008) were used to identify patients undergoing CAS and CEA. We first analyzed morbidity data without the POA indicator, using International Classification of Diseases, Ninth Revision complication codes (eg, 997.02, iatrogenic cerebrovascular infarction or hemorrhage, postoperative stroke) and diagnosis codes (eg, 433.11, occlusion and stenosis of the carotid artery with cerebral infarction). Then, we applied the POA indicator to both diagnosis and complication codes and calculated the proportion of events that were labeled POA. Symptom status and perioperative stroke rate were compared using these coding approaches.ResultsWe identified 21,639 patients who underwent CEA and 3688 patients who underwent CAS. Without the POA indicator, the complication code for stroke indicated a postoperative stroke rate of 1.4% for CEA and 2.4% for CAS. After applying the POA indicator, 54% (CEA) and 62% (CAS) of these strokes were labeled POA. These POA strokes were either preoperative or intraoperative events. Proportion of symptomatic patients ranged from 7% to 16% for CEA and from 5% to 22% for CAS. Perioperative stroke rate was the lowest in the POA method (1.1% CEA, 1.8% CAS) compared with two other methods without POA information (1.4% and 9.5% CEA and 2.4% and 16.4% CAS). Kappa indicated a poor (0.2) to fair (0.7) agreement between these approaches.ConclusionsAdministrative data has known limitations for assignment of symptom status and nonfatal perioperative outcomes. Given the uncertain timing of POA events as preoperative vs intraoperative and its apparent underestimation of the perioperative stroke rate, the use of administrative data even with the POA indicator for symptom status and non-fatal outcomes after CEA and CAS is hazardous.

Project description:BackgroundAboriginal people are under-reported on administrative health data in Australia. Various approaches have been used or proposed to improve reporting of Aboriginal people using linked records. This cross-sectional study used self-reported Aboriginality from the NSW Patient Survey Program (PSP) as a reference standard to assess the accuracy of reporting of Aboriginal people on NSW Admitted Patient (APDC) and Emergency Department Data Collections (EDDC), and compare the accuracy of selected approaches to enhance reporting Aboriginality using linked data.MethodsTen PSP surveys were linked to five administrative health data collections, including APDC, EDDC, perinatal, and birth and death registration records. Accuracy of reporting of Aboriginality was assessed using sensitivity, specificity, and positive and negative predictive values (PPVs and NPVs) and F score for the EDDC and APDC as baseline and four enhancement approaches using linked records: "Most recent linked record", "Ever reported as Aboriginal", and two approaches using a weight of evidence, "Enhanced Reporting of Aboriginality (ERA) algorithm" and "Multi-stage median (MSM)".ResultsThere was substantial under-reporting of Aboriginality on APDC and EDDC records (sensitivities 84 and 77% respectively) with PPVs of 95% on both data collections. Overall, specificities and NPVs were above 98%. Of people who were reported as Aboriginal on the PSP, 16% were not reported as Aboriginal on any of their linked records. Record linkage approaches generally increased sensitivity, accompanied by decrease in PPV with little change in overall F score for the APDC and an increase in F score for the EDDC. The "ERA algorithm" and "MSM" approaches provided the best overall accuracy.ConclusionsWeight of evidence approaches are preferred when record linkage is used to improve reporting of Aboriginality on administrative health data collections. However, as a substantial number of Aboriginal people are not reported as Aboriginal on any of their linked records, improvements in reporting are incomplete and should be taken into account when interpreting results of any analyses. Enhancement of reporting of Aboriginality using record linkage should not replace efforts to improve recording of Aboriginal people at the point of data collection and addressing barriers to self-identification for Aboriginal people.

Project description:ContextMany of the publicly available health quality report cards are based on administrative data. ICD-9-CM codes in administrative data are not date stamped to distinguish between medical conditions present at the time of hospital admission and complications, which occur after hospital admission. Treating complications as preexisting conditions gives poor-performing hospitals "credit" for their complications and may cause some hospitals that are delivering low-quality care to be misclassified as average- or high-performing hospitals.ObjectiveTo determine whether hospital quality assessment based on administrative data is impacted by the inclusion of condition present at admission (CPAA) modifiers in administrative data as a date stamp indicator.Design, setting, and patientsRetrospective cohort study based on 648,866 inpatient admissions between 1998 and 2000 for coronary artery bypass graft (CABG) surgery, coronary angioplasty (PTCA), carotid endarterectomy (CEA), abdominal aortic aneurysm (AAA) repair, total hip replacement (THR), acute MI (AMI), and stroke using the California State Inpatient Database which includes CPAA modifiers. Hierarchical logistic regression was used to create separate condition-specific risk adjustment models. For each study population, one model was constructed using only secondary diagnoses present at admission based on the CPAA modifier: "date stamp" model. The second model was constructed using all secondary diagnoses, ignoring the information present in the CPAA modifier: the "no date stamp model." Hospital quality was assessed separately using the "date stamp" and the "no date stamp" risk-adjustment models.ResultsForty percent of the CABG hospitals, 33 percent of the PTCA hospitals, 40 percent of the THR hospitals, and 33 percent of the AMI hospitals identified as low-performance hospitals by the "date stamp" models were not classified as low-performance hospitals by the "no date stamp" models. Fifty percent of the CABG hospitals, 33 percent of the PTCA hospitals, 50 percent of the CEA hospitals, and 36 percent of the AMI hospitals identified as low-performance hospitals by the "no date stamp" models were not identified as low-performance hospitals by the "date stamp" models. The inclusion of the CPAA modifier had a minor impact on hospital quality assessment for AAA repair, stroke, and CEA.ConclusionThis study supports the hypothesis that the use of routine administrative data without date stamp information to construct hospital quality report cards may result in the mis-identification of hospital quality outliers. However, the CPAA modifier will need to be further validated before date stamped administrative data can be used as the basis for health quality report cards.

Project description:BackgroundChildhood cancer relies heavily on inpatient hospital services to deliver tumor-directed therapy and manage toxicities. Hospitalizations have increased over the past decade, though not uniformly across childhood cancer diagnoses. Analysis of the reasons for admission of children with cancer could enhance comparison of resource use between cancers, and allow clinical practice data to be interpreted more readily. Such comparisons using nationwide data sources are difficult because of numerous subdivisions in the International Classification of Diseases Clinical Modification (ICD-9) system and inherent complexities of treatments. This study aimed to develop a systematic approach to classifying cancer-related admissions in administrative data into categories that reflected clinical practice and predicted resource use.MethodsWe developed a multistep algorithm to stratify indications for childhood cancer admissions in the Kids Inpatient Databases from 2003, 2006 and 2009 into clinically meaningful categories. This algorithm assumed that primary discharge diagnoses of cancer or cytopenia were insufficient, and relied on procedure codes and secondary diagnoses in these scenarios. Clinical Classification Software developed by the Healthcare Cost and Utilization Project was first used to sort thousands of ICD-9 codes into 5 mutually exclusive diagnosis categories and 3 mutually exclusive procedure categories, and validation was performed by comparison with the ICD-9 codes in the final admission indication. Mean cost, length of stay, and costs per day were compared between categories of indication for admission.ResultsA cohort of 202,995 cancer-related admissions was grouped into four categories of indication for admission: chemotherapy (N=77,791, 38%), to undergo a procedure (N=30,858, 15%), treatment for infection (N=30,380, 15%), or treatment for other toxicities (N=43,408, 21.4%). The positive predictive value for the algorithm was >95% for each category. Admissions for procedures had higher mean hospital costs, longer hospital stays, and higher costs per day compared with other admission reasons (p<0.001).ConclusionsThis is the first description of a method for grouping indications for childhood cancer admission within an administrative dataset into clinically relevant categories. This algorithm provides a framework for more detailed analyses of pediatric hospitalization data by cancer type.

Dataset Information

The accuracy of present-on-admission reporting in administrative data.

Objective

Data sources

Study design

Data collection

Principal findings

Conclusions

Publications

The accuracy of present-on-admission reporting in administrative data.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets