Dataset Information

Validity of AHRQ patient safety indicators derived from ICD-10 hospital discharge abstract data (chart review study).

ABSTRACT:

Objective

To assess if the Agency for Healthcare Research and Quality patient safety indictors (PSIs) could be used for case findings in the International Classification of Disease 10th revision (ICD-10) hospital discharge abstract data.

Design

We identified and randomly selected 490 patients with a foreign body left during a procedure (PSI 5-foreign body), selected infections (IV site) due to medical care (PSI 7-infection), postoperative pulmonary embolism (PE) or deep vein thrombosis (DVT; PSI 12-PE/DVT), postoperative sepsis (PSI 13-sepsis)and accidental puncture or laceration (PSI 15-laceration) among patients discharged from three adult acute care hospitals in Calgary, Canada in 2007 and 2008. Their charts were reviewed for determining the presence of PSIs and used as the reference standard, positive predictive value (PPV) statistics were calculated to determine the proportion of positives in the administrative data representing 'true positives'.

Results

The PPV for PSI 5-foreign body was 62.5% (95% CI 35.4% to 84.8%), PSI 7-infection was 79.1% (67.4% to 88.1%), PSI 12-PE/DVT was 89.5% (66.9% to 98.7%), PSI 13-sepsis was 12.5% (1.6% to 38.4%) and PSI 15-laceration was 86.4% (75.0% to 94.0%) after excluding those who presented to the hospital with the condition.

Conclusions

Several PSIs had high PPV in the ICD administrative data and are thus powerful tools for true positive case finding. The tools could be used to identify potential cases from the large volume of admissions for verification through chart reviews. In contrast, their sensitivity has not been well characterised and users of PSIs should be cautious if using them for 'quality of care reporting' presenting the rate of PSIs because under-coded data would generate falsely low PSI rates.

SUBMITTER: Quan H

PROVIDER: S-EPMC3796280 | biostudies-literature | 2013 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Validity of AHRQ patient safety indicators derived from ICD-10 hospital discharge abstract data (chart review study).

Quan Hude H Eastwood Cathy C Cunningham Ceara Tess CT Liu Mingfu M Flemons Ward W De Coster Carolyn C Ghali William A WA

BMJ open 20131010 10

<h4>Objective</h4>To assess if the Agency for Healthcare Research and Quality patient safety indictors (PSIs) could be used for case findings in the International Classification of Disease 10th revision (ICD-10) hospital discharge abstract data.<h4>Design</h4>We identified and randomly selected 490 patients with a foreign body left during a procedure (PSI 5-foreign body), selected infections (IV site) due to medical care (PSI 7-infection), postoperative pulmonary embolism (PE) or deep vein thro ...[more]

PMID: 24114372

Similar Datasets

Project description:BACKGROUND: Administrative data are widely used to study health systems and make important health policy decisions. Yet little is known about the influence of coder characteristics on administrative data validity in these studies. Our goal was to describe the relationship between several measures of validity in coded hospital discharge data and 1) coders' volume of coding (> or = 13,000 vs. <13,000 records), 2) coders' employment status (full- vs. part-time), and 3) hospital type. METHODS: This descriptive study examined 6 indicators of face validity in ICD-10 coded discharge records from 4 hospitals in Calgary, Canada between April 2002 and March 2007. Specifically, mean number of coded diagnoses, procedures, complications, Z-codes, and codes ending in 8 or 9 were compared by coding volume and employment status, as well as hospital type. The mean number of diagnoses was also compared across coder characteristics for 6 major conditions of varying complexity. Next, kappa statistics were computed to assess agreement between discharge data and linked chart data reabstracted by nursing chart reviewers. Kappas were compared across coder characteristics. RESULTS: 422,618 discharge records were coded by 59 coders during the study period. The mean number of diagnoses per record decreased from 5.2 in 2002/2003 to 3.9 in 2006/2007, while the number of records coded annually increased from 69,613 to 102,842. Coders at the tertiary hospital coded the most diagnoses (5.0 compared with 3.9 and 3.8 at other sites). There was no variation by coder or site characteristics for any other face validity indicator. The mean number of diagnoses increased from 1.5 to 7.9 with increasing complexity of the major diagnosis, but did not vary with coder characteristics. Agreement (kappa) between coded data and chart review did not show any consistent pattern with respect to coder characteristics. CONCLUSIONS: This large study suggests that coder characteristics do not influence the validity of hospital discharge data. Other jurisdictions might benefit from implementing similar employment programs to ours, e.g.: a requirement for a 2-year college training program, a single management structure across sites, and rotation of coders between sites. Limitations include few coder characteristics available for study due to privacy concerns.

Project description:BackgroundThe Agency for Healthcare Research and Quality (AHRQ) Hospital Survey on Patient Safety Culture was designed to assess staff views on patient safety culture in hospital settings. The purpose of this study was to examine the multilevel psychometric properties of the survey.MethodsSurvey data from 331 U.S. hospitals with 2,267 hospital units and 50,513 respondents were analyzed to examine the psychometric properties of the survey's items and composites. Item factor loadings, intraclass correlations (ICCs), design effects, internal consistency reliabilities, and multilevel confirmatory factor analyses (MCFA) were examined as well as intercorrelations among the survey's composites.ResultsPsychometric analyses confirmed the multilevel nature of the data at the individual, unit and hospital levels of analysis. Results provided overall evidence supporting the 12 dimensions and 42 items included in the AHRQ Hospital Survey on Patient Safety Culture as having acceptable psychometric properties at all levels of analysis, with a few exceptions. The Staffing composite fell slightly below cutoffs in a number of areas, but is conceptually important given its impact on patient safety. In addition, one hospital-level model fit indicator for the Supervisor/Manager Expectations & Actions Promoting Patient Safety composite was low (CFI = .82), but all other psychometrics for this scale were good. Average dimension intercorrelations were moderate at .42 at the individual level, .50 at the unit level, and .56 at the hospital level.ConclusionsPsychometric analyses conducted on a very large database of hospitals provided overall support for the patient safety culture dimensions and items included in the AHRQ Hospital Survey on Patient Safety Culture. The survey's items and dimensions overall are psychometrically sound at the individual, unit, and hospital levels of analysis and can be used by researchers and hospitals interested in assessing patient safety culture. Further research is needed to study the criterion-related validity of the survey by analysing the relationship between patient safety culture and patient outcomes and studying how to improve patient safety culture.

Project description:Human papillomavirus vaccine (HPV) impact on cervical precancer (cervical intraepithelial neoplasia grades 2+ [CIN2+]) is observable sooner than impact on cancer. Biopsy-confirmed CIN2+ is not included in most US cancer registries. Billing codes could provide surrogate metrics; however, the International Classification of Diseases, ninth (ICD-9) to tenth (ICD-10) transition disrupts trends. We built, validated, and compared claims-based models to identify CIN2+ events in both ICD eras. A database of Davidson County (Nashville), Tennessee, pathology-confirmed CIN2+ from the HPV Vaccine Impact Monitoring Project (HPV-IMPACT) provided gold standard events. Using Tennessee Medicaid 2008-2017, cervical diagnostic procedures (N = 8549) among Davidson County women aged 18-39 years were randomly split into 60% training and 40% testing sets. Relevant diagnosis, procedure, and screening codes were used to build models from CIN2+ tissue diagnosis codes alone, least absolute shrinkage and selection operator (LASSO), and random forest. Model-classified index events were counted to estimate incident events. HPV-IMPACT identified 983 incident CIN2+ events. Models identified 1007 (LASSO), 1245 (CIN2+ tissue diagnosis codes alone), and 957 (random forest) incident events. LASSO performed well in ICD-9 and ICD-10 eras: 77.3% (95% confidence interval [CI] = 72.5% to 81.5%) vs 81.1% (95% CI = 71.5% to 88.6%) sensitivity, 93.0% (95% CI = 91.9% to 94.0%) vs 90.2% (95% CI = 87.2% to 92.7%) specificity, 61.3% (95% CI = 56.6% to 65.8%) vs 60.3% (95% CI = 51.0% to 69.1%) positive predictive value, 96.6% (95% CI = 95.8% to 97.3%) vs 96.3% (95% CI = 94.1% to 97.8%) negative predictive value, 91.0% (95% CI = 89.9% to 92.1%) vs 88.8% (95% CI = 85.9% to 91.2%) accuracy, and 85.1% (95% CI = 82.9% to 87.4%) vs 85.6% (95% CI = 81.4% to 89.9%) C-indices, respectively; performance did not statistically significantly differ between eras (95% confidence intervals all overlapped). Results confirmed model utility with good performance across both ICD eras for CIN2+ surveillance. Validated claims-based models may be used in future CIN2+ trend analyses to estimate HPV vaccine impact where population-based biopsies are unavailable.

Project description:BackgroundSurveillance using coded administrative health data has shown that the prevalence of hypertension and diabetes in Canada increased substantially between 1998 to 2008. These findings require an assumption that the validity of hypertension and diabetes coding is stable over time. We tested this assumption by examining temporal trends in the validity of coding for hypertension and diabetes in the Canadian hospital Discharge Abstract Database.MethodsWe used the Alberta Provincial Project for Outcome Assessment in Coronary Heart Disease (APPROACH) database, a clinical registry, as the reference standard to evaluate the validity of the Discharge Abstract Database in recording hypertension and diabetes in Alberta. The APPROACH database contains data for all Alberta residents who have undergone cardiac catheterization and includes prospective ascertainment of comorbid conditions before each procedure. We linked patient data between the 2 databases for 2002 to 2013 using patient provincial health number. Temporal trends in sensitivity, specificity, positive predictive value, negative predictive value and Cohen ? were calculated for both hypertension and diabetes in the Discharge Abstract Database.ResultsWe matched 63?483 patients between the APPROACH database and the Discharge Abstract Database. The validity of the Discharge Abstract Database for hypertension and diabetes remained mostly consistent over time. Between 2002 and 2013, sensitivity, specificity, positive predictive value and negative predictive value ranged from 66% to 87% for hypertension and from 81% to 98% for diabetes; the corresponding ? scores ranged from 0.50 to 0.62 and from 0.80 to 0.89. No significant differences in the validity of coding were found across age, sex or hospital location subgroups.InterpretationThe validity of coding for hypertension and diabetes in the Discharge Abstract Database remained fairly consistent between 2002 and 2013. Our findings support the use of the Discharge Abstract Database for hypertension and diabetes surveillance in hospital settings.

Project description:The Agency for Healthcare and Research Quality patient safety indicators track adverse safety events in hospitalized patients but overlook safety incidents specific to CKD. This study considers candidate CKD-pertinent patient safety indicators and compares them with the Agency for Healthcare and Research Quality patient safety indicators.Using a national Veterans Health Administration database of hospitalized veterans from fiscal year 2005, 247,160 hospitalized veterans with prehospitalization measures of renal function were retrospectively examined for proposed CKD patient safety indicators versus Agency for Healthcare and Research Quality patient safety indicators using International Classification of Diseases, Ninth Revision diagnosis codes. Candidate CKD-pertinent patient safety indicators included in-hospital acute kidney failure; in-hospital congestive heart failure (and related diagnostic codes); electrolyte disturbances; and medication errors, poisoning, and intoxication. Patients with a prehospital estimated GFR<60 ml/min per 1.73 m(2) (CKD group) were compared with a non-CKD group. For CKD patient safety indicators, hospitalizations were excluded if the admitting condition was a potential cause of the secondary condition. Regression methods were used to present adjusted rates in study groups of interest.The CKD patient safety indicators were generally more common than the Agency for Healthcare and Research Quality patient safety indicators in all groups, tended to occur in different patients than those patients who experienced Agency for Healthcare and Research Quality patient safety indicators, and were more common in the CKD group than the non-CKD group, except for hypoglycemia, hypokalemia, and hyponatremia. The adjusted composite CKD patient safety indicators rate (per 1000 patient-hospitalizations) was 398.0 (95% confidence interval, 391.2 to 405.0) for patients in the CKD group and 250.0 (95% confidence interval, 247.4 to 252.7) for patients in the non-CKD group. The prevalence ratio of CKD patient safety indicators to Agency for Healthcare and Research Quality patient safety indicators was 23.4 (95% confidence interval, 21.9 to 25.0).The candidate CKD patient safety indicators that occur in hospitalized patients are distinct from the Agency for Healthcare and Research Quality patient safety indicators and tend to be more common in CKD than non-CKD patients. These measures have the potential to serve as sentinel tools for identifying patients with CKD who warrant examination for disease-pertinent safety events.

Dataset Information

Validity of AHRQ patient safety indicators derived from ICD-10 hospital discharge abstract data (chart review study).

Objective

Design

Results

Conclusions

Publications

Validity of AHRQ patient safety indicators derived from ICD-10 hospital discharge abstract data (chart review study).

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets