Dataset Information

Reliability and Validity of the Chinese Version Appropriateness Evaluation Protocol.

ABSTRACT:

Objective

To adapt the Appropriateness Evaluation Protocol (AEP) to the specific settings of health care in China and to validate the Chinese version AEP (C-AEP).

Methods

Forward and backward translations were carried out to the original criteria. Twenty experts participated in the consultancy to form a preliminary version of the C-AEP. To ensure applicability, tests of reliability and validity were performed on 350 admissions and 3,226 hospital days of acute myocardial infraction patients and total hip replacement patients in two tertiary hospitals by two C-AEP reviewers and two physician reviewers. Overall agreement, specific agreement, and Cohen's Kappa were calculated to compare the concordance of decisions between pairs of reviewers to test inter-rater reliability and convergent validity. The use of "overrides" and opinions of experts were recorded as measurements of content validity. Face validity was tested through collecting perspectives of nonprofessionals. Sensitivity, specificity, and predictive values were also reported.

Results

There are 14 admission and 24 days of care criteria in the initial version of C-AEP. Kappa coefficients indicate substantial agreement between reviewers: with regard to inter-rater reliability, Kappa (?) coefficients are 0.746 (95% confidence interval [CI] 0.644-0.834) and 0.743 (95% CI 0.698-0.767) of admission and hospital days, respectively; for convergent validity, the ? statistics are 0.678 (95% CI 0.567-0.778) and 0.691 (95% CI 0.644-0.717), respectively. Overrides account for less than 2% of all judgments. Content validity and face validity were confirmed by experts and nonprofessionals, respectively. According to the C-AEP reviewers, 18.3% of admissions and 28.5% of inpatient days were deemed inappropriate.

Conclusions

The C-AEP is a reliable and valid screening tool in China's tertiary hospitals. The prevalence of inappropriateness is substantial in our research. To reduce inappropriate utilization, further investigation is needed to elucidate the reasons and risk factors for this inappropriateness.

SUBMITTER: Liu W

PROVIDER: S-EPMC4549286 | biostudies-literature | 2015

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reliability and Validity of the Chinese Version Appropriateness Evaluation Protocol.

Liu Wenwei W Yuan Suwei S Wei Fengqing F Yang Jing J Zhang Zhe Z Zhu Changbin C Ma Jin J

PloS one 20150825 8

<h4>Objective</h4>To adapt the Appropriateness Evaluation Protocol (AEP) to the specific settings of health care in China and to validate the Chinese version AEP (C-AEP).<h4>Methods</h4>Forward and backward translations were carried out to the original criteria. Twenty experts participated in the consultancy to form a preliminary version of the C-AEP. To ensure applicability, tests of reliability and validity were performed on 350 admissions and 3,226 hospital days of acute myocardial infraction ...[more]

PMID: 26305363

Similar Datasets

Project description:STUDY DESIGN:Cross-cultural adaptation and psychometric evaluation. OBJECTIVE:The aim of this study was to translate the Neck Disability Index (NDI) into the simplified-Chinese language and to evaluate the reliability, validity, and responsiveness of the new questionnaire. SUMMARY OF BACKGROUND DATA:Neck pain is a major health problem resulting in major disability. NDI is the most frequently used scale for self-rating of disability due to neck pain. At present, there is no simplified-Chinese version of the NDI. The aims of this study were to culturally adapt and translate the NDI into the simplified-Chinese language (NDI-SC) and to evaluate its psychometric properties in patients with neck pain. METHODS:The NDI was translated into simplified-Chinese version based on established guidelines. A total of 70 patients participated in this study. Patients were asked to complete a set of questionnaires comprising of their demographic information, the NDI-SC, and a visual analog scale (VAS) of pain. Fifty-six patients returned after 1 to 2 weeks to complete the same set of questionnaires and the global rating of change (GROC) scale. Then, the NDI-SC was evaluated for content validity, construct validity, internal consistency, test-retest reliability, and responsiveness. RESULTS:The NDI-SC demonstrated excellent internal consistency (Cronbach ??=?0.92) and good test-retest reliability (ICC2,1?=?0.85). Content validity was confirmed as no floor or ceiling effects were detected for the NDI-SC total score. Construct validity was established with factor analysis revealing two-factor subscales explaining 66% of the variance. The NDI-SC showed a strong correlation with VAS (Rp?=?0.61, P?<?0.001) and a moderate correlation with GROC (Rs?=?0.46, P?<?0.001). The correlation between NDI-SC change scores and VAS change scores was also moderate (Rp?=?0.59, P?<?0.001). CONCLUSION:The results showed that the NDI-SC is a reliable, valid, and responsive instrument to measure functional limitations in patients with neck pain. LEVEL OF EVIDENCE:3.

Project description:Fatigue is a common symptom in the general population and has a substantial effect on individuals' quality of life. The Multidimensional Fatigue Inventory (MFI) has been widely used to quantify the impact of fatigue, but no Traditional Chinese translation has yet been validated. The goal of this study was to translate the MFI from English into Traditional Chinese ('the MFI-TC') and subsequently to examine its validity and reliability.The study recruited a convenience sample of 123 people from various age groups in Taiwan. The MFI was examined using a two-step process: (1) translation and back-translation of the instrument; and (2) examination of construct validity, convergent validity, internal consistency, test-retest reliability, and measurement error. The validity and reliability of the MFI-TC were assessed by factor analysis, Spearman rho correlation coefficient, Cronbach's alpha coefficient, intraclass correlation coefficient (ICC), minimal detectable change (MDC), and Bland-Altman analysis. All participants completed the Short-Form-36 Health Survey Taiwan Form (SF-36-T) and the Chinese version of the Pittsburgh Sleep Quality Index (PSQI) concurrently to test the convergent validity of the MFI-TC. Test-retest reliability was assessed by readministration of the MFI-TC after a 1-week interval.Factor analysis confirmed the four dimensions of fatigue: general/physical fatigue, reduced activity, reduced motivation, and mental fatigue. A four-factor model was extracted, combining general fatigue and physical fatigue as one factor. The results demonstrated moderate convergent validity when correlating fatigue (MFI-TC) with quality of life (SF-36-T) and sleep disturbances (PSQI) (Spearman's rho = 0.68 and 0.47, respectively). Cronbach's alpha for the MFI-TC total scale and subscales ranged from 0.73 (mental fatigue subscale) to 0.92 (MFI-TC total scale). ICCs ranged from 0.85 (reduced motivation) to 0.94 (MFI-TC total scale), and the MDC ranged from 2.33 points (mental fatigue) to 9.5 points (MFI-TC total scale). The Bland-Altman analyses showed no significant systematic bias between the repeated assessments.The results support the use of the Traditional Chinese version of the MFI as a comprehensive instrument for measuring specific aspects of fatigue. Clinicians and researchers should consider interpreting general fatigue and physical fatigue as one subscale when measuring fatigue in Traditional Chinese-speaking populations.

Dataset Information

Reliability and Validity of the Chinese Version Appropriateness Evaluation Protocol.

Objective

Methods

Results

Conclusions

Publications

Reliability and Validity of the Chinese Version Appropriateness Evaluation Protocol.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets