Dataset Information

Validation of the Dutch version of the Swallowing Quality-of-Life Questionnaire (DSWAL-QoL) and the adjusted DSWAL-QoL (aDSWAL-QoL) using item analysis with the Rasch model: a pilot study.

ABSTRACT:

Background

The Swallowing Quality-of-Life Questionnaire (SWAL-QoL) is considered the gold standard for assessing health-related QoL in oropharyngeal dysphagia. The Dutch translation (DSWAL-QoL) and its adjusted version (aDSWAL-QoL) have been validated using classical test theory (CTT). However, these scales have not been tested against the Rasch measurement model, which is required to establish the structural validity and objectivity of the total scale and subscale scores. Thus, the purpose of this study was to examine the psychometric properties of these scales using item analysis according to the Rasch model.

Methods

Item analysis with the Rasch model was performed using RUMM2030 software with previously collected data from a validation study of 108 patients. The assessment included evaluations of overall model fit, reliability, unidimensionality, threshold ordering, individual item and person fits, differential item functioning (DIF), local item dependency (LID) and targeting.

Results

The analysis could not establish the psychometric properties of either of the scales or their subscales because they did not fit the Rasch model, and multidimensionality, disordered thresholds, DIF, and/or LID were found. The reliability and power of fit were high for the total scales (PSI = 0.93) but low for most of the subscales (PSI < 0.70). The targeting of persons and items was suboptimal. The main source of misfit was disordered thresholds for both the total scales and subscales. Based on the results of the analysis, adjustments to improve the scales were implemented as follows: disordered thresholds were rescaled, misfit items were removed and items were split for DIF. However, the multidimensionality and LID could not be resolved. The reliability and power of fit remained low for most of the subscales.

Conclusions

This study represents the first analyses of the DSWAL-QoL and aDSWAL-QoL with the Rasch model. Relying on the DSWAL-QoL and aDSWAL-QoL total and subscale scores to make conclusions regarding dysphagia-related HRQoL should be treated with caution before the structural validity and objectivity of both scales have been established. A larger and well-targeted sample is recommended to derive definitive conclusions about the items and scales. Solutions for the psychometric weaknesses suggested by the model and practical implications are discussed.

SUBMITTER: Simpelaere IS

PROVIDER: S-EPMC5383953 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:INTRODUCTION:Oropharyngeal dysphagia (OD) is a disorder that can have devastating and long lasting effects on a person's medical, mental and psychosocial well-being, thus negatively impacting quality of life. There is currently no validated dysphagia-specific quality of life instrument in Norway. This project aims to evaluate the psychometric properties of the culturally adapted Norwegian version of SWAL-QOL (Nor-SWAL-QOL). METHODS:The original SWAL-QOL was translated into Norwegian according the international translation guidelines. A group of 102 persons with OD and a group of 123 healthy controls were recruited to assess the validity and reliability of the Nor-SWAL-QOL. Correlation analysis of the Nor-SWAL-QOL and the Short Form 36 (SF-36) and correlation analysis of OD group and control group Nor-SWAL-QOL subscale scores were computed to determine convergent, discriminant, and known-groups validity which help comprise construct validity. Internal consistency, test-retest reliability and intraclass correlation coefficient (ICC) were computed for reliability. RESULTS:Convergent and discriminant validity was demonstrated between Nor-SWAL-QOL subscales and SF-36 domains, and distinguished between persons with and those without oropharyngeal dysphagia on all subscales and on the symptom frequency battery (p < 0.001). Additionally, the Nor-SWAL-QOL differentiated between symptom severity levels within the OD group; those requiring food and liquid modifications and those who are tube fed and not tube fed. Nor-SWAL-QOL showed good reliability with adequate internal consistency (Cronbach's α ≥0.70), test-retest reliability (Spearman's rho values 0.68-0.90) and ICC values (0.67-0.89) for all subscales and for the symptom frequency battery. CONCLUSION:Access to valid and reliable dysphagia-specific QoL outcome measures for health care practitioners, dysphagia clinicians and researchers is necessary for comprehensive assessment and treatment outcome measures. The Nor-SWAL-QOL exhibits sufficient psychometric properties for implementation in the Norwegian population.

Project description:The Boston Carpal Tunnel Questionnaire (BCTQ) is a scale that has been developed specifically for carpal tunnel syndrome (CTS). It consists of the Functional Status Scale (FSS) and the Symptom Severity Scale (SSS). It is the most widely used patient reported outcome measure in CTS and has been validated in many languages. Although already widely used, psychometric properties of the Dutch version of the BCTQ are yet unknown. The aim of this study was to assess the validity, reliability, responsiveness, and acceptability of the Dutch version. Moreover, this paper focuses the longitudinal validity (the use after an intervention) of the BCTQ, which has not been investigated before. A total of 180 patients completed the BCTQ in addition to a six-point Likert scale for perceived improvement, before and about 6-8 months after carpal tunnel release (CTR). Principal factor analysis revealed that the FSS is unidimensional, consisting of a single latent factor ("functionality") and has a high internal consistency (Cronbach's α = 0.825). However, the SSS has three dimensions, which are all highly internally consistent: "daytime symptoms" (Cronbach's α = 0.805), "nighttime symptoms" (Cronbach's α = 0.835), and "operational capacity" (Cronbach's α = 0.723). Post-treatment, the FSS still consisted of one factor, but the SSS changed in dimensionality, as it had only two factors left post-treatment. The ΔFSS and ΔSSS had good correlation with the six-point Likert scale for perceived improvement (r = 0.524; p < 0.01 and r = 0.574; p < 0.01, respectively), a moderate correlation between FSS and pinch grip (r = 0.259; p < 0.01) was found, and a weak correlation between SSS and pinch grip (r = 0.231; p < 0.01) was found. Standard Response Mean for FSS and SSS was 0.76 and 1.49, respectively. Effect size was 0.92 and 1.96, respectively, both indicating a good responsiveness. Response rate was high (82-84%). We concluded that the Dutch version of the BCTQ has a proper reliability, validity, responsiveness, and acceptability to assess the symptom severity and functional disabilities of CTS patients. Because of multidimensionality, we would recommend to create sum scores of the four different dimensions instead of two. Caution is required when interpreting the results postoperatively, due to the insufficient longitudinal validity of the SSS.

Project description:ObjectiveUterine fibroids can cause a variety of symptoms in women, from heavy menstrual bleeding and dysmenorrhea to bulk symptoms. The Uterine Fibroid Symptom and health-related Quality Of Life questionnaire (UFS-QOL) is a patient-reported outcome measure developed for assessing fibroid-related symptoms in a standardised way. Our aim was to translate and validate the UFS-QOL in Dutch.DesignValidation study.SettingPatients were recruited by a gynaecologist at the outpatient clinic.ParticipantsWomen with uterine fibroids.MethodsThe UFS-QOL was translated into Dutch (UFS-QOL NL) and validated through testing construct validity (comprising of structural validity and hypotheses testing), reliability, responsiveness and interpretability, assessing floor and ceiling effects and minimal important change. An option to answer 'not applicable' was added to the translated questionnaire.Results191 women with uterine fibroids completed the UFS-QOL NL at baseline, after 2 weeks and after 3 months. The questionnaire retained the same factor structure after translation (Comparative Fit Index 0.94-0.95; Tucker-Lewis fit Index 0.93-0.95; Root Mean Square Error of Approximation 0.10-0.11) and correlations to other questionnaires (RAND 36, Hospital Anxiety and Depression Scale and Golombok Rust Inventory of Sexual Satisfaction) were generally moderate, as hypothesised (Pearson's r 0.3-0.7). We found a sufficient reliability with intraclass correlation coefficients of approximately 0.8-0.9 for all subscales. Responsiveness was sufficient when testing hypotheses comparing women who had surgery with those who did not. Cronbach's alpha was higher than 0.7 for all subscales, indicating sufficient internal consistency and there were no concerns about floor or ceiling effects. Minimal important change could not be calculated due to low correlation between the different subscales and the anchor question.ConclusionsThe results support the measurement properties of the Dutch UFS-QOL for assessing fibroid-related symptoms and health-related quality of life in Dutch women with uterine fibroids.

Project description:BACKGROUND:Person-centred care is the bedrock of modern dementia services, yet the evidence-base to support its implementation is not firmly established. Research is hindered by a need for more robust measurement instruments. The 14-item Person-Centred Climate Questionnaire - Staff version (PCQ-S) is one of the most established scales and has promising measurement properties. However, its construction under classical test theory methods leaves question marks over its rigour and the need for evaluation under more modern testing procedures. METHODS:The PCQ-S was self-completed by nurses and other care staff working across nursing homes in 35 Swedish municipalities in 2013/14. A Rasch analysis was undertaken in RUMM2030 using a partial credit model suited to the Likert-type items. Three subscales of the PCQ-S were evaluated against common thresholds for overall fit to the Rasch model; ordering of category thresholds; unidimensionality; local dependency; targeting; and Differential Item Functioning. Three subscales were evaluated separately as unidimensional models and then combined as subtests into a single measure. Due to large number of respondents (n?=?4381), two random sub-samples were drawn, with a satisfactory model established in the first ('evaluation') and confirmed in the second ('validation'). Final item locations and a table converting raw scores to Rasch-transformed values were created using the full sample. RESULTS:All three subscales had disordered thresholds for some items, which were resolved by collapsing categories. The three subscales fit the assumptions of the Rasch model after the removal of two items, except for subscale 3, where there was evidence of local dependence between two items. By forming subtests, the 3 subscales were combined into a single Rasch model which had satisfactory fit statistics. The Rasch form of the instrument (PCQ-S-R) had an adequate but modest Person Separation Index (<?0.80) and some evidence of mistargeting due to a low number of 'difficult-to-endorse' items. CONCLUSIONS:The PCQ-S-R has 12 items and can be used as a unidimensional scale with interval level properties, using the nomogram presented within this paper. The scale is reliable but has some inefficiencies due to too few high-end thresholds inhibiting discrimination amongst populations who already perceive that person-centred care is very good in their environment.