Dataset Information

Validity and Reliability of the Self-administered Psycho-TherApy-SystemS (SELFPASS) Item Pool for the Daily Mood Tracking of Depressive Symptoms: Cross-sectional Web-Based Survey.

ABSTRACT:

Background

e-Mental health apps targeting depression have gained increased attention in mental health care. Daily self-assessment is an essential part of e-mental health apps. The Self-administered Psycho-TherApy-SystemS (SELFPASS) app is a self-management app to manage depressive and comorbid anxiety symptoms of patients with a depression diagnosis. A self-developed item pool with 40 depression items and 12 anxiety items is included to provide symptom-specific suggestions for interventions. However, the psychometric properties of the item pool have not yet been evaluated.

Objective

The aim of this study is to investigate the validity and reliability of the SELFPASS item pool.

Methods

A weblink with the SELFPASS item pool and validated mood assessment scales was distributed to healthy subjects and patients who had received a diagnosis of a depressive disorder within the last year. Two scores were derived from the SELFPASS item pool: SELFPASS depression (SP-D) and SELFPASS anxiety (SP-A). Reliability was examined using Cronbach α. Construct validity was assessed through Pearson correlations with the Patient Health Questionnaire-9 (PHQ-9), the General Anxiety Disorder Scale-7 (GAD-7), and the WHO-5-Wellbeing-Scale (WHO-5). Logistic regression analysis was performed as an indicator for concurrent criterion validity of SP-D and SP-A. Factor analysis was performed to provide information about the underlying factor structure of the item pool. Item-scale correlations were calculated in order to determine item quality.

Results

A total of 284 participants were included, with 192 (67.6%) healthy subjects and 92 (32.4%) patients. Cronbach α was set to .94 for SP-D and α=.88 for SP-A. We found significant positive correlations between SP-D and PHQ-9 scores (r=0.87; P<.001) and between SP-A and GAD-7 scores (r=0.80; P<.001), and negative correlations between SP-D and WHO-5 scores (r=-0.80; P<.001) and between SP-A and WHO-5 scores (r=-0.69; P<.001). Increasing scores of SP-D and SP-A led to increased odds of belonging to the patient group (SP-D: odds ratio 1.03, 95% CI 1.01-1.05; P<.001; SP-A: 1.05, 1.05-1.01; P=.01). The item pool yielded 2 factors: one that consisted of mood-related items and another with somatic-related items.

Conclusions

The SELFPASS item pool showed good psychometric properties in terms of reliability, construct, and criterion validity. The item pool is an appropriate source for daily mood tracking in future e-mental health apps among patients with depression. Our study provides general recommendations for future developments as well as recommendations within the item pool.

SUBMITTER: Mayer G

PROVIDER: S-EPMC8561414 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:To improve and support medication adherence among patients with chronic diseases, especially for long-term medication, it is important to consider both their relationship with healthcare providers and their lifestyle. We tested the reliability and validity of a modified 12-item Medication Adherence Scale.We revised a 14-item measure of medication adherence, created in 2009, to a more concise and clear 12-item version, and we verified the reliability and validity of the 12-item scale. We included 328 patients with chronic diseases participating in the Chronic Disease Self-Management Program in Japan from 2011 to 2014. Confirmatory factor analysis was used to assess whether the four factors assessed were the same as the previous 14-item Medication Adherence Scale. Cronbach's coefficient alpha was used to assess internal consistency reliability, and the relationships between patient demographic characteristics and medication adherence were compared with previous studies.The 12 items were categorized into the four factors "medication compliance", "collaboration with healthcare providers", "willingness to access and use information about medication", and "acceptance to take medication and how taking medication fits patient's lifestyle". Confirmatory factor analysis showed ?2/df?=?2.6, CFI?=?0.94, and RMSEA?=?0.069. Cronbach's alpha for the 12-item scale was 0.78. Cronbach's alpha for the four subscales was 0.74, 0.81, 0.67, and 0.45. Higher medication adherence was significantly associated with being a female patient, living with someone else, and age 40-49 years versus age 20-29 years. These relationships were the same as in previous studies.We modified our original 14-item scale to a 12-item Medication Adherence Scale for patients with chronic diseases, which considers their relationship with healthcare providers and lifestyle. Refinement might be needed because of the relatively low reliability of subscales. However, the modified scale is expected to contribute to more effective self-management of medication and to improving medication adherence, particularly among patients with chronic diseases who require long-term medication not only in Japan but also in other countries.

Project description:BackgroundValidation of self-reported tools, such as physical activity (PA) questionnaires, is crucial. The aim of this study was to determine test-retest reliability, internal consistency, and the concurrent, construct, and predictive validity of the short semi-quantitative Physical Activity Unit 7 item Screener (PAU-7S), using accelerometry as the reference measurement. The effect of linear calibration on PAU-7S validity was tested.MethodsA randomized sample of 321 healthy children aged 8-16 years (149 boys, 172 girls) from the nationwide representative PASOS study completed the PAU-7S before and after wearing an accelerometer for at least 7 consecutive days. Weight, height, and waist circumference were measured. Cronbach alpha was calculated for internal consistency. Test-retest reliability was determined by intra-class correlation (ICC). Concurrent validity was assessed by ICC and Spearman correlation coefficient between moderate to vigorous PA (MVPA) derived by the PAU-7S and by accelerometer. Concordance between both methods was analyzed by absolute agreement, weighted kappa, and Bland-Altman statistics. Multiple linear regression models were fitted for construct validity and predictive validity was determined by leave-one-out cross-validation.ResultsThe PAU-7S overestimated MVPA by 18%, compared to accelerometers (106.5 ± 77.0 vs 95.2 ± 33.2 min/day, respectively). A Cronbach alpha of 0.76 showed an acceptable internal consistency of the PAU-7S. Test-retest reliability was good (ICC 0.71 p < 0.001). Spearman correlation and ICC coefficients of MVPA derived by the PAU-7S and accelerometers increased from 0.31 to 0.62 and 0.20 to 0.62, respectively, after calibration of the PAU-7S. Between-methods concordance improved from a weighted kappa of 0.24 to 0.50 after calibration. A slight reduction in ICC, from 0.62 to 0.60, yielded good predictive validity. Multiple linear regression models showed an inverse association of MVPA with standardized body mass index (β - 0.162; p < 0.077) and waist to height ratio (β - 0.010; p < 0.014). All validity dimensions were somewhat stronger in boys compared to girls.ConclusionThe PAU-7S shows a good test-retest reliability and acceptable internal consistency. All dimensions of validity increased from poor/fair to moderate/good after calibration. The PAU-7S is a valid instrument for measuring MVPA in children and adolescents.Trial registrationTrial registration number ISRCTN34251612 .