Dataset Information

Validity and reliability of patient reported outcomes measurement information system computerized adaptive tests in systemic lupus erythematous.

ABSTRACT:

Background

The evaluation of Patient Reported Outcomes Measurement Information System (PROMIS) computerized adaptive test (CAT) in adults with systemic lupus erythematous (SLE) is an emerging field of research. We aimed to examine the test-retest reliability and construct validity of the PROMIS CAT in a Canadian cohort of patients with SLE.

Methods

Two hundred twenty-seven patients completed 14 domains of PROMIS CAT and seven legacy instruments during their clinical visits. Test-retest reliability of PROMIS was evaluated 7-10 days from baseline using intraclass correlation coefficient (ICC (2; 1)). The construct validity of the PROMIS CAT domains was evaluated against the commonly used legacy instruments, and also in comparison to disease activity and disease damage using Spearman correlations. A multitrait-multimethod matrix (MMM) approach was used to further assess construct validity comparing selected 10 domains of PROMIS and SF-36 domains.

Results

Moderate to excellent reliability was found for all domains (ICC [2;1] ranging from lowest, 0.66 for Sleep Disturbance and highest, 0.93 for the Mobility domain). Comparing seven legacy instruments with 14 domains of PROMIS CAT, moderate to strong correlations (0.51-0.91) were identified. The average time to complete all PROMIS CAT domains was 11.7 min. The MMM further established construct validity by showing moderate to strong correlations (0.55-0.87) between select PROMIS and SF-36 domains; the average correlations from similar traits (convergent validity) were significantly greater than the average correlations from different traits.

Conclusions

These results provide evidence on the reliability and validity of PROMIS CAT in SLE in a Canadian cohort.

SUBMITTER: Moazzami M

PROVIDER: S-EPMC8649426 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:UK Biobank is a health resource with data from over 500,000 adults. The cognitive assessment in UK Biobank is brief and bespoke, and is administered without supervision on a touchscreen computer. Psychometric information on the UK Biobank cognitive tests are limited. Despite the non-standard nature of these tests and the limited psychometric information, the UK Biobank cognitive data have been used in numerous scientific publications. The present study examined the validity and short-term test-retest reliability of the UK Biobank cognitive tests. A sample of 160 participants (mean age = 62.59, SD = 10.24) was recruited who completed the UK Biobank cognitive assessment and a range of well-validated cognitive tests ('reference tests'). Fifty-two participants returned 4 weeks later to repeat the UK Biobank tests. Correlations were calculated between UK Biobank tests and reference tests. Two measures of general cognitive ability were created by entering scores on the UK Biobank cognitive tests, and scores on the reference tests, respectively, into separate principal component analyses and saving scores on the first principal component. Four-week test-retest correlations were calculated for UK Biobank tests. UK Biobank cognitive tests showed a range of correlations with their respective reference tests, i.e. those tests that are thought to assess the same underlying cognitive ability (mean Pearson r = 0.53, range = 0.22 to 0.83, p?.005). The measure of general cognitive ability based on the UK Biobank cognitive tests correlated at r = 0.83 (p < .001) with a measure of general cognitive ability created using the reference tests. Four-week test-retest reliability of the UK Biobank tests were moderate-to-high (mean Pearson r = 0.55, range = 0.40 to 0.89, p?.003). Despite the brief, non-standard nature of the UK Biobank cognitive tests, some tests showed substantial concurrent validity and test-retest reliability. These psychometric results provide currently-lacking information on the validity of the UK Biobank cognitive tests.

Project description:PurposeTo determine the change in Patient-Reported Outcomes Measurement Information System Computerized Adaptive Testing (PROMIS CAT) scores for physical function, pain interference, and depression that constitute minimum clinically important difference (MCID) using an anchor-based technique and to identify pre-operative clinical thresholds in anchor-based MCID that predict likelihood of achieving MCID following anterior cruciate ligament (ACL) reconstruction.MethodsAdult patients aged 18 years or older undergoing ACL reconstruction that completed both preoperative and postoperative PROMIS CAT assessments and an anchor-based questionnaire were identified over a 23-month period. Anchor-based MCID was determined for PROMIS CAT forms for physical function (PROMIS PF CAT), pain interference (PROMIS PI CAT), and depression (PROMIS D CAT).ResultsA total of 137 patients were included for statistical analysis, with pre-operative PROMIS CAT forms completed 27.9 ± 31.2 days before surgery and 492.5 ± 219.9 days postoperatively on average. Statistically significant improvements were observed for all PROMIS CAT domains. PROMIS PF CAT improved from 39.5 ± 8.2 to 55.0 ± 9.7 (P < .0005), PROMIS PI CAT from 59.8 ± 7.2 to 48.2 ± 8.3 (P < .0005), and PROMIS D CAT from 47.9 ± 8.8 to 41.5 ± 8.6 (P < .0005). Anchor-based MCID for each PROMIS CAT form was calculated to be +4.5, -5.4, and -4.1 for PROMIS PF CAT, PROMIS PI CAT, and PROMIS D CAT, respectively. Mean difference between preoperative and postoperative PROMIS CAT scores exceeded MCID for all domains. The percentage of patients achieving MCID for PROMIS PF CAT, PROMIS PI CAT, and PROMIS D CAT was 85%, 72%, and 55%, respectively. After introduction of 95% specificity cutoffs, the percentage of patients achieving MCID for PROMIS PF CAT, PROMIS PI CAT, and PROMIS D CAT increased to 100% (<35.6 cutoff score), 92% (>65.7 cutoff score), and 83% (>57.5 cutoff score), respectively.ConclusionsAccording to anchor-based analysis of PROMIS CAT MCID, ACL reconstruction is effective in improving physical function, pain interference, and depression symptoms. In addition, preoperative PROMIS CAT scores can predict the likelihood of achieving MCID postoperatively.Level of evidenceLevel IV, prognostic case series.