Reliability and Construct Validity of the Patient-Reported Outcomes Measurement Information System (PROMIS) Instruments in Women with Fibromyalgia.
Ontology highlight
ABSTRACT:
SUBMITTER: Merriwether EN
PROVIDER: S-EPMC6279305 | biostudies-literature | 2017 Aug
REPOSITORIES: biostudies-literature
Publications
Reliability and Construct Validity of the Patient-Reported Outcomes Measurement Information System (PROMIS) Instruments in Women with Fibromyalgia.
Merriwether Ericka N EN Rakel Barbara A BA Zimmerman Miriam B MB Dailey Dana L DL Vance Carol G T CGT Darghosian Leon L Golchha Meenakshi M Geasland Katherine M KM Chimenti Ruth R Crofford Leslie J LJ Sluka Kathleen A KA
Pain medicine (Malden, Mass.) 20170801 8
<h4>Objective</h4>The Patient-Reported Outcomes Measurement Information System (PROMIS) was developed to standardize measurement of clinically relevant patient-reported outcomes. This study evaluated the reliability and construct validity of select PROMIS static short-form (SF) instruments in women with fibromyalgia.<h4>Design</h4>Analysis of baseline data from the Fibromyalgia Activity Study with TENS (FAST), a randomized controlled trial of the efficacy of transcutaneous electrical nerve stimu ...[more]
Similar Datasets
Project description:The psychometric properties of Patient Reported Outcomes Measurement Information System (PROMIS) instruments have been explored in a number of general and clinical samples. No study, however, has evaluated the psychometric function of these measures in individuals with symptomatic knee osteoarthritis (KOA). The aim of this project was to evaluate the construct (structural) validity and floor/ceiling effects of four PROMIS measures in this population.We conducted a secondary analysis of baseline data from a randomized trial comparing Tai Chi and physical therapy. Participants completed four PROMIS static short-form instruments (i.e., Anxiety, Depression, Physical Function, and Pain Interference) as well as six well-validated (legacy) measures that assess pain, function, and psychological health. We calculated descriptive statistics and percentages of participants scoring the minimum (floor) and maximum (ceiling) possible scores for PROMIS and legacy measures. We also estimated the association between PROMIS scores and scores on legacy measures using Spearman's rank correlations coefficients.Data from 204 participants were analyzed. Mean age of the sample was 60 years; 70% were female. The PROMIS Anxiety and Depression had floor effects with 17 and 24% of participants scoring the minimum, respectively. PROMIS Anxiety and Depression scores had strongest associations with general mental health, including stress (Perceived Stress Scale, r???0.65) and depression (Beck Depression Index-II, r?=?0.70). PROMIS Pain Interference scores correlated most strongly with measures of whole body pain (Short-Form 36 Bodily Pain, r?=?-0.73) and physical health (Short-Form 36 Physical-Component Summary, r?=?-0.73); their correlations were lower with other legacy measures, including with the WOMAC knee-specific pain (r?=?0.47). PROMIS Physical Function scores had stronger associations with scores on the Short-Form 36 Physical Function (r?=?0.79) than with scores on other legacy measures.The four PROMIS static-short forms performed well among individuals with symptomatic knee osteoarthritis as evidenced in correlations with legacy measures. PROMIS Anxiety and Depression target general mental health (e.g., stress, depression), and PROMIS Pain Interference and Physical Function static-short forms target whole-body outcomes among participants with symptomatic knee osteoarthritis. Floor effects in the PROMIS Anxiety and Depression scores should be considered if needing to distinguish among patients with very low levels of these outcomes.Clinicaltrials.gov NCT01258985. Registered 10 December 2010.
| S-EPMC4570513 | biostudies-literature
Project description:BackgroundLimitations in physical functioning are a big concern especially for patients with chronic or musculoskeletal diseases. Therefore, physical functioning is often used as a core outcome of treatments. The generic patient-reported outcomes information system (PROMIS) physical function (PF) item bank has shown potential to measure PF with better precision, interpretability and lower respondent burden compared with traditional patient-reported outcome measures. This study provides an overview of the current evidence on the quality of the measurement properties of the translated Dutch-Flemish PROMIS-PF item bank and its subdomains, and their derived short forms and computer adaptive tests (CATs).MethodsPubMed was searched up to June 17th 2020 for validation studies of Dutch-Flemish PROMIS-PF in Dutch and Flemish adults. Quality assessment of the included studies was conducted using the COSMIN Risk of bias checklist. The COSMIN criteria for good measurement properties were used to judge the results of the studies, which were adjusted and added to where needed for this review, in the context of IRT instruments and item banks. The quality of evidence was summarized for each measurement property based on the Grading of Recommendation Assessment, Development, and Evaluation (GRADE) approach.ResultsEleven studies were included, evaluating the PROMIS-PF item bank, the Upper Extremity (UE) subdomain, and/or their derived short forms and CATs in different clinical populations. There is evidence for sufficient structural validity, measurement precision, construct validity, and cross-cultural validity of the Dutch-Flemish PROMIS-PF item bank. The upper extremity subdomain item bank shows high quality evidence for structural validity and measurement precision. Content validity of these item banks has not been thoroughly demonstrated in a Dutch-Flemish population. Furthermore, the derived instruments have far less robust evidence: there are fewer validation studies available and none examined their performance as stand-alone administered instruments.ConclusionsThe first studies into the Dutch-Flemish PROMIS-PF item bank and the UE subdomain show promising results, with especially high quality evidence for sufficient structural validity and measurement precision. However, more studies, and with higher methodological quality, are needed to study the instruments derived from these item banks. These studies should also evaluate content validity, reliability and responsiveness.
| S-EPMC7905571 | biostudies-literature
Project description:BackgroundThe evaluation of Patient Reported Outcomes Measurement Information System (PROMIS) computerized adaptive test (CAT) in adults with systemic lupus erythematous (SLE) is an emerging field of research. We aimed to examine the test-retest reliability and construct validity of the PROMIS CAT in a Canadian cohort of patients with SLE.MethodsTwo hundred twenty-seven patients completed 14 domains of PROMIS CAT and seven legacy instruments during their clinical visits. Test-retest reliability of PROMIS was evaluated 7-10 days from baseline using intraclass correlation coefficient (ICC (2; 1)). The construct validity of the PROMIS CAT domains was evaluated against the commonly used legacy instruments, and also in comparison to disease activity and disease damage using Spearman correlations. A multitrait-multimethod matrix (MMM) approach was used to further assess construct validity comparing selected 10 domains of PROMIS and SF-36 domains.ResultsModerate to excellent reliability was found for all domains (ICC [2;1] ranging from lowest, 0.66 for Sleep Disturbance and highest, 0.93 for the Mobility domain). Comparing seven legacy instruments with 14 domains of PROMIS CAT, moderate to strong correlations (0.51-0.91) were identified. The average time to complete all PROMIS CAT domains was 11.7 min. The MMM further established construct validity by showing moderate to strong correlations (0.55-0.87) between select PROMIS and SF-36 domains; the average correlations from similar traits (convergent validity) were significantly greater than the average correlations from different traits.ConclusionsThese results provide evidence on the reliability and validity of PROMIS CAT in SLE in a Canadian cohort.
| S-EPMC8649426 | biostudies-literature
Project description:To evaluate the reliability and construct validity of measures from the Patient-Reported Outcomes Measurement Information System(®) (PROMIS(®)) for patients with heart failure before and after heart transplantation.We assessed reliability of the PROMIS short forms using Cronbach's alpha and the average marginal reliability. To assess the construct validity of PROMIS computerized adaptive tests and short-form measures, we calculated Pearson product moment correlations between PROMIS measures of physical function, fatigue, depression, and social function and existing PRO measures of similar domains (i.e., convergent validity) as well as different domains (i.e., discriminate validity) in patients with heart failure awaiting heart transplant. We evaluated the responsiveness of these measures to change after heart transplant using effect sizes.Forty-eight patients were included in the analyses. Across the many domains examined, correlations between conceptually similar domains were larger than correlations between different domains of health, demonstrating construct validity. Health status improved substantially after heart transplant (standardized effect sizes, 0.63-1.24), demonstrating the responsiveness of the PROMIS measures. Scores from the computerized adaptive tests and the short forms were similar.This study provides evidence for the reliability and construct validity (including responsiveness to change) of four PROMIS domains in patients with heart failure before and after heart transplant. PROMIS measures are a reasonable choice in this context and will facilitate comparisons across studies and health conditions.
| S-EPMC4593724 | biostudies-literature
Project description:PurposeTo examine known-groups validity of the Patient-Reported Outcomes Measurement Information System (PROMIS(®)) Short Forms (SFs) for adolescents and young adults with special healthcare needs (SHCN) using data collected from the PROMIS Linking Study.MethodsIn total, 292 adolescents aged 14-17.9 years and 300 young adults aged 18-20 years with SHCN from the PROMIS Linking Study were used for analyses. Presence of SHCN was classified into three categories (medication use, service use, and functional limitations). HRQoL was measured with the PROMIS Pediatric and Adult SFs. Differences in health-related quality of life (HRQoL) domain scores between SHCN sample and the norms of the PROMIS pediatric and adult calibration samples, respectively, were compared using t tests. Associations of HRQoL scores with the presence of individual SHCN categories were tested using linear regression.ResultsAll HRQoL domain scores for the SHCN samples were significantly worse than the respective calibration samples. Adolescents and young adults with SHCN-related service use and functional limitations reported worse HRQoL than those without service use and functional limitations (p's < 0.01).ConclusionsPROMIS Pediatric and Adult SFs possess satisfactory known-groups validity related to SHCN status.
| S-EPMC4893933 | biostudies-literature
Project description:Background contextThe Patient-Reported Outcomes Information System (PROMIS) instruments are an important advancement in the use of PROs, but need to be evaluated with longitudinal data to determine whether they are responsive to change in specific clinical populations.PurposeThe purpose of this study was to assess the responsiveness of the PROMIS Physical Function (PF), PROMIS Pain Interference (PI), Neck Disability Index (NDI), and the Oswestry Disability Index (ODI).Study design/settingThis study entailed prospective data collection from consecutive patients aged 18 and older, visiting a university-based orthopaedic spine clinic between October 2013 and January 2017.Patient sampleA total of 763 participants in the sample had a mean age of 58 (SD = 15) years and the sample was 50.2% male and 92.8% Caucasian.Outcome measuresThe PROMIS PF and PROMIS PI Computerized Adaptive Tests along with either the NDI or ODI instruments were administered on tablet computers before clinic visits. Global rating of change questions relating to pain and function levels was also administered.MethodsBaseline scores were compared with follow-up scores at four different time-points from 3-months to 6-months and beyond. Patient demographics, mean scores, paired-sample t tests, Standardized Response Mean (SRM), and Effect Size (ES) were analyzed to determine instrument responsiveness. This project was funded by the National Institute of Arthritis and Musculoskeletal and Skin Diseases of the National Institutes of Health under award number U01AR067138 and the authors have no conflicts of interest to disclose.ResultsThe PROMIS instruments were strongly correlated with each other as well as with the NDI and ODI. Responsiveness was significant on all four instruments at every time-point assessed (paired sample t tests ranged from p < .001 to p = .049). SRM's were large and over 0.94 for every instrument at every time-point. Cohen's d ES were large and over 0.96 for all at all time-points, except for the NDI which had ES ranging from 0.74 to 0.83. This study showed large effect sizes and responsiveness of the PROMIS PF, PROMIS PI, NDI and ODI in a population of orthopaedic patients with spine pathologies.ConclusionThis study demonstrates strong responsiveness of the PROMIS PF and PROMIS PI in a spine clinic population.
| S-EPMC6309663 | biostudies-literature
Project description:The National Institutes of Health (NIH) Patient-Reported Outcomes Measurement Information System (PROMIS(®)) is a standardized set of patient-reported outcomes (PROs) that cover physical, mental, and social health. The aim of this study was to develop the NIH PROMIS gastrointestinal (GI) symptom measures.We first conducted a systematic literature review to develop a broad conceptual model of GI symptoms. We complemented the review with 12 focus groups including 102 GI patients. We developed PROMIS items based on the literature and input from the focus groups followed by cognitive debriefing in 28 patients. We administered the items to diverse GI patients (irritable bowel syndrome (IBS), inflammatory bowel disease (IBD), systemic sclerosis (SSc), and other common GI disorders) and a census-based US general population (GP) control sample. We created scales based on confirmatory factor analyses and item response theory modeling, and evaluated the scales for reliability and validity.A total of 102 items were developed and administered to 865 patients with GI conditions and 1,177 GP participants. Factor analyses provided support for eight scales: gastroesophageal reflux (13 items), disrupted swallowing (7 items), diarrhea (5 items), bowel incontinence/soilage (4 items), nausea and vomiting (4 items), constipation (9 items), belly pain (6 items), and gas/bloat/flatulence (12 items). The scales correlated significantly with both generic and disease-targeted legacy instruments, and demonstrate evidence of reliability.Using the NIH PROMIS framework, we developed eight GI symptom scales that can now be used for clinical care and research across the full range of GI disorders.
| S-EPMC4285435 | biostudies-literature
Project description:Background and objectiveThe Patient-Reported Outcomes Measurement Information System (PROMIS-29) is gaining popularity as healthcare system funders increasingly seek value-based care. However, it is limited in its ability to estimate utilities and thus inform economic evaluations. This study develops the first mapping algorithm for estimating EuroQol 5-Dimension 5-Level (EQ-5D-5L) utilities from PROMIS-29 responses using a large dataset and through extensive comparisons between econometric models.MethodsAn online survey was conducted to collect responses to PROMIS-29 and EQ-5D-5L from the general Australian population (N = 3013). Direct and indirect mapping methods were explored, including linear regression, Tobit, generalised linear model, censored regression model, beta regression (Betamix), the adjusted limited dependent variable mixture model (ALDVMM) and generalised ordered logit. The most robust model was selected by assessing the performance based on average ten-fold cross-validation geometric mean absolute error and geometric mean squared error, the predicted mean, maximum and minimum utilities, as well as the fitting across the entire distribution.ResultsThe direct approach using ALDVMM was considered the preferred model based on lowest geometric mean absolute error and geometric mean squared error in cross-validation (0.0882, 0.0299) and its superiority in predicting the actual observed mean, full health states and lower utility extremes. The robustness and precision in prediction across the entire distribution of utilities with ALDVMM suggest it is an accurate and valid mapping algorithm. Moreover, the suggested mapping algorithm outperformed previously published algorithms using Australian data, indicating the validity of this model for economic evaluations.ConclusionsThis study developed a robust algorithm to estimate EQ-5D-5L utilities from PROMIS-29. Consistent with the recent literature, the ALDVMM outperformed all other econometric models considered in this study, suggesting that the mixture models have relatively better performance and are an ideal candidate model for mapping.
| S-EPMC9883346 | biostudies-literature
Project description:Background: Nonrestorative sleep is commonly reported by individuals with fibromyalgia, but there is limited information on the reliability and responsiveness of self-reported sleep measures in this population. Objectives: (1) Examine the reliability and validity of the Patient-Reported Outcomes Measurement Information System (PROMIS) sleep measures in women with fibromyalgia, and (2) Determine the responsiveness of the PROMIS sleep measures to a daily transcutaneous electrical nerve stimulation (TENS) intervention in women with fibromyalgia over 4 weeks compared with other measures of restorative sleep. Methods: In a double-blinded, dual-site clinical trial, 301 women with fibromyalgia were randomly assigned to utilize either Active-TENS, Placebo-TENS, or No-TENS at home. Measures were collected at baseline and after 4 weeks of treatment. To assess self-reported sleep, the participants completed three PROMIS short forms: Sleep Disturbance, Sleep-Related Impairment, Fatigue, and the Pittsburgh Sleep Quality Index (PSQI). To assess device-measured sleep, actigraphy was used to quantify total sleep time, wake after sleep onset, and sleep efficiency. Linear mixed models were used to examine the effects of treatment, time, and treatment*time interactions. Results: The PROMIS short forms had moderate test-retest reliability (ICC 0.62 to 0.71) and high internal consistency (Cronbach's alpha 0.89 to 0.92). The PROMIS sleep measures [mean change over 4 weeks, 95% confidence interval (CI)], Sleep Disturbance: -1.9 (-3.6 to -0.3), Sleep-Related Impairment: -3 (-4.6 to -1.4), and Fatigue: -2.4 (-3.9 to -0.9) were responsive to improvement in restorative sleep and specific to the Active-TENS group but not in the Placebo-TENS [Sleep Disturbance: -1.3 (-3 to 0.3), Sleep-Related Impairment: -1.2 (-2.8 to 0.4), Fatigue: -1.1 (-2.7 to 0.9)] or No-TENS [Sleep Disturbance: -0.1 (-1.6 to 1.5), Sleep-Related Impairment: -0.2 (-1.7 to 1.4), Fatigue: -.3 (-1.8 to 1.2)] groups. The PSQI was responsive but not specific with improvement detected in both the Active-TENS: -0.9 (-1.7 to -0.1) and Placebo-TENS: -0.9 (-1.7 to 0) groups but not in the No-TENS group: -0.3 (-1.1 to 0.5). Actigraphy was not sensitive to any changes in restorative sleep with Active-TENS [Sleep Efficiency: -1 (-2.8 to 0.9), Total Sleep Time: 3.3 (-19.8 to 26.4)]. Conclusion: The PROMIS sleep measures are reliable, valid, and responsive to improvement in restorative sleep in women with fibromyalgia. Clinical Trial Registration: www.ClinicalTrials.gov, identifier: NCT01888640.
| S-EPMC8915631 | biostudies-literature
Project description:This study assesses validity of self-report for the use of major classes of illicit drugs and opioid-maintenance therapy among pregnant women at a substance abuse treatment program.Analyses used data collected from 83 pregnant women in a prospective cohort study at the University of New Mexico. Study participants with a history of substance abuse were screened and, if eligible, enrolled during an early prenatal care visit. A follow-up interview was conducted shortly after delivery. Self-reported information about drug use later in pregnancy was compared with urine drug screen (UDS) results collected during the third trimester. Simple kappa (k) and prevalence-and-bias-adjusted kappa (PABAK) coefficients were calculated as the measures of agreement. Sensitivity and specificity of self-report for each drug class were estimated using UDS as the 'gold standard'.The sample included a large proportion of ethnic minority (80% Hispanic/Latina and 7% American Indian) and socially disadvantaged (50% less than high school education and 94% Medicaid-insured) pregnant women. On average, patients had 4.8 ± 3.0 urine drug screens during the third trimester. Sensitivity of self-report was low (<60%) for all classes of illicit drugs; however, marijuana and opioids demonstrated slightly higher sensitivity (57.9 and 58.3%, respectively) than other classes (<47%).This study found substantial underreporting for all classes of illicit drugs among pregnant women in a substance abuse treatment program. Rates of underreporting are expected to be higher among the general population of pregnant women.
| S-EPMC4713294 | biostudies-other