Dataset Information

Validation of the alcohol use item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS).

ABSTRACT: The Patient-Reported Outcomes Measurement Information System (PROMIS) includes five item banks for alcohol use. There are limited data, however, regarding their validity (e.g., convergent validity, responsiveness to change). To provide such data, we conducted a prospective study with 225 outpatients being treated for substance abuse.Assessments were completed shortly after intake and at 1-month and 3-month follow-ups. The alcohol item banks were administered as computerized adaptive tests (CATs). Fourteen CATs and one six-item short form were also administered from eight other PROMIS domains to generate a comprehensive health status profile. After modeling treatment outcome for the sample as a whole, correlates of outcome from the PROMIS health status profile were examined.For convergent validity, the largest correlation emerged between the PROMIS alcohol use score and the Alcohol Use Disorders Identification Test (r=.79 at intake). Regarding treatment outcome, there were modest changes across the target problem of alcohol use and other domains of the PROMIS health status profile. However, significant heterogeneity was found in initial severity of drinking and in rates of change for both abstinence and severity of drinking during follow-up. This heterogeneity was associated with demographic (e.g., gender) and health-profile (e.g., emotional support, social participation) variables.The results demonstrated the validity of PROMIS CATs, which require only 4-6 items in each domain. This efficiency makes it feasible to use a comprehensive health status profile within the substance use treatment setting, providing important prognostic information regarding abstinence and severity of drinking.

SUBMITTER: Pilkonis PA

PROVIDER: S-EPMC6032515 | biostudies-literature | 2016 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Validation of the alcohol use item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS).

Pilkonis Paul A PA Yu Lan L Dodds Nathan E NE Johnston Kelly L KL Lawrence Suzanne M SM Daley Dennis C DC

Drug and alcohol dependence 20160217

<h4>Background</h4>The Patient-Reported Outcomes Measurement Information System (PROMIS) includes five item banks for alcohol use. There are limited data, however, regarding their validity (e.g., convergent validity, responsiveness to change). To provide such data, we conducted a prospective study with 225 outpatients being treated for substance abuse.<h4>Methods</h4>Assessments were completed shortly after intake and at 1-month and 3-month follow-ups. The alcohol item banks were administered as ...[more]

PMID: 26936412

Similar Datasets

Project description:BackgroundLimitations in physical functioning are a big concern especially for patients with chronic or musculoskeletal diseases. Therefore, physical functioning is often used as a core outcome of treatments. The generic patient-reported outcomes information system (PROMIS) physical function (PF) item bank has shown potential to measure PF with better precision, interpretability and lower respondent burden compared with traditional patient-reported outcome measures. This study provides an overview of the current evidence on the quality of the measurement properties of the translated Dutch-Flemish PROMIS-PF item bank and its subdomains, and their derived short forms and computer adaptive tests (CATs).MethodsPubMed was searched up to June 17th 2020 for validation studies of Dutch-Flemish PROMIS-PF in Dutch and Flemish adults. Quality assessment of the included studies was conducted using the COSMIN Risk of bias checklist. The COSMIN criteria for good measurement properties were used to judge the results of the studies, which were adjusted and added to where needed for this review, in the context of IRT instruments and item banks. The quality of evidence was summarized for each measurement property based on the Grading of Recommendation Assessment, Development, and Evaluation (GRADE) approach.ResultsEleven studies were included, evaluating the PROMIS-PF item bank, the Upper Extremity (UE) subdomain, and/or their derived short forms and CATs in different clinical populations. There is evidence for sufficient structural validity, measurement precision, construct validity, and cross-cultural validity of the Dutch-Flemish PROMIS-PF item bank. The upper extremity subdomain item bank shows high quality evidence for structural validity and measurement precision. Content validity of these item banks has not been thoroughly demonstrated in a Dutch-Flemish population. Furthermore, the derived instruments have far less robust evidence: there are fewer validation studies available and none examined their performance as stand-alone administered instruments.ConclusionsThe first studies into the Dutch-Flemish PROMIS-PF item bank and the UE subdomain show promising results, with especially high quality evidence for sufficient structural validity and measurement precision. However, more studies, and with higher methodological quality, are needed to study the instruments derived from these item banks. These studies should also evaluate content validity, reliability and responsiveness.

Project description:PurposeThis study aimed to validate the PROMIS Pediatric item bank v2.0 Peer Relationships and compare reliability of the full item bank to its short form, computerized adaptive test (CAT) and the social functioning (SF) subscale of the Pediatric Quality of Life Inventory (PedsQL™).MethodsChildren aged 8-18 (n = 1327), representative of the Dutch population completed the Peer Relationships item bank. A graded response model (GRM) was fit to the data. Structural validity was assessed by checking item-fit statistics (S-X2, p < 0.001 = misfit). For construct validity, a moderately strong correlation (> 0.50) was expected between Peer Relationships and the PedsQL SF subscale. Cross-cultural DIF between U.S. and NL was assessed using logistic regression, where an item with McFadden's pseudo R2 > 0.02 was considered to have DIF. Percentage of participants reliably measured was assessed using the standard error of measurement (SEM) < 0.32 as a criterion (reliability of 0.90). Relative efficiency ((1-SEM2)/nitems) was calculated to compare how well the instruments performed relative to the amount of items administered.ResultsIn total, 527 (response rate: 39.7%) children completed the PROMIS v2.0 Peer Relationships item bank (nitems = 15) and the PedsQL™ (nitems = 23). Structural validity of the Peer Relationships item bank was sufficient, but one item displayed misfit in the GRM model (S-X2 < 0.001); 5152R1r ("I played alone and kept to myself"). The item 733R1r ("I was a good friend") was the only item that displayed cross-cultural DIF (R2 = 0.0253). The item bank correlated moderately high (r = 0.61) with the PedsQL SF subscale Reliable measurements were obtained at the population mean and > 2SD in the clinically relevant direction. CAT outperformed all other measures in efficiency. Mean T-score of the Dutch general population was 46.9(SD 9.5).ConclusionThe pediatric PROMIS Peer Relationships item bank was successfully validated for use within the Dutch population and reference data are now available.

Project description:Background and objectiveThe Patient-Reported Outcomes Measurement Information System (PROMIS-29) is gaining popularity as healthcare system funders increasingly seek value-based care. However, it is limited in its ability to estimate utilities and thus inform economic evaluations. This study develops the first mapping algorithm for estimating EuroQol 5-Dimension 5-Level (EQ-5D-5L) utilities from PROMIS-29 responses using a large dataset and through extensive comparisons between econometric models.MethodsAn online survey was conducted to collect responses to PROMIS-29 and EQ-5D-5L from the general Australian population (N = 3013). Direct and indirect mapping methods were explored, including linear regression, Tobit, generalised linear model, censored regression model, beta regression (Betamix), the adjusted limited dependent variable mixture model (ALDVMM) and generalised ordered logit. The most robust model was selected by assessing the performance based on average ten-fold cross-validation geometric mean absolute error and geometric mean squared error, the predicted mean, maximum and minimum utilities, as well as the fitting across the entire distribution.ResultsThe direct approach using ALDVMM was considered the preferred model based on lowest geometric mean absolute error and geometric mean squared error in cross-validation (0.0882, 0.0299) and its superiority in predicting the actual observed mean, full health states and lower utility extremes. The robustness and precision in prediction across the entire distribution of utilities with ALDVMM suggest it is an accurate and valid mapping algorithm. Moreover, the suggested mapping algorithm outperformed previously published algorithms using Australian data, indicating the validity of this model for economic evaluations.ConclusionsThis study developed a robust algorithm to estimate EQ-5D-5L utilities from PROMIS-29. Consistent with the recent literature, the ALDVMM outperformed all other econometric models considered in this study, suggesting that the mixture models have relatively better performance and are an ideal candidate model for mapping.

Project description:PurposeTo analyze time to completion of preoperative legacy patient-reported outcomes (PROs) and more recent computer adaptive Patient-Reported Outcomes Measurement Information System (PROMIS) questionnaires in patients with symptomatic femoroacetabular impingement syndrome undergoing primary hip arthroscopy.MethodsA retrospective analysis was conducted on patients undergoing hip arthroscopy by a single fellowship-trained hip arthroscopist. Inclusion criteria were patients undergoing primary arthroscopic hip surgery and completion of at least 1 legacy PRO or PROMIS questionnaire at the preoperative time point. Exclusion criteria were history of contralateral or ipsilateral hip surgery, non-English-speaking patients, patients who completed PROs by phone or by paper form, and patients who did not complete preoperative PROs. Legacy PROs included modified Harris Hip Score (mHHS), Hip Outcome Score (HOS), International Hip Outcome Tool (iHOT-12), and Hip Pain Visual Analog Scale (VAS-Pain). PROMIS PROs included Physical Function (PROMIS-PF), Pain Interference (PROMIS-PI), and Depression (PROMIS-D). Only preoperative PROs were included in the analysis. Completion time was calculated using the questionnaire start and stop time reported by the survey collecting software. The median and interquartile range of each PRO were reported for analysis of central tendency and statistical dispersion, respectively.ResultsA total of 1,901 patients and 269 patients were included in the legacy and PROMIS groups, respectively. The median time required for completion of each PRO in (minutes: seconds) format was as follows: mHHS (1:29), HOS (3:58), iHOT (2:11), VAS-Pain (0:32), PROMIS-PF (0:46), PROMIS-PI (0:37), and PROMIS-D (0:43). The interquartile range of the middle 50% of respondents was as follows; mHHS (0:58), HOS (2:46), iHOT (1:22), VAS-Pain (0:28), PROMIS-PI (0:19), PROMIS-D (0:29), and PROMIS-PF (0:20).ConclusionsThis study supports that preoperative PROMIS forms require less time to complete than preoperative legacy PROs and are not significantly influenced by age, race, or workers compensation status.Level of evidenceLevel IV, case series.

Project description:ObjectiveTo assess the psychometric properties of 8 pediatric Patient-Reported Outcomes Measurement Information System (PROMIS) item banks in a clinical sample of children with juvenile idiopathic arthritis (JIA).MethodsA total of 154 Dutch children (mean ± SD age 14.4 ± 3.0 years; range 8-18 years) with JIA completed 8 pediatric version 1.0 PROMIS item banks (anger, anxiety, depressive symptoms, fatigue, pain interference, peer relationships, physical function mobility, physical function upper extremity) twice and the Pediatric Quality of Life Inventory (PedsQL) and the Childhood Health Assessment Questionnaire (C-HAQ) once. Structural validity of the item banks was assessed by fitting a graded response model (GRM) and inspecting GRM fit (comparative fit index [CFI], Tucker-Lewis index [TLI], and root mean square error of approximation [RMSEA]) and item fit (S-X2 statistic). Convergent validity (with PedsQL/C-HAQ subdomains) and discriminative validity (active/inactive disease) were assessed. Reliability of the item banks, short forms, and computerized adaptive testing (CAT) was expressed as the SE of theta (SE[θ]). Test-retest reliability was assessed using intraclass correlation coefficients (ICCs) and smallest detectable change.ResultsAll item banks had sufficient overall GRM fit (CFI >0.95, TLI >0.95, RMSEA <0.08) and no item misfit (all S-X2 P > 0.001). High correlations (>0.70) were found between most PROMIS T scores and hypothesized PedsQL/C-HAQ (sub)domains. Mobility, pain interference, and upper extremity item banks were able to discriminate between patients with active and inactive disease. Regarding reliability, PROMIS item banks outperformed legacy instruments. Post hoc CAT simulations outperformed short forms. Test-retest reliability was strong (ICC >0.70) for all full-length item banks and short forms, except for the peer relationships item bank.ConclusionThe pediatric PROMIS item banks displayed sufficient psychometric properties for Dutch children with JIA. PROMIS item banks are ready for use in clinical research and practice for children with JIA.

Dataset Information

Validation of the alcohol use item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS).

Publications

Validation of the alcohol use item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS).

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets