Generic PROMIS item banks in adults with hemophilia for patient-reported outcome assessment: Feasibility, measurement properties, and relevance.
Ontology highlight
ABSTRACT: Background
Legacy hemophilia-specific questionnaires are considered too long, show floor-/ceiling effects, and/or include irrelevant questions. Patient Reported Outcomes Measurement Information System (PROMIS) item banks, including Computer Adaptive Tests (CATs) and short forms, were designed for more efficient outcome assessment.Objectives
Evaluate the feasibility, measurement properties, and relevance of seven PROMIS CATs and two short forms in patients with hemophilia.Patients/methods
In this cross-sectional study, Dutch adults with hemophilia completed nine PROMIS item banks electronically. Feasibility was assessed by number of items and floor/ceiling effects. Reliability was determined as the proportion of reliable scores (standard error ≤3.2). Construct validity was assessed by comparison with legacy instruments and expected differences between subgroups. Relevance of item banks was determined by proportions of limited scores.Results
Overall, 142 of 373 invited patients (mean age, 47 [range, 18-79], 49% severe hemophilia, 46% receiving prophylaxis) responded. Per CAT item bank, mean number of items answered varied from 5 (range, 3-12) to 9 (range, 5-12), with floor effects in pain interference (26% lowest scores) and depression (18% lowest scores). Construct validity and reliability were good for physical function, pain interference, satisfaction with social roles and activities, and fatigue. The CAT physical function showed the most limited scores (38%). The self-efficacy short forms showed ceiling effects (22%-28%) and no relation with the legacy instruments.Conclusions
The PROMIS CATs physical function, pain interference, satisfaction with social roles and activities, and fatigue are feasible, reliable, and valid alternatives to legacy instruments for patients with hemophilia, with few items and low floor-/ceiling effects.
SUBMITTER: Kuijlaars IAR
PROVIDER: S-EPMC8606028 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The Patient-Reported Outcomes Measurement Information System (PROMIS) includes five item banks for alcohol use. There are limited data, however, regarding their validity (e.g., convergent validity, responsiveness to change). To provide such data, we conducted a prospective study with 225 outpatients being treated for substance abuse.Assessments were completed shortly after intake and at 1-month and 3-month follow-ups. The alcohol item banks were administered as computerized adaptive tests (CATs). Fourteen CATs and one six-item short form were also administered from eight other PROMIS domains to generate a comprehensive health status profile. After modeling treatment outcome for the sample as a whole, correlates of outcome from the PROMIS health status profile were examined.For convergent validity, the largest correlation emerged between the PROMIS alcohol use score and the Alcohol Use Disorders Identification Test (r=.79 at intake). Regarding treatment outcome, there were modest changes across the target problem of alcohol use and other domains of the PROMIS health status profile. However, significant heterogeneity was found in initial severity of drinking and in rates of change for both abstinence and severity of drinking during follow-up. This heterogeneity was associated with demographic (e.g., gender) and health-profile (e.g., emotional support, social participation) variables.The results demonstrated the validity of PROMIS CATs, which require only 4-6 items in each domain. This efficiency makes it feasible to use a comprehensive health status profile within the substance use treatment setting, providing important prognostic information regarding abstinence and severity of drinking.
| S-EPMC6032515 | biostudies-literature
Project description:The Patient-Reported Outcomes Measurement Information System (PROMIS) Smoking Initiative has developed item banks for assessing six smoking behaviors and biopsychosocial correlates of smoking among adult cigarette smokers. The goal of this study is to evaluate the performance of the Spanish version of the PROMIS smoking item banks as compared to the original banks developed in English.The six PROMIS banks for daily smokers were translated into Spanish and administered to a sample of Spanish-speaking adult daily smokers in the United States (N = 302). We first evaluated the unidimensionality of each bank using confirmatory factor analysis. We then conducted a two-group item response theory calibration, including an item response theory-based Differential Item Functioning (DIF) analysis by language of administration (Spanish vs. English). Finally, we generated full bank and short form scores for the translated banks and evaluated their psychometric performance.Unidimensionality of the Spanish smoking item banks was supported by confirmatory factor analysis results. Out of a total of 109 items that were evaluated for language DIF, seven items in three of the six banks were identified as having levels of DIF that exceeded an established criterion. The psychometric performance of the Spanish daily smoker banks is largely comparable to that of the English versions.The Spanish PROMIS smoking item banks are highly similar, but not entirely equivalent, to the original English versions. The parameters from these two-group calibrations can be used to generate comparable bank scores across the two language versions.In this study, we developed a Spanish version of the PROMIS smoking toolkit, which was originally designed and developed for English speakers. With the growing Spanish-speaking population, it is important to make the toolkit more accessible by translating the items and calibrating the Spanish version to be comparable with English-language scores. This study provided the translated item banks and short forms, comparable unbiased scores for Spanish speakers and evaluations of the psychometric properties of the new Spanish toolkit.
| S-EPMC4902883 | biostudies-other
Project description:BackgroundTwo item banks for substance use were developed as part of the Patient-Reported Outcomes Measurement Information System (PROMIS(®)): severity of substance use and positive appeal of substance use.MethodsQualitative item analysis (including focus groups, cognitive interviewing, expert review, and item revision) reduced an initial pool of more than 5300 items for substance use to 119 items included in field testing. Items were written in a first-person, past-tense format, with 5 response options reflecting frequency or severity. Both 30-day and 3-month time frames were tested. The calibration sample of 1336 respondents included 875 individuals from the general population (ascertained through an internet panel) and 461 patients from addiction treatment centers participating in the National Drug Abuse Treatment Clinical Trials Network.ResultsFinal banks of 37 and 18 items were calibrated for severity of substance use and positive appeal of substance use, respectively, using the two-parameter graded response model from item response theory (IRT). Initial calibrations were similar for the 30-day and 3-month time frames, and final calibrations used data combined across the time frames, making the items applicable with either interval. Seven-item static short forms were also developed from each item bank.ConclusionsTest information curves showed that the PROMIS item banks provided substantial information in a broad range of severity, making them suitable for treatment, observational, and epidemiological research in both clinical and community settings.
| S-EPMC4633351 | biostudies-literature
Project description:OBJECTIVE:To describe the development of the Patient-Reported Outcome Measurement Information System (PROMIS) Pediatric Meaning and Purpose item banks, child-report and parent-proxy editions. METHODS:Data were collected from two samples. The first comprised 1,895 children (8-17?years old) and 927 parents of children 5-17?years old recruited from an Internet panel, medical clinics, and schools. The second comprised a nationally representative sample of 990 children 8-17?years old and 1,292 parents of children 5-17?years old recruited from a different Internet panel. Item pool evaluation was done with Sample 1 and analyses were used to support decisions about item retention. The combined sample was used for item response theory (IRT) calibration of the item bank. Both samples were used in validation studies. RESULTS:Eleven items were deleted from the item pool because of poor psychometric performance. The final versions of the scales showed excellent reliability (>0.90). Short form scales (4 or 8 items) had a high degree of precision across over 4 SD units of the latent variable. The item bank positively correlated with extant measures of positive psychological functioning, and negatively correlated with measures of emotional distress, pessimism, and pain. Lower meaning and purpose scores were associated with adolescence and presence of a special healthcare need. CONCLUSION:The PROMIS Pediatric Meaning and Purpose item banks and their short forms are ready for use in clinical research and practice. They are measures of children's eudaimonic well-being and indicative of children's hopefulness, optimism, goal-directedness, and feelings that life is worth living.
| S-EPMC6761958 | biostudies-literature
Project description:BackgroundLimitations in physical functioning are a big concern especially for patients with chronic or musculoskeletal diseases. Therefore, physical functioning is often used as a core outcome of treatments. The generic patient-reported outcomes information system (PROMIS) physical function (PF) item bank has shown potential to measure PF with better precision, interpretability and lower respondent burden compared with traditional patient-reported outcome measures. This study provides an overview of the current evidence on the quality of the measurement properties of the translated Dutch-Flemish PROMIS-PF item bank and its subdomains, and their derived short forms and computer adaptive tests (CATs).MethodsPubMed was searched up to June 17th 2020 for validation studies of Dutch-Flemish PROMIS-PF in Dutch and Flemish adults. Quality assessment of the included studies was conducted using the COSMIN Risk of bias checklist. The COSMIN criteria for good measurement properties were used to judge the results of the studies, which were adjusted and added to where needed for this review, in the context of IRT instruments and item banks. The quality of evidence was summarized for each measurement property based on the Grading of Recommendation Assessment, Development, and Evaluation (GRADE) approach.ResultsEleven studies were included, evaluating the PROMIS-PF item bank, the Upper Extremity (UE) subdomain, and/or their derived short forms and CATs in different clinical populations. There is evidence for sufficient structural validity, measurement precision, construct validity, and cross-cultural validity of the Dutch-Flemish PROMIS-PF item bank. The upper extremity subdomain item bank shows high quality evidence for structural validity and measurement precision. Content validity of these item banks has not been thoroughly demonstrated in a Dutch-Flemish population. Furthermore, the derived instruments have far less robust evidence: there are fewer validation studies available and none examined their performance as stand-alone administered instruments.ConclusionsThe first studies into the Dutch-Flemish PROMIS-PF item bank and the UE subdomain show promising results, with especially high quality evidence for sufficient structural validity and measurement precision. However, more studies, and with higher methodological quality, are needed to study the instruments derived from these item banks. These studies should also evaluate content validity, reliability and responsiveness.
| S-EPMC7905571 | biostudies-literature
Project description:PURPOSE:Health status descriptive systems based on item response theory (IRT), such as the Patient-Reported Outcomes Measurement Information System (PROMIS®), have item banks to measure domains of health. We developed a method to present such banks for health-state valuation. METHODS:We evaluated four different presentation approaches: a single item (1S), 2 items presented separately (2S), 2 items presented together (2T), or 5 items presented together (5T). We evaluated these four approaches in three PROMIS item banks (depression, physical function, and sleep disturbance). Adult community members valued health-state descriptions using the visual analog scale and standard gamble methods. We compared the approaches by the range of item bank theta scores captured, participants' assessments of difficulty (1 = very easy to 7 = very hard), and exit interviews. RESULTS:Participants (n = 118) ranged in age from 18 to 71; 63% were female and 54% were white. The 1S approach captured the smallest range of theta scores. A monotonic relationship between theta score and mean standard gamble estimate was found with all approaches except 2S. Across all 3 item banks, mean difficulty assessments were 2.35 (1S), 2.69 (2T), 2.78 (5T), and 2.80 (2S). In exit interviews, participants generally found all four approaches similarly meaningful and realistic. CONCLUSIONS:Creating health descriptions by presenting 2 items maximized the range of theta while minimizing difficulty and maintaining a monotonic relationship with utility estimates. We recommend this approach for valuation of IRT-based descriptive systems such as PROMIS.
| S-EPMC6611549 | biostudies-literature
Project description:PurposeTo analyze time to completion of preoperative legacy patient-reported outcomes (PROs) and more recent computer adaptive Patient-Reported Outcomes Measurement Information System (PROMIS) questionnaires in patients with symptomatic femoroacetabular impingement syndrome undergoing primary hip arthroscopy.MethodsA retrospective analysis was conducted on patients undergoing hip arthroscopy by a single fellowship-trained hip arthroscopist. Inclusion criteria were patients undergoing primary arthroscopic hip surgery and completion of at least 1 legacy PRO or PROMIS questionnaire at the preoperative time point. Exclusion criteria were history of contralateral or ipsilateral hip surgery, non-English-speaking patients, patients who completed PROs by phone or by paper form, and patients who did not complete preoperative PROs. Legacy PROs included modified Harris Hip Score (mHHS), Hip Outcome Score (HOS), International Hip Outcome Tool (iHOT-12), and Hip Pain Visual Analog Scale (VAS-Pain). PROMIS PROs included Physical Function (PROMIS-PF), Pain Interference (PROMIS-PI), and Depression (PROMIS-D). Only preoperative PROs were included in the analysis. Completion time was calculated using the questionnaire start and stop time reported by the survey collecting software. The median and interquartile range of each PRO were reported for analysis of central tendency and statistical dispersion, respectively.ResultsA total of 1,901 patients and 269 patients were included in the legacy and PROMIS groups, respectively. The median time required for completion of each PRO in (minutes: seconds) format was as follows: mHHS (1:29), HOS (3:58), iHOT (2:11), VAS-Pain (0:32), PROMIS-PF (0:46), PROMIS-PI (0:37), and PROMIS-D (0:43). The interquartile range of the middle 50% of respondents was as follows; mHHS (0:58), HOS (2:46), iHOT (1:22), VAS-Pain (0:28), PROMIS-PI (0:19), PROMIS-D (0:29), and PROMIS-PF (0:20).ConclusionsThis study supports that preoperative PROMIS forms require less time to complete than preoperative legacy PROs and are not significantly influenced by age, race, or workers compensation status.Level of evidenceLevel IV, case series.
| S-EPMC8551417 | biostudies-literature
Project description:BACKGROUND:The Patient-Reported Outcomes Measurement Information System® (PROMIS) includes a Physical Function (PF) item bank and an Upper Extremity (UE) item bank, which is composed of a subset of items from the PF bank. The UE item bank has few items and known ceiling effects. Therefore, this study aimed to expand the item bank to assess a wider range of functioning. With the additional content, other psychometric properties-improved content validity, item bank depth, range of measurement, and score reliability-were also evaluated. We convened an expert panel to review potential items, and then conducted psychometric analyses on both extant and newly-collected data. RESULTS:Expert focus groups reviewed the PF item bank for items that were "sufficiently" related to upper extremity functioning for inclusion in the expanded UE item bank. The candidate item bank was quantitatively evaluated in a new sample of 600 people. The final items were calibrated in an aggregated dataset (n?=?11,635) from two existing datasets, and the newly collected sample. The original UE item bank included 15 items. After expert review and quantitative evaluation, 31 items were added. The combined 46 items were calibrated using item response theory (IRT). Then computer adaptive tests (CATs) were simulated based off of the psychometric results. These indicated that the new UE item bank has an extended measurement range compared to the original version. CONCLUSIONS:The expanded PROMIS UE item bank assesses a wider range of upper extremity functioning compared to the initial UE item bank. However, ceiling effects remain a concern for unimpaired groups. The new UE item bank is recommended for individuals with known or suspected upper extremity limitations.
| S-EPMC6879697 | biostudies-literature
Project description:PurposeThis study aimed to validate the PROMIS Pediatric item bank v2.0 Peer Relationships and compare reliability of the full item bank to its short form, computerized adaptive test (CAT) and the social functioning (SF) subscale of the Pediatric Quality of Life Inventory (PedsQL™).MethodsChildren aged 8-18 (n = 1327), representative of the Dutch population completed the Peer Relationships item bank. A graded response model (GRM) was fit to the data. Structural validity was assessed by checking item-fit statistics (S-X2, p < 0.001 = misfit). For construct validity, a moderately strong correlation (> 0.50) was expected between Peer Relationships and the PedsQL SF subscale. Cross-cultural DIF between U.S. and NL was assessed using logistic regression, where an item with McFadden's pseudo R2 > 0.02 was considered to have DIF. Percentage of participants reliably measured was assessed using the standard error of measurement (SEM) < 0.32 as a criterion (reliability of 0.90). Relative efficiency ((1-SEM2)/nitems) was calculated to compare how well the instruments performed relative to the amount of items administered.ResultsIn total, 527 (response rate: 39.7%) children completed the PROMIS v2.0 Peer Relationships item bank (nitems = 15) and the PedsQL™ (nitems = 23). Structural validity of the Peer Relationships item bank was sufficient, but one item displayed misfit in the GRM model (S-X2 < 0.001); 5152R1r ("I played alone and kept to myself"). The item 733R1r ("I was a good friend") was the only item that displayed cross-cultural DIF (R2 = 0.0253). The item bank correlated moderately high (r = 0.61) with the PedsQL SF subscale Reliable measurements were obtained at the population mean and > 2SD in the clinically relevant direction. CAT outperformed all other measures in efficiency. Mean T-score of the Dutch general population was 46.9(SD 9.5).ConclusionThe pediatric PROMIS Peer Relationships item bank was successfully validated for use within the Dutch population and reference data are now available.
| S-EPMC8233291 | biostudies-literature
Project description:Background and aimsPatient-reported outcome measures (PROMs) for children (aged ≤ 18 years) present methodological challenges. PROMs can be categorised by their diverse underlying conceptual bases, including functional, disability and health (FDH) status; quality of life (QoL); and health-related quality of life (HRQoL). Some PROMs are designed to be accompanied by preference weights. PROMs should account for childhood developmental differences by incorporating age-appropriate health/QoL domains, guidance on respondent type(s) and design. This systematic review aims to identify generic multidimensional childhood PROMs and synthesise their characteristics by conceptual basis, target age, measurement considerations, and the preference-based value sets that accompany them.MethodsThe study protocol was registered in the Prospective Register of Systematic Reviews (CRD42021230833), and reporting followed Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. We conducted systematic database searches for generic multidimensional childhood PROMs covering the period 2012-2020, which we combined with published PROMs identified by an earlier systematic review that covered the period 1992-2011. A second systematic database search identified preference-based value sets for generic multidimensional PROMs. The PROMs were categorised by conceptual basis (FDH status, QoL and HRQoL) and by target age (namely infants and pre-schoolers aged < 5 years, pre-adolescents aged 5-11, adolescents aged 12-18 and multi-age group coverage). Descriptive statistics assessed how PROM characteristics (domain coverage, respondent type and design) varied by conceptual basis and age categories. Involvement of children in PROM development and testing was assessed to understand content validity. Characteristics of value sets available for the childhood generic multidimensional PROMs were identified and compared.ResultsWe identified 89 PROMs, including 110 versions: 52 FDH, 29 QoL, 12 HRQoL, nine QoL-FDH and eight HRQoL-FDH measures; 20 targeted infants and pre-schoolers, 29 pre-adolescents, 24 adolescents and 37 for multiple age groups. Domain coverage demonstrated development trajectories from observable FDH aspects in infancy through to personal independence and relationships during adolescence. PROMs targeting younger children relied more on informant report, were shorter and had fewer ordinal scale points. One-third of PROMs were developed following qualitative research or surveys with children or parents for concept elicitation. There were 21 preference-based value sets developed by 19 studies of ten generic multidimensional childhood PROMs: seven were based on adolescents' stated preferences, seven were from adults from the perspective of or on behalf of the child, and seven were from adults adopting an adult's perspective. Diverse preference elicitation methods were used to elicit values. Practices with respect to anchoring values on the utility scale also varied considerably. The range and distribution of values reflect these differences, resulting in value sets with notably different properties.ConclusionIdentification and categorisation of generic multidimensional childhood PROMs and value sets by this review can aid the development, selection and interpretation of appropriate measures for clinical and population research and cost-effectiveness-based decision-making.
| S-EPMC9007803 | biostudies-literature