Dataset Information

Evaluation of Version 2.0 of the PROMIS Upper Extremity Computer Adaptive Test in Nonshoulder Upper Extremity Patients.

ABSTRACT: PURPOSE:The Patient-Reported Outcomes Measurement Information System (PROMIS) Upper Extremity Computer Adaptive Test (UE CAT) was recently updated to version 2.0 (v2.0). We hypothesized that the PROMIS UE CAT v2.0 would exhibit improved performance characteristics compared with the Quick Disabilities of the Arm, Shoulder, and Hand (QuickDASH) when administered to a nonshoulder upper extremity patient population. METHODS:The UE CAT v2.0, Physical Function (PF) CAT v2.0, and the QuickDASH were each prospectively administered via tablet computer to all patients presenting to a tertiary hand and upper extremity clinic between April 2017 and October 2017. Patient responses were analyzed, and the mean, range, floor and ceiling effect, and correlations between instruments were calculated. RESULTS:Among 825 patients, the mean UE CAT v2.0 score was 38.3 (SD 10.7) with a range of 15 to 61 and interquartile range of 15.4. The UE CAT v2.0 had a strong correlation with the QuickDASH (r = -0.749) and the PF CAT v2.0 (r = 0.719). No patient scored between 56 and 60, indicating a gap in scoring in that range. The UE CAT v2.0 demonstrated a floor effect of 1%, a ceiling effect of 6.9%, and a high internal consistency with a Cronbach alpha of 0.99. CONCLUSIONS:The PROMIS UE CAT v2.0 demonstrated improved ceiling effects, range, and a decreased gap in scoring compared with prior versions. Limitations of the PROMIS UE CAT v2.0 are still present, but updates have led to an incremental improvement over prior versions, demonstrating the ability to influence PROMIS instrument performance through upgrades. CLINICAL RELEVANCE:The updated PROMIS UE CAT v2.0 still demonstrates a ceiling effect and gap in scores at the upper end of the instrument, both of which may limit discrimination between different levels of upper extremity function for high-functioning patients.

SUBMITTER: Tyser AR

PROVIDER: S-EPMC6450736 | biostudies-literature | 2019 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Evaluation of Version 2.0 of the PROMIS Upper Extremity Computer Adaptive Test in Nonshoulder Upper Extremity Patients.

Tyser Andrew R AR Hung Man M Bounsanga Jerry J Voss Maren W MW Kazmers Nikolas H NH

The Journal of hand surgery 20190226 4

<h4>Purpose</h4>The Patient-Reported Outcomes Measurement Information System (PROMIS) Upper Extremity Computer Adaptive Test (UE CAT) was recently updated to version 2.0 (v2.0). We hypothesized that the PROMIS UE CAT v2.0 would exhibit improved performance characteristics compared with the Quick Disabilities of the Arm, Shoulder, and Hand (QuickDASH) when administered to a nonshoulder upper extremity patient population.<h4>Methods</h4>The UE CAT v2.0, Physical Function (PF) CAT v2.0, and the Qui ...[more]

PMID: 30819409

Similar Datasets

Project description:BackgroundMinimal clinically important difference (MCID) estimates are useful for gauging clinical relevance when interpreting changes or differences in patient-reported outcomes scores. These values are lacking in the setting of elbow trauma. Our primary purpose was to estimate the MCID of the Patient-Reported Outcomes Measurement Information System (PROMIS) physical function (PF) computer adaptive test (CAT), the PROMIS upper extremity (UE) CAT, and the QuickDASH using an anchor-based approach for patients recovering from elbow trauma and related surgeries. Secondarily, we aimed to estimate the MCID using the 1/2 standard deviation method.Materials & methodsAdult patients undergoing treatment for isolated elbow injuries between July 2014 and April 2020 were identified at a single tertiary academic medical center. Outcomes, including the PROMIS PF CAT v1.2/2.0, PROMIS UE CAT v1.2, and QuickDASH, were collected via a tablet computer. For inclusion, baseline (6 months before injury up to 11 days postoperatively or after injury) and follow-up (11 to 150 days postoperative or after injury) PF or UE CAT scores were required, as well as a response to an anchor question querying improvement in physical function. The MCID was calculated using (1) an anchor-based approach using the difference in mean score change between anchor groups reporting "No change" and "Slightly Improved/Improved" and (2) the 1/2 standard deviation method.ResultsOf the 146 included patients, the mean age was 46 ± 18 years and 67 (46%) were women. Most patients (129 of 146 or 88%) were recovering from surgery, and the remaining 12% were recovering from nonoperatively managed fractures and/or dislocations. The mean follow-up was 157 ± 192 days. Scores for each instrument improved significantly between baseline and follow-up. Anchor-based MCID values were calculated as follows: 5.7, 4.6, and 5.3 for the PROMIS PF CAT, PROMIS UE CAT, and QuickDASH, respectively. MCID values estimated using the 1/2 standard deviation method were 4.3, 4.8, and 11.7 for the PROMIS PF CAT, PROMIS UE CAT, and QuickDASH, respectively.ConclusionsIn the setting of elbow trauma, we propose MCID ranges of 4.3 to 5.7 for the PROMIS PF CAT, 4.6 to 4.8 for the PROMIS UE CAT, and 5.3 to 11.7 for the QuickDASH. These values will provide a framework for clinical relevance when interpreting clinical outcomes studies, or powering clinical trials, for populations recovering from trauma.

Project description:BackgroundA crucial component to improving patient care is better clinician understanding of patients' health-related quality of life (HRQoL). In orthopaedic surgery, HRQoL assessment instruments such as the NIH developed Patient Reported Outcomes Measurement Information System (PROMIS), provide surgeons with a framework to assess how a treatment or medical condition is affecting each patient's HRQoL. PROMIS has been demonstrated as a valuable instrument in many diseases; however, the extent to which orthopaedic surgery subspecialties have used and validated PROMIS measures in peer-reviewed research is unclear.MethodsSystematic scoping methodology was used to investigate the characteristics of studies using PROMIS to assess HRQoL measures as orthopaedic surgical outcomes as well as studies validating computerized adaptive test (CAT) PROMIS physical health (PH) domains including: Physical Function (PF), Upper Extremity (UE), Lower Extremity (LE).ResultsA systematic search of PubMed identified 391 publications utilizing PROMIS in orthopaedics; 153 (39%) were PROMIS PH CAT validation publications. One-hundred publications were in Hand and Upper Extremity, 69 in Spine, 44 in Adult Reconstruction, 43 in Foot and Ankle, 43 in Sports, 37 in Trauma, 31 in General orthopaedics, and 24 in Tumor. From 2011 through 2020 there was an upward trend in orthopaedic PROMIS publications each year (range, 1-153) and an increase in studies investigating or utilizing PROMIS PH CAT domains (range, 1-105). Eighty-five percent (n = 130) of orthopaedic surgery PROMIS PH CAT validation publications (n = 153) analyzed PF; 30% (n = 46) analyzed UE; 3% (n = 4) analyzed LE.ConclusionsPROMIS utilization within orthopaedics as a whole has significantly increased within the past decade, particularly within PROMIS CAT domains. The existing literature reviewed in this scoping study demonstrates that PROMIS PH CAT domains (PF, UE, and LE) are reliable, responsive, and interpretable in most contexts of patient care throughout all orthopaedic surgery subspecialties. The expanded use of PROMIS CATs in orthopaedic surgery highlights the potential for improved quality of patient care. While challenges of integrating PROMIS into electronic medical records exist, expanded use of PROMIS CAT measurement instruments throughout orthopaedic surgery should be performed. Plain english summary In orthopaedic surgery, health-related quality of life tools such as the NIH developed Patient Reported Outcomes Measurement Information System (PROMIS), offer patients an opportunity to better understand their medical condition and be involved in their own care. Additionally, PROMIS provides surgeons with a framework to assess how a treatment or medical condition is affecting each patient's functional status and quality of life. The efficacy of PROMIS has been demonstrated in many diseases; however, its application throughout orthopaedic care has yet to be depicted. This study sought to identify the extent to which all orthopaedic surgery subspecialties have used and validated PROMIS measures in peer-reviewed research in order to identify its potential as an applicable and valuable tool across specialties. We determined that PROMIS utilization has significantly increased within the past decade. The existing literature reviewed in this scoping study demonstrates that the PROMIS computerized adaptive test domains evaluating physical function status are reliable, responsive, and interpretable in most contexts of patient care throughout all orthopaedic surgery subspecialties. Based on these results, this study recommends the expanded and more uniform use of PROMIS computerized adaptive test measurement instruments in the clinical care of orthopaedic patients.

Project description:BACKGROUND:The Dutch-Flemish PROMIS® Upper Extremity (DF-PROMIS-UE) V2.0 item bank was recently developed using Item Response Theory (IRT). Unknown for this bank are: (1) if it is legitimate to calculate IRT-based scores for short forms and Computerized Adaptive Tests (CATs), which requires that the items meet the assumptions of and fit the IRT-model (Graded Response Model [GRM]);(2) if it is legitimate to compare (sub) groups of patients using this measure, which requires measurement invariance; and (3) the precision of the estimated patients' scores for patients with different levels of functioning and compared to legacy measures. Aims were to evaluate (1) the assumptions of and fit to the GRM, (2) measurement invariance and (3) (comparative) precision of the DF-PROMIS-UE v2.0. METHODS:Cross-sectional data were collected in Dutch patients with upper extremity disorders. Assessed were IRT-assumptions (unidimensionality [bi-factor analysis], local independence [residual correlations], monotonicity [coefficient H]), GRM item fit, measurement invariance (absence of Differential Item Functioning [DIF] due to age, gender, center, duration, and location of complaints) and precision (standard error of IRT-based scores across levels of functioning). To study measurement invariance for language [Dutch vs. English], additional US data were used. Legacy instruments were the Disability of the Arm, Shoulder and Hand (DASH), the QuickDASH and the Michigan Hand Questionnaire (MHQ). RESULTS:In total 521 Dutch (mean age?±?SD?=?51?±?17?years, 49% female) and 246 US patients (mean age?±?SD?=?48?±?14?years, 69% female) participated. The DF-PROMIS-UE v2.0 item bank was sufficiently unidimensional (Omega-H?=?0.80, Explained Common Variance?=?0.68), had negligible local dependence (four out of 1035 correlations >?0.20), good monotonicity (H?=?0.63), good GRM fit (no misfitting items) and demonstrated sufficient measurement invariance. Precise estimates (Standard Error?<?3.2) were obtained for most patients (7-item short form, 88.5%; standard CAT, 91.3%; and, fixed 7-item CAT, 87.6%). The DASH displayed better reliability than the DF-PROMIS-UE short form and standard CAT, the QuickDASH displayed comparable reliability. The MHQ-ADL displayed better reliability than the DF-PROMIS-UE short form and standard CAT for T-scores between 28 and 50. For patients with low function, the DF-PROMIS-UE measures performed better. CONCLUSIONS:The DF-PROMIS-UE v2.0 item bank showed sufficient psychometric properties in Dutch patients with UE disorders.

Project description:PurposeThe purpose of this study was to preoperatively assess the Patient-Reported Outcomes Measurement Information System (PROMIS) Item Bank v2.0-Mobility in patients with anterior cruciate ligament (ACL) tears to (1) determine construct validity by correlating with legacy patient-reported outcomes (PROs), (2) evaluate test burden, (3) determine the presence of floor or ceiling effects, and (4) revisit the conventional threshold for inclusiveness (floor/ceiling effects) in the modern era of computer adaptive testing (CAT)-based PROs.MethodsPatients at a large academic musculoskeletal specialty center diagnosed with ACL tears indicated for surgery were administered the following outcomes measures before surgery: PROMIS Mobility CAT, PROMIS Pain Interference CAT (PROMIS PI), International Knee Documentation Committee (IKDC), the Marx Knee Activity Rating Scale (Marx), and Single Assessment Numeric Evaluation (SANE). Construct validity was evaluated using Spearman correlation coefficients. Correlation strengths were defined as high (≥0.7), high-moderate (0.61-0.69), moderate (0.4-0.6), moderate-weak (0.31-0.39) and weak (≤0.3). Number of questions to completion were recorded as a marker of test burden. The percentage of patients scoring at the extreme high (ceiling) or low (floor) of each measure was recorded to measure inclusivity.ResultsA total of 1126 patients were evaluated. The mean number of questions answered (± standard deviation) was 4.7 ± 2.1 for PROMIS Mobility and 4.5 ± 1.9 for PROMIS PI. PROMIS Mobility demonstrated a high correlation with IKDC, (r = 0.81, P < .001), a high-moderate correlation with PROMIS PI (r = -0.63), and a moderate correlation with SANE (r = 0.46, P < .01). Neither PROMIS Mobility nor PROMIS PI met conventional criteria for floor or ceiling effects (>15%).ConclusionsThe PROMIS Mobility measure maintains construct validity, because its scores correlate strongly with other PROs measuring physical function with high efficiency among preoperative patients with ACL injuries. Although ceiling effects of PROMIS Mobility CAT were below the conventional significance threshold of 15% at the preoperative timepoint in this population, this study provides critical feedback for redesigning the Mobility bank.Level of evidenceLevel III (Diagnostic study).

Project description:Background and objectivePrediction of voluntary upper extremity (UE) movement recovery is largely unknown in patients with little voluntary UE movement at admission. The present study aimed to investigate (1) the extent and variation of voluntary UE movement recovery, and (2) the best predictive model of the recovery of voluntary UE movement by clinical variables in patients with severe UE paresis.DesignProspective cohort study.Methods140 (out of 590) stroke patients with severe UE paresis completed all assessments. Voluntary UE movement was assessed using the UE subscale of the Stroke Rehabilitation Assessment of Movement (STREAM-UE). Two outcome measures, STREAM-UE scores at discharge (DC(STREAM-UE)) and changes between admission and discharge (Δ(STREAM-UE)), were investigated to represent the final states and improvement of the recovery of voluntary UE movement. Stepwise regression analyses were used to investigate 19 clinical variables and to find the best predictive models of the two outcome measures.ResultsThe participants showed wide variation in both DC(STREAM-UE) and Δ(STREAM-UE). 3.6% of the participants almost fully recovered at discharge (DC(STREAM-UE) > 15). A large improvement (Δ(STREAM-UE) >= 10) occurred in 16.4% of the participants, while 32.9% of the participants did not have any improvement. The four predictors for the DC(STREAM-UE) (R(2) = 35.0%) were 'baseline STREAM-UE score', 'hemorrhagic stroke', 'baseline National Institutes of Health Stroke Scale (NIHSS) score', and 'cortical lesion excluding primary motor cortex'. The three predictors for the Δ(STREAM-UE) (R(2) = 22.0%) were 'hemorrhagic stroke', 'baseline NIHSS score', and 'cortical lesion excluding primary motor cortex'.ConclusionsRecovery of voluntary UE movement varied widely in patients with severe UE paresis after stroke. The predictive power of clinical variables was poor. Both results indicate the complex nature of voluntary UE movement recovery in patients with severe UE paresis after stroke.

Dataset Information

Evaluation of Version 2.0 of the PROMIS Upper Extremity Computer Adaptive Test in Nonshoulder Upper Extremity Patients.

Publications

Evaluation of Version 2.0 of the PROMIS Upper Extremity Computer Adaptive Test in Nonshoulder Upper Extremity Patients.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets