Dataset Information

Psycholinguistic features, design attributes, and respondent-reported cognition predict response time to patient-reported outcome measure items.

ABSTRACT:

Purpose

Patient-reported outcome measures (PROMs) vary in their psycholinguistic complexity. This study examined whether response time to PROM items is related to psycholinguistic attributes of the item and/or the self-reported cognitive ability of the respondent.

Methods

Baseline data from Wave 2 of the Quality of Life in Neurological Disorders (Neuro-QoL) development study were reanalyzed. That sample contained 581 adults with neurological disorders and whose self-reported cognitive abilities were quantified by the Neuro-QoL v2.0 Cognitive Function Item Bank. 185 Neuro-QoL items were coded for several psycholinguistic variables and design attributes: number of words and syllables, mean imageability of words, mean word frequency, mean age of word acquisition, and response format (e.g., about symptom frequency or task difficulty). Data were analyzed with linear and generalized linear mixed models.

Results

Main effects models revealed that slower response times were associated with respondents with lower self-reported cognitive abilities and with PROM items that contained more syllables, less imageable (e.g., more abstract) words, and that asked about task difficulty rather than symptom frequency. Interaction effects were found between self-reported cognition and those same PROM attributes such that people with worse self-reported cognitive abilities were disproportionately slow when responding to items that were longer (more syllables), contained less imageable words, and asked about task difficulty.

Conclusion

Completing a PROM requires multiple cognitive skills (e.g., memory, executive functioning) and appraisal processes. Response time is a means of operationalizing the amount or difficulty of cognitive processing, and this report indicates several aspects of PROM design that relate to a measure's cognitive burden. However, future research with better experimental control is needed.

SUBMITTER: Cohen ML

PROVIDER: S-EPMC8178143 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Background Validity is the ability of an instrument to measure what it claims to measure. It means the degree to which the empirical evidence supports the trustworthiness of interpretations based on the calculated scores. The hematological malignancy (HM) specific patient reported outcome measure (HM-PRO), is a newly developed instrument for use in daily clinical practice as well as in research. This study, provides the evidence for construct validity of the HM-PRO, specifically focusing on the convergent and divergent validity compared to the other established instruments used in hematology. Methods This validation study adopted a prospective cross-sectional design where a heterogeneous group of patients diagnosed with different HMs and different disease state were recruited. A total of 905 patients were recruited from seven secondary care hospitals in the UK and online through five patient organizations. Patients were asked to complete the HM-PRO and other cancer specific PRO’s, FACT-G and EORTC QLQ C-30. Data analysis was performed using IBM SPSS 23 statistical software. Results A total of 486 males (53.7%) and 419 females (46.3%), with a mean age of 64.3 (± 12.4) years and mean time since diagnosis of 4.6 ( ± 5.2) were recruited. The total score of Part A of the HM-PRO highly correlated with the five functional scales of the EORTC QLQ-C30 (Physical = ?0.71, Role = ?0.72, Emotional = ?0.64, Cognitive = ?0.58, Social = ?0.74—p < 0.001). With respect to correlation with FACT-G, the total score of Part A of the HM-PRO highly correlated with Physical (?0.74), Emotional (?0.57), Functional (?0.66) domains and overall score of FACT-G (?0.74). Similarly, the total score of Part B of the HM-PRO highly correlated with three symptoms scales of EORTC QLQ-C30 (Fatigue scale = ?0.74, Nausea and Vomiting = ?0.52, Pain = ?0.59—p < 0.001) and individual symptom items (Dyspnea = 0.51, Insomnia= 0.43, Appetite loss = 0.54—p < 0.001). Conclusion The construct validity evidence presented in this research is a testimony to the HM-PRO’s ability to measure HRQoL issues which it intends to measure. This is of utmost importance when a PRO is used in routine clinical practice so that the interpretation of the scores or response to an individual item is understood by the clinicians/nurses as intended by the patients.

Project description:BACKGROUND:In the past years, a mobile health (mHealth) app called the Dutch Talking Touch Screen Questionnaire (DTTSQ) was developed in The Netherlands. The aim of development was to enable Dutch physical therapy patients to autonomously complete a health-related questionnaire regardless of their level of literacy and digital skills. OBJECTIVE:The aim of this study was to evaluate the usability (defined as the effectiveness, efficiency, and satisfaction) of the prototype of the DTTSQ for Dutch physical therapy patients with diverse levels of experience in using mobile technology. METHODS:The qualitative Three-Step Test-Interview method, including both think-aloud and retrospective probing techniques, was used to gain insight into the usability of the DTTSQ. A total of 24 physical therapy patients were included. The interview data were analyzed using a thematic content analysis approach aimed at analyzing the accuracy and completeness with which participants completed the questionnaire (effectiveness), the time it took the participants to complete the questionnaire (efficiency), and the extent to which the participants were satisfied with the ease of use of the questionnaire (satisfaction). The problems encountered by the participants in this study were given a severity rating that was used to provide a rough estimate of the need for additional usability efforts. RESULTS:All participants within this study were very satisfied with the ease of use of the DTTSQ. Overall, 9 participants stated that the usability of the app exceeded their expectations. The group of 4 average-/high-experienced participants encountered only 1 problem in total, whereas the 11 little-experienced participants encountered an average of 2 problems per person and the 9 inexperienced participants an average of 3 problems per person. A total of 13 different kind of problems were found during this study. Of these problems, 4 need to be addressed before the DTTSQ will be released because they have the potential to negatively influence future usage of the tool. The other 9 problems were less likely to influence future usage of the tool substantially. CONCLUSIONS:The usability of the DTTSQ needs to be improved before it can be released. No problems were found with satisfaction or efficiency during the usability test. The effectiveness needs to be improved by (1) making it easier to navigate through screens without the possibility of accidentally skipping one, (2) enabling the possibility to insert an answer by tapping on the text underneath a photograph instead of just touching the photograph itself, and (3) making it easier to correct wrong answers. This study shows the importance of including less skilled participants in a usability study when striving for inclusive design and the importance of measuring not just satisfaction but also efficiency and effectiveness during such studies.

Project description:ObjectiveAdult symptomatic lumbar scoliosis (ASLS) is a widespread and debilitating subset of adult spinal deformity. Although many patients benefit from operative treatment, surgery entails substantial cost and risk for adverse events. Patient-reported outcome measures (PROMs) are patient-centered tools used to evaluate the appropriateness of surgery and to assist in the shared decision-making process. Framing realistic patient expectations should include the possible functional limitation to improvement inherent in surgical intervention, such as multilevel fusion to the sacrum. The authors' objective was to predict postoperative ASLS PROMs by using clustering analysis, generalized longitudinal regression models, percentile analysis, and clinical improvement analysis of preoperative health-related quality-of-life scores for use in surgical counseling.MethodsOperative results from the combined ASLS cohorts were examined. PROM score clustering after surgery investigated limits of surgical improvement. Patients were categorized by baseline disability (mild, moderate, moderate to severe, or severe) according to preoperative Scoliosis Research Society (SRS)-22 and Oswestry Disability Index (ODI) scores. Responder analysis for patients achieving improvement meeting the minimum clinically important difference (MCID) and substantial clinical benefit (SCB) standards was performed using both fixed-threshold and patient-specific values (MCID = 30% of remaining scale, SCB = 50%). Best (top 5%), worst (bottom 5%), and median scores were calculated across disability categories.ResultsA total of 171/187 (91%) of patients with ASLS achieved 2-year follow-up. Patients rarely achieved a PROM ceiling for any measure, with 33%-43% of individuals clustering near 4.0 for SRS domains. Patients with severe baseline disability (< 2.0) SRS-pain and SRS-function scores were often left with moderate to severe disability (2.0-2.9), unlike patients with higher (≥ 3.0) initial PROM values. Patients with mild disability according to baseline SRS-function score were unlikely to improve. Crippling baseline ODI disability (> 60) commonly left patients with moderate disability (median ODI = 32). As baseline ODI disability increased, patients were more likely to achieve MCID and SCB (p < 0.001). Compared to fixed threshold values for MCID and SCB, patient-specific values were more sensitive to change for patients with minimal ODI baseline disability (p = 0.008) and less sensitive to change for patients with moderate to severe SRS subscore disability (p = 0.01).ConclusionsThese findings suggest that ASLS surgeries have a limit to possible improvement, probably due to both baseline disability and the effects of surgery. The most disabled patients often had moderate to severe disability (SRS < 3, ODI > 30) at 2 years, emphasizing the importance of patient counseling and expectation management.

Project description:BackgroundThe Near Visual Acuity Questionnaire Presbyopia (NAVQ-P) is a patient-reported outcome (PRO) measure that was developed in a phakic presbyopia population to assess near vision function impacts. The study refined and explored the psychometric properties and score interpretability of the NAVQ-P and additional PRO items assessing near vision correction independence (NVCI), near vision satisfaction (NVS), and near vision correction preference (NVCP).MethodsThis was a psychometric validation study conducted using PRO data collected as part of a Phase IIb clinical trial (CUN8R44 A2202) consisting of 235 randomized adults with presbyopia from the US, Japan, Australia, and Canada. Data collected at baseline, week 2, and months 1, 2, and 3 during the 3-month trial treatment period were included in the analyses to assess item (question) properties, NAVQ-P dimensionality and scoring, reliability, validity, and score interpretation.ResultsItem responses were distributed across the full response scale for most NAVQ-P and additional PRO items. Confirmatory factor analysis supported the pre-defined unidimensional structure and calculation of a NAVQ-P total score as a measure of near vision function. Item deletion informed by item response distributions, dimensionality analyses, item response theory, and previous qualitative findings, including clinical input, supported retention of 14 NAVQ-P items. The 14-item NAVQ-P total score had excellent internal consistency (α = 0.979) and high test-retest reliability (Intraclass Correlation Coefficients > = 0.898). There was good evidence of construct-related validity for all PROs supported by strong correlations with concurrent measures. Excellent results for known-groups validity and ability to detect change analyses were also demonstrated. Anchor-based and distribution-based methods supported interpretation of scores through generation of group-level and within-individual estimates of meaningful change thresholds. A meaningful within-patient change in the range of 8-15-point improvement on the NAVQ-P total score (score range 0-42) was recommended, including a more specific responder definition of 10-point improvement.ConclusionsThe NAVQ-P, NVCI, and NVS are valid and reliable instruments which have the ability to detect change over time. Findings strongly support the use of these measures as outcome assessments in clinical/research studies and in clinical practice in the presbyopia population.