Dataset Information

Assessing the content validity of patient-reported outcome measures in adult myositis: A report from the OMERACT myositis working group.

ABSTRACT:

Objective

To investigate the content validity of several patient-reported outcome measures (PROMs) in patients with idiopathic inflammatory myopathies (IIM).

Methods

Seven individual PROM instruments were selected by the Outcome Measures in Rheumatology (OMERACT) Myositis Working Group relating to the following domains: pain, fatigue, physical function and physical activity. Twenty patients from the Johns Hopkins Myositis Center were selected for one-on-one face-to-face or phone interviews for cognitive interviewing of individual PROMs to assess comprehension and content validity. Additionally, patients were asked if they thought muscle symptoms, an area originally identified in qualitative studies, were encapsulated by the other four domains.

Results

The majority of patients (>70%) felt that each of the instruments was clear, easy to read and understand, and could be used for assessment of its domain. Two-thirds (66%) of patients felt that 'muscle symptoms' were captured by the other domains.

Conclusions

We provided evidence to support adequate content validity for several PROMs. Further research is needed to determine whether 'muscle symptoms' warrant a separate domain.

SUBMITTER: Esfandiary T

PROVIDER: S-EPMC7646936 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ImportanceChemotherapy-induced peripheral neuropathy (CIPN) is a substantial adverse effect of anticancer treatments. As such, the assessment of CIPN remains critically important in both research and clinic settings.ObjectiveTo compare the validity of various patient-reported outcome measures (PROMs) with neurophysiological and sensory functional measures as the optimal method of CIPN assessment.Design, setting, and participantsThis cohort study evaluated participants treated with neurotoxic chemotherapy across 2 cohorts using a dual-study design. Participants commencing treatment were assessed prospectively at beginning of neurotoxic treatment, midtreatment, and at the end of treatment. Participants who completed treatment up to 5 years prior were assessed cross-sectionally and completed a single assessment time point. Participants were recruited from oncology centers in Australia from August 2015 to November 2022. Data analysis occurred from February to November 2023.ExposuresNeurotoxic cancer treatment including taxanes, platinums, vinca-alkaloids, proteasome inhibitors, and thalidomide.Main outcomes and measuresCIPN was assessed via PROMs (European Organization for Research and Treatment of Cancer Quality of Life Questionnaire [EORTC-CIPN20], Functional Assessment of Cancer Therapy/Gynecological Cancer Group Neurotoxicity Questionnaire (FACT/GOG-Ntx), and the patient-reported outcomes version of the Common Terminology Criteria for Adverse Events [PRO-CTCAE]), neurological and neurophysiological assessment (Total Neuropathy Score and sural and tibial compound nerve amplitudes), and sensory measures (Grating orientation, Von Frey monofilament, and 2-point discrimination tasks). Core measurement properties of CIPN outcome measures were evaluated. Convergent and known-groups validity was assessed cross-sectionally following treatment completion, and responsiveness was evaluated prospectively during treatment. Neurological, neurophysiological, and sensory outcome measure scores were compared between those who reported high and low levels of CIPN symptoms using linear regressions.ResultsA total of 1033 participants (median [IQR] age, 61 [50-59] years; 676 female [65.4%]) were recruited to this study, incorporating 1623 assessments. PROMs demonstrated best ability to accurately assess CIPN (convergent validity), especially the PRO-CTCAE composite score (r = 0.85; P < .001) and EORTC-CIPN20 (r = 0.79; P < .001). PROMS also demonstrated the best ability to discriminate between CIPN severity (known-groups validity) and to detect changes at onset of CIPN development (responsiveness), especially for EORTC-CIPN20 (d = 0.67; 95% CI, 0.52-0.83), FACT/GOG-Ntx (d = 0.65; 95% CI, 0.49-0.81) and the PRO-CTCAE (d = 0.83; 95% CI, 0.64-1.02). Other measures did not achieve threshold for convergent validity (α < 0.7). Neurophysiological and sensory measures did not demonstrate acceptable responsiveness. In regression models, neurological, neurophysiological, and sensory outcome measures were significantly impaired in participants who reported high levels of CIPN symptoms compared with those who reported low levels of CIPN symptoms.Conclusions and relevanceIn this cohort study of 1033 cancer patients, PROMs were the only measures to satisfy all 3 core measurement property criteria (convergent validity, known-groups validity, and responsiveness). These findings suggest that adoption of PROMs in clinical practice can equip clinicians with valuable information in assessing CIPN morbidity.

Project description:BackgroundPatient-reported outcome measures (PROMs) are questionnaires that measure patient outcomes related to quality of life, health, and functioning, and are increasingly used to assess important outcomes from the patient's perspective. For PROMs to contribute to better health and better care, it is vital that their content validity be adequate. This requires patient involvement in various steps of PROM development. PROM developers not only recognize the benefits of patient involvement but also report difficulties in recruiting patients and experience patient involvement as time-consuming, logistically challenging, and expensive.ObjectiveThis study seeks to explore different strategies for disclosing the experiential knowledge of patients, namely through analyzing patient stories on the web and social media. The research questions are as follows: (1) how do bloggers living with a disease experience their health-related quality of life? (2) How are these experiences reflected in the domains and items of PROMs related to their disease?MethodsFirst, a qualitative analysis of blogs written by patients was performed. Second, subthemes and underlying codes resulting from this qualitative analysis were systematically compared with the domains and items in PROMs for the respective diseases that the bloggers write about. Blogs were identified via the Google search engine between December 2019 and May 2021.ResultsBloggers describe a wide range of experiences regarding their physical functioning and health; mental well-being; social network and support; daily life, education, work, and leisure; coping; and self-management. Bloggers also write about their positive and negative experiences with health care delivery, the organization of health care, and health care professionals. In general, patients' experiences as described in blogs were reflected in the domains and items of the PROMs related to their disease. However, except for diabetes mellitus, in all the sets of PROMs, potentially missing topics could be identified. Similarly, with the exception of Parkinson disease, all PROMs address issues that patients did not write about in their blogs and that might therefore be redundant.ConclusionsWeb-based patient stories in the form of blogs reveal how people living with a certain disease experience their health-related quality of life. These stories enable analyses of patients' experiences that can be used to assess the content validity of PROMs. This can be a useful step for researchers who are looking for sets of measuring instruments that match their purposes.

Project description:BackgroundThe quality of life of patients at all stages of hematological malignancy is greatly affected by the disease and its treatment. There is a wide range of health-related quality of life (HRQoL) issues important to these patients. Any new instrument developed to measure HRQoL of such patients should be content valid, i.e., the items should be comprehensively relevant to the patients and their health condition. The aim of the present study was to examine content validity of a hematological malignancy specific patient reported outcome measure (HM-PRO) developed for use in routine clinical practice.MethodsFollowing literature review and semi-structured interviews, the generated themes and sub-themes were discussed to develop the prototype version of the HM-PRO. A 4-step approach was used for content validation: initial testing and cognitive interviewing; item rating; content validity panel meeting; final field testing and cognitive interviewing. Additional questions related to patients' perception of recall period and preferred sentence structure (i.e., question or statement) of the items were also asked during cognitive interviews.ResultsThe content analysis of 129 transcribed semi-structured interviews resulted in the prototype version of the instrument consisting of 58 items grouped into two parts: Part A (impact/HRQoL - 34 items) and Part B (signs and symptoms - 24 items). The initial testing showed intra-class correlation coefficient (ICC) of >0.8 for both Part A and Part B. Item rating for language clarity, completeness, relevance, and response scale by experts and patients showed content validity index for scales average >0.8 for both Part A and Part B, except 0.64 for relevance for Part A by the patient panel. The final testing of the revised version of the instrument showed the Cronbach's alpha value of 0.91 for Part A and 0.76 for Part B, suggesting high internal consistency, and ICC of 0.91 for Part A and 0.76 for Part B. The recall period of "today" for Part-A and "last 3 days" for Part-B were the patients' preferred "recall period." Furthermore, the patients expressed preference to the HM-PRO items as statements.ConclusionThe findings of this study confirm that the HM-PRO possesses a strong content validity, includes all the issues important to patients and is easy to read, understand and respond to spontaneously.