Assessing the content validity of patient-reported outcome measures in adult myositis: A report from the OMERACT myositis working group.
Ontology highlight
ABSTRACT: Objective
To investigate the content validity of several patient-reported outcome measures (PROMs) in patients with idiopathic inflammatory myopathies (IIM).Methods
Seven individual PROM instruments were selected by the Outcome Measures in Rheumatology (OMERACT) Myositis Working Group relating to the following domains: pain, fatigue, physical function and physical activity. Twenty patients from the Johns Hopkins Myositis Center were selected for one-on-one face-to-face or phone interviews for cognitive interviewing of individual PROMs to assess comprehension and content validity. Additionally, patients were asked if they thought muscle symptoms, an area originally identified in qualitative studies, were encapsulated by the other four domains.Results
The majority of patients (>70%) felt that each of the instruments was clear, easy to read and understand, and could be used for assessment of its domain. Two-thirds (66%) of patients felt that 'muscle symptoms' were captured by the other domains.Conclusions
We provided evidence to support adequate content validity for several PROMs. Further research is needed to determine whether 'muscle symptoms' warrant a separate domain.
SUBMITTER: Esfandiary T
PROVIDER: S-EPMC7646936 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:ObjectivePain interference, fatigue, and impaired physical function are common features of idiopathic inflammatory myopathies (IIM). The objective of this study was to evaluate the construct validity and test-retest reliability of the Patient Reported Outcome Information System (PROMIS) Pain Interference 6av1.0, Fatigue 7av1.0, and Physical Function 8bv2.0 instruments.MethodsPatient-Reported Outcome Measures (PROMs) were deployed to adult IIM patients from OMERACT Myositis Working Group (MWG) international clinic sites via two online surveys (2019, 2021). Internal consistency of each PROM was analyzed by Cronbach's α. Construct validity was determined by a priori hypotheses generated by the MWG with >75% agreement for each hypothesis and calculated with Pearson correlations. Test-retest reliability was assessed using intraclass correlation coefficient with PROMIS instruments administered at time zero and 7 days.ResultsSurveys were sent to 368 participants in total; participants who completed each questionnaire varied (n=65 to 263). For construct validity, 10 out of 13 a priori hypotheses were met supporting construct validity of PROMIS instruments (Pain Interference 3/4, fatigue 4/4, and Physical Function 3/5). Test-retest reliability was strong for all PROMIS instruments. All PROMIS instruments demonstrated excellent internal consistency. None of the measures demonstrated any ceiling or floor effects except for a ceiling effect in the Pain Interference instrument.ConclusionsThis study presents test-retest reliability and construct validity evidence supporting PROMIS Pain Interference (6a v1.0), Fatigue (7a v1.0), and Physical Function (8b v2.0) using a large international cohort of patients with IIM. Internal consistency of these instruments was excellent. A ceiling effect was noted in the Pain Interference instrument.
| S-EPMC10354786 | biostudies-literature
Project description:IntroductionAlthough calcium pyrophosphate deposition (CPPD) is common, there are no validated outcome domains and/or measurements for CPPD studies. The aim of this work was to identify domains that have been reported in prior clinical studies in CPPD, to inform the development of a core set of domains for CPPD studies.MethodsWe performed a scoping literature review for clinical studies in CPPD, searching in Medline (via PubMed), EMBASE, and Cochrane Central Register of Controlled Trials (CENTRAL) databases; published from January 1, 1946 to January 7, 2020. All reported outcomes and study design data were extracted and mapped to the core areas and domains as defined by the OMERACT Filter 2.1.The protocol was registered on PROSPERO (CRD: 42019137075; 09-07-2019).FindingsThere were 112 papers identified, comprising of 109 observational studies and three randomized controlled trials. Most studies reported clinical presentations of OA with CPPD or acute CPP crystal arthritis. Outcomes that mapped to 22 domains were identified; the most frequently reported measures mapped to the following domains/sub-domains: imaging (joint damage on imaging tests - 59 studies; joint calcification on imaging tests - 28 studies), joint pain (26 studies), response to treatment (23 studies), side effects of treatment (15 studies), inflammation in the joint fluid or blood (ESR or C-reactive protein - 12 studies; synovial fluid markers - 4 studies; other blood markers - 2 studies), overall function (14 studies), joint swelling (12 studies) and range of joint movement (10 studies). Very few studies mapped to domains related to life impact, societal/resource use or longevity.ConclusionThere is substantial variability in outcomes reported in CPPD studies. Outcomes that map to imaging manifestations, joint pain and response to treatment domains are most often reported.
| S-EPMC10124328 | biostudies-literature
Project description:BackgroundContent validity is the most important measurement property of a patient-reported outcome measure (PROM) and the most challenging to assess. Our aims were to: (1) develop standards for evaluating the quality of PROM development; (2) update the original COSMIN standards for assessing the quality of content validity studies of PROMs; (3) develop criteria for what constitutes good content validity of PROMs, and (4) develop a rating system for summarizing the evidence on a PROM's content validity and grading the quality of the evidence in systematic reviews of PROMs.MethodsAn online 4-round Delphi study was performed among 159 experts from 21 countries. Panelists rated the degree to which they (dis)agreed to proposed standards, criteria, and rating issues on 5-point rating scales ('strongly disagree' to 'strongly agree'), and provided arguments for their ratings.ResultsDiscussion focused on sample size requirements, recording and field notes, transcribing cognitive interviews, and data coding. After four rounds, the required 67% consensus was reached on all standards, criteria, and rating issues. After pilot-testing, the steering committee made some final changes. Ten criteria for good content validity were defined regarding item relevance, appropriateness of response options and recall period, comprehensiveness, and comprehensibility of the PROM.DiscussionThe consensus-based COSMIN methodology for content validity is more detailed, standardized, and transparent than earlier published guidelines, including the previous COSMIN standards. This methodology can contribute to the selection and use of high-quality PROMs in research and clinical practice.
| S-EPMC5891557 | biostudies-literature
Project description:Purpose of reviewWe aimed to systematically evaluate the content validity of patient-reported outcome measures (PROMs) specifically developed to measure (aspects of) health-related quality of life (HRQOL) in people with type 2 diabetes. A systematic review was performed in PubMed and Embase of PROMs measuring perceived symptoms, physical function, mental function, social function/participation, and general health perceptions, and that were validated to at least some extent. Content validity (relevance, comprehensiveness, and comprehensibility) was evaluated using COSMIN methodology.Recent findingsWe identified 54 (different versions of) PROMs, containing 150 subscales. We found evidence for sufficient content validity for only 41/150 (27%) (subscales of) PROMs. The quality of evidence was generally very low. We found 66 out of 150 (44%) (subscales of) PROMs with evidence for either insufficient relevance, insufficient comprehensiveness, or insufficient comprehensibility. For measuring diabetes-specific symptoms, physical function, mental function, social function/participation, and general health perceptions, we identified one to 11 (subscales of) PROMs with sufficient content validity, although quality of the evidence was generally low. For measuring depressive symptoms, no PROM with sufficient content validity was identified. For each aspect of HRQL, we found at least one PROM with sufficient content validity, except for depressive symptoms. The quality of the evidence was mostly very low.
| S-EPMC9355936 | biostudies-literature
Project description:ImportanceChemotherapy-induced peripheral neuropathy (CIPN) is a substantial adverse effect of anticancer treatments. As such, the assessment of CIPN remains critically important in both research and clinic settings.ObjectiveTo compare the validity of various patient-reported outcome measures (PROMs) with neurophysiological and sensory functional measures as the optimal method of CIPN assessment.Design, setting, and participantsThis cohort study evaluated participants treated with neurotoxic chemotherapy across 2 cohorts using a dual-study design. Participants commencing treatment were assessed prospectively at beginning of neurotoxic treatment, midtreatment, and at the end of treatment. Participants who completed treatment up to 5 years prior were assessed cross-sectionally and completed a single assessment time point. Participants were recruited from oncology centers in Australia from August 2015 to November 2022. Data analysis occurred from February to November 2023.ExposuresNeurotoxic cancer treatment including taxanes, platinums, vinca-alkaloids, proteasome inhibitors, and thalidomide.Main outcomes and measuresCIPN was assessed via PROMs (European Organization for Research and Treatment of Cancer Quality of Life Questionnaire [EORTC-CIPN20], Functional Assessment of Cancer Therapy/Gynecological Cancer Group Neurotoxicity Questionnaire (FACT/GOG-Ntx), and the patient-reported outcomes version of the Common Terminology Criteria for Adverse Events [PRO-CTCAE]), neurological and neurophysiological assessment (Total Neuropathy Score and sural and tibial compound nerve amplitudes), and sensory measures (Grating orientation, Von Frey monofilament, and 2-point discrimination tasks). Core measurement properties of CIPN outcome measures were evaluated. Convergent and known-groups validity was assessed cross-sectionally following treatment completion, and responsiveness was evaluated prospectively during treatment. Neurological, neurophysiological, and sensory outcome measure scores were compared between those who reported high and low levels of CIPN symptoms using linear regressions.ResultsA total of 1033 participants (median [IQR] age, 61 [50-59] years; 676 female [65.4%]) were recruited to this study, incorporating 1623 assessments. PROMs demonstrated best ability to accurately assess CIPN (convergent validity), especially the PRO-CTCAE composite score (r = 0.85; P < .001) and EORTC-CIPN20 (r = 0.79; P < .001). PROMS also demonstrated the best ability to discriminate between CIPN severity (known-groups validity) and to detect changes at onset of CIPN development (responsiveness), especially for EORTC-CIPN20 (d = 0.67; 95% CI, 0.52-0.83), FACT/GOG-Ntx (d = 0.65; 95% CI, 0.49-0.81) and the PRO-CTCAE (d = 0.83; 95% CI, 0.64-1.02). Other measures did not achieve threshold for convergent validity (α < 0.7). Neurophysiological and sensory measures did not demonstrate acceptable responsiveness. In regression models, neurological, neurophysiological, and sensory outcome measures were significantly impaired in participants who reported high levels of CIPN symptoms compared with those who reported low levels of CIPN symptoms.Conclusions and relevanceIn this cohort study of 1033 cancer patients, PROMs were the only measures to satisfy all 3 core measurement property criteria (convergent validity, known-groups validity, and responsiveness). These findings suggest that adoption of PROMs in clinical practice can equip clinicians with valuable information in assessing CIPN morbidity.
| S-EPMC11316238 | biostudies-literature
Project description:Background and aimsPatient-reported outcome measures are increasingly important in daily care and research in inflammatory bowel disease [IBD]. This study provides an overview of the content and content validity of IBD-specific patient-reported outcome measures on three selected constructs.MethodsDatabases were searched up to May 2019 for development and/or content validity studies on IBD-specific self-report measures on health-related quality of life, disability, and self-report disease activity in adults. Evidence was synthesised on content validity in three aspects: relevance, comprehensiveness, and comprehensibility following the COnsensus-based Standards for the selection of health Measurement INstruments methodology. Questionnaire items were organised in themes to provide an overview of important aspects of these constructs.ResultsFor 14/44 instruments, 25 content validity studies were identified and 25/44 measures had sufficient content validity, the strongest evidence being of moderate quality, though most evidence is of low or very low quality. The Crohn's Life Impact Questionnaire and IBD questionnaire-32 on quality of life, the IBD-Control on disease activity, and the IBD Disability Index Self-Report and its 8-item version on disability, have the strongest evidence of sufficient relevance, comprehensiveness, and comprehensibility, ranging from moderate to very low quality. A fair number of recurring items themes, possibly important for the selected constructs, was identified.ConclusionsThe body of evidence for content validity of IBD-specific health-related quality of life, self-report disease activity, and disability self-report measures is limited. More content validity studies should be performed after reaching consensus on the constructs of interest for IBD, and studies should involve patients.
| S-EPMC7493218 | biostudies-literature
Project description:BackgroundPatient-reported outcome measures (PROMs) are questionnaires that measure patient outcomes related to quality of life, health, and functioning, and are increasingly used to assess important outcomes from the patient's perspective. For PROMs to contribute to better health and better care, it is vital that their content validity be adequate. This requires patient involvement in various steps of PROM development. PROM developers not only recognize the benefits of patient involvement but also report difficulties in recruiting patients and experience patient involvement as time-consuming, logistically challenging, and expensive.ObjectiveThis study seeks to explore different strategies for disclosing the experiential knowledge of patients, namely through analyzing patient stories on the web and social media. The research questions are as follows: (1) how do bloggers living with a disease experience their health-related quality of life? (2) How are these experiences reflected in the domains and items of PROMs related to their disease?MethodsFirst, a qualitative analysis of blogs written by patients was performed. Second, subthemes and underlying codes resulting from this qualitative analysis were systematically compared with the domains and items in PROMs for the respective diseases that the bloggers write about. Blogs were identified via the Google search engine between December 2019 and May 2021.ResultsBloggers describe a wide range of experiences regarding their physical functioning and health; mental well-being; social network and support; daily life, education, work, and leisure; coping; and self-management. Bloggers also write about their positive and negative experiences with health care delivery, the organization of health care, and health care professionals. In general, patients' experiences as described in blogs were reflected in the domains and items of the PROMs related to their disease. However, except for diabetes mellitus, in all the sets of PROMs, potentially missing topics could be identified. Similarly, with the exception of Parkinson disease, all PROMs address issues that patients did not write about in their blogs and that might therefore be redundant.ConclusionsWeb-based patient stories in the form of blogs reveal how people living with a certain disease experience their health-related quality of life. These stories enable analyses of patients' experiences that can be used to assess the content validity of PROMs. This can be a useful step for researchers who are looking for sets of measuring instruments that match their purposes.
| S-EPMC10422175 | biostudies-literature
Project description:BackgroundThe content validity (appropriateness and acceptability) of patient-reported outcome (PRO) measures for scalp hair loss, eyebrow loss, eyelash loss, nail damage and eye irritation has been demonstrated in adults with alopecia areata (AA) but not adolescents.ObjectivesTo explore the content validity of the suite of AA PRO measures and accompanying photoguides in an adolescent sample.MethodsSemi-structured, 90-min, combined concept elicitation and cognitive interviews were conducted face-to-face with adolescents who experienced ≥ 50% AA-related scalp hair loss. Transcripts underwent thematic and framework analysis.ResultsEleven adolescents (aged 12-17 years, 55% female, 45% nonwhite) diagnosed with AA for 5·9 years (mean) participated. Participants had 69·6% scalp hair (mean) and current eyebrow (82%) and/or eyelash loss (82%) and/or nail involvement (36%). Adolescents reported scalp, eyebrow and eyelash hair loss as their top three most bothersome signs/symptoms. Despite mostly accepting their AA, impacts related to visible areas of hair loss were prominent. Participants demonstrated good understanding and appropriate use of the PRO measures, and advocated including hair loss percentages alongside descriptive categories in the Scalp Hair Assessment PRO™. Results confirmed treatment success thresholds established with adults: achievement of ≤ 20% scalp hair loss, no/minimal eyebrow and eyelash loss, no/a little nail damage and eye irritation (PRO measure categories 0 or 1).ConclusionsThe Scalp Hair Assessment PRO™, PRO Measure for Eyebrows™, PRO Measure for Eyelashes™, PRO Measure for Nail Appearance™ and PRO Measure for Eye Irritation™ and accompanying photoguides are fit-for-purpose self-reported measures of AA signs/symptoms that are impactful to adolescents with AA.
| S-EPMC9305453 | biostudies-literature
Project description:ObjectiveTo define a set of core patient-reported domains and respective instruments for use in idiopathic inflammatory myopathies (IIM). Previously, we reported a systematic literature review on patient-reported outcomes (PRO) in IIM followed by conducting international focus groups to elicit patient perspectives of myositis symptoms and effects.MethodsBased on qualitative content analysis of focus groups, an initial list of 26 candidate domains was constructed. We subsequently conducted an international modified Delphi survey to identify the importance of each of the 26 domains. Participants were asked to rate each domain on a scale of 0-10 (0 = not important, 10 = very important).ResultsIn this first round of the Delphi survey, 643 patients participated from the United States (n = 543), Sweden (n = 49), and South Korea (n = 51). Of the 26 domains, 19 (73%) were rated of high importance (≥ 7/10). The top 5 domains were muscle symptoms, fatigue, interactions with healthcare, medication side effects, and pain. During Outcome Measures in Rheumatology (OMERACT) 2016, we discussed the goal for ultimate reduction in the number of domains and the importance of considering representation of healthcare providers from other specialties, caregivers, representatives of pharmaceutical industries, and regulatory authorities in the next rounds of Delphi to represent broader perspectives on IIM.ConclusionFurther prioritization and a reduction in the number of domains will be needed for the next Delphi. At the next biennial OMERACT meeting, we aim to present and seek voting on a Myositis Preliminary PRO Core Set to enable ultimate measure selection and development.
| S-EPMC6106775 | biostudies-literature
Project description:BackgroundThe quality of life of patients at all stages of hematological malignancy is greatly affected by the disease and its treatment. There is a wide range of health-related quality of life (HRQoL) issues important to these patients. Any new instrument developed to measure HRQoL of such patients should be content valid, i.e., the items should be comprehensively relevant to the patients and their health condition. The aim of the present study was to examine content validity of a hematological malignancy specific patient reported outcome measure (HM-PRO) developed for use in routine clinical practice.MethodsFollowing literature review and semi-structured interviews, the generated themes and sub-themes were discussed to develop the prototype version of the HM-PRO. A 4-step approach was used for content validation: initial testing and cognitive interviewing; item rating; content validity panel meeting; final field testing and cognitive interviewing. Additional questions related to patients' perception of recall period and preferred sentence structure (i.e., question or statement) of the items were also asked during cognitive interviews.ResultsThe content analysis of 129 transcribed semi-structured interviews resulted in the prototype version of the instrument consisting of 58 items grouped into two parts: Part A (impact/HRQoL - 34 items) and Part B (signs and symptoms - 24 items). The initial testing showed intra-class correlation coefficient (ICC) of >0.8 for both Part A and Part B. Item rating for language clarity, completeness, relevance, and response scale by experts and patients showed content validity index for scales average >0.8 for both Part A and Part B, except 0.64 for relevance for Part A by the patient panel. The final testing of the revised version of the instrument showed the Cronbach's alpha value of 0.91 for Part A and 0.76 for Part B, suggesting high internal consistency, and ICC of 0.91 for Part A and 0.76 for Part B. The recall period of "today" for Part-A and "last 3 days" for Part-B were the patients' preferred "recall period." Furthermore, the patients expressed preference to the HM-PRO items as statements.ConclusionThe findings of this study confirm that the HM-PRO possesses a strong content validity, includes all the issues important to patients and is easy to read, understand and respond to spontaneously.
| S-EPMC7066982 | biostudies-literature