Dataset Information

Psychometric Validation and Meaningful Change Thresholds of the New Nasal Polyposis Symptom Diary.

ABSTRACT:

Objectives

The Nasal Polyposis Symptom Diary (NPSD) is a novel and short patient-reported outcome (PRO) tool specifically developed to assess important and relevant symptoms reported by patients with chronic rhinosinusitis with nasal polyposis (CRSwNP). We evaluated the psychometric properties of 4 predefined NPSD-derived scores intended to support symptom-improvement assessments of investigational therapies for inclusion in product labeling.

Methods

Five hundred eighteen patients with severe CRSwNP from a Phase III clinical trial (NCT03401229) completed the NPSD, comprising 11 items: 8 symptom-specific, 2 symptom-impact, and 1 optional medication-compliance. The psychometric characteristics of 3 single-item symptom scores (Nasal Blockage Score [NBS], Nasal Congestion Score [NCS], and Difficulty with Sense of Smell Score [DSS]) and a Total Symptom Score (TSS, summary of the 8 symptom-specific items) were evaluated for reliability, validity, and ability to detect change. Within-patient meaningful change thresholds (MCTs) were established using anchor- and distribution-based methods. Comparative PROs included the 22-item Sino-Nasal Outcome Test (SNOT-22) and Patient Global Impression of Severity (PGI-S).

Results

The TSS exhibited strong internal consistency (Cronbach α = .88) and test-retest reliability (intraclass correlation coefficient >.80). Correlation between the TSS and SNOT-22 total score indicated good convergent validity (r = .70). All 4 NPSD scores demonstrated known-groups validity (significant differences among subgroups of patients with predetermined disease severity levels based on PGI-S categories) and were sensitive to detect change in patients' clinical status (significant differences among subgroups of patients with reported changes between 2 time-points in PGI-S and Patient Global Impression of Change scores). MCTs for improvement were established at 1.0 point for NBS, NCS, and DSS, and 4.0 points for TSS.

Conclusion

These findings support the reliability, validity, and suitability of the 4 NPSD-derived scores for evaluating treatment effect on CRSwNP symptoms and their use in clinical trials with predetermined MCTs for improvement.

SUBMITTER: Shih VH

PROVIDER: S-EPMC10571433 | biostudies-literature | 2023 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Psychometric Validation and Meaningful Change Thresholds of the New Nasal Polyposis Symptom Diary.

Shih Vivian H VH Slagle Ashley F AF Ivanescu Cristina C Flore Giulio G Meyers Oren O Kreindler James J Martin Ubaldo J UJ Werkström Viktoria V

The Annals of otology, rhinology, and laryngology 20230604 12

<h4>Objectives</h4>The Nasal Polyposis Symptom Diary (NPSD) is a novel and short patient-reported outcome (PRO) tool specifically developed to assess important and relevant symptoms reported by patients with chronic rhinosinusitis with nasal polyposis (CRSwNP). We evaluated the psychometric properties of 4 predefined NPSD-derived scores intended to support symptom-improvement assessments of investigational therapies for inclusion in product labeling.<h4>Methods</h4>Five hundred eighteen patients ...[more]

PMID: 37271980

Similar Datasets

Project description:ImportanceDefining meaningful improvement using the Total Vitiligo Area Scoring Index (T-VASI) and the Facial VASI (F-VASI) aids interpretation of findings from clinical trials evaluating vitiligo treatments; however, clear and clinically meaningful thresholds have not yet been established.ObjectiveTo assess concept validity and measurement performance of the T-VASI and F-VASI in patients with nonsegmental vitiligo and to identify meaningful change thresholds.Design, settings, and participantsThis mixed-methods study consisted of a secondary analysis of a phase 2 multicenter double-blind dose-ranging randomized clinical trial and embedded qualitative interviews conducted at 35 sites in Canada, France, Japan, and the US. The secondary analysis included the trial's adult patients with nonsegmental vitiligo (T-VASI ≥5 and F-VASI ≥0.5 at baseline). Psychometric performance of the T-VASI and F-VASI and thresholds for meaningful change were evaluated using clinician- and patient-reported information. The trial's embedded interviews were used to qualitatively assess content validity and patient perceptions of meaningful repigmentation. Data analyses were performed from March to July 2023.InterventionParticipants were randomized to 6-, 11-, or 22-mg/day upadacitinib or placebo for 24 weeks.Main outcomes and measuresPsychometric performance of the T-VASI and F-VASI and thresholds for meaningful changed plus content validity and patient perceptions of meaningful repigmentation. Measurement instruments included the T-VASI, F-VASI, Vitiligo Noticeability Scale, Total-Patient Global Vitiligo Assessment, Face-Patient Global Vitiligo Assessment, Total-Physician Global Vitiligo Assessment (PhGVA-T), Face-Physician Global Vitiligo Assessment (PhGVA-F), Patient's Global Impression of Change-Vitiligo, Physician's Global Impression of Change-Vitiligo (PhGIC-V), Vitiligo Quality-of-Life Instrument, Dermatology Life Quality Index, the Hospital Anxiety and Depression Scale, and transcribed verbatim interviews with patients.ResultsThe psychometric analysis included 164 participants (mean [SD] age, 46 years; 103 [63%] females) and the qualitative analysis included 14 participants (mean [SD] age, 48.8 [12.2] years; 9 females [64%] and 5 males [36%]). Intraclass correlation coefficients were 0.98 for T-VASI and 0.99 for F-VASI in patients with clinically stable vitiligo between baseline and week 4, supporting test-retest reliability. At baseline and week 24, correlations were moderate to strong between T-VASI and PhGVA-T (r = 0.63-0.65) and between F-VASI and PhGVA-F (r = 0.65-0.71). Average baseline and week-24 VASI scores decreased with repigmentation (ie, increasing PhGVA scores). Least-square mean VASI scores increased with greater repigmentation as measured by the PhGIC-V. Least-square mean VASI scores also differed between patients with improved PhGIC-V and those with no change or worsened V-PhGIC scores. Using a multiple anchor approach, improvements of 30% in T-VASI and 50% in F-VASI scores reflected meaningful repigmentation between baseline and week 24.Conclusion and relevanceThis mixed-methods study found that the T-VASI and F-VASI are reliable, valid, able to differentiate between clinically distinct groups, and responsive in patients with nonsegmental vitiligo. The thresholds for meaningful change were lower than those historically used in clinical trials, suggesting that T-VASI 50 and F-VASI 75 are conservative estimates and reflect improvements that would be meaningful in patients with nonsegmental vitiligo.Trial registrationClinicalTrials.gov Identifier: NCT04927975.

Project description:ImportanceChange from baseline score on the validated Psoriasis Symptoms and Signs Diary (PSSD) is a widely used, patient-reported end point in clinical trials for psoriasis. Meaningful score change thresholds anchored to patient-reported assessments have not been established in a clinical trial setting.ObjectiveTo evaluate meaningful within-patient score change thresholds for the PSSD using data from the phase 3 Program to Evaluate the Efficacy and Safety of Deucravacitinib, a Selective TYK2 Inhibitor (POETYK), PSO-1 clinical trial, which compared the efficacy and safety of deucravacitinib vs placebo and apremilast among adults with moderate to severe plaque psoriasis.Design, setting, and participantsIn this predefined analysis using data from the POETYK PSO-1 multicenter, randomized, double-blind, placebo-controlled phase 3 clinical trial, conducted from August 7, 2018, to September 2, 2020, 666 adults with moderate to severe plaque psoriasis completed the PSSD daily throughout the trial. Meaningful change thresholds were derived by anchoring mean PSSD score change from baseline to week 16 to category improvements on the Patient Global Impression of Change (PGI-C) and the Patient Global Impression of Severity (PGI-S).InterventionsDeucravacitinib, 6 mg, once daily; placebo; or apremilast, 30 mg, twice daily.Main outcome and measuresThe main outcome was score change from baseline to week 16 on the PSSD, anchored to the PGI-C and PGI-S.ResultsThe trial included 666 patients (mean [SD] age, 46.1 [13.4] years; 453 men [68.0%]). Three thresholds were identified using an analysis set of 609 patients. Score improvement of at least 15 points from baseline reflected meaningful within-patient change anchored to the PGI-C. Score improvements of 25 points were supported by both the PGI-C and the PGI-S, while a 30-point score change identified patients with greater improvements in their psoriasis symptoms and signs.Conclusions and relevanceThis analysis suggests that PSSD score improvements of 15, 25, or 30 points represent increasing improvements in disease burden that are meaningful to patients with psoriasis.

Project description:BackgroundPatient-reported outcome measures that facilitate self-report by children are needed to reduce the bias of proxy report. We previously developed an electronic Pediatric Asthma Symptom Diary (ePASD) to assess the severity of daily asthma symptoms and proximal impacts in children aged 6-11 years with mild to severe asthma. The ePASD, administered via a digital application with visuals, sounds, and text, is uniquely designed to minimize the importance of reading skills on children's ability to self-report accurately. Here, we describe the ePASD's psychometric properties.MethodsNinety-one children aged 6-11 years with mild to severe asthma and their caregivers participated in 2 study visits, which consisted of training on the provisioned device and completing asthma-specific clinical outcome assessment (COA) questionnaires. The children self-completed the ePASD at home twice daily for 8 consecutive days. The scoring of the ePASD was guided by factor analyses, inter-item correlations, and internal consistencies. Reliability, discriminating ability, construct validity, and responsiveness were evaluated for ePASD items and candidate scores.ResultsAll COAs included in the study-the ePASD, Asthma Control Questionnaire (ACQ), Childhood Asthma Control Test, Pediatric Asthma Quality of Life Questionnaire-Standardized (PAQLQ[S]), and global ratings-demonstrated that the children exhibited few asthma-related symptoms and impacts at all timepoints, and consequently, showed little change over time. Internal consistencies (all Cronbach's alphas ≥ 0.52) and test-retest reliabilities (all intraclass correlation coefficients ≥ 0.60) were largely satisfactory. Patterns of convergent and divergent correlations supported the construct validity of ePASD scores. The ePASD symptom scores correlated moderately to strongly with PAQLQ(S) Symptom scores (all correlations ≥ - 0.46) and with ACQ scores (all correlations ≥ 0.42), as predicted. Evidence of the discriminating ability of ePASD items and composite scores was demonstrated by known-groups analyses.ConclusionsThe ePASD is a reliable and valid measure of asthma symptoms and proximal impacts in children aged 6-11 years with mild, moderate, or severe asthma. These results lay the psychometric groundwork for use of the ePASD in future clinical trials for the management of pediatric asthma. An ongoing pediatric asthma treatment trial is anticipated to provide evidence of the ePASD's responsiveness to change.

Dataset Information

Psychometric Validation and Meaningful Change Thresholds of the New Nasal Polyposis Symptom Diary.

Objectives

Methods

Results

Conclusion

Publications

Psychometric Validation and Meaningful Change Thresholds of the New Nasal Polyposis Symptom Diary.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets