Dataset Information

Content Validity of the Lee Chronic Graft-versus-Host Disease Symptom Scale as Assessed by Cognitive Interviews.

ABSTRACT: The Lee Chronic Graft-versus-Host Disease (cGVHD) Symptom Scale has been recommended for use by the 2005 and 2014 National Institutes of Health (NIH) Consensus Conferences to capture cGVHD symptoms. Although the cGVHD Symptom Scale was previously validated, this study aims to reexamine the instrument's content validity by exploring the clarity, comprehensibility, relevance, and ease of use in a contemporary cGVHD sample, toward Food and Drug Administration (FDA) qualification of this patient-reported outcomes (PRO) instrument as a drug development tool. Attaining FDA qualification means that an instrument has been judged to be a reliable and valid measure of clinical benefit. Twenty adult patients with a median age of 58 year (range, 31 to 79 years) participated. The median duration of cGVHD was 33 months (range, 0 to 134.4 months), and current NIH severity score was mild in 1 patient, moderate in 10 patients, and severe in 9 patients, with a median of 5.5 treatments (range, 0 to 14) ever used for cGVHD. The median summary score was 23 (range, 8 to 51), and the median time to complete the scale was 2 minutes, 7 seconds (range, 1 minute, 8 seconds to 4 minutes). Symptoms of cGVHD were well captured on the Lee cGVHD Symptom Scale, although 4 additional symptoms/signs were mentioned by 15% of the participants. Participants mostly reported that item wording was clear and provided accurate definitions of specific terminologies; however, 7 participants (35%) reported finding 1 or more items in the skin domain unclear, reporting, for example, that rashes and itchy skin seemed synonymous. Two of 19 participants (10.5%) described how their answers would have changed had they been asked about their symptoms within the past month instead of within the past week, owing to recently resolved symptoms. All participants were able to accurately explain the concept of "bother" in their own words and distinguish it from symptom severity or other related symptom attributes. In summary, participants found the Lee GVHD Symptom Scale to be a comprehensive and understandable way to report their cGVHD symptom experience. Future work will focus on options for the recall period, the phrasing of skin items, and whether some very rare symptoms (eg, feeding tube, use of oxygen) should continue to be a part of the scale.

SUBMITTER: Merkel EC

PROVIDER: S-EPMC4850024 | biostudies-literature | 2016 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Content Validity of the Lee Chronic Graft-versus-Host Disease Symptom Scale as Assessed by Cognitive Interviews.

Merkel Emily C EC Mitchell Sandra A SA Lee Stephanie J SJ

Biology of blood and marrow transplantation : journal of the American Society for Blood and Marrow Transplantation 20160102 4

The Lee Chronic Graft-versus-Host Disease (cGVHD) Symptom Scale has been recommended for use by the 2005 and 2014 National Institutes of Health (NIH) Consensus Conferences to capture cGVHD symptoms. Although the cGVHD Symptom Scale was previously validated, this study aims to reexamine the instrument's content validity by exploring the clarity, comprehensibility, relevance, and ease of use in a contemporary cGVHD sample, toward Food and Drug Administration (FDA) qualification of this patient-rep ...[more]

PMID: 26751003

Similar Datasets

Project description:BackgroundAvailable measures of patient-reported outcomes for complementary and alternative medicine (CAM) inadequately capture the range of patient-reported treatment effects. The Self-Assessment of Change questionnaire was developed to measure multi-dimensional shifts in well-being for CAM users. With content derived from patient narratives, items were subsequently focused through interviews on a new cohort of participants. Here we present the development of the final version in which the content and format is refined through cognitive interviews.MethodsWe conducted cognitive interviews across five iterations of questionnaire refinement with a culturally diverse sample of 28 CAM users. In each iteration, participant critiques were used to revise the questionnaire, which was then re-tested in subsequent rounds of cognitive interviews. Following all five iterations, transcripts of cognitive interviews were systematically coded and analyzed to examine participants' understanding of the format and content of the final questionnaire. Based on this data, we established summary descriptions and selected exemplar quotations for each word pair on the final questionnaire.ResultsThe final version of the Self-Assessment of Change questionnaire (SAC) includes 16 word pairs, nine of which remained unchanged from the original draft. Participants consistently said that these stable word pairs represented opposite ends of the same domain of experience and the meanings of these terms were stable across the participant pool. Five pairs underwent revision and two word pairs were added. Four word pairs were eliminated for redundancy or because participants did not agree on the meaning of the terms. Cognitive interviews indicate that participants understood the format of the questionnaire and considered each word pair to represent opposite poles of a shared domain of experience.ConclusionsWe have placed lay language and direct experience at the center of questionnaire revision and refinement. In so doing, we provide an innovative model for the development of truly patient-centered outcome measures. Although this instrument was designed and tested in a CAM-specific population, it may be useful in assessing multi-dimensional shifts in well-being across a broader patient population.

Project description:BackgroundChronic graft-versus-host disease (cGVHD) is a debilitating late complication of hematopoietic stem cell transplantation. It is often accompanied by extensive symptom burden. No validated cGVHD patient-reported outcome (PRO) measure exists to evaluate cGVHD symptom bother in children and adolescents younger than 18 years. This paper presents the study protocol for a multi-center, two-phase protocol to develop a psychometrically valid pediatric cGVHD Symptom Scale (PCSS) and a companion caregiver-proxy measure to capture the symptom burden experienced by children with cGVHD. In the first phase of the study, our aim is to evaluate the comprehension, clarity and ease of response of the PCSS through cognitive interviewing and to iteratively refine the measure to optimize content validity. In the second phase of the study, we will quantitatively examine the measurement properties of the PCSS in children and their caregiver-proxies.Methods and analysisEligible participants are children/adolescents ages 5-17 with cGVHD who are receiving systemic immunosuppressive treatment or have recently tapered to discontinuation. In the first phase, we are enrolling 60 child and caregiver-proxy dyads in three child age strata (5-7, 8-12, and 13-17 years old). Semi-scripted cognitive debriefing interviews are conducted to assess comprehension, clarity, and ease of response of each PCSS item with the child alone, and then jointly with the caregiver-proxy to explore discordant ratings. In phase two, an age-stratified cohort of 120 child-caregiver dyads will be enrolled to evaluate test-retest reliability, construct validity, and responsiveness. Anchors for known-groups validity include the PedsQL module and clinical variables, including cGVHD clinician-rated severity scores. In participants ages 13-17, we will also compare responses on the PCSS with those from the Lee cGVHD Symptom Scale, to gauge the youngest age at which adolescent respondents can comprehend this adult measure.DiscussionThis study will yield a well-validated, counterpart measure to the Lee cGVHD Symptom Scale for use in children with cGVHD and their caregiver-proxies. This new patient-reported outcome measure can be integrated into clinical trials and care delivery for pediatric transplant survivors to improve the precision and accuracy with which their cGVHD symptom experience is captured.Clinical trial registrationwww.ClinicalTrials.gov, NCT04044365.

Project description:BackgroundSituational judgment tests (SJTs) are used in health sciences education to measure examinee knowledge using case-based scenarios. Despite their popularity, there is a significant gap in the validity research on the response process that demonstrates how SJTs measure their intended constructs. A model of SJT response processes has been proposed in the literature by Robert Ployhart; however, few studies have explored and expanded the factors. The purpose of this study was to describe the factors involved in cognitive processes that examinees use as they respond to SJT items in a health professions education context.MethodsThirty participants-15 student pharmacists and 15 practicing pharmacists-completed a 12-item SJT designed to measure empathy. Each participant engaged in a think-aloud interview while completing the SJT, followed by a cognitive interview probing their decision-making processes. Interviews were transcribed and independently coded by three researchers to identify salient factors that contributed to response processes.ResultsThe findings suggest SJT response processes include all four stages (comprehension, retrieval, judgment, and response selection) as initially proposed by Ployhart. The study showed factors from other published research were present, including job-specific knowledge and experiences, emotional intelligence, and test-taking. The study also identified new factors not yet described, including identifying a task objective in the scenario, assumptions about the scenario, perceptions about the scenario, and the setting of the item.ConclusionsThis study provides additional SJT validity evidence by exploring participants' response processes through cognitive and think-aloud interviews. It also confirmed the four-stage model previously described by Ployhart and identified new factors that may influence SJT response processes. This study contributes to the literature with an expanded SJT response process model in a health professions education context and offers an approach to evaluate SJT response processes in the future.

Dataset Information

Content Validity of the Lee Chronic Graft-versus-Host Disease Symptom Scale as Assessed by Cognitive Interviews.

Publications

Content Validity of the Lee Chronic Graft-versus-Host Disease Symptom Scale as Assessed by Cognitive Interviews.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets