Dataset Information

Pre-validation methods for developing a patient reported outcome instrument.

ABSTRACT: BACKGROUND:Measures that reflect patients' assessment of their health are of increasing importance as outcome measures in randomised controlled trials. The methodological approach used in the pre-validation development of new instruments (item generation, item reduction and question formatting) should be robust and transparent. The totality of the content of existing PRO instruments for a specific condition provides a valuable resource (pool of items) that can be utilised to develop new instruments. Such 'top down' approaches are common, but the explicit pre-validation methods are often poorly reported. This paper presents a systematic and generalisable 5-step pre-validation PRO instrument methodology. METHODS:The method is illustrated using the example of the Aberdeen Glaucoma Questionnaire (AGQ). The five steps are: 1) Generation of a pool of items; 2) Item de-duplication (three phases); 3) Item reduction (two phases); 4) Assessment of the remaining items' content coverage against a pre-existing theoretical framework appropriate to the objectives of the instrument and the target population (e.g. ICF); and 5) qualitative exploration of the target populations' views of the new instrument and the items it contains. RESULTS:The AGQ 'item pool' contained 725 items. Three de-duplication phases resulted in reduction of 91, 225 and 48 items respectively. The item reduction phases discarded 70 items and 208 items respectively. The draft AGQ contained 83 items with good content coverage. The qualitative exploration ('think aloud' study) resulted in removal of a further 15 items and refinement to the wording of others. The resultant draft AGQ contained 68 items. CONCLUSIONS:This study presents a novel methodology for developing a PRO instrument, based on three sources: literature reporting what is important to patient; theoretically coherent framework; and patients' experience of completing the instrument. By systematically accounting for all items dropped after the item generation phase, our method ensures that the AGQ is developed in a transparent, replicable manner and is fit for validation. We recommend this method to enhance the likelihood that new PRO instruments will be appropriate to the research context in which they are used, acceptable to research participants and likely to generate valid data.

SUBMITTER: Prior ME

PROVIDER: S-EPMC3225127 | biostudies-literature | 2011 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Pre-validation methods for developing a patient reported outcome instrument.

Prior Maria E ME Hamzah Jemaima Che JC Francis Jillian J JJ Ramsay Craig R CR Castillo Mayret M MM Campbell Susan E SE Azuara-Blanco Augusto A Burr Jennifer M JM

BMC medical research methodology 20110809

<h4>Background</h4>Measures that reflect patients' assessment of their health are of increasing importance as outcome measures in randomised controlled trials. The methodological approach used in the pre-validation development of new instruments (item generation, item reduction and question formatting) should be robust and transparent. The totality of the content of existing PRO instruments for a specific condition provides a valuable resource (pool of items) that can be utilised to develop new ...[more]

PMID: 21827689

Similar Datasets

Project description:ObjectivesTo examine the acceptability and validity of two patient-reported outcome measures (PROMs) for adult acne, comparing them to the validated Acne-specific Quality of Life (Acne-QoL) measure.DesignMixed-methods validation study.SettingParticipants were recruited by (1) mail-out through primary care if they had ever consulted for acne and received a prescription for acne treatment within the last 6 months, (2) opportunistically in secondary care and (3) poster advertisement in community venues.Participants221 (204 quantitative and 17 qualitative) participants with acne, aged 18-50 years.Outcome measuresQuantitative sub-study participants completed Acne-QoL, Skindex-16 and Comprehensive Acne Quality of Life Scale (CompAQ) at baseline, 24 hours and 6 weeks. Qualitative sub-study participants took part in cognitive think-aloud interviews, while completing the same measures. Transcribed audio recordings were analysed using inductive thematic analysis.ResultsQuantitative analyses suggested high internal consistency (Cronbach's alpha 0.74-0.96) and reliability (intraclass correlation coefficient values 0.88-0.97) for both questionnaires. Both scales showed floor effects on some subdomains. Skindex-16 and CompAQ showed good evidence of construct validity when compared with Acne-QoL with Spearman's correlation coefficients 0.54-0.81, and good repeatability over 24 hours.Qualitative data uncovered wide-ranging views regarding usability and acceptability. Interviewees held strong but differing views about layout, question/response wording, redundant/similar questions and guidance notes. Similarly, interviewees differed in perceptions of acceptability of the different scales, particularly on relatability of questions and emotive reactions to scales.ConclusionsAll PROMs performed well in statistical analyses. No PROM showed superior usability and acceptability in the qualitative study. Any PROM should be acceptable for further research in adult acne but researchers should consider the different domains and whether they will measure only facial or facial and trunk acne before making a selection. A new PROM or further evaluation of novel PROMs may be beneficial.

Project description:Background and objectivesFatigue is a very common and debilitating symptom and identified by patients as a critically important core outcome to be included in all trials involving patients receiving hemodialysis. A valid, standardized measure for fatigue is needed to yield meaningful and relevant evidence about this outcome. This study validated a core patient-reported outcome measure for fatigue in hemodialysis.Design, setting, participants, & measurementsA longitudinal cohort study was conducted to assess the validity and reliability of a new fatigue measure (Standardized Outcomes in Nephrology-Hemodialysis Fatigue [SONG-HD Fatigue]). Eligible and consenting patients completed the measure at three time points: baseline, a week later, and 12 days following the second time point. Cronbach α and intraclass correlation coefficient were calculated to assess internal consistency, and Spearman rho was used to assess convergent validity. Confirmatory factor analysis was also conducted. Hemodialysis units in the United Kingdom, Australia, and Romania participated in this study. Adult patients aged 18 years and over who were English speaking and receiving maintenance hemodialysis were eligible to participate. Standardized Outcomes in Nephrology-Hemodialysis, the Visual Analog Scale for fatigue, the 12-Item Short Form Survey, and Functional Assessment of Chronic Illness Therapy-Fatigue were used.ResultsIn total, 485 participants completed the study across the United Kingdom, Australia, and Romania. Psychometric assessment demonstrated that Standardized Outcomes in Nephrology-Hemodialysis is internally consistent (Cronbach α =0.81-0.86) and stable over a 1-week period (intraclass correlation coefficient =0.68-0.74). The measure demonstrated convergence with Functional Assessment of Chronic Illness Therapy-Fatigue and had moderate correlations with other measures that assessed related but not the same concept (the 12-Item Short Form Survey and the Visual Analog Scale). Confirmatory factor analysis supported the one-factor model.ConclusionsSONG-HD Fatigue seems to be a reliable and valid measure to be used in trials involving patients receiving hemodialysis.

Project description:IntroductionOur recent systematic review has indicated the lack of a patient-reported outcome (PRO) instrument to measure health-related quality of life (HRQOL) of children and adolescents with lower limb deformities. We are developing a PRO instrument which will be applicable internationally across various countries. This manuscript describes our approach to the development of a new PRO instrument for measuring HRQOL for children and adolescents with lower limb deformities.Methods and analysisThree phases in the development of this PRO instrument are as described: (1) This phase involves the development of a conceptual framework of HRQOL and item pool that is used to inform a set of preliminary scales. We have developed a preliminary conceptual framework of HRQOL based on our systematic review. Qualitative interviews are being conducted at five sites in Canada, Ethiopia, India and the USA. An item pool will be generated from this qualitative phase. The preliminary items and scales will be sent out to children at the five participating centres. Cognitive debriefing interviews will gather detailed feedback on the items from the children. Expert opinion will be sought from clinicians from the participating centres. (2) During this phase, an international field-test study will be conducted to refine the scales and examine their psychometric properties. (3) During this phase, tests of reliability, validity and responsiveness will be conducted. Phase 1 will also involve translations and cultural adaptations. At the end of this study, we expect to produce an internationally applicable PRO instrument which is scientifically sound and clinically relevant to the lower limb deformity population.Ethics and disseminationThis study is approved by Research Ethics Boards for each of the participating sites.Results of this study will be published in peer-reviewed journals and presented at national and international conferences. An integrated knowledge translation approach is applied to engage patients, families and clinicians from the start of the study.

Project description:BACKGROUND:A current limitation in the care of patients with severe lower extremity traumatic injuries is the lack of a rigorously developed patient-reported outcome (PRO) instrument specific to lower extremity trauma patients. OBJECTIVE:This mixed methods protocol aims to describe phases I and II of the development of a PRO instrument for lower extremity trauma patients, following international PRO development guidelines. METHODS:The phase I study follows an interpretive description approach. Development of the PRO instrument begins with identifying the concepts that are important to patients, after which a preliminary conceptual framework is devised from a systematic literature review and used to generate an interview guide. Patients aged 18 years or above with limb-threatening lower extremity traumatic injuries resulting in reconstruction, amputation, or amputation after failed reconstruction will be recruited. The subjects will participate in semistructured, in-depth qualitative interviews to identify all important concepts of interest. The qualitative interview data will be coded with top-level domains, themes, and subthemes. The codes will then be utilized to refine the conceptual framework and generate preliminary items and a set of scales. The preliminary scales will be further refined via a process of conducting cognitive debriefing interviews with lower extremity trauma patients and soliciting expert opinions. Phase III will include a large-scale field test, using Rasch measurement theory to analyze the psychometric properties of the instrument; shortening and finalizing the scales; and determining the reliability, validity, and responsiveness of the instrument. RESULTS:Phases I and II of this study have been funded. Phase I of this study has been completed, and phase II began in January 2019 and is expected to be completed in November 2019. Phase III will begin following the completion of phase II. CONCLUSIONS:This protocol describes the initial phases of development of a novel PRO instrument for use in lower extremity trauma patients. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID):DERR1-10.2196/14397.

Dataset Information

Pre-validation methods for developing a patient reported outcome instrument.

Publications

Pre-validation methods for developing a patient reported outcome instrument.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets