Voice-Related Patient-Reported Outcome Measures: A Systematic Review of Instrument Development and Validation.
Ontology highlight
ABSTRACT:
SUBMITTER: Francis DO
PROVIDER: S-EPMC5533561 | biostudies-other | 2017 Jan
REPOSITORIES: biostudies-other
Similar Datasets
Project description:Study objectivesTo develop an archive of self-report questions assessing sleep disturbance and sleep-related impairments (SRI), to develop item banks from this archive, and to validate and calibrate the item banks using classic validation techniques and item response theory analyses in a sample of clinical and community participants.DesignCross-sectional self-report study.SettingAcademic medical center and participant homes.ParticipantsOne thousand nine hundred ninety-three adults recruited from an Internet polling sample and 259 adults recruited from medical, psychiatric, and sleep clinics.InterventionsNone.Measurements and resultsThis study was part of PROMIS (Patient-Reported Outcomes Information System), a National Institutes of Health Roadmap initiative. Self-report item banks were developed through an iterative process of literature searches, collecting and sorting items, expert content review, qualitative patient research, and pilot testing. Internal consistency, convergent validity, and exploratory and confirmatory factor analysis were examined in the resulting item banks. Factor analyses identified 2 preliminary item banks, sleep disturbance and SRI. Item response theory analyses and expert content review narrowed the item banks to 27 and 16 items, respectively. Validity of the item banks was supported by moderate to high correlations with existing scales and by significant differences in sleep disturbance and SRI scores between participants with and without sleep disorders.ConclusionsThe PROMIS sleep disturbance and SRI item banks have excellent measurement properties and may prove to be useful for assessing general aspects of sleep and SRI with various groups of patients and interventions.
| S-EPMC2880437 | biostudies-literature
Project description:BACKGROUND:Measures that reflect patients' assessment of their health are of increasing importance as outcome measures in randomised controlled trials. The methodological approach used in the pre-validation development of new instruments (item generation, item reduction and question formatting) should be robust and transparent. The totality of the content of existing PRO instruments for a specific condition provides a valuable resource (pool of items) that can be utilised to develop new instruments. Such 'top down' approaches are common, but the explicit pre-validation methods are often poorly reported. This paper presents a systematic and generalisable 5-step pre-validation PRO instrument methodology. METHODS:The method is illustrated using the example of the Aberdeen Glaucoma Questionnaire (AGQ). The five steps are: 1) Generation of a pool of items; 2) Item de-duplication (three phases); 3) Item reduction (two phases); 4) Assessment of the remaining items' content coverage against a pre-existing theoretical framework appropriate to the objectives of the instrument and the target population (e.g. ICF); and 5) qualitative exploration of the target populations' views of the new instrument and the items it contains. RESULTS:The AGQ 'item pool' contained 725 items. Three de-duplication phases resulted in reduction of 91, 225 and 48 items respectively. The item reduction phases discarded 70 items and 208 items respectively. The draft AGQ contained 83 items with good content coverage. The qualitative exploration ('think aloud' study) resulted in removal of a further 15 items and refinement to the wording of others. The resultant draft AGQ contained 68 items. CONCLUSIONS:This study presents a novel methodology for developing a PRO instrument, based on three sources: literature reporting what is important to patient; theoretically coherent framework; and patients' experience of completing the instrument. By systematically accounting for all items dropped after the item generation phase, our method ensures that the AGQ is developed in a transparent, replicable manner and is fit for validation. We recommend this method to enhance the likelihood that new PRO instruments will be appropriate to the research context in which they are used, acceptable to research participants and likely to generate valid data.
| S-EPMC3225127 | biostudies-literature
Project description:ImportancePatient-reported outcome (PRO) measures address the need for patient-centered data and are now used in diverse clinical, research, and policy pursuits. They are important in conditions causing upper airway-related dyspnea in which the patient's reported experience and physiological data can be discrepant.ObjectivesTo perform a systematic review of the literature on upper airway dyspnea-related PRO measures and to rigorously evaluate each measure's developmental properties, validation, and applicability.Evidence reviewThis study strictly adhered to Preferred Reporting Items for Systematic Review and Meta-analysis (PRISMA) guidelines. MEDLINE via the PubMed interface, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), and the Health and Psychosocial Instruments (HaPI) database were searched using relevant vocabulary terms and key terms related to PRO measures and upper airway-related dyspnea. Three investigators performed abstract review, and 2 investigators independently performed full-text review by applying an established checklist to evaluate the conceptual model, content validity, reliability, construct validity, scoring and interpretability, and respondent burden and presentation of each identified instrument. The initial literature search was conducted in November 2014 and was updated in April 2016.FindingsOf 1269 studies reviewed, 3 upper airway-related dyspnea PRO measures met criteria for inclusion. One PRO measure was designed de novo to assess upper airway-related dyspnea symptoms and monitor treatment outcomes, while 2 were adapted from established instruments designed for lower airway disease. Measurement properties and psychometric characteristics differed, and none met all checklist criteria. Two met a criterion in each of 7 domains evaluated. Two demonstrated test-retest and internal consistency reliability, and 2 showed that their scores were responsive to change. Thematic deficiencies in current upper airway-related dyspnea PRO measures are lack of patient involvement in item development (content validity), plan for interpretation, and literacy level assessments.Conclusions and relevancePRO measures are critical in the assessment of patients with upper airway-related dyspnea. Three instruments with disparate developmental rigor have been designed or adapted to assess this construct. Care must be taken to understand the measurement characteristics and contextual relevance before applying these PRO measures for clinical, research, or quality initiatives.
| S-EPMC5604091 | biostudies-literature
Project description:BackgroundPatient-reported outcome measures (PROMs) are measures of the outcome of treatment(s) reported directly by the patient or carer. There is increasing international policy interest in using these to assess the impact of clinical care.AimsTo identify suitably validated PROMs for asthma and examine their potential for use in clinical settings.MethodsWe systematically searched MEDLINE, EMBASE and Web of Science databases from 1990 onwards to identify PROMs for asthma. These were critically appraised, then narratively synthesised. We also identified the generic PROMs commonly used alongside asthma-specific PROMs.ResultsWe identified 68 PROMs for asthma, 13 of which were selected through screening as being adequately developed to warrant full-quality appraisal: 8 for adults, 4 for children and 1 for a child's caregiver. The PROMs found to be sufficiently well validated to offer promise for use in clinical settings were the Asthma Quality of Life Questionnaire (AQLQ) and mini-AQLQ for adults, and Pediatric Asthma Quality of Life Questionnaire for children. Rhinasthma was considered promising in simultaneously assessing the impact of asthma and rhinitis in those with coexistent disease. We identified 28 generic PROMs commonly used in conjunction with asthma-specific instruments.ConclusionsWe identified asthma PROMs that offer the greatest potential for use in clinical settings. Further work is needed to assess whether these are fit-for-purpose for use in clinical practice with individual patients. In particular, there is a need to ensure these are validated for use in clinical settings, acceptable to patients, caregivers and clinicians, and yield meaningful outcomes.
| S-EPMC4373322 | biostudies-literature
Project description:PurposeInformal caregivers provide invaluable help and support to people with cancer. As treatments extend survival and the potential burdens on carers increase, there is a need to assess the impact of the role. This systematic review identified instruments that measure the impact of caregiving, evaluated their psychometric performance specifically in cancer and appraised the content.MethodsA two-stage search strategy was employed to: (1) identify instruments that measure the impact of caregiving, and (2) run individual searches on each measure to identify publications evaluating psychometric performance in the target population. Searches were conducted in MEDLINE, EMBASE, CINAHL and PsycINFO and restricted to English for instrument used and article language. Psychometric performance was evaluated for content and construct validity, internal consistency, test-retest reliability, precision, responsiveness and acceptability. Individual scale items were extracted and systematically categorised into conceptual domains.ResultsTen papers were included reporting on the psychometric properties of eight measures. Although construct validity and internal consistency were most frequently evaluated, no study comprehensively evaluated all relevant properties. Few studies met our inclusion criteria so it was not possible to consider the psychometric performance of the measures across a group of studies. Content analysis resulted in 16 domains with 5 overarching themes: lifestyle disruption; well-being; health of the caregiver; managing the situation and relationships.ConclusionsFew measures of caregiver impact have been subject to psychometric evaluation in cancer caregivers. Those that have do not capture well changes in roles and responsibilities within the family and career, indicating the need for a new instrument.
| S-EPMC4945691 | biostudies-literature
Project description:This review article systematically reviews the use of Patient Reported Outcome Measures (PROMs) in Vitreoretinal surgery, with the aim of recommending a preferred PROM-tool for use in clinical practice. Vitreoretinal surgery lags behind other ophthalmic subspecialties in the adoption of PROMs as a core outcome measure of success post-operatively. Current outcomes rely heavily on post-operative Best Corrected Visual Acuity (BCVA) and anatomical success on imaging modalities such as Ocular Coherence Tomography (OCT), despite the link between each of these measures and patient satisfaction being uncertain. We systematically reviewed the available literature in March 2021, in accordance with PRISMA guidelines, searching six databases: MEDLINE, EMBASE, Web of Science, APA PsycINFO, SCOPUS and Cochrane Library. Critical appraisal of PROM-tools was facilitated using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) risk of bias checklist. We identified 14 eligible original research papers that used PROMs as a primary or secondary outcome of success post-operatively in patients having undergone vitreoretinal surgery. Eight different generic and vision-related PROM-tools were identified as being used in vitreoretinal studies, none of which were vitreoretinal-disease-specific. Our review article considers whether generic-health PROMs (e.g., EQ5D) or vision-related PROMs (e.g. NEI VFQ-25) are precise or responsive enough following vitreoretinal surgery to have a meaningful impact on clinical or research practice. We also consider the importance of standardisation of clinical outcomes in vitreoretinal clinical trials.
| S-EPMC9905525 | biostudies-literature
Project description:BackgroundHealthcare requires patient feedback to improve outcomes and experience. This study undertook a systematic review of the depth, variability, and digital suitability of current patient-reported outcome measures (PROMs) in patients undergoing laparoscopic cholecystectomy.MethodsA PROSPERO-registered (registration number CRD42021261707) systematic review was undertaken for all relevant English language articles using PubMed version of MEDLINE, Scopus, and Web of Science electronic databases in June 2021. The search used Boolean operators and wildcards and included the keywords: laparoscopic cholecystectomy AND patient outcome OR patient-reported outcome OR patient-reported outcome measure OR PRO OR PROM. Medical Subjects Heading terms were used to search PubMed and Scopus. Articles published from 1 January 2011 to 2 June 2021 were included.ResultsA total of 4960 individual articles were reviewed in this study, of which 44 were found to evaluate PROMs in patients undergoing laparoscopic cholecystectomy and underwent methodological index for non-randomized studies (MINORS) grading. Twenty-one articles spanning 19 countries and four continents met all inclusion criteria and were included in the qualitative data synthesis. There was significant heterogeneity in PROMs identified with eight different comprehensive PROM tools used in the 21 studies. There was wide variation in the time points at which PROMs were recorded. Fourteen of 21 studies recorded PROMs before and after surgery, and 7 of 21 recorded PROMs only after surgery. Follow-up intervals ranged from 3 days to 2 years after surgery.ConclusionsThis study identified that while post-laparoscopic cholecystectomy PROMs are infrequently measured currently, tools are widely available to achieve this in clinical practice. PROMs may not capture all the outcomes but should be incorporated into future cholecystectomy outcome research. The EQ-5D™ (EuroQoL Group, Rotterdam, the Netherlands) provides a simple platform for the modern digital era.
| S-EPMC9171002 | biostudies-literature
Project description:BackgroundPeople with multimorbidity are increasingly engaged, enabled, and empowered to take responsibility for managing their health status. The purpose of the study was to systematically review and appraise the psychometric properties of tools measuring patient engagement in adults with multimorbidity and their applicability for use within engagement programs.MethodsPubMed, Scopus, Web of Science, and PsycInfo were searched from inception to 1 July 2021. Gray literature was searched using EBSCO host-database "Open dissertation". The reference lists of studies meeting the inclusion criteria were searched to identify additional eligible studies. The screening of the search results and the data extraction were performed independently by two reviewers. The methodological quality of the included studies was evaluated with the COSMIN checklist. Relevant data from all included articles were extracted and summarized in evidence synthesis tables.ResultsTwenty articles on eight tools were included. We included tools that measure all four dimensions of patient engagement (i.e., engagement, empowerment, activation, and participation). Their psychometric properties were analyzed separately. Most tools were developed in the last 10 years in Europe or the USA. The comparison of the estimated psychometric properties of the retrieved tools highlighted a significant lack of reliable patient engagement measures for people with multimorbidity. Available measures capture a diversity of constructs and have very limited evidence of psychometric properties that are vital for patient-reported measures, such as invariance, reliability, and responsiveness.ConclusionThis review clarifies how patient engagement, as operationalized in measures purporting to capture this concept, overlaps with, and differs from other related constructs in adults with multimorbidity. The methodological quality of psychometric tools measuring patient engagement in adults with multimorbidity could be improved.Systematic review registrationhttps://www.crd.york.ac.uk/prospero/display_record.php?RecordID=259968, identifier CRD42021259968.
| S-EPMC11294995 | biostudies-literature
Project description:ObjectivesTo identify patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs) in clinical quality registries, for people with cutaneous melanoma, to inform a new Australian Melanoma Clinical Outcomes Registry; and describe opportunities and challenges of routine PROM/PREM collection, especially in primary care.DesignSystematic review.Primary and secondary outcome measuresWhich PROMs and PREMs are used in clinical quality registries for people with cutaneous melanoma, how they are collected, frequency of collection, participant recruitment methods and funding models for each registry.Results1134 studies were identified from MEDLINE, PreMEDLINE, Embase, PsychInfo, Cochrane Database of Abstracts of Reviews of Effects databases and TUFTS Cost-Effectiveness Analysis Registry, alongside grey literature, from database inception to 5th February 2020. Following screening, 14 studies were included, identifying four relevant registries: Dutch Melanoma Registry, Adelphi Real-World Disease-Specific Programme (Melanoma), Patient-Reported Outcomes Following Initial treatment and Long-term Evaluation of Survivorship Registry, and Cancer Experience Registry. These used seven PROMs: EuroQol-5 Dimensions, Functional Assessment of Cancer-General (FACT-G) and FACT-Melanoma (FACT-M), European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire-Cancer 30 (EORTC QLQ-C30), Fatigue Assessment Scale Hospital Anxiety and Depression Scale, Patient-Reported Outcome Measures Information System-29 and one PREM; EORTC QLQ-Information Module 26. PROMs/PREMs in registries were reported to improve transparency of care; facilitate clinical auditing for quality assessment; enable cost-effectiveness analyses and create large-scale research platforms. Challenges included resource burden for data entry and potential collection bias toward younger, more affluent respondents. Feedback from patients with melanoma highlighted the relevance of PROMs/PREMs in assessing patient outcomes and patient experiences.ConclusionsClinical registries indicate PROMs/PREMs for melanoma care can be incorporated and address important gaps, however cost and collection bias may limit generalisability.Prospero registration numberCRD42018086737.
| S-EPMC7880114 | biostudies-literature
Project description:BackgroundWith the rise of digital health technologies and telemedicine, the need for evidence-based evaluation is growing. Patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs) are recommended as an essential part of the evaluation of telemedicine. For the first time, a systematic review has been conducted to investigate the use of PROMs and PREMs in the evaluation studies of telemedicine covering all application types and medical purposes.ObjectiveThis study investigates the following research questions: in which scenarios are PROMs and PREMs collected for evaluation purposes, which PROM and PREM outcome domains have been covered and how often, which outcome measurement instruments have been used and how often, does the selection and quantity of PROMs and PREMs differ between study types and application types, and has the use of PROMs and PREMs changed over time.MethodsWe conducted a systematic literature search of the MEDLINE and Embase databases and included studies published from inception until April 2, 2020. We included studies evaluating telemedicine with patients as the main users; these studies reported PROMs and PREMs within randomized controlled trials, controlled trials, noncontrolled trials, and feasibility trials in English and German.ResultsOf the identified 2671 studies, 303 (11.34%) were included; of the 303 studies, 67 (22.1%) were feasibility studies, 70 (23.1%) were noncontrolled trials, 20 (6.6%) were controlled trials, and 146 (48.2%) were randomized controlled trials. Health-related quality of life (n=310; mean 1.02, SD 1.05), emotional function (n=244; mean 0.81, SD 1.18), and adherence (n=103; mean 0.34, SD 0.53) were the most frequently assessed outcome domains. Self-developed PROMs were used in 21.4% (65/303) of the studies, and self-developed PREMs were used in 22.3% (68/303). PROMs (n=884) were assessed more frequently than PREMs (n=234). As the evidence level of the studies increased, the number of PROMs also increased (τ=-0.45), and the number of PREMs decreased (τ=0.35). Since 2000, not only has the number of studies using PROMs and PREMs increased, but the level of evidence and the number of outcome measurement instruments used have also increased, with the number of PREMs permanently remaining at a lower level.ConclusionsThere have been increasingly more studies, particularly high-evidence studies, which use PROMs and PREMs to evaluate telemedicine. PROMs have been used more frequently than PREMs. With the increasing maturity stage of telemedicine applications and higher evidence level, the use of PROMs increased in line with the recommendations of evaluation guidelines. Health-related quality of life and emotional function were measured in almost all the studies. Simultaneously, health literacy as a precondition for using the application adequately, alongside proper training and guidance, has rarely been reported. Further efforts should be pursued to standardize PROM and PREM collection in evaluation studies of telemedicine.
| S-EPMC8663685 | biostudies-literature