Dataset Information

Funnel plots of patient-reported outcomes to evaluate health-care quality: Basic principles, pitfalls and considerations.

ABSTRACT: A funnel plot is a graphical method to evaluate health-care quality by comparing hospital performances on certain outcomes. So far, in nephrology, this method has been applied to clinical outcomes like mortality and complications. However, patient-reported outcomes (PROs; eg, health-related quality of life [HRQOL]) are becoming increasingly important and should be incorporated into this quality assessment. Using funnel plots has several advantages, including clearly visualized precision, detection of volume-effects, discouragement of ranking hospitals and easy interpretation of results. However, without sufficient knowledge of underlying methods, it is easy to stumble into pitfalls, such as overinterpretation of standardized scores, incorrect direct comparisons of hospitals and assuming a hospital to be in-control (ie, to perform as expected) based on underpowered comparisons. Furthermore, application of funnel plots to PROs is accompanied by additional challenges related to the multidimensional nature of PROs and difficulties with measuring PROs. Before using funnel plots for PROs, high and consistent response rates, adequate case mix correction and high-quality PRO measures are required. In this article, we aim to provide insight into the use and interpretation of funnel plots by presenting an overview of the basic principles, pitfalls and considerations when applied to PROs, using examples from Dutch routine dialysis care.

SUBMITTER: van der Willik EM

PROVIDER: S-EPMC7891340 | biostudies-literature | 2021 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Funnel plots of patient-reported outcomes to evaluate health-care quality: Basic principles, pitfalls and considerations.

van der Willik Esmee M EM van Zwet Erik W EW Hoekstra Tiny T van Ittersum Frans J FJ Hemmelder Marc H MH Zoccali Carmine C Jager Kitty J KJ Dekker Friedo W FW Meuleman Yvette Y

Nephrology (Carlton, Vic.) 20201001 2

A funnel plot is a graphical method to evaluate health-care quality by comparing hospital performances on certain outcomes. So far, in nephrology, this method has been applied to clinical outcomes like mortality and complications. However, patient-reported outcomes (PROs; eg, health-related quality of life [HRQOL]) are becoming increasingly important and should be incorporated into this quality assessment. Using funnel plots has several advantages, including clearly visualized precision, detecti ...[more]

PMID: 32725679

Similar Datasets

Project description:BackgroundHealth-related Quality of Life (HrQoL) is a multidimensional measure, which has gained clinical and social relevance. Implementation of a patient-centred approach to both clinical research and care settings, has increased the recognition of patient and/or observer reported outcome measures (PROMs or ObsROMs) as informative and reliable tools for HrQoL assessment. Inherited Metabolic Diseases (IMDs) are a group of heterogeneous conditions with phenotypes ranging from mild to severe and mostly lacking effective therapies. Consequently, HrQoL evaluation is particularly relevant.ObjectivesWe aimed to: (1) identify patient and/or caregiver-reported HrQoL instruments used among IMDs; (2) identify the main results of the application of each HrQoL tool and (3) evaluate the main limitations of HrQoL instruments and study design/methodology in IMDs.MethodsA scoping review was conducted using methods outlined by Arksey and O'Malley. Additionally, we critically analysed each article to identify the HrQoL study drawbacks.ResultsOf the 1954 studies identified, 131 addressed HrQoL of IMDs patients using PROMs and/or ObsROMs, both in observational or interventional studies. In total, we identified 32 HrQoL instruments destined to self- or proxy-completion; only 2% were disease-specific. Multiple tools (both generic and disease-specific) proved to be responsive to changes in HrQoL; the SF-36 and PedsQL questionnaires were the most frequently used in the adult and pediatric populations, respectively. Furthermore, proxy data often demonstrated to be a reliable approach complementing self-reported HrQoL scores. Nevertheless, numerous limitations were identified especially due to the rarity of these conditions.ConclusionsHrQoL is still not frequently assessed in IMDs. However, our results show successful examples of the use of patient-reported HrQoL instruments in this field. The importance of HrQoL measurement for clinical research and therapy development, incites to further research in HrQoL PROMs' and ObsROMs' creation and validation in IMDs.

Project description:BackgroundThere is no physiotherapy-specific quality indicator tool available to evaluate physiotherapy care for people with hip and/or knee osteoarthritis (OA). This study aimed to develop a patient-reported quality indicator tool (QUIPA) for physiotherapy management of hip and knee OA and to assess its reliability and validity.MethodsTo develop the QUIPA tool, quality indicators were initially developed based on clinical guideline recommendations most relevant to physiotherapy practice and those of an existing generic OA quality indicator tool. Draft items were then further refined using patient focus groups. Test-retest reliability, construct validity (hypothesis testing) and criterion validity were then evaluated. Sixty-five people with hip and/or knee OA attended a single physiotherapy consultation and completed the QUIPA tool one, twelve- and thirteen-weeks after. Physiotherapists (n = 9) completed the tool post-consultation. Patient test-retest reliability was assessed between weeks twelve and thirteen. Construct validity was assessed with three predefined hypotheses and criterion validity was based on agreement between physiotherapists and participants at week one.ResultsA draft list of 23 clinical guideline recommendations most relevant to physiotherapy was developed. Following feedback from three patient focus groups, the final QUIPA tool contained 18 items (three subscales) expressed in lay language. The test-retest reliability estimates (Cohen's Kappa) for single items ranged from 0.30-0.83 with observed agreement of 64-94%. The intraclass correlation coefficient (ICC) and 95% confidence interval (CI) for the Assessment and Management Planning subscale was 0.70 (0.54, 0.81), Core Recommended Treatments subscale was 0.84 (0.75, 0.90), Adjunctive Treatments subscale was 0.70 (0.39, 0.87) and for the total QUIPA score was 0.80 (0.69, 0.88). All predefined hypotheses regarding construct validity were confirmed. However, agreement between physiotherapists and participants for single items showed large measurement error (Cohen's Kappa estimates ranged from - 0.04-0.59) with the ICC (95% CI) for the total score being 0.11 (- 0.14, 0.34).ConclusionsThe QUIPA tool showed acceptable test-retest reliability for subscales and total score but inadequate reliability for individual items. Construct validity was confirmed but criterion validity for individual items, subscales and the total score was inadequate. Further research is needed to refine the QUIPA tool to improve its clinimetric properties before implementation.

Dataset Information

Funnel plots of patient-reported outcomes to evaluate health-care quality: Basic principles, pitfalls and considerations.

Publications

Funnel plots of patient-reported outcomes to evaluate health-care quality: Basic principles, pitfalls and considerations.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets