Dataset Information

Feedback of aggregate patient-reported outcomes (PROs) data to clinicians and hospital end users: findings from an Australian codesign workshop process.

ABSTRACT:

Objectives

Patient-reported outcomes (PROs) are increasingly used to measure the patient's perspective of their outcomes following healthcare interventions. The aim of this study was to determine the preferred formats for reporting service-level PROs data to clinicians, researchers and managers to support greater utility of these data to improve healthcare and patient outcomes.

Setting

Healthcare professionals receiving PRO data feedback at the health service level.

Participants

An interdisciplinary Project Working Group comprised of clinicians participated in three workshops to codesign reporting templates of summarised PRO data (modified Rankin Scale, EuroQol Five Dimension Descriptive System, EuroQol Visual Analogue Scale and Hospital Anxiety and Depression Scale) using a modified Delphi process. An electronic survey was then distributed to short list the preferred templates among a broad sample of clinical end users. A final workshop was undertaken with the Project Working Group to review results and reach consensus on the final templates.

Primary and secondary outcome measures

The recommendation of preferred PRO summary data feedback templates and guiding principles for reporting aggregate PRO data to clinicians was the primary outcome. A secondary outcome was the identification of perceived barriers and enablers to the use of PRO data in hospitals. For each outcome measure, quantitative and qualitative data were summarised.

Results

31 Working Group members (19 stroke, 2 psychology, 1 pharmacy, 9 researchers) participated in the workshops, where 25/55 templates were shortlisted for wider assessment. The survey was completed by 114 end users. Strongest preferences were identified for bar charts (37/82 votes, 45%) and stacked bar charts (37/91 votes, 41%). At the final workshop, recommendations to enhance communication of PROs data for comparing health service performance were made including tailoring feedback to professional roles and use of case-mix adjustment to ensure fair comparisons.

Conclusions

Our research provides guidance on PROs reporting for optimising data interpretation and comparing hospital performance.

SUBMITTER: Ryan OF

PROVIDER: S-EPMC9252210 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:IntroductionNetwork meta-analyses (NMAs) are complex methodological approaches that may be challenging for non-technical end-users, such as policymakers and clinicians, to understand. Consideration should be given to identifying optimal approaches to presenting NMAs that help clarify analyses. It is unclear what guidance researchers currently have on how to present and tailor NMAs to different end-users.MethodsA systematic review of NMA guidelines was conducted to identify guidance on how to present NMAs. Electronic databases and supplementary sources were searched for NMA guidelines. Presentation format details related to sample formats, target audiences, data sources, analysis methods and results were extracted and frequencies tabulated. Guideline quality was assessed following criteria developed for clinical practice guidelines.ResultsSeven guidelines were included. Current guidelines focus on how to conduct NMAs but provide limited guidance to researchers on how to best present analyses to different end-users. None of the guidelines provided reporting templates. Few guidelines provided advice on tailoring presentations to different end-users, such as policymakers. Available guidance on presentation formats focused on evidence networks, characteristics of individual trials, comparisons between direct and indirect estimates and assumptions of heterogeneity and/or inconsistency. Some guidelines also provided examples of figures and tables that could be used to present information.ConclusionsLimited guidance exists for researchers on how best to present NMAs in an accessible format, especially for non-technical end-users such as policymakers and clinicians. NMA guidelines may require further integration with end-users' needs, when NMAs are used to support healthcare policy and practice decisions. Developing presentation formats that enhance understanding and accessibility of NMAs could also enhance the transparency and legitimacy of decisions informed by NMAs.

Project description:BackgroundLong length of stays (LOS) in emergency departments (ED) negatively affect quality of care. Ordering of inappropriate diagnostic tests contributes to long LOS and reduces quality of care. One strategy to change practice patterns is to use performance feedback dashboards for physicians. While this strategy has proven to be successful in multiple settings, the most effective ways to deliver such interventions remain unknown. Involving end-users in the process is likely important for a successful design and implementation of a performance dashboard within a specific workplace culture. This mixed methods study aimed to develop design requirements for an ED performance dashboard and to understand the role of culture and social networks in the adoption process.MethodsWe performed 13 semi-structured interviews with attending physicians in different roles within a single public ED in the U.S. to get an in-depth understanding of physicians' needs and concerns. Principles of human-centered design were used to translate these interviews into design requirements and to iteratively develop a front-end performance feedback dashboard. Pre- and post- surveys were used to evaluate the effect of the dashboard on physicians' motivation and to measure their perception of the usefulness of the dashboard. Data on the ED culture and underlying social network were collected. Outcomes were compared between physicians involved in the human-centered design process, those with exposure to the design process through the ED social network, and those with limited exposure.ResultsKey design requirements obtained from the interviews were ease of access, drilldown functionality, customization, and a visual data display including monthly time-trends and blinded peer-comparisons. Identified barriers included concerns about unintended consequences and the veracity of underlying data. The surveys revealed that the ED culture and social network are associated with reported usefulness of the dashboard. Additionally, physicians' motivation was differentially affected by the dashboard based on their position in the social network.ConclusionsThis study demonstrates the feasibility of designing a performance feedback dashboard using a human-centered design approach in the ED setting. Additionally, we show preliminary evidence that the culture and underlying social network are of key importance for successful adoption of a dashboard.