Dataset Information

Applying a framework to assess the impact of cardiovascular outcomes improvement research.

ABSTRACT:

Background

Health and medical research funding agencies are increasingly interested in measuring the impact of funded research. We present a research impact case study for the first four years of an Australian National Health and Medical Research Council funded Centre of Research Excellence in Cardiovascular Outcomes Improvement (2016-2020). The primary aim of this paper was to explore the application of a research impact matrix to assess the impact of cardiovascular outcomes improvement research.

Methods

We applied a research impact matrix developed from a systematic review of existing methodological frameworks used to measure research impact. This impact matrix was used as a bespoke tool to identify and understand various research impacts over different time frames. Data sources included a review of existing internal documentation from the research centre and publicly available information sources, informal iterative discussions with 10 centre investigators, and confirmation of information from centre grant and scholarship recipients.

Results

By July 2019, the impact on the short-term research domain category included over 41 direct publications, which were cited over 87 times (median journal impact factor of 2.84). There were over 61 conference presentations, seven PhD candidacies, five new academic collaborations, and six new database linkages conducted. The impact on the mid-term research domain category involved contributions towards the development of a national cardiac registry, cardiovascular guidelines, application for a Medicare Benefits Schedule reimbursement item number, introduction of patient-reported outcome measures into several databases, and the establishment of nine new industry collaborations. Evidence of long-term impacts were described as the development and use of contemporary management for aortic stenosis, a cardiovascular risk prediction model and prevention targets in several data registries, and the establishment of cost-effectiveness for stenting compared to surgery.

Conclusions

We considered the research impact matrix a feasible tool to identify evidence of academic and policy impact in the short- to midterm; however, we experienced challenges in capturing long-term impacts. Cost containment and broader economic impacts represented another difficult area of impact to measure.

SUBMITTER: Sarkies MN

PROVIDER: S-EPMC8059028 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:In the U.S., where the prevalence of type 2 diabetes has reached epidemic proportions, many patients with this disease are treated by primary care physicians in community-based systems, including accountable care organisations (ACOs). To address gaps in the quality of diabetes care, national quality measures have been established, including patient-centered measures adopted by the Centers for Medicare and Medicaid Services for its Shared Savings Program for ACOs. From a patient-centered perspective, high-quality diabetes care depends on effective communication between clinicians and patients, along with patient education and counseling about medications and lifestyle. We designed and implemented a quality improvement (QI) program for 30 primary care physicians treating patients with type 2 diabetes in three structurally similar but geographically diverse ACOs. Retrospective chart audits were conducted before (n = 300) and after (n = 300) each physician participated in accredited continuing medical education (CME) courses that focused on QI strategies. Randomly selected charts were audited to measurably assess essential interventions for improved outcomes in type 2 diabetes including the physicians' documentation of patient counseling and assessment of side effects, and patients' medication adherence status and changes in hemoglobin A1C (A1C) and body mass index (BMI). Paced educational interventions included a private performance improvement Internet live course conducted for each physician, small-group Internet live courses involving peer discussion, and a set of enduring materials, which were also multi-accredited for all clinicians in the physician's practice. Continual improvement cycles were guided by analysis of the baseline chart audits, quantitative survey data, and qualitative feedback offered by participants. To extend the benefit of the education, the enduring materials were offered to the interprofessional team of clinicians throughout the U.S. who did not participate in the QI program. For brevity, this article presents outcomes of the 30 primary care physicians. Baseline to post-education improvements were observed for percentages of charts with documented assessment of medication side effects (+11%) and counseling about medication risks/benefits (+28%), medication adherence (+13%), and lifestyle modifications (+8%). Improvements were also observed for documented adherence to diabetes medications (+24%) and first-to-last visit changes in A1C (-0.16%) and BMI (-2.1). The findings indicate a positive influence of QI education on primary care physicians' performance of patient-centered quality measures and patient outcomes.

Project description:ObjectivesTo (1) apply the Framework to Assess the Impact from Translational health research (FAIT) to Lessons from the Best to Better the Rest (LFTB), (2) report on impacts from LFTB and (3) assess the feasibility and outcomes from a retrospective application of FAIT.SettingThree Indigenous primary healthcare (PHC) centres in the Northern Territory, Australia; project coordinating centre distributed between Townsville, Darwin and Cairns and the broader LFTB learning community across Australia.ParticipantsLFTB research team and one representative from each PHC centre.Primary and secondary outcome measuresImpact reported as (1) quantitative metrics within domains of benefit using a modified Payback Framework, (2) a cost-consequence analysis given a return on investment was not appropriate and (3) a narrative incorporating qualitative evidence of impact. Data were gathered through in-depth stakeholder interviews and a review of project documentation, outputs and relevant websites.ResultsLFTB contributed to knowledge advancement in Indigenous PHC service delivery; enhanced existing capacity of health centre staff, researchers and health service users; enhanced supportive networks for quality improvement; and used a strengths-based approach highly valued by health centres. LFTB also leveraged between $A1.4 and $A1.6 million for the subsequent Leveraging Effective Ambulatory Practice (LEAP) Project to apply LFTB learnings to resource development and creation of a learning community to empower striving PHC centres.ConclusionRetrospective application of FAIT to LFTB, although not ideal, was feasible. Prospective application would have allowed Indigenous community perspectives to be included. Greater appreciation of the full benefit of LFTB including a measure of return on investment will be possible when LEAP is complete. Future assessments of impact need to account for the limitations of fully capturing impact when intermediate/final impacts have not yet been realised and captured.

Project description:BackgroundThere is a paucity of translational research programmes to improve implementation of evidence-based care in drug and alcohol settings. This systematic review aimed to provide a synthesis and evaluation of the effectiveness of implementation programmes of treatment for patients with drug and alcohol problems using the Consolidated Framework for Implementation Research (CFIR).MethodsA comprehensive systematic review was conducted using five online databases (from inception onwards). Eligible studies included clinical trials and observational studies evaluating strategies used to implement evidence-based psychosocial treatments for alcohol and substance use disorders. Extracted data were qualitatively synthesised for common themes according to the CFIR. Primary outcomes included the implementation, service system or clinical practice. Risk of bias of individual studies was appraised using appropriate tools. A protocol was registered with (PROSPERO) (CRD42019123812) and published previously (Louie et al. Systematic 9:2020).ResultsOf the 2965 references identified, twenty studies were included in this review. Implementation research has employed a wide range of strategies to train clinicians in a few key evidence-based approaches to treatment. Implementation strategies were informed by a range of theories, with only two studies using an implementation framework (Baer et al. J Substance Abuse Treatment 37:191-202, 2009) used Context-Tailored Training and Helseth et al. J Substance Abuse Treatment 95:26-34, 2018) used the CFIR). Thirty of the 36 subdomains of the CFIR were evaluated by included studies, but the majority were concerned with the Characteristics of Individuals domain (75%), with less than half measuring Intervention Characteristics (45%) and Inner Setting constructs (25%), and only one study measuring the Outer Setting and Process domains. The most common primary outcome was the effectiveness of implementation strategies on treatment fidelity. Although several studies found clinician characteristics influenced the implementation outcome (40%) and many obtained clinical outcomes (40%), only five studies measured service system outcomes and only four studies evaluated the implementation.ConclusionsWhile research has begun to accumulate in domains such as Characteristics of Individuals and Intervention Characteristics (e.g. education, beliefs and attitudes and organisational openness to new techniques), this review has identified significant gaps in the remaining CFIR domains including organisational factors, external forces and factors related to the process of the implementation itself. Findings of the review highlight important areas for future research and the utility of applying comprehensive implementation frameworks.