Dataset Information

Evaluation of initial progress to implement Common Metrics across the NIH Clinical and Translational Science Awards (CTSA) Consortium.

ABSTRACT:

Introduction

The Clinical and Translational Science Awards (CTSA) Consortium, about 60 National Institutes of Health (NIH)-supported CTSA hubs at academic health care institutions nationwide, is charged with improving the clinical and translational research enterprise. Together with the NIH National Center for Advancing Translational Sciences (NCATS), the Consortium implemented Common Metrics and a shared performance improvement framework.

Methods

Initial implementation across hubs was assessed using quantitative and qualitative methods over a 19-month period. The primary outcome was implementation of three Common Metrics and the performance improvement framework. Challenges and facilitators were elicited.

Results

Among 59 hubs with data, all began implementing Common Metrics, but about one-third had completed all activities for three metrics within the study period. The vast majority of hubs computed metric results and undertook activities to understand performance. Differences in completion appeared in developing and carrying out performance improvement plans. Seven key factors affected progress: hub size and resources, hub prior experience with performance management, alignment of local context with needs of the Common Metrics implementation, hub authority in the local institutional structure, hub engagement (including CTSA Principal Investigator involvement), stakeholder engagement, and attending training and coaching.

Conclusions

Implementing Common Metrics and performance improvement in a large network of research-focused organizations proved feasible but required substantial time and resources. Considerable heterogeneity across hubs in data systems, existing processes and personnel, organizational structures, and local priorities of home institutions created disparate experiences across hubs. Future metric-based performance management initiatives across heterogeneous local contexts should anticipate and account for these types of differences.

SUBMITTER: Welch LC

PROVIDER: S-EPMC8057371 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:PurposeTo respond to increased public and programmatic demand to address underenrollment of clinical translational research studies, the authors examined participant recruitment practices at Clinical and Translational Science Award (CTSA) sites and make recommendations for performance metrics and accountability.MethodThe CTSA Recruitment and Retention taskforce in 2010 invited representatives at 46 CTSAs to complete an online 48-question survey querying accrual and recruitment outcomes, practices, evaluation methods, policies, and perceived gaps in related knowledge/practice. Descriptive statistical and thematic analyses were conducted.ResultsForty-six respondents representing 44 CTSAs completed the survey. Recruitment conducted by study teams was the most common practice reported (78%-91%, by study type); 39% reported their institution offered recruitment services to investigators. Respondents valued study feasibility assessment as a successful practice (39%); desired additional resources included feasibility assessments (49%) and participant registries (44%). None reported their institution systematically required justification of feasibility; some indicated relevant information was considered prior to institutional review board (IRB) review (30%) or contract approval (22%). All respondents' IRBs tracked study progress, but only 10% of respondents could report outcome data for timely accrual. Few reported written policies addressing poor accrual or provided data to support recruitment practice effectiveness.ConclusionsMany CTSAs lack the necessary frame work to support study accrual. Recom men dations to enhance accrual include articulating institutional expectations and policy for routine recruitment plan ning; providing recruitment expertise to inform feasibility assessment and recruit ment planning; and developing interdepartmental coordination and integrated informatics infrastructure to drive the conduct, evaluation, and improvement of recruitment practices.