Dataset Information

The Clinical Sustainability Assessment Tool: measuring organizational capacity to promote sustainability in healthcare.

ABSTRACT:

Background

Few validated assessment tools are available to increase understanding and measure factors associated with sustainment of clinical practices, an increasingly recognized need among clinicians. We describe the development of the Clinical Sustainability Assessment Tool (CSAT), designed to assess factors that contribute to sustainable practices in clinical settings.

Methods

Sixty-four participants from clinical and research fields participated in concept mapping and were recruited to brainstorm factors that lead to sustained clinical practices. Once repeated factors were removed, participants sorted items based on similarity and rated them by importance and feasibility. Using concept mapping analyses, items were grouped into meaningful domains to develop an initial tool. We then recruited pilot sites and early adopters, for a total of 286 practicing clinicians, to pilot and evaluate the tool. Individuals were recruited from clinical settings across pediatric and adult medical and surgical subspecialties. The data were analyzed using confirmatory factor analysis (CFA) to test hypothesized subscale structure in the instrument. We used root mean square error of approximation (RMSEA) and the standardized root mean square residual (SRMR) to assess fit and thus the ability of CSAT to measure the identified domains.

Results

The concept mapping produced sorted statements that were edited into items that could be responded to, resulting in the creation of a tool with seven determinant domains and 47 items. The pilot and CFA testing resulted in a final CSAT instrument made up 35 items, five per domain. CFA results demonstrated very good fit of the seven domain structure of the CSAT (RMSEA = 0.049; SRMR = 0.049). Usability testing indicated the CSAT is brief, easy to use, easy to learn, and does not require extensive training. Additionally, the measure scored highly (18/20) on the Psychometric and Pragmatic Evidence Rating Scale (PAPERS). The seven final CSAT domains were engaged staff and leadership, engaged stakeholders, organizational readiness, workflow integration, implementation and training, monitoring and evaluation, and outcomes and effectiveness.

Conclusions

The CSAT is a new reliable assessment tool which allows for greater practical and scientific understanding of contextual factors that enable sustainable clinical practices over time.

SUBMITTER: Malone S

PROVIDER: S-EPMC8285819 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundNot all primary care clinics are prepared to implement care coordination services for chronic conditions, such as diabetes. Understanding true capacity to coordinate care is an important first-step toward establishing effective and efficient care coordination. Yet, we could identify no diabetes-specific instruments to systematically assess readiness and/or status of primary care clinics to engage in diabetes care coordination.ObjectiveThis report describes the development and initial validation of the Diabetes Care Coordination Readiness Assessment (DCCRA), which is intended to measure primary care clinic readiness to coordinate care for adult patients with diabetes.DesignThe instrument was developed through iterative item generation within a framework of five domains of care coordination: Organizational Capacity, Care Coordination, Clinical Management, Quality Improvement, and Technical Infrastructure.ParticipantsValidation data was collected on 39 primary care clinics.Main measuresContent validity, inter-rater reliability, internal consistency, and construct validity of the 49-item instrument were assessed.Key resultsInter-rater agreement indices per item ranged from 0.50 to 1.0. Cronbach's alpha of the entire instrument was 0.964, and for the five domain scales ranged from 0.688 to 0.961. Clinics with existing care coordinators were rated as more ready to support care coordination than clinics without care coordinators for the entire DCCRA and for each domain, supporting construct validity.ConclusionsAs providers increasingly attempt to adopt patient-centered approaches, introduction of the DCCRA is timely and appropriate for assisting clinics with identifying gaps in provision of care coordination services. The DCCRA's strengths include promising psychometric properties. A valid measure of diabetes care coordination readiness should be useful in diabetes program evaluation, assistance with quality improvement initiatives, and measurement of patient-centered care in research.

Project description:ObjectivesA key barrier in supporting health research capacity development (HRCD) is the lack of empirical measurement of competencies to assess skills and identify gaps in research activities. An effective tool to measure HRCD in healthcare workers would help inform teams to undertake more locally led research. The objective of this systematic review is to identify tools measuring healthcare workers' individual capacities to conduct research.DesignSystematic review and narrative synthesis using Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist for reporting systematic reviews and narrative synthesis and the Critical Appraisals Skills Programme (CASP) checklist for qualitative studies.Data sources11 databases were searched from inception to 16 January 2020. The first 10 pages of Google Scholar results were also screened.Eligibility criteriaWe included papers describing the use of tools/to measure/assess HRCD at an individual level among healthcare workers involved in research. Qualitative, mixed and quantitative methods were all eligible. Search was limited to English language only.Data extraction and synthesisTwo authors independently screened and reviewed studies using Covidence software, and performed quality assessments using the extraction log validated against the CASP qualitative checklist. The content method was used to define a narrative synthesis.ResultsThe titles and abstracts for 7474 unique records were screened and the full texts of 178 references were reviewed. 16 papers were selected: 7 quantitative studies; 1 qualitative study; 5 mixed methods studies; and 3 studies describing the creation of a tool. Tools with different levels of accuracy in measuring HRCD in healthcare workers at the individual level were described. The Research Capacity and Culture tool and the 'Research Spider' tool were the most commonly defined. Other tools designed for ad hoc interventions with good generalisability potential were identified. Three papers described health research core competency frameworks. All tools measured HRCD in healthcare workers at an individual level with the majority adding a measurement at the team/organisational level, or data about perceived barriers and motivators for conducting health research.ConclusionsCapacity building is commonly identified with pre/postintervention evaluations without using a specific tool. This shows the need for a clear distinction between measuring the outcomes of training activities in a team/organisation, and effective actions promoting HRCD. This review highlights the lack of globally applicable comprehensive tools to provide comparable, standardised and consistent measurements of research competencies.Prospero registration numberCRD42019122310.

Project description:BackgroundImplementation science comprises a large set of theories suggesting interacting factors at different organisational levels. Development of literature syntheses and frameworks for implementation have contributed to comprehensive descriptions of implementation. However, corresponding instruments for measuring these comprehensive descriptions are currently lacking. The present study aimed to develop an instrument measuring care providers' perceptions of an implementation effort, and to explore the instrument's psychometric properties.MethodsBased on existing implementation literature, a questionnaire was designed with items on individual and team factors and on stages of change in an implementation process. The instrument was tested in a Norwegian study on implementation of evidence based practices for psychosis. Item analysis, factor structure, and internal consistency at baseline were examined.ResultsThe 27-item Implementation Process Assessment Tool (IPAT) revealed large variation between mean score of the items. The total scale scores were widely dispersed across respondents. Internal consistency for the total scale was high (Cronbach's alpha: .962), and all but one item contributed positively to the construct. The results indicated four underlying constructs: individual stages for behavioural change, individual activities and perceived support, collective readiness and support, and individual perceptions of the intervention.ConclusionsThe IPAT appears to be a feasible instrument for investigating the implementation process from the perspective of those making the change. It can enable examination of the relative importance of factors thought to be essential for implementation outcomes. It may also provide ongoing feedback for leaders tailoring support for teams to improve implementation. However, further research is needed to detect the instrument's properties later in the implementation process and in different contexts.Trial registrationClinicalTrials.gov code NCT03271242 (retrospective registered September 5, 2017).

Project description:While increasing attention is placed on using evidence-based decision making (EBDM) to improve public health, there is little research assessing the current EBDM capacity of the public health workforce. Public health agencies serve a wide range of populations with varying levels of resources. Our survey tool allows an individual agency to collect data that reflects its unique workforce.Health department leaders and academic researchers collaboratively developed and conducted cross-sectional surveys in Kansas and Mississippi (USA) to assess EBDM capacity. Surveys were delivered to state- and local-level practitioners and community partners working in chronic disease control and prevention. The core component of the surveys was adopted from a previously tested instrument and measured gaps (importance versus availability) in competencies for EBDM in chronic disease. Other survey questions addressed expectations and incentives for using EBDM, self-efficacy in three EBDM skills, and estimates of EBDM within the agency.In both states, participants identified communication with policymakers, use of economic evaluation, and translation of research to practice as top competency gaps. Self-efficacy in developing evidence-based chronic disease control programs was lower than in finding or using data. Public health practitioners estimated that approximately two-thirds of programs in their agency were evidence-based. Mississippi participants indicated that health department leaders' expectations for the use of EBDM was approximately twice that of co-workers' expectations and that the use of EBDM could be increased with training and leadership prioritization.The assessment of EBDM capacity in Kansas and Mississippi built upon previous nationwide findings to identify top gaps in core competencies for EBDM in chronic disease and to estimate a percentage of programs in U.S. health departments that are evidence-based. The survey can serve as a valuable tool for other health departments and non-governmental organizations to assess EBDM capacity within their own workforce and to assist in the identification of approaches that will enhance the uptake of EBDM processes in public health programming and policymaking. Localized survey findings can provide direction for focusing workforce training programs and can indicate the types of incentives and policies that could affect the culture of EBDM in the workplace.

Project description:BackgroundSustainability of adherence to clinical practice guidelines (CPGs) represents an important indicator of the successful implementation in the primary care setting.AimTo explore the sustainability of primary care providers' adherence to CPGs after receiving planned guideline implementation strategies, activities, or programmes.MethodsCochrane Central Register of Controlled Trials (CENTRAL); Cumulative Index to Nursing and Allied Health Literature (CINAHL); EMBase; Joanna Briggs Institute; Journals@Ovid; Medline; PsycoINFO; PubMed, and Web of Science were searched from January 2000 through May 2021 to identify relevant studies. Studies evaluating the sustainability of primary care providers' (PCPs') adherence to CPGs in primary care after any planned guideline implementation strategies, activities, or programmes were included. Two reviewers extracted data from the included studies and assessed methodological quality independently. Narrative synthesis of the findings was conducted.ResultsEleven studies were included. These studies evaluated the sustainability of adherence to CPGs related to drug prescribing, disease management, cancer screening, and hand hygiene in primary care. Educational outreach visits, teaching sessions, reminders, audit and feedback, and printed materials were utilized in the included studies as guideline implementation strategies. None of the included studies utilized purpose-designed measurements to evaluate the extent of sustainability. Three studies showed positive sustainability results, three studies showed mixed sustainability results, and four studies reported no significant changes in the sustainability of adherence to CPGs. Overall, it was difficult to quantify the extent to which CPG-based healthcare behaviours were fully sustained based on the variety of results reported in the included studies.ConclusionCurrent guideline implementation strategies may potentially improve the sustainability of PCPs' adherence to CPGs. However, the literature reveals a limited body of evidence for any given guideline implementation strategy. Further research, including the development of a validated purpose-designed sustainability tool, is required to address this important clinical issue.Trial registrationThe study protocol has been registered at PROSPERO (No. CRD42021259748 ).