Dataset Information

Implementation and sustainment of diverse practices in a large integrated health system: a mixed methods study.

ABSTRACT: Background:One goal of health systems seeking to evolve into learning health systems is to accelerate the implementation and sustainment of evidence-based practices (EBPs). As part of this evolution, the Veterans Health Administration (VHA) developed the Innovation Ecosystem, which includes the Diffusion of Excellence (DoE), a program that identifies and diffuses Gold Status Practices (GSPs) across facilities. The DoE hosts an annual "Shark Tank" competition in which leaders bid on the opportunity to implement a GSP with 6 months of implementation support. Over 750 diverse practices were submitted in cohorts 2 and 3 of Shark Tank; 23 were designated GSPs and were implemented in 31 VA networks or facilities. As part of a national evaluation of the DoE, we identified factors contributing to GSP implementation and sustainment. Methods:Our sequential mixed methods evaluation of cohorts 2 and 3 of Shark Tank included semi-structured interviews with at least one representative from 30/31 implementing teams (N = 78/105 people invited) and survey responses from 29/31 teams (N = 39/47 invited). Interviews focused on factors influencing implementation and future sustainment. Surveys focused on sustainment 1.5-2?years after implementation. The Consolidated Framework for Implementation Research (CFIR) informed data collection and directed content analysis. Ordinal scales were developed inductively to rank implementation and sustainment outcomes. Results:Over 50% of teams (17/30) successfully implemented their GSP within the 6-month implementation period. Despite extensive implementation support, significant barriers related to centralized decision-making, staffing, and resources led to partial (n = 6) or no (n = 7) implementation for the remaining teams. While 12/17 initially successful implementation teams reported sustained use of their GSP, over half of the initially unsuccessful teams (n = 7/13) also reported sustained GSP use 1.5?years after the initial implementation period. When asked at 6 months, 18/27 teams with complete data accurately anticipated their future sustainability based on reported sustainment an average of 1.5?years later. Conclusions:Most teams implemented within 6 months and/or sustained their GSP 1.5?years later. High levels of implementation and sustainment across diverse practices and teams suggest that VHA's DoE is a successful large-scale model of diffusion. Team predictions about sustainability after the first 6 months of implementation provide a promising early assessment and point of intervention to increase sustainability.

SUBMITTER: Nevedal AL

PROVIDER: S-EPMC7427879 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Implementation and sustainment of diverse practices in a large integrated health system: a mixed methods study.

Nevedal Andrea L AL Reardon Caitlin M CM Jackson George L GL Cutrona Sarah L SL White Brandolyn B Gifford Allen L AL Orvek Elizabeth E DeLaughter Kathryn K White Lindsay L King Heather A HA Henderson Blake B Vega Ryan R Damschroder Laura L

Implementation science communications 20200703

<h4>Background</h4>One goal of health systems seeking to evolve into learning health systems is to accelerate the implementation and sustainment of evidence-based practices (EBPs). As part of this evolution, the Veterans Health Administration (VHA) developed the Innovation Ecosystem, which includes the Diffusion of Excellence (DoE), a program that identifies and diffuses Gold Status Practices (GSPs) across facilities. The DoE hosts an annual "Shark Tank" competition in which leaders bid on the o ...[more]

PMID: 32885216

Similar Datasets

Project description:ObjectivesTo assess prostate cancer screening practices in primary care since the initial United States Preventive Services Task Force (USPSTF) recommendation against prostate-specific antigen (PSA) testing for older men, and to assess primary provider variation associated with prostate cancer screening.Patients and methodsOur study population included 160 211 men aged ?40 years with at least one visit to a primary care clinic in any of the study years in a large, integrated health system. We conducted a retrospective cohort study using electronic medical record data from January 2007 to December 2014. Yearly rates of screening PSA testing by primary care providers (PCPs), rates of re-screening, and rates of prostate biopsies were assessed.ResultsAnnual PSA-screening testing declined from 2007 to 2014 in all age groups, as did biennial and quadrennial screening. Yearly rates declined for men aged ?70 years, from 22.8% to 8.9%; ages 50-69 years, from 39.2% to 20%; and ages 40-49 years, from 11% to 4.6%. Overall rates were lower for African-American (A-A) men vs non-A-A men; for men with a family history of prostate cancer, rates were similar or slightly higher than for those without a family history. PCP variation associated with ordering of PSA testing did not substantially change after the USPSTF recommendations. While the number of men screened and rates of follow-up prostate cancer screening declined in 2011-2014 compared to 2007-2010, similar re-screening rates were noted for men aged 45-75 years with initial PSA levels of <1 ng/mL or 1-3 ng/mL in both the earlier and later cohorts. For men aged >75 years with initial PSA levels of <3 ng/mL screened in both cohorts, follow-up screening rates were similar. Rates of prostate biopsy declined for men aged ?70 years in 2014 compared to 2007. For men who had PSA screening, rates of first prostate biopsy increased in later years for A-A men and men with a family history of prostate cancer.ConclusionsProstate cancer screening declined from 2007 to 2014 even in higher-risk groups and follow-up screening rates were not related to previous PSA level. However, rates of first prostate biopsy in men who were screened with a PSA test were higher for men with an increased risk of prostate cancer in later years. Variation in PSA testing was noted among PCPs. Future work should further explore sources of variation in screening practices and implementation of risk-based strategies for prostate cancer screening in primary care.

Project description:ImportanceThe electronic health record (EHR) is a source of practitioner dissatisfaction in part because of challenges with information retrieval. To improve data accessibility, a better understanding of practitioners' information needs within individual patient records is needed.ObjectiveTo assess EHR users' searches using data from a large integrated health care system.Design, setting, and participantsThis retrospective cross-sectional analysis used EHR search data from Kaiser Permanente Northern California, an integrated health care delivery system with more than 4.4 million members. Users' EHR search activity data were obtained from April 1, 2018, to May 15, 2019.Main outcomes and measuresSearch term frequency was grouped by user and practitioner types. Network analyses were performed of co-occurring search terms within a single search episode, and centrality measures for search terms (degree and betweenness centrality) were calculated.ResultsA total of 12 313 047 search activities (including 4 328 330 searches and 7 984 717 result views) conducted by 34 735 unique users within 977 160 unique patient EHRs were identified. In aggregate, users searched for 208 374 unique search terms and conducted a median of 4 searches (interquartile range, 1-28 searches). Of all 97 367 active EHR users, 34 735 (35.7%) conducted at least 1 search. However, of all 12 968 active EHR physician users, 9801 (75.6%) conducted at least 1 search, and of all 1908 active pharmacist users, 1402 (73.5%) conducted at least 1 search. The top 3 most commonly searched terms were statin (75 017 searches [1.7%]), colonoscopy (73 545 [1.7%]), and pft (54 990 [1.3%]). However, wide variation in top searches were noted across practitioner groups. Terms searched most often with another term in a single linked search episode included statin, lisinopril, colonoscopy, gabapentin, and aspirin.Conclusions and relevanceAlthough physicians and pharmacists were the most active users of EHR searches, search volume and frequently searched terms varied considerably by and within user role. Further customization of the EHR interface may help leverage users' search content and patterns to improve targeted information retrieval.

Project description:ObjectiveTo evaluate the prevalence of and characterize resistant hypertension in a large representative population with successful hypertension management and reliable health information.Patient and methodsWe performed a cross-sectional study using clinical encounter, laboratory, and administrative information from the Kaiser Permanente Southern California health system between January 1, 2006, and December 31, 2007. From individuals older than 17 years with hypertension, resistant hypertension was identified and prevalence was determined. Multivariable logistic regression was used to calculate odds ratios (ORs), with adjustments for demographic characteristics, clinical variables, and medication use.ResultsOf 470,386 hypertensive individuals, 60,327 (12.8%) were identified as having resistant disease, representing 15.3% of those taking medications. Overall, 37,061 patients (7.9%) had uncontrolled hypertension while taking 3 or more medicines. The ORs (95% CIs) for resistant hypertension were greater for black race (1.68 [1.62-1.75]), older age (1.11 [1.10-1.11] for every 5-year increase), male sex (1.06 [1.03-1.10]), and obesity (1.46 [1.42-1.51]). Medication adherence rates were higher in those with resistant hypertension (93% vs 89.8%; P<.001). Chronic kidney disease (OR, 1.84; 95% CI, 1.78-1.90), diabetes mellitus (OR, 1.58; 95% CI, 1.53-1.63), and cardiovascular disease (OR, 1.34; 95% CI, 1.30-1.39) were also associated with higher risk of resistant hypertension.ConclusionIn a more standardized hypertension treatment environment, we observed a rate of resistant hypertension comparable with that of previous studies using more fragmented data sources. Past observations have been limited due to nonrepresentative populations, reliability of the data, heterogeneity of the treatment environments, and less than ideal control rates. This cohort, which was established using an electronic medical record-based approach, has the potential to provide a better understanding of resistant hypertension and outcomes.

Project description:BackgroundFrail older patients are at risk of experiencing a decline in physical and cognitive function unrelated to the reason for admission. The Elder-Friendly Care (EFC) program was designed to improve the care, experiences, and outcomes of frail older adults. The project supported 8 Early Adoption Sites (EAS) in a large Canadian healthcare organization by providing multiple strategies, educational opportunities, and resources. The purpose of this study was to assess the usefulness of EFC educational materials and resources, staff practice changes and perceptions in pilot sites, and readiness for scale and spread.MethodsThe study was conducted from May 2017 to June 2018 using a mixed-methods approach incorporating the Kirkpatrick Model of Training/Evaluation. A total of 76 Direct Care Staff participated in the staff survey, which assessed their awareness of, satisfaction with, and utilization of EFC principles, resources, and practices. Additionally, 12 interviews were conducted with staff who were directly involved in site implementation of EFC.ResultsMost survey participants were aware (86%, n = 63) of the EFC program, and 85% (n = 41) indicated they or their site/unit had implemented EFC. Out of these 41 participants, the most common practice changes identified were: incorporating alternatives to restraint (81%, n = 33), decreased use of pharmacological restraint (78%, n = 32), and patient and family care planning (76%, n = 31). Participants that attended all 3 EFC Learning Workshops (LWs) were significantly more likely to recommend the EFC Toolkit to others (87% versus 40%; χ2 = 8.82, p < 0.01) compared to participants attending less than 3 EFC LWs. Interview participants indicated that the program was well structured and flexible as sites/units could adopt changes that suited their individual sites, needs, contexts, and challenges.ConclusionsThe educational materials and resources used for the EFC project are useful and appreciated by the Direct Care Staff. Further, participants perceive the EFC intervention as effective in creating positive practice change and useful in reducing hospital-related complications for older patients. Future implementation will investigate the impact of EFC on system-level outcomes in acute care.

Project description:BackgroundThere are challenges associated with measuring sustainment of evidence-informed practices (EIPs). First, the terms sustainability and sustainment are often falsely conflated: sustainability assesses the likelihood of an EIP being in use in the future while sustainment assesses the extent to which an EIP is (or is not) in use. Second, grant funding often ends before sustainment can be assessed. The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program is one of few large-scale models of diffusion; it seeks to identify and disseminate practices across the VHA system. The DoE sponsors "Shark Tank" competitions, in which leaders bid on the opportunity to implement a practice with approximately 6 months of implementation support. As part of an ongoing evaluation of the DoE, we sought to develop and pilot a pragmatic survey tool to assess sustainment of DoE practices.MethodsIn June 2020, surveys were sent to 64 facilities that were part of the DoE evaluation. We began analysis by comparing alignment of quantitative and qualitative responses; some facility representatives reported in the open-text box of the survey that their practice was on a temporary hold due to COVID-19 but answered the primary outcome question differently. As a result, the team reclassified the primary outcome of these facilities to Sustained: Temporary COVID-Hold. Following this reclassification, the number and percent of facilities in each category was calculated. We used directed content analysis, guided by the Consolidated Framework for Implementation Research (CFIR), to analyze open-text box responses.ResultsA representative from forty-one facilities (64%) completed the survey. Among responding facilities, 29/41 sustained their practice, 1/41 partially sustained their practice, 8/41 had not sustained their practice, and 3/41 had never implemented their practice. Sustainment rates increased between Cohorts 1-4.ConclusionsThe initial development and piloting of our pragmatic survey allowed us to assess sustainment of DoE practices. Planned updates to the survey will enable flexibility in assessing sustainment and its determinants at any phase after adoption. This assessment approach can flex with the longitudinal and dynamic nature of sustainment, including capturing nuances in outcomes when practices are on a temporary hold. If additional piloting illustrates the survey is useful, we plan to assess the reliability and validity of this measure for broader use in the field.

Project description:Background:Policies and programmes in Mexico promote the integration of mental health services into primary health care (PHC), however these services remain largely unavailable in the country. Since 2014 a non-governmental organisation has delivered a mental health programme at PHC clinics in the state of Chiapas, in partnership with the local Ministry of Health (MoH). The programme provides mental health services based on the mhGAP guidelines through multiple implementation strategies, including programme financing, infrastructure strengthening, high-intensity training, and supervision. This study aimed to examine the implementation process and outcomes of this mental health programme to understand the extent to which mental health care integration has been achieved and to identify the successes and remaining challenges in order to inform the development and implementation of similar programmes. Methods:We used a mixed-methods convergent design. Quantitative data for the period between December 2016 and December 2017 were extracted from the organisation's health information system to capture process indicators, including the amount (dose) and quality (fidelity) of services delivered. We conducted two focus groups and 24 semi-structured interviews with health providers and managers to ascertain implementation outcome data: penetration, fidelity, acceptability, appropriateness and feasibility. Quantitative and qualitative data were analysed using descriptive and framework analyses, respectively. Results:During the study period, health providers delivered mental health consultations to 486 adults diagnosed with a mood or anxiety disorder. Programme fidelity was limited given that talk-based interventions, which are required in all consultations according to programme guidelines, were only provided in 24% of consultations. Only 42% of service users attended more than 50% of scheduled mental health follow-up consultations, which also hindered fidelity. Low attendance is partially attributed to limited programme appropriateness, given that interventions to address social risk factors are not available. High levels of acceptability and feasibility enabled through strong support from the organisation were key programme strengths. Conclusions:Mental health programmes at PHC can be implemented when adequate support and supervision structures are in place, and key resources are available. There is an urgent need for health systems strengthening to support efforts to provide mental health care, and to link PHC with locally-relevant social interventions.

Dataset Information

Implementation and sustainment of diverse practices in a large integrated health system: a mixed methods study.

Publications

Implementation and sustainment of diverse practices in a large integrated health system: a mixed methods study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets