Dataset Information

Translating evidence in complex systems: a comparative review of implementation and improvement frameworks.

ABSTRACT:

Purpose

An increasing number of implementation and improvement frameworks seek to describe and explain how change is made in healthcare. This paper aims to explore how existing frameworks conceptualize the influence of complexity in translating evidence into practice in healthcare.

Data sources

A database was interrogated using a search strategy to identify publications that present frameworks and models for implementation and improvement.

Study selection

Ten popular implementation and improvement frameworks were purposively selected.

Data extraction

Comparative analysis was conducted using an analytical framework derived from SHIFT-Evidence, a framework that conceptualizes complexity in implementation and improvement initiatives.

Results

Collectively the frameworks accounted for key concepts of translating evidence in complex systems: understanding the uniqueness of each setting; the interdependency of practices/processes and the need to respond to unpredictable events and emergent learning. The analysis highlighted heterogeneity of the frameworks in their focus on different aspects of complexity. Differences include the extent to which problems and solutions are investigated or assumed; whether endpoints are defined as the uptake of interventions or achievement of goals; and emphasis placed on fixed-term interventions versus continual improvement. None of the individual frameworks reviewed incorporated all the implications of complexity, as described by SHIFT-Evidence.

Conclusion

This research identifies the differences in how implementation and improvement frameworks consider complexity, suggesting that SHIFT-Evidence offers a more comprehensive overview compared with the other frameworks. The similarity of concepts across the frameworks suggests growing consensus in the literature, with SHIFT-Evidence providing a conceptual bridge between the implementation and improvement fields.

SUBMITTER: Reed JE

PROVIDER: S-EPMC6464095 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundReduction or elimination of inappropriate, ineffective, or potentially harmful healthcare services and public health programs can help to ensure limited resources are used effectively. Frameworks and models (FM) are valuable tools in conceptualizing and guiding the study of de-implementation. This scoping review sought to identify and characterize FM that can be used to study de-implementation as a phenomenon and identify gaps in the literature to inform future model development and application for research.MethodsWe searched nine databases and eleven journals from a broad array of disciplines (e.g., healthcare, public health, public policy) for de-implementation studies published between 1990 and June 2020. Two raters independently screened titles and abstracts, and then a pair of raters screened all full text records. We extracted information related to setting, discipline, study design, methodology, and FM characteristics from included studies.ResultsThe final search yielded 1860 records, from which we screened 126 full text records. We extracted data from 27 articles containing 27 unique FM. Most FM (n = 21) were applicable to two or more levels of the Socio-Ecological Framework, and most commonly assessed constructs were at the organization level (n = 18). Most FM (n = 18) depicted a linear relationship between constructs, few depicted a more complex structure, such as a nested or cyclical relationship. Thirteen studies applied FM in empirical investigations of de-implementation, while 14 articles were commentary or review papers that included FM.ConclusionDe-implementation is a process studied in a broad array of disciplines, yet implementation science has thus far been limited in the integration of learnings from other fields. This review offers an overview of visual representations of FM that implementation researchers and practitioners can use to inform their work. Additional work is needed to test and refine existing FM and to determine the extent to which FM developed in one setting or for a particular topic can be applied to other contexts. Given the extensive availability of FM in implementation science, we suggest researchers build from existing FM rather than recreating novel FM.RegistrationNot registered.

Project description:Governance of the health system is a relatively new concept and there are gaps in understanding what health system governance is and how it could be assessed. We conducted a systematic review of the literature to describe the concept of governance and the theories underpinning as applied to health systems; and to identify which frameworks are available and have been applied to assess health systems governance. Frameworks were reviewed to understand how the principles of governance might be operationalized at different levels of a health system. Electronic databases and web portals of international institutions concerned with governance were searched for publications in English for the period January 1994 to February 2016. Sixteen frameworks developed to assess governance in the health system were identified and are described. Of these, six frameworks were developed based on theories from new institutional economics; three are primarily informed by political science and public management disciplines; three arise from the development literature and four use multidisciplinary approaches. Only five of the identified frameworks have been applied. These used the principal-agent theory, theory of common pool resources, North's institutional analysis and the cybernetics theory. Governance is a practice, dependent on arrangements set at political or national level, but which needs to be operationalized by individuals at lower levels in the health system; multi-level frameworks acknowledge this. Three frameworks were used to assess governance at all levels of the health system. Health system governance is complex and difficult to assess; the concept of governance originates from different disciplines and is multidimensional. There is a need to validate and apply existing frameworks and share lessons learnt regarding which frameworks work well in which settings. A comprehensive assessment of governance could enable policy makers to prioritize solutions for problems identified as well as replicate and scale-up examples of good practice.

Project description:BackgroundTask-sharing is a promising strategy to expand mental healthcare in low-resource settings, especially in low- and middle-income countries (LMICs). Research on how to best implement task-sharing mental health interventions, however, is hampered by an incomplete understanding of the barriers and facilitators to their implementation. This review aims to systematically identify implementation barriers and facilitators in evidence-based task-sharing mental health interventions using an implementation science lens, organizing factors across a novel, integrated implementation science framework.MethodsPubMed, PsychINFO, CINAHL, and Embase were used to identify English-language, peer-reviewed studies using search terms for three categories: "mental health," "task-sharing," and "LMIC." Articles were included if they: focused on mental disorders as the main outcome(s); included a task-sharing intervention using or based on an evidence-based practice; were implemented in an LMIC setting; and included assessment or data-supported analysis of barriers and facilitators. An initial conceptual model and coding framework derived from the Consolidated Framework for Implementation Research and the Theoretical Domains Framework was developed and iteratively refined to create an integrated conceptual framework, the Barriers and Facilitators in Implementation of Task-Sharing Mental Health Interventions (BeFITS-MH), which specifies 37 constructs across eight domains: (I) client characteristics, (II) provider characteristics, (III) family and community factors, (IV) organizational characteristics, (V) societal factors, (VI) mental health system factors, (VII) intervention characteristics, and (VIII) stigma.ResultsOf the 26,935 articles screened (title and abstract), 192 articles underwent full-text review, yielding 37 articles representing 28 unique intervention studies that met the inclusion criteria. The most prevalent facilitators occur in domains that are more amenable to adaptation (i.e., the intervention and provider characteristics domains), while salient barriers occur in domains that are more challenging to modulate or intervene on-these include constructs in the client characteristics as well as the broader societal and structural levels of influence (i.e., the organizational, mental health system domains). Other notable trends include constructs in the family and community domains occurring as barriers and as facilitators roughly equally, and stigma constructs acting exclusively as barriers.ConclusionsUsing the BeFITS-MH model we developed based on implementation science frameworks, this systematic review provides a comprehensive identification and organization of barriers and facilitators to evidence-based task-sharing mental health interventions in LMICs. These findings have important implications for ongoing and future implementation of this critically needed intervention strategy, including the promise of leveraging task-sharing intervention characteristics as sites of continued innovation, the importance of but relative lack of engagement with constructs in macro-level domains (e.g., organizational characteristics, stigma), and the need for more delineation of strategies for task-sharing mental health interventions that researchers and implementers can employ to enhance implementation in and across levels.Trial registrationPROSPERO CRD42020161357.

Project description:BackgroundComputerized clinical decision support systems (CDSSs) are essential components of modern health system service delivery, particularly within acute care settings such as hospitals. Theories, models, and frameworks may assist in facilitating the implementation processes associated with CDSS innovation and its use within these care settings. These processes include context assessments to identify key determinants, implementation plans for adoption, promoting ongoing uptake, adherence, and long-term evaluation. However, there has been no prior review synthesizing the literature regarding the theories, models, and frameworks that have informed the implementation and adoption of CDSSs within hospitals.ObjectiveThis scoping review aims to identify the theory, model, and framework approaches that have been used to facilitate the implementation and adoption of CDSSs in tertiary health care settings, including hospitals. The rationales reported for selecting these approaches, including the limitations and strengths, are described.MethodsA total of 5 electronic databases were searched (CINAHL via EBSCOhost, PubMed, Scopus, PsycINFO, and Embase) to identify studies that implemented or adopted a CDSS in a tertiary health care setting using an implementation theory, model, or framework. No date or language limits were applied. A narrative synthesis was conducted using full-text publications and abstracts. Implementation phases were classified according to the "Active Implementation Framework stages": exploration (feasibility and organizational readiness), installation (organizational preparation), initial implementation (initiating implementation, ie, training), full implementation (sustainment), and nontranslational effectiveness studies.ResultsA total of 81 records (42 full text and 39 abstracts) were included. Full-text studies and abstracts are reported separately. For full-text studies, models (18/42, 43%), followed by determinants frameworks (14/42,33%), were most frequently used to guide adoption and evaluation strategies. Most studies (36/42, 86%) did not list the limitations associated with applying a specific theory, model, or framework.ConclusionsModels and related quality improvement methods were most frequently used to inform CDSS adoption. Models were not typically combined with each other or with theory to inform full-cycle implementation strategies. The findings highlight a gap in the application of implementation methods including theories, models, and frameworks to facilitate full-cycle implementation strategies for hospital CDSSs.

Project description:BackgroundSignificant efforts have been made to develop artificial intelligence (AI) solutions for health care improvement. Despite the enthusiasm, health care professionals still struggle to implement AI in their daily practice.ObjectiveThis paper aims to identify the implementation frameworks used to understand the application of AI in health care practice.MethodsA scoping review was conducted using the Cochrane, Evidence Based Medicine Reviews, Embase, MEDLINE, and PsycINFO databases to identify publications that reported frameworks, models, and theories concerning AI implementation in health care. This review focused on studies published in English and investigating AI implementation in health care since 2000. A total of 2541 unique publications were retrieved from the databases and screened on titles and abstracts by 2 independent reviewers. Selected articles were thematically analyzed against the Nilsen taxonomy of implementation frameworks, and the Greenhalgh framework for the nonadoption, abandonment, scale-up, spread, and sustainability (NASSS) of health care technologies.ResultsIn total, 7 articles met all eligibility criteria for inclusion in the review, and 2 articles included formal frameworks that directly addressed AI implementation, whereas the other articles provided limited descriptions of elements influencing implementation. Collectively, the 7 articles identified elements that aligned with all the NASSS domains, but no single article comprehensively considered the factors known to influence technology implementation. New domains were identified, including dependency on data input and existing processes, shared decision-making, the role of human oversight, and ethics of population impact and inequality, suggesting that existing frameworks do not fully consider the unique needs of AI implementation.ConclusionsThis literature review demonstrates that understanding how to implement AI in health care practice is still in its early stages of development. Our findings suggest that further research is needed to provide the knowledge necessary to develop implementation frameworks to guide the future implementation of AI in clinical practice and highlight the opportunity to draw on existing knowledge from the field of implementation science.

Project description:BackgroundThe relevance of context in implementation science is reflected in the numerous theories, frameworks, models and taxonomies that have been proposed to analyse determinants of implementation (in this paper referred to as determinant frameworks). This scoping review aimed to investigate and map how determinant frameworks used in implementation science were developed, what terms are used for contextual determinants for implementation, how the context is conceptualized, and which context dimensions that can be discerned.MethodsA scoping review was conducted. MEDLINE and EMBASE were searched from inception to October 2017, and supplemented with implementation science text books and known published overviews. Publications in English that described a determinant framework (theory, model, taxonomy or checklist), of which context was one determinant, were eligible. Screening and inclusion were done in duplicate. Extracted data were analysed to address the study aims. A qualitative content analysis with an inductive approach was carried out concerning the development and core context dimensions of the frameworks. The review is reported according to the PRISMA guidelines.ResultsThe database searches yielded a total of 1113 publications, of which 67 were considered potentially relevant based on the predetermined eligibility criteria, and retrieved in full text. Seventeen unique determinant frameworks were identified and included. Most were developed based on the literature and/or the developers' implementation experiences. Six of the frameworks explicitly referred to "context", but only four frameworks provided a specific definition of the concept. Instead, context was defined indirectly by description of various categories and sub-categories that together made up the context. Twelve context dimensions were identified, pertaining to different aggregation levels. The most widely addressed context dimensions were organizational support, financial resources, social relations and support, and leadership.ConclusionsThe findings suggest variation with regard to how the frameworks were developed and considerable inconsistency in terms used for contextual determinants, how context is conceptualized, and which contextual determinants are accounted for in frameworks used in implementation science. Common context dimensions were identified, which can facilitate research that incorporates a theory of context, i.e. assumptions about how different dimensions may influence each other and affect implementation outcomes. A thoughtful application of the concept and a more consistent terminology would enhance transparency, simplify communication among researchers, and facilitate comparison across studies.