Dataset Information

Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures.

ABSTRACT:

Background

Two of the current methodological barriers to implementation science efforts are the lack of agreement regarding constructs hypothesized to affect implementation success and identifiable measures of these constructs. In order to address these gaps, the main goals of this paper were to identify a multi-level framework that captures the predominant factors that impact implementation outcomes, conduct a systematic review of available measures assessing constructs subsumed within these primary factors, and determine the criterion validity of these measures in the search articles.

Method

We conducted a systematic literature review to identify articles reporting the use or development of measures designed to assess constructs that predict the implementation of evidence-based health innovations. Articles published through 12 August 2012 were identified through MEDLINE, CINAHL, PsycINFO and the journal Implementation Science. We then utilized a modified five-factor framework in order to code whether each measure contained items that assess constructs representing structural, organizational, provider, patient, and innovation level factors. Further, we coded the criterion validity of each measure within the search articles obtained.

Results

Our review identified 62 measures. Results indicate that organization, provider, and innovation-level constructs have the greatest number of measures available for use, whereas structural and patient-level constructs have the least. Additionally, relatively few measures demonstrated criterion validity, or reliable association with an implementation outcome (e.g., fidelity).

Discussion

In light of these findings, our discussion centers on strategies that researchers can utilize in order to identify, adapt, and improve extant measures for use in their own implementation research. In total, our literature review and resulting measures compendium increases the capacity of researchers to conceptualize and measure implementation-related constructs in their ongoing and future research.

SUBMITTER: Chaudoir SR

PROVIDER: S-EPMC3598720 | biostudies-literature | 2013 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures.

Chaudoir Stephenie R SR Dugan Alicia G AG Barr Colin H I CH

Implementation science : IS 20130217

<h4>Background</h4>Two of the current methodological barriers to implementation science efforts are the lack of agreement regarding constructs hypothesized to affect implementation success and identifiable measures of these constructs. In order to address these gaps, the main goals of this paper were to identify a multi-level framework that captures the predominant factors that impact implementation outcomes, conduct a systematic review of available measures assessing constructs subsumed within ...[more]

PMID: 23414420

Similar Datasets

Project description:BACKGROUND:The number of patient portals is rising, and although portals can have positive effects, their implementation has major impacts on the providing health care institutions. However, little is known about the organizational factors affecting successful implementation. Knowledge of the specific barriers to and facilitators of various stakeholders is likely to be useful for future implementations. OBJECTIVE:The objective of this study was to identify the barriers to and facilitators of patient portal implementation facing various stakeholders within hospital organizations in the Netherlands. METHODS:Purposive sampling was used to select hospitals of various types. A total of 2 university medical centers, 3 teaching hospitals, and 2 general hospitals were included. For each, 3 stakeholders were interviewed: (1) medical professionals, (2) managers, and (3) information technology employees. In total, 21 semistructured interviews were conducted using the Grol and Wensing model, which describes barriers to and facilitators of change in health care practice at 6 levels: (1) innovation; (2) individual professional; (3) patient; (4) social context; (5) organizational context; and (6) economic and political context. Two researchers independently selected and coded quotes by applying this model using a (deductive) directed content approach. Additional factors related to technical and portal characteristics were added using the model of McGinn et al, developed for implementation of electronic health records. RESULTS:In total, we identified 376 quotes, 26 barriers, and 28 facilitators. Thirteen barriers and 12 facilitators were common for all stakeholder groups. The facilitators' perceived usefulness (especially less paperwork) was mentioned by all the stakeholders, followed by subjects' positive attitude. The main barriers were lack of resources (namely, lack of staff and materials), financial difficulties (especially complying with high costs, lack of reimbursements), and guaranteeing privacy and security (eg, strict regulations). Both similarities and differences were found between stakeholder groups and hospital types. For example, managers and information technology employees mainly considered guaranteeing privacy and security as a predominant barrier. Financial difficulties were particularly mentioned by medical professionals and managers. CONCLUSIONS:Patient portal implementation is a complex process and is not only a technical process but also affects the organization and its staff. Barriers and facilitators occurred at various levels and differed among hospital types (eg, lack of accessibility) and stakeholder groups (eg, sufficient resources) in terms of several factors. Our findings underscore the importance of involving multiple stakeholders in portal implementations. We identified a set of barriers and facilitators that are likely to be useful in making strategic and efficient implementation plans.

Project description:BackgroundModifications to interventions can jeopardize intervention outcomes. Pre-existing perceived barriers and facilitators to the intervention arising in the implementation preparation phase may help explain why modifications to the intervention may occur during the implementation phase. This two-site comparative case study describes modifications made to a complex organizational-level intervention and examines how known implementation science factors may have enabled such changes to occur.MethodsNorthwestern Medicine'sTM Hispanic Kidney Transplant Program (HKTP) is a culturally competent transplant center-based intervention designed to reduce disparities in living donor kidney transplantation among Hispanics. In-depth qualitative interviews and discussions were longitudinally conducted with transplant stakeholders (i.e., physicians, administrators, clinicians) at two kidney transplant programs with large Hispanic populations during implementation preparation and implementation phases. The Consolidated Framework for Implementation Research (CFIR) guided interview design and qualitative analysis, and Stirman's Framework for Reporting Adaptations and Modifications-Expanded (FRAME) guided modification classification.ResultsAcross sites, 57 stakeholders participated in an interview, group discussion, and/or learning collaborative discussion. Site-B made more modifications than Site-A (n = 29 versus n = 18). Sites differed in the proportions of delaying/skipping (Site-A 50% versus Site-B 28%) and adding (Site-A 11% versus Site-B 28%) but had comparable substituting (Site-A 17% versus Site-B 17%) and tweaking (Site-A 17% versus Site-B 14%) modification types. Across sites, the transplant team consistently initiated the most modifications (Site-A 66%; Site-B 62%). While individuals initiated slightly more modifications at Site-B (21% versus Site-A 17%), institutions instigated proportionately slightly more modifications at Site-A (17% versus Site-B 10%). CFIR inner setting factors (i.e., structural characteristics, culture, available resources, implementation climate) that prominently emerged during the implementation preparation phase explained similarities and differences in sites' modification numbers, types, and agents in the implementation phase.ConclusionOrganizations implementing a culturally competent care intervention made modifications. CFIR inner setting factors emerging in the implementation preparation phase largely explained similarities and differences in study sites' modifications. Identifying factors contributing to modifications may help institutions become better prepared to implement an intervention by addressing known factors in advance, which may foster greater fidelity leading to desired outcomes.Trial registrationClinicalTrials.gov NCT03276390 . We registered the study retrospectively on 9-7-17.

Project description:ObjectiveTo examine the extent to which medical group and market factors are related to individual primary care physician (PCP) performance on patient experience measures.Data sourcesThis study employs Clinician and Group CAHPS survey data (n=105,663) from 2,099 adult PCPs belonging to 34 diverse medical groups across California. Medical group directors were interviewed to assess the magnitude and nature of financial incentives directed at individual physicians and the adoption of patient experience improvement strategies. Primary care services area (PCSA) data were used to characterize the market environment of physician practices.Study designWe used multilevel models to estimate the relationship between medical group and market factors and physician performance on each Clinician and Group CAHPS measure. Models statistically controlled for respondent characteristics and accounted for the clustering of respondents within physicians, physicians within medical groups, and medical groups within PCSAs using random effects.Principal findingsCompared with physicians belonging to independent practice associations, physicians belonging to integrated medical groups had better performance on the communication ( p=.007) and care coordination ( p=.03) measures. Physicians belonging to medical groups with greater numbers of PCPs had better performance on all measures. The use of patient experience improvement strategies was not associated with performance. Greater emphasis on productivity and efficiency criteria in individual physician financial incentive formulae was associated with worse access to care ( p=.04). Physicians located in PCSAs with higher area-level deprivation had worse performance on the access to care ( p=.04) and care coordination ( p<.001) measures.ConclusionsPhysicians from integrated medical groups and groups with greater numbers of PCPs performed better on several patient experience measures, suggesting that organized care processes adopted by these groups may enhance patients' experiences. Physicians practicing in markets with high concentrations of vulnerable populations may be disadvantaged by constraints that affect performance. Future studies should clarify the extent to which performance deficits associated with area-level deprivation are modifiable.

Dataset Information

Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures.

Background

Method

Results

Discussion

Publications

Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets