Dataset Information

Health outcomes measurement and organizational readiness support quality improvement: a systematic review.

ABSTRACT:

Background

Using outcome measures to advance healthcare continues to be of widespread interest. The goal is to summarize the results of studies which use outcome measures from clinical registries to implement and monitor QI initiatives. The second objective is to identify a) facilitators and/or barriers that contribute to the realization of QI efforts, and b) how outcomes are being used as a catalyst to change outcomes over time.

Methods

We searched the PubMed, EMBASE and Cochrane databases for relevant articles published between January 1995 and March 2017. We used a standardized data abstraction form. Studies were included when the following three criteria were fulfilled: 1) they relied on structural data collection, 2) when a structural and comprehensive QI intervention had been implemented and evaluated, and 3) impact on improving clinical and/or patient-reported outcomes was described. Data on QI strategies, QI initiatives and the impact on outcomes was extracted using standardized assessment tools.

Results

We included 21 articles, of which eight showed statistically significant improvements on outcomes using data from clinical registries. Out of these eight studies, the Chronic Care Model, IT application as feedback, benchmarking and the Collaborative Care Model were used as QI methods. Encouraging trends in realizing improved outcomes through QI initiatives were observed, ranging from improving teamwork, implementation of clinical guidelines, implementation of physician alerts and development of a decision support system. Facilitators for implementing QI initiatives included a high quality database, audits, frequent reporting and feedback, patient involvement, communication, standardization, engagement, and leadership.

Conclusion

This review suggests that outcomes collected in clinical registries are supportive to realize QI initiatives. Organizational readiness and an active approach are key in achieving improved outcomes.

SUBMITTER: Kampstra NA

PROVIDER: S-EPMC6311059 | biostudies-literature | 2018 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Health outcomes measurement and organizational readiness support quality improvement: a systematic review.

Kampstra Nynke A NA Zipfel Nina N van der Nat Paul B PB Westert Gert P GP van der Wees Philip J PJ Groenewoud A Stef AS

BMC health services research 20181229 1

<h4>Background</h4>Using outcome measures to advance healthcare continues to be of widespread interest. The goal is to summarize the results of studies which use outcome measures from clinical registries to implement and monitor QI initiatives. The second objective is to identify a) facilitators and/or barriers that contribute to the realization of QI efforts, and b) how outcomes are being used as a catalyst to change outcomes over time.<h4>Methods</h4>We searched the PubMed, EMBASE and Cochrane ...[more]

PMID: 30594193

Similar Datasets

Project description:BackgroundThe translation of research into practices has been incomplete. Organizational readiness for change (ORC) is a potential facilitator of effective knowledge translation (KT). However we know little about the best way to assess ORC. Therefore, we sought to systematically review ORC measurement instruments.MethodsWe searched for published studies in bibliographic databases (Pubmed, Embase, CINAHL, PsychINFO, Web of Science, etc.) up to November 1st, 2012. We included publications that developed ORC measures and/or empirically assessed ORC using an instrument at the organizational level in the health care context. We excluded articles if they did not refer specifically to ORC, did not concern the health care domain or were limited to individual-level change readiness. We focused on identifying the psychometric properties of instruments that were developed to assess readiness in an organization prior to implementing KT interventions in health care. We used the Standards for Educational and Psychological Testing to assess the psychometric properties of identified ORC measurement instruments.FindingsWe found 26 eligible instruments described in 39 publications. According to the Standards for Educational and Psychological Testing, 18 (69%) of a total of 26 measurement instruments presented both validity and reliability criteria. The Texas Christian University -ORC (TCU-ORC) scale reported the highest instrument validity with a score of 4 out of 4. Only one instrument, namely the Modified Texas Christian University - Director version (TCU-ORC-D), reported a reliability score of 2 out of 3. No information was provided regarding the reliability and validity of five (19%) instruments.ConclusionOur findings indicate that there are few valid and reliable ORC measurement instruments that could be applied to KT in the health care sector. The TCU-ORC instrument presents the best evidence in terms of validity testing. Future studies using this instrument could provide more knowledge on its relevance to diverse clinical contexts.

Project description:BackgroundA culture of improvement is an important feature of high-quality health care systems. However, health care teams often need support to translate quality improvement (QI) activities into practice. One method of support is consultation from a QI coach. The literature suggests that coaching interventions have a positive impact on clinical outcomes. However, the impact of coaching on specific process outcomes, like adoption of clinical care activities, is unknown. Identifying the process outcomes for which QI coaching is most effective could provide specific guidance on when to employ this strategy.MethodsWe searched multiple databases from inception through July 2021. Studies that addressed the effects of QI coaching on process of care outcomes were included. Two reviewers independently extracted study characteristics and assessed risk of bias. Certainty of evidence was assessed using GRADE.ResultsWe identified 1983 articles, of which 23 cluster-randomized trials met eligibility criteria. All but two took place in a primary care setting. Overall, interventions typically targeted multiple simultaneous processes of care activities. We found that coaching probably has a beneficial effect on composite process of care outcomes (n = 9) and ordering of labs and vital signs (n = 6), and possibly has a beneficial effect on changes in organizational process of care (n = 5), appropriate documentation (n = 5), and delivery of appropriate counseling (n = 3). We did not perform meta-analyses because of conceptual heterogeneity around intervention design and outcomes; rather, we synthesized the data narratively. Due to imprecision, inconsistency, and high risk of bias of the included studies, we judged the certainty of these results as low or very low.ConclusionQI coaching interventions may affect certain processes of care activities such as ordering of labs and vital signs. Future research that advances the identification of when QI coaching is most beneficial for health care teams seeking to implement improvement processes in pursuit of high-quality care will support efficient use of QI resources.Protocol registrationThis study was registered and followed a published protocol (PROSPERO: CRD42020165069).

Project description:BackgroundAbout 5.8 million maternal deaths, neonatal deaths and stillbirths occur every year with 99% of them taking place in low- and middle-income countries. Two thirds of them could be prevented through cost-effective interventions during pregnancy, intrapartum and postpartum periods. Despite the availability of standards and guidelines for the care of mother and newborn, challenges remain in translating these standards into practice in health facilities. Although several quality improvement (QI) interventions have been systematically reviewed by the Cochrane Effective Practice and Organization of Care (EPOC) group, evidence lack on QI interventions for improving perinatal outcomes in health facilities. This systematic review will identify QI interventions implemented for maternal and neonatal care in health facilities and their impact on perinatal outcomes.Methods/designThis review will look at studies of mothers, newborn and both who received inpatient care at health facilities. QI interventions targeted at health system level (macro), at healthcare organization (meso) and at health workers practice (micro) will be reviewed. Mortality of mothers and newborn and relevant health worker practices will be assessed. The MEDLINE, Embase, World Health Organization Global Health Library, Cochrane Library and trial registries electronic databases will be searched for relevant studies from the year 2000 onwards. Data will be extracted from the identified relevant literature using Epi review software. Risk of bias will be assessed in the studies using the Cochrane risk of bias tool for randomized and observational studies. Standard data synthesis and analysis will be used for the review, and the data will be analysed using EPPI Reviewer 4.DiscussionThis review will inform the global agenda for evidence-based health care by (1) providing a basis for operational guidelines for implementing clinical standards of perinatal care, (2) identify research priorities for generating evidence for QI interventions and (3) QI intervention options with lessons learnt for implementation based on the level of needed resources.Systematic review registrationPROSPERO registration number CRD42018106075.

Project description:BackgroundEfforts to improve the quality, safety, and efficiency of health care provision have often focused on changing approaches to the way services are organized and delivered. Continuous quality improvement (CQI), an approach used extensively in industrial and manufacturing sectors, has been used in the health sector. Despite the attention given to CQI, uncertainties remain as to its effectiveness given the complex and diverse nature of health systems. This review assesses the effectiveness of CQI across different health care settings, investigating the importance of different components of the approach.MethodsWe searched 11 electronic databases: MEDLINE, CINAHL, EMBASE, AMED, Academic Search Complete, HMIC, Web of Science, PsycINFO, Cochrane Central Register of Controlled Trials, LISTA, and NHS EED to February 2019. Also, we searched reference lists of included studies and systematic reviews, as well as checking published protocols for linked papers. We selected randomized controlled trials (RCTs) within health care settings involving teams of health professionals, evaluating the effectiveness of CQI. Comparators included current usual practice or different strategies to manage organizational change. Outcomes were health care professional performance or patient outcomes. Studies were published in English.ResultsTwenty-eight RCTs assessed the effectiveness of different approaches to CQI with a non-CQI comparator in various settings, with interventions differing in terms of the approaches used, their duration, meetings held, people involved, and training provided. All RCTs were considered at risk of bias, undermining their results. Findings suggested that the benefits of CQI compared to a non-CQI comparator on clinical process, patient, and other outcomes were limited, with less than half of RCTs showing any effect. Where benefits were evident, it was usually on clinical process measures, with the model used (i.e., Plan-Do-Study-Act, Model of Improvement), the meeting type (i.e., involving leaders discussing implementation) and their frequency (i.e., weekly) having an effect. None considered socio-economic health inequalities.ConclusionsCurrent evidence suggests the benefits of CQI in improving health care are uncertain, reflecting both the poor quality of evaluations and the complexities of health services themselves. Further mixed-methods evaluations are needed to understand how the health service can use this proven approach.Trial registrationProtocol registered on PROSPERO (CRD42018088309).

Project description:BACKGROUND: Continuous quality improvement (CQI) methods are widely used in healthcare; however, the effectiveness of the methods is variable, and evidence about the extent to which contextual and other factors modify effects is limited. Investigating the relationship between these factors and CQI outcomes poses challenges for those evaluating CQI, among the most complex of which relate to the measurement of modifying factors. We aimed to provide guidance to support the selection of measurement instruments by systematically collating, categorising, and reviewing quantitative self-report instruments. METHODS: DATA SOURCES: We searched MEDLINE, PsycINFO, and Health and Psychosocial Instruments, reference lists of systematic reviews, and citations and references of the main report of instruments. STUDY SELECTION: The scope of the review was determined by a conceptual framework developed to capture factors relevant to evaluating CQI in primary care (the InQuIRe framework). Papers reporting development or use of an instrument measuring a construct encompassed by the framework were included. Data extracted included instrument purpose; theoretical basis, constructs measured and definitions; development methods and assessment of measurement properties. Analysis and synthesis: We used qualitative analysis of instrument content and our initial framework to develop a taxonomy for summarising and comparing instruments. Instrument content was categorised using the taxonomy, illustrating coverage of the InQuIRe framework. Methods of development and evidence of measurement properties were reviewed for instruments with potential for use in primary care. RESULTS: We identified 186 potentially relevant instruments, 152 of which were analysed to develop the taxonomy. Eighty-four instruments measured constructs relevant to primary care, with content measuring CQI implementation and use (19 instruments), organizational context (51 instruments), and individual factors (21 instruments). Forty-one instruments were included for full review. Development methods were often pragmatic, rather than systematic and theory-based, and evidence supporting measurement properties was limited. CONCLUSIONS: Many instruments are available for evaluating CQI, but most require further use and testing to establish their measurement properties. Further development and use of these measures in evaluations should increase the contribution made by individual studies to our understanding of CQI and enhance our ability to synthesise evidence for informing policy and practice.

Project description:BackgroundGovernments in some countries or states/provinces mandate school-based policies intended to improve the health and well-being of primary and secondary students and in some cases the health of school staff. Examples include mandating a minimum time spent per week in programmed physical activity, mandating provision of healthy foods and limiting fat content of school meals, and banning tobacco products or use on school campuses. Although school health researchers have studied whether schools, districts, or states/provinces are meeting requirements, it is unclear to what extent implementation processes and determinants are assessed. The purposes of the present systematic review of quantitative measures of school policy implementation were to (1) identify quantitative school health policy measurement tools developed to measure implementation at the school, district, or state/provincial levels; (2) describe the policy implementation outcomes and determinants assessed and identify the trends in measurement; and (3) assess pragmatic and psychometric properties of identified implementation measures to understand their quality and suitability for broader application.MethodsPeer-reviewed journal articles published 1995-2020 were included if they (1) had multiple-item quantitative measures of school policy implementation and (2) addressed overall wellness, tobacco, physical activity, nutrition, obesity prevention, or mental health/bullying/social-emotional learning. The final sample comprised 86 measurement tools from 67 peer-review articles. We extracted study characteristics, such as psychometric and pragmatic measure properties, from included articles based on three frameworks: (1) Implementation Outcomes Framework, (2) Consolidated Framework for Implementation Research, and (3) Policy Implementation Determinants Framework.ResultsMost implementation tools were developed to measure overall wellness policies which combined multiple policy topics (n = 35, 40%) and were in survey form (n = 75, 87%). Fidelity was the most frequently prevalent implementation outcome (n = 70, 81%), followed by adoption (n = 32, 81%). The implementation determinants most assessed were readiness for implementation, including resources (n = 43, 50%), leadership (n = 42, 49%), and policy communication (n = 41, 48%). Overall, measures were low-cost and had easy readability. However, lengthy tools and lack of reported validity/reliability data indicate low transferability.ConclusionsImplementation science can contribute to more complete and rigorous assessment of school health policy implementation processes, which can improve implementation strategies and ultimately the intended health benefits. Several high-quality measures of implementation determinants and implementation outcomes can be applied to school health policy implementation assessment. Dissemination and implementation science researchers can also benefit from measurement experiences of school health researchers.

Dataset Information

Health outcomes measurement and organizational readiness support quality improvement: a systematic review.

Background

Methods

Results

Conclusion

Publications

Health outcomes measurement and organizational readiness support quality improvement: a systematic review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets