Implementation Outcomes and Indicators as a New Challenge in Health Services Research: A Systematic Scoping Review.
Ontology highlight
ABSTRACT:
SUBMITTER: Willmeroth T
PROVIDER: S-EPMC6661793 | biostudies-literature | 2019 Jan-Dec
REPOSITORIES: biostudies-literature
Publications
Implementation Outcomes and Indicators as a New Challenge in Health Services Research: A Systematic Scoping Review.
Willmeroth Tabea T Wesselborg Bärbel B Kuske Silke S
Inquiry : a journal of medical care organization, provision and financing 20190101
The aim of this systematic scoping review was to identify and analyze indicators that address implementation quality or success in health care services and to deduce recommendations for further indicator development. This review was conducted according to the Joanna Briggs Manual and the PRISMA Statement. CINAHL, EMBASE, MEDLINE, and PsycINFO were searched. Studies or reviews published between August 2008 and 2018 that reported monitoring of the quality or the implementation success in health ca ...[more]
Similar Datasets
Project description:BackgroundSimple visualizations in health research data, such as scatter plots, heat maps, and bar charts, typically present relationships between 2 variables. Interactive visualization methods allow for multiple related facets such as numerous risk factors to be studied simultaneously, leading to data insights through exploring trends and patterns from complex big health care data. The technique presents a powerful tool that can be used in combination with statistical analysis for knowledge discovery, hypothesis generation and testing, and decision support.ObjectiveThe primary objective of this scoping review is to describe and summarize the evidence of interactive visualization applications, methods, and tools being used in population health and health services research (HSR) and their subdomains in the last 15 years, from January 1, 2005, to March 30, 2019. Our secondary objective is to describe the use cases, metrics, frameworks used, settings, target audience, goals, and co-design of applications.MethodsWe adapted standard scoping review guidelines with a peer-reviewed search strategy: 2 independent researchers at each stage of screening and abstraction, with a third independent researcher to arbitrate conflicts and validate findings. A comprehensive abstraction platform was built to capture the data from diverse bodies of literature, primarily from the computer science and health care sectors. After screening 11,310 articles, we present findings from 56 applications from interrelated areas of population health and HSR, as well as their subdomains such as epidemiologic surveillance, health resource planning, access, and use and costs among diverse clinical and demographic populations.ResultsIn this companion review to our earlier systematic synthesis of the literature on visual analytics applications, we present findings in 6 major themes of interactive visualization applications developed for 8 major problem categories. We found a wide application of interactive visualization methods, the major ones being epidemiologic surveillance for infectious disease, resource planning, health service monitoring and quality, and studying medication use patterns. The data sources included mostly secondary administrative and electronic medical record data. In addition, at least two-thirds of the applications involved participatory co-design approaches while introducing a distinct category, embedded research, within co-design initiatives. These applications were in response to an identified need for data-driven insights into knowledge generation and decision support. We further discuss the opportunities stemming from the use of interactive visualization methods in studying global health; inequities, including social determinants of health; and other related areas. We also allude to the challenges in the uptake of these methods.ConclusionsVisualization in health has strong historical roots, with an upward trend in the use of these methods in population health and HSR. Such applications are being fast used by academic and health care agencies for knowledge discovery, hypotheses generation, and decision support.International registered report identifier (irrid)RR2-10.2196/14019.
| S-EPMC8900899 | biostudies-literature
Project description:PurposeThis study is a scoping review of the different methods used to measure rurality in the health services research (HSR) literature.MethodsWe identified peer-reviewed empirical studies from 2010-2020 from seven leading HSR journals, including the Journal of Rural Health, that used any definition to measure rurality as a part of their analysis. From each study, we identified the geographic unit (e.g., county, zip code) and definition (e.g., Rural Urban Continuum Codes, Rural Urban Commuting Areas) used to classify categories of rurality. We analyzed whether geographic units and definitions used to classify rurality differed by focus area of studies, including costs, quality, and access to care. Lastly, we examined the number of rural categories used by authors to assess rural areas.FindingsIn 103 included studies, five different geographic units and 11 definitions were used to measure rurality. The most common geographic units used to measure rurality were county (n = 59, 57%), which was used most frequently in studies examining cost (n = 12, 75%) and access (n = 33, 57.9%). Rural Urban Commuting Area codes were the most common definition used to measure rurality for studies examining access (n = 13, 22.8%) and quality (n = 10, 44%). The majority of included studies made rural versus urban comparisons (n = 82, 80%) as opposed to focusing on rural populations only (n = 21, 20%). Among studies that compared rural and urban populations, most studies used only one category to identify rural locations (n = 49 of 82 studies, 60%).ConclusionGeographic units and definitions to determine rurality were used inconsistently within and across studies with an HSR focus. This finding may affect how health disparities by rural location are determined and thus how resources and federal funds are allocated. Future research should focus on developing a standardized system to determine under what circumstances researchers should use different geographic units and methods to determine rurality by HSR focus area.
| S-EPMC9652888 | biostudies-literature
Project description:Dietary diversity has long been recognized as a key component of diet quality and many dietary diversity indicators (DDIs) have been developed. This systematic scoping review aimed to present a comprehensive inventory of DDIs and summarize evidence linking DDIs and dietary adequacy or health outcomes in adolescents and adults. Two search strategies were developed to identify peer-reviewed articles published in English up until June 2018 and were applied to Medline, Web of Science, and Scopus. A 2-stage screening process was used to select the studies to be reviewed. Four types of DDIs were identified among 161 articles, the majority of them belonging to the food group-based indicator type (n = 106 articles). Fifty studies indicated that DDIs were proxies of nutrient adequacy, but there was a lack of evidence about their relation with nutrients to limit. Associations between DDIs and health outcomes were largely inconsistent among 137 studies, especially when the outcomes studied were body weight (n = 60) and noncommunicable diseases (n = 41). We conclude that the ability of DDIs to reflect diet quality was found to be principally limited to micronutrient adequacy and that DDIs do not readily relate to health outcomes. These findings have implications for studies in low- and lower-middle-income economies where DDIs are often used to assess dietary patterns and overall diet quality.
| S-EPMC8483968 | biostudies-literature
Project description:BackgroundCultural competency is a multifaceted intervention approach, which needs to be implemented at various levels of health-care systems to improve quality of care for culturally and ethnically diverse populations. One level of health care where cultural competency is required is in the provision of health promotion services and programs targeted to diverse patient groups who experience health-care and health inequalities. To inform the implementation and evaluation of health promotion programs and services to improve cultural competency, research must assess both intervention strategies and intervention outcomes.MethodsThis scoping review was completed as part of a larger systematic literature search conducted on evaluations of cultural competence interventions in health care in Canada, the United States, Australia, and New Zealand. Seventeen peer-reviewed databases, 13 websites and clearinghouses, and 11 literature reviews were searched. Overall, 64 studies on cultural competency interventions were found, with 22 being health promotion programs and services. A process of thematic analysis was utilized to identify key intervention strategies and outcomes reported in the literature.ResultsThe review identified three overarching strategies utilized in health promotion services and programs to improve cultural competency: community-focused strategies, culturally focused strategies, and language-focused strategies. Studies took different approaches to delivering culturally competent health interventions, with the majority incorporating multiple strategies from each overarching category. There were various intermediate health-care and health outcomes reported across the included studies. Most commonly reported were positive reports of patient satisfaction, patient/participant service access, and program/study retention rates. The health outcome results indicate positive potential of health promotion services and programs to improve cultural competency to impact cardiovascular disease and mental health outcomes. However, due to measurement and study quality issues, it is difficult to determine the extent of the impacts.DiscussionExamined together, these intervention strategies and outcomes provide a framework that can be used by service providers and researchers in the implementation and evaluation of health promotion services and programs to improve cultural competency. While there is evidence indicating the effectiveness of such health promotion interventions in improving intermediate and health outcomes, further attention is needed to issues of measurement and study quality.
| S-EPMC5327788 | biostudies-literature
Project description:BackgroundVisual analytics (VA) promotes the understanding of data with visual, interactive techniques, using analytic and visual engines. The analytic engine includes automated techniques, whereas common visual outputs include flow maps and spatiotemporal hot spots.ObjectiveThis scoping review aims to address a gap in the literature, with the specific objective to synthesize literature on the use of VA tools, techniques, and frameworks in interrelated health care areas of population health and health services research (HSR).MethodsUsing the 2018 PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines, the review focuses on peer-reviewed journal articles and full conference papers from 2005 to March 2019. Two researchers were involved at each step, and another researcher arbitrated disagreements. A comprehensive abstraction platform captured data from diverse bodies of the literature, primarily from the computer and health sciences.ResultsAfter screening 11,310 articles, findings from 55 articles were synthesized under the major headings of visual and analytic engines, visual presentation characteristics, tools used and their capabilities, application to health care areas, data types and sources, VA frameworks, frameworks used for VA applications, availability and innovation, and co-design initiatives. We found extensive application of VA methods used in areas of epidemiology, surveillance and modeling, health services access, use, and cost analyses. All articles included a distinct analytic and visualization engine, with varying levels of detail provided. Most tools were prototypes, with 5 in use at the time of publication. Seven articles presented methodological frameworks. Toward consistent reporting, we present a checklist, with an expanded definition for VA applications in health care, to assist researchers in sharing research for greater replicability. We summarized the results in a Tableau dashboard.ConclusionsWith the increasing availability and generation of big health care data, VA is a fast-growing method applied to complex health care data. What makes VA innovative is its capability to process multiple, varied data sources to demonstrate trends and patterns for exploratory analysis, leading to knowledge generation and decision support. This is the first review to bridge a critical gap in the literature on VA methods applied to the areas of population health and HSR, which further indicates possible avenues for the adoption of these methods in the future. This review is especially important in the wake of COVID-19 surveillance and response initiatives, where many VA products have taken center stage.International registered report identifier (irrid)RR2-10.2196/14019.
| S-EPMC7716797 | biostudies-literature
Project description:BackgroundCommunity participation is widely believed to be beneficial to the development, implementation and evaluation of health services. However, many challenges to successful and sustainable community involvement remain. Importantly, there is little evidence on the effect of community participation in terms of outcomes at both the community and individual level. Our systematic review seeks to examine the evidence on outcomes of community participation in high and upper-middle income countries.Methods and findingsThis review was developed according to PRISMA guidelines. Eligible studies included those that involved the community, service users, consumers, households, patients, public and their representatives in the development, implementation, and evaluation of health services, policy or interventions. We searched the following databases from January 2000 to September 2016: Medline, Embase, Global Health, Scopus, and LILACs. We independently screened articles for inclusion, conducted data extraction, and assessed studies for risk of bias. No language restrictions were made. 27,232 records were identified, with 23,468 after removal of duplicates. Following titles and abstracts screening, 49 met the inclusion criteria for this review. A narrative synthesis of the findings was conducted. Outcomes were categorised as process outcomes, community outcomes, health outcomes, empowerment and stakeholder perspectives. Our review reports a breadth of evidence that community involvement has a positive impact on health, particularly when substantiated by strong organisational and community processes. This is in line with the notion that participatory approaches and positive outcomes including community empowerment and health improvements do not occur in a linear progression, but instead consists of complex processes influenced by an array of social and cultural factors.ConclusionThis review adds to the evidence base supporting the effectiveness of community participation in yielding positive outcomes at the organizational, community and individual level.Trial registrationProspero record number: CRD42016048244.
| S-EPMC6510456 | biostudies-literature
Project description:ObjectiveTo examine the extent and nature of evidence on the use of the environmental scan (ES) in the health services delivery literature.DesignScoping review.MethodsThis scoping review followed the five-stage scoping review methodology outlined by Khalil et al. A Peer Review of Electronic Search Strategies was completed. Seven electronic databases and the grey literature were searched. Pairs of researchers independently performed two levels of screening and data extraction. Data were analysed using qualitative content and thematic analysis.ResultsNinety-six studies were included in the scoping review. Researchers conducted ESs for many purposes, the most common being to examine the current state of programmes, services or policies. Recommendations were informed by ESs in 20% of studies. Most common data collection methods were literature review (71%), key informant or semistructured interviews (46%) and surveys (35%). Over half (53%) of the studies used a combination of passive (looking at information eg, literature, policies, guidelines) and active (looking for information eg, surveys, interviews) approaches to data collection. Person sources of data (eg, healthcare stakeholders, community representatives) and non-person sources of data (eg, documents, electronic databases, the web) were drawn on to a similar extent. The thematic analysis of the definitions/descriptions yielded several themes including instrument of discovery, knowledge synthesis, forward-looking and decision making. Research gaps identified included absence of a standard definition, inconsistencies in terminology and lack of guiding frameworks in the health services delivery context.ConclusionESs were conducted to gather evidence and to help inform decision making on a range of policy and health services delivery issues across the continuum of care. Consistency in terminology, a consensus definition and more guidance on ES design may help provide structure for researchers and other stakeholders, and ultimately advance ES as a methodological approach. A working definition of ES in a health services delivery context is presented.
| S-EPMC8587593 | biostudies-literature
Project description:BACKGROUND:Quality indicators are a commonly used improvement tool in health care. There is growing interest and activity in the use of quality indicators to improve community pharmacy practice. OBJECTIVES:To conduct a scoping review of the use of quality indicators for community pharmacy practice, including their methods of development and evaluation. METHODS:Electronic databases (EMBASE and PubMed) were searched to identify papers published between January 2008 and April 2018. No limits were applied for language of publication or country of origin. Studies were included if they reported empirical data regarding the development or evaluation of quality indicators. All study designs were eligible for inclusion. Duplicate independent screening was undertaken of the search results. Data extraction was performed by one reviewer. RESULTS:Of the 988 records identified from the database search, 15 articles were included. The studies were conducted in 12 countries from six continents. Eleven studies described the development of quality indicators, eight of which included the evaluation of the psychometric properties of the indicators developed. Four studies examined the impact of quality indicators on practice all of which reported improvements in some aspects of quality, mainly with structure indicators rather than those relating to process and outcome. CONCLUSIONS:Whilst there is a growing emphasis on promoting improvement in community pharmacy services, evidence is lacking of the effect of indicators on improving quality. Measurable process and outcome indicators are needed. The future development of quality indicators would also benefit from a multi-stakeholder approach.
| S-EPMC6900189 | biostudies-literature
Project description:BackgroundSeveral studies have documented the production of wasteful research, defined as research of no scientific importance and/or not meeting societal needs. We argue that this redundancy in research may to a large degree be due to the lack of a systematic evaluation of the best available evidence and/or of studies assessing societal needs.ObjectivesThe aim of this scoping review is to (A) identify meta-research studies evaluating if redundancy is present within biomedical research, and if so, assessing the prevalence of such redundancy, and (B) to identify meta-research studies evaluating if researchers had been trying to minimise or avoid redundancy.Eligibility criteriaMeta-research studies (empirical studies) were eligible if they evaluated whether redundancy was present and to what degree; whether health researchers referred to all earlier similar studies when justifying and designing a new study and/or when placing new results in the context of earlier similar trials; and whether health researchers systematically and transparently considered end users' perspectives when justifying and designing a new study.Sources of evidenceThe initial overall search was conducted in MEDLINE, Embase via Ovid, CINAHL, Web of Science, Social Sciences Citation Index, Arts & Humanities Citation Index, and the Cochrane Methodology Register from inception to June 2015. A 2nd search included MEDLINE and Embase via Ovid and covered January 2015 to 26 May 2021. No publication date or language restrictions were applied.Charting methodsCharting methods included description of the included studies, bibliometric mapping, and presentation of possible research gaps in the identified meta-research.ResultsWe identified 69 meta-research studies. Thirty-four (49%) of these evaluated the prevalence of redundancy and 42 (61%) studies evaluated the prevalence of a systematic and transparent use of earlier similar studies when justifying and designing new studies, and/or when placing new results in context, with seven (10%) studies addressing both aspects. Only one (1%) study assessed if the perspectives of end users had been used to inform the justification and design of a new study. Among the included meta-research studies evaluating whether redundancy was present, only two of nine health domains (medical areas) and only two of 10 research topics (different methodological types) were represented. Similarly, among the included meta-research studies evaluating whether researchers had been trying to minimise or avoid redundancy, only one of nine health domains and only one of 10 research topics were represented.Conclusions that relate to the review questions and objectivesEven with 69 included meta-research studies, there was a lack of information for most health domains and research topics. However, as most included studies were evaluating across different domains, there is a clear indication of a high prevalence of redundancy and a low prevalence of trying to minimise or avoid redundancy. In addition, only one meta-research study evaluated whether the perspectives of end users were used to inform the justification and design of a new study.Systematic review registrationProtocol registered at Open Science Framework: https://osf.io/3rdua/ (15 June 2021).
| S-EPMC9667610 | biostudies-literature
Project description:BackgroundMany interventions found to be effective in health services research studies fail to translate into meaningful patient care outcomes across multiple contexts. Health services researchers recognize the need to evaluate not only summative outcomes but also formative outcomes to assess the extent to which implementation is effective in a specific setting, prolongs sustainability, and promotes dissemination into other settings. Many implementation theories have been published to help promote effective implementation. However, they overlap considerably in the constructs included in individual theories, and a comparison of theories reveals that each is missing important constructs included in other theories. In addition, terminology and definitions are not consistent across theories. We describe the Consolidated Framework For Implementation Research (CFIR) that offers an overarching typology to promote implementation theory development and verification about what works where and why across multiple contexts.MethodsWe used a snowball sampling approach to identify published theories that were evaluated to identify constructs based on strength of conceptual or empirical support for influence on implementation, consistency in definitions, alignment with our own findings, and potential for measurement. We combined constructs across published theories that had different labels but were redundant or overlapping in definition, and we parsed apart constructs that conflated underlying concepts.ResultsThe CFIR is composed of five major domains: intervention characteristics, outer setting, inner setting, characteristics of the individuals involved, and the process of implementation. Eight constructs were identified related to the intervention (e.g., evidence strength and quality), four constructs were identified related to outer setting (e.g., patient needs and resources), 12 constructs were identified related to inner setting (e.g., culture, leadership engagement), five constructs were identified related to individual characteristics, and eight constructs were identified related to process (e.g., plan, evaluate, and reflect). We present explicit definitions for each construct.ConclusionThe CFIR provides a pragmatic structure for approaching complex, interacting, multi-level, and transient states of constructs in the real world by embracing, consolidating, and unifying key constructs from published implementation theories. It can be used to guide formative evaluations and build the implementation knowledge base across multiple studies and settings.
| S-EPMC2736161 | biostudies-literature