Dataset Information

Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review.

ABSTRACT: BACKGROUND: The purpose of the study was to evaluate systematic reviews of research into two public health priorities, tobacco consumption and HIV infection, in terms of the reporting of data related to the applicability of trial results (i.e., whether the results of a trial can be reasonably applied or generalized to a definable group of patients in a particular setting in routine practice, also called external validity or generalisability). METHODS: All systematic reviews of interventions aimed at reducing or stopping tobacco use and treating or preventing HIV infection published in the Cochrane database of systematic reviews and in journals indexed in MEDLINE between January 1997 and December 2007 were selected. We used a standardized data abstraction form to extract data related to applicability in terms of the context of the trial, (country, centres, settings), participants (recruitment, inclusion and exclusion criteria, baseline characteristics of participants such as age, sex, ethnicity, coexisting diseases or co-morbidities, and socioeconomic status), treatment (duration, intensity/dose of treatment, timing and delivery format), and the outcomes assessment from selected reviews. RESULTS: A total of 98 systematic reviews were selected (57 Cochrane reviews and 41 non-Cochrane reviews); 49 evaluated interventions aimed at reducing or stopping tobacco use and 49 treating or preventing HIV infection. The setting of the individual studies was reported in 45 (46%) of the systematic reviews, the number of centres in 21 (21%), and the country where the trial took place in 62 (63%). Inclusion and exclusion criteria of the included studies were reported in 16 (16%) and 13 (13%) of the reviews, respectively. Baseline characteristics of participants in the included studies were described in 59 (60%) of the reviews. These characteristics concerned age in about half of the reviews, sex in 46 (47%), and ethnicity in 9 (9%).Applicability of results was discussed in 13 (13%) of the systematic reviews. The reporting was better in systematic reviews by the Cochrane Collaboration than by non-Cochrane groups. CONCLUSIONS: Our study highlighted the lack of consideration of applicability of results in systematic reviews of research into 2 public health priorities: tobacco consumption and HIV infection.

SUBMITTER: Ahmad N

PROVIDER: S-EPMC2838881 | biostudies-other | 2010

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review.

Ahmad Nizar N Boutron Isabelle I Dechartres Agnès A Durieux Pierre P Ravaud Philippe P

Trials 20100226

<h4>Background</h4>The purpose of the study was to evaluate systematic reviews of research into two public health priorities, tobacco consumption and HIV infection, in terms of the reporting of data related to the applicability of trial results (i.e., whether the results of a trial can be reasonably applied or generalized to a definable group of patients in a particular setting in routine practice, also called external validity or generalisability).<h4>Methods</h4>All systematic reviews of inter ...[more]

PMID: 20187938

Similar Datasets

Project description:BackgroundAs a source of readily available evidence, rigorously synthesized and interpreted by expert clinicians and methodologists, clinical guidelines are part of an evidence-based practice toolkit, which, transformed into practice recommendations, have the potential to improve both the process of care and patient outcomes. In Brazil, the process of development and updating of the clinical guidelines for the Brazilian Unified Health System (Sistema Único de Saúde, SUS) is already well systematized by the Ministry of Health. However, the implementation process of those guidelines has not yet been discussed and well structured. Therefore, the first step of this project and the primary objective of this study was to summarize the evidence on the effectiveness of strategies used to promote clinical practice guideline implementation and dissemination.MethodsThis overview used systematic review methodology to locate and evaluate published systematic reviews regarding strategies for clinical practice guideline implementation and adhered to the PRISMA guidelines for systematic review (PRISMA).ResultsThis overview identified 36 systematic reviews regarding 30 strategies targeting healthcare organizations, healthcare providers and patients to promote guideline implementation. The most reported interventions were educational materials, educational meetings, reminders, academic detailing and audit and feedback. Care pathways-single intervention, educational meeting-single intervention, organizational culture, and audit and feedback-both strategies implemented in combination with others-were strategies categorized as generally effective from the systematic reviews. In the meta-analyses, when used alone, organizational culture, educational intervention and reminders proved to be effective in promoting physicians' adherence to the guidelines. When used in conjunction with other strategies, organizational culture also proved to be effective. For patient-related outcomes, education intervention showed effective results for disease target results at a short and long term.ConclusionThis overview provides a broad summary of the best evidence on guideline implementation. Even if the included literature highlights the various limitations related to the lack of standardization, the methodological quality of the studies, and especially the lack of conclusion about the superiority of one strategy over another, the summary of the results provided by this study provides information on strategies that have been most widely studied in the last few years and their effectiveness in the context in which they were applied. Therefore, this panorama can support strategy decision-making adequate for SUS and other health systems, seeking to positively impact on the appropriate use of guidelines, healthcare outcomes and the sustainability of the SUS.

Project description:This systematic review assessed the effectiveness of capacity building interventions relevant to public health practice. The aim is to inform and improve capacity building interventions.Four strategies were used: 1) electronic database searching; 2) reference lists of included papers; 3) key informant consultation; and 4) grey literature searching. Inclusion (e.g., published in English) and exclusion criteria (e.g., non-English language papers published earlier than 2005) are outlined with included papers focusing on capacity building, learning plans, or professional development plans within public health and related settings, such as non-governmental organizations, government, or community-based organizations relating to public health or healthcare. Outcomes of interest included changes in knowledge, skill or confidence (self-efficacy), changes in practice (application or intent), and perceived support or supportive environments, with outcomes reported at the individual, organizational or systems level(s). Quality assessment of all included papers was completed.Fourteen papers were included in this review. These papers reported on six intervention types: 1) internet-based instruction, 2) training and workshops, 3) technical assistance, 4) education using self-directed learning, 5) communities of practice, and 6) multi-strategy interventions. The available literature showed improvements in one or more capacity-building outcomes of interest, mainly in terms of individual-level outcomes. The available literature was moderate in quality and showed a range of methodological issues.There is evidence to inform capacity building programming and how interventions can be selected to optimize impact. Organizations should carefully consider methods for analysis of capacity building interventions offered; specifically, through which mechanisms, to whom, and for which purpose. Capacity-building interventions can enhance knowledge, skill, self-efficacy (including confidence), changes in practice or policies, behaviour change, application, and system-level capacity. However in applying available evidence, organizations should consider the outcomes of highest priority, selecting intervention(s) effective for the outcome(s) of interest. Examples are given for selecting intervention(s) to match priorities and context, knowing effectiveness evidence is only one consideration in decision making. Future evaluations should: extend beyond the individual level, assess outcomes at organizational and systems levels, include objective measures of effect, assess baseline conditions, and evaluate features most critical to the success of interventions.

Project description:IntroductionAs the world's population ages, there has been increasing attention to developing health policies to support older adults. Engaging older adults in policy-making is one way to ensure that policy decisions align with their needs and priorities. However, ageist stereotypes often underestimate older adults' ability to participate in such initiatives. This scoping review aims to describe the characteristics and impacts of public engagement initiatives designed to help inform health policy-making for older adults.MethodsA systematic search of peer-reviewed and grey literature (English only) describing public engagement initiatives in health policy-making for older adults was conducted using six electronic databases, Google and the Participedia website. No geographical, methodological or time restrictions were applied to the search. Eligibility criteria were purposefully broad to capture a wide array of relevant engagement initiatives. The outcomes of interest included participants, engagement methods and reported impacts.ResultsThis review included 38 papers. The majority of public engagement initiatives were funded or initiated by governments or government agencies as a formal activity to address policy issues, compared to initiatives without a clear link to a specific policy-making process (e.g., research projects). While most initiatives engaged older adults as target participants, there was limited reporting on efforts to achieve participant diversity. Consultation-type engagement activities were most prevalent, compared to deliberative and collaborative approaches. Impacts of public engagement were frequently reported without formal evaluations. Notably, a few articles reported negative impacts of such initiatives.ConclusionThis review describes how public engagement practices have been conducted to help inform health policy-making for older adults and the documented impacts. The findings can assist policymakers, government staff, researchers and seniors' advocates in supporting the design and execution of public engagement initiatives in this policy sector.Patient or public contributionOlder adult partners from the McMaster University Collaborative for Health and Aging provided strategic advice throughout the key phases of this review, including developing a review protocol, data charting and synthesis and interpreting and presenting the review findings. This collaborative partnership was an essential aspect of this review, enhancing its relevance and meaningfulness for older adults.

Project description:BackgroundSystematic identification of evidence in health policy can be time-consuming and challenging. This study examines three questions pertaining to systematic reviews on obesity prevention policy, in order to identify the most efficient search methods: (1) What percentage of the primary studies selected for inclusion in the reviews originated in scholarly as opposed to gray literature? (2) How much of the primary scholarly literature in this topic area is indexed in PubMed/MEDLINE? (3) Which databases index the greatest number of primary studies not indexed in PubMed, and are these databases searched consistently across systematic reviews?MethodsWe identified systematic reviews on obesity prevention policy and explored their search methods and citations. We determined the percentage of scholarly vs. gray literature cited, the most frequently cited journals, and whether each primary study was indexed in PubMed. We searched 21 databases for all primary study articles not indexed in PubMed to determine which database(s) indexed the highest number of these relevant articles.ResultsIn total, 21 systematic reviews were identified. Ten of the 21 systematic reviews reported searching gray literature, and 12 reviews ultimately included gray literature in their analyses. Scholarly articles accounted for 577 of the 649 total primary study papers. Of these, 495 (76%) were indexed in PubMed. Google Scholar retrieved the highest number of the remaining 82 non-PubMed scholarly articles, followed by Scopus and EconLit. The Journal of the American Dietetic Association was the most-cited journal.ConclusionsResearchers can maximize search efficiency by searching a small yet targeted selection of both scholarly and gray literature resources. A highly sensitive search of PubMed and those databases that index the greatest number of relevant articles not indexed in PubMed, namely multidisciplinary and economics databases, could save considerable time and effort. When combined with a gray literature search and additional search methods, including cited reference searching and consulting with experts, this approach could help maintain broad retrieval of relevant studies while improving search efficiency. Findings also have implications for designing specialized databases for public health research.

Dataset Information

Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review.

Publications

Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets