Dataset Information

An optimal search filter for retrieving systematic reviews and meta-analyses.

ABSTRACT:

Background

Health-evidence.ca is an online registry of systematic reviews evaluating the effectiveness of public health interventions. Extensive searching of bibliographic databases is required to keep the registry up to date. However, search filters have been developed to assist in searching the extensive amount of published literature indexed. Search filters can be designed to find literature related to a certain subject (i.e. content-specific filter) or particular study designs (i.e. methodological filter). The objective of this paper is to describe the development and validation of the health-evidence.ca Systematic Review search filter and to compare its performance to other available systematic review filters.

Methods

This analysis of search filters was conducted in MEDLINE, EMBASE, and CINAHL. The performance of thirty-one search filters in total was assessed. A validation data set of 219 articles indexed between January 2004 and December 2005 was used to evaluate performance on sensitivity, specificity, precision and the number needed to read for each filter.

Results

Nineteen of 31 search filters were effective in retrieving a high level of relevant articles (sensitivity scores greater than 85%). The majority achieved a high degree of sensitivity at the expense of precision and yielded large result sets. The main advantage of the health-evidence.ca Systematic Review search filter in comparison to the other filters was that it maintained the same level of sensitivity while reducing the number of articles that needed to be screened.

Conclusions

The health-evidence.ca Systematic Review search filter is a useful tool for identifying published systematic reviews, with further screening to identify those evaluating the effectiveness of public health interventions. The filter that narrows the focus saves considerable time and resources during updates of this online resource, without sacrificing sensitivity.

SUBMITTER: Lee E

PROVIDER: S-EPMC3515398 | biostudies-literature | 2012 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

An optimal search filter for retrieving systematic reviews and meta-analyses.

Lee Edwin E Dobbins Maureen M Decorby Kara K McRae Lyndsey L Tirilis Daiva D Husson Heather H

BMC medical research methodology 20120418

<h4>Background</h4>Health-evidence.ca is an online registry of systematic reviews evaluating the effectiveness of public health interventions. Extensive searching of bibliographic databases is required to keep the registry up to date. However, search filters have been developed to assist in searching the extensive amount of published literature indexed. Search filters can be designed to find literature related to a certain subject (i.e. content-specific filter) or particular study designs (i.e. ...[more]

PMID: 22512835

Similar Datasets

Project description:BACKGROUND:Integrated care is an increasingly important principle for organising healthcare. Integrated care models show promise in reducing resource wastage and service fragmentation whilst improving the accessibility, patient-centredness and quality of care for patients. Those needing reliable access to the growing research evidence base for integrated care can be frustrated by search challenges reflective of the topic's complexity. The aim of this study is to report the empirical development and validation of two search filters for rapid and effective retrieval of integrated care evidence in PubMed. One filter is optimised for recall and the other for precision. METHODS:An Expert Advisory Group comprising international integrated care experts guided the study. A gold standard test set of citations was formed from screening Handbook Integrated Care chapter references for relevance. This set was divided into a Term Identification Set (20%) for determining candidate terms using frequency analysis; a Filter Development Set (40%) for testing performance of term combinations; and a Filter Validation Set (40%) reserved for confirming final filter performance. In developing the high recall filter, recall was steadily increased while maintaining precision at ?50%. Similarly, the high precision filter sought to maximise precision while keeping recall ?50%. For each term combination tested, an approximation of precision was obtained by reviewing the first 100 citations retrieved in Medline for relevance. RESULTS:The gold standard set comprised 534 citations. The search filter optimised for recall ('Broad Integrated Care Search') achieved 86.0-88.3% recall with corresponding low precision (47-53%). The search filter optimised for precise searching ('Narrow Integrated Care Search') demonstrated precision of 73-95% with recall reduced to between 55.9 and 59.8%. These filters are now available as one-click URL hyperlinks in the website of International Foundation for Integrated Care. CONCLUSIONS:The Broad and Narrow Integrated Care Search filters provide potential users, such as policy makers and researchers, seamless, reliable and ongoing access to integrated care evidence for decision making. These filters were developed according to a rigorous and transparent methodology designed to circumvent the challenges of information retrieval posed by this complex, multifaceted topic.

Project description:BackgroundThe QUOROM and PRISMA statements were published in 1999 and 2009, respectively, to improve the consistency of reporting systematic reviews (SRs)/meta-analyses (MAs) of clinical trials. However, not all SRs/MAs adhere completely to these important standards. In particular, it is not clear how well SRs/MAs of acupuncture studies adhere to reporting standards and which reporting criteria are generally ignored in these analyses.ObjectivesTo evaluate reporting quality in SRs/MAs of acupuncture studies.MethodsWe performed a literature search for studies published prior to 2014 using the following public archives: PubMed, EMBASE, Web of Science, the Cochrane Database of Systematic Reviews (CDSR), the Chinese Biomedical Literature Database (CBM), the Traditional Chinese Medicine (TCM) database, the Chinese Journal Full-text Database (CJFD), the Chinese Scientific Journal Full-text Database (CSJD), and the Wanfang database. Data were extracted into pre-prepared Excel data-extraction forms. Reporting quality was assessed based on the PRISMA checklist (27 items).ResultsOf 476 appropriate SRs/MAs identified in our search, 203, 227, and 46 were published in Chinese journals, international journals, and the Cochrane Database, respectively. In 476 SRs/MAs, only 3 reported the information completely. By contrast, approximately 4.93% (1/203), 8.81% (2/227) and 0.00% (0/46) SRs/Mas reported less than 10 items in Chinese journals, international journals and CDSR, respectively. In general, the least frequently reported items (reported≤50%) in SRs/MAs were "protocol and registration", "risk of bias across studies", and "additional analyses" in both methods and results sections.ConclusionsSRs/MAs of acupuncture studies have not comprehensively reported information recommended in the PRISMA statement. Our study underscores that, in addition to focusing on careful study design and performance, attention should be paid to comprehensive reporting standards in SRs/MAs on acupuncture studies.

Project description:BackgroundBibliometric analysis is a quantitative method which applies mathematical and statistical tools to evaluate the inter-relationships and impacts of publications, authors, institutions and countries in a specific research area. Systematic reviews and meta-analyses (SRMAs) are summaries of the best available evidence to address a specific research question via comprehensively literature search, in-depth analysis and synthesis of results. To date, there have been several studies summarizing the publication trends of SRMAs in research specialties, however, none has conducted specifically in ophthalmology. The purpose of this study is to establish the scientometric landscape of SRMAs published in the field of ophthalmology over time.MethodsWe retrieved relevant ophthalmological SRMAs and the corresponding bibliometric parameters during 2000 to 2020 from Web of Science Core Collection. Bibliometric analysis was performed using bibliometrix package. Pre-registration and guideline compliance of each article was independently assessed by two investigators.ResultsA total of 2,660 SRMAs were included, and the average annual growth rate was 21.26%. China and the United States were the most productive countries, while Singapore was the country with the highest average citations per document. Wong TY was not only the most productive, but also the most frequently cited author. The most productive affiliation was National University of Singapore (n = 236). Systematic reviews and meta-analyses output in most subspecialties had steadily increased with retina/vitreous (n = 986), glaucoma (n = 411) and cornea/external diseases (n = 303) constantly as the most dominant fields. Rates of pre-registration and guideline compliance had dramatically increased over time, with 20.0 and 63.5% of article being pre-registered and reported guideline in 2020, respectively. However, SRMAs published on ophthalmology journals tended to be less frequently pre-registered and guideline complied than those on non-ophthalmology journals (both p < 0.001).ConclusionThe annual output of SRMAs has been rapidly increasing over the past two decades. China and the United States were the most productive countries, whereas Singapore has the most prolific and influential scholar and institution. Raising awareness and implementation of SRMAs pre-registration and guideline compliance is still necessary to ensure quality, especially for ophthalmology journals.

Dataset Information

An optimal search filter for retrieving systematic reviews and meta-analyses.

Background

Methods

Results

Conclusions

Publications

An optimal search filter for retrieving systematic reviews and meta-analyses.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets