Dataset Information

Development and validation of a search filter to identify equity-focused studies: reducing the number needed to screen.

ABSTRACT: BACKGROUND:Health inequalities, worse health associated with social and economic disadvantage, are reported by a minority of research articles. Locating these studies when conducting an equity-focused systematic review is challenging due to a deficit in standardised terminology, indexing, and lack of validated search filters. Current reporting guidelines recommend not applying filters, meaning that increased resources are needed at the screening stage. METHODS:We aimed to design and test search filters to locate studies that reported outcomes by a social determinant of health. We developed and expanded a 'specific terms strategy' using keywords and subject headings compiled from recent systematic reviews that applied an equity filter. A 'non-specific strategy' was compiled from phrases used to describe equity analyses that were reported in titles and abstracts, and related subject headings. Gold standard evaluation and validation sets were compiled. The filters were developed in MEDLINE, adapted for Embase and tested in both. We set a target of 0.90 sensitivity (95% CI; 0.84, 0.94) in retrieving 150 gold standard validation papers. We noted the reduction in the number needed to screen in a proposed equity-focused systematic review and the proportion of equity-focused reviews we assessed in the project that applied an equity filter to their search strategy. RESULTS:The specific terms strategy filtered out 93-95% of all records, and retrieved a validation set of articles with a sensitivity of 0.84 in MEDLINE (0.77, 0.89), and 0.87 (0.81, 0.92) in Embase. When combined (Boolean 'OR') with the non-specific strategy sensitivity was 0.92 (0.86, 0.96) in MEDLINE (Embase 0.94; 0.89, 0.97). The number needed to screen was reduced by 77% by applying the specific terms strategy, and by 59.7% (MEDLINE) and 63.5% (Embase) by applying the combined strategy. Eighty-one per cent of systematic reviews filtered studies by equity. CONCLUSIONS:A combined approach of using specific and non-specific terms is recommended if systematic reviewers wish to filter studies for reporting outcomes by social determinants. Future research should concentrate on the indexing standardisation for equity studies and further development and testing of both specific and non-specific terms for accurate study retrieval.

SUBMITTER: Prady SL

PROVIDER: S-EPMC6186133 | biostudies-literature | 2018 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and validation of a search filter to identify equity-focused studies: reducing the number needed to screen.

Prady Stephanie L SL Uphoff Eleonora P EP Power Madeleine M Golder Su S

BMC medical research methodology 20181012 1

<h4>Background</h4>Health inequalities, worse health associated with social and economic disadvantage, are reported by a minority of research articles. Locating these studies when conducting an equity-focused systematic review is challenging due to a deficit in standardised terminology, indexing, and lack of validated search filters. Current reporting guidelines recommend not applying filters, meaning that increased resources are needed at the screening stage.<h4>Methods</h4>We aimed to design a ...[more]

PMID: 30314471

Similar Datasets

Project description:BackgroundDegenerative cervical myelopathy (DCM) is a common condition with many unmet clinical needs. Pooled analysis of studies is an important tool for advancing medical understanding. This process starts with a systematic search of the literature. Identification of studies in DCM is challenged by a number of factors, including non-specific terminology and index terms. Search filters or HEDGEs, are search strings developed and validated to optimise medical literature searches. We aimed to develop a search filter for DCM for the MEDLINE database.MethodsThe diagnostic test assessment framework of a "development dataset" and seperate "validation dataset" was used. The development dataset was formed by hand searching four leading spinal journals (Spine, Journal of Neurosurgery Spine, Spinal Cord and Journal of Spinal Disorders and Techniques) in 2005 and 2010. The search filter was initially developed focusing on sensitivity and subsequently refined using NOT functions to improve specificity. One validation dataset was formed from DCM narrative and systematic review articles and the second, articles published in April of 1989, 1993, 1997, 2001, 2005, 2009, 2013 and 2017 retrieved via the search MeSH term 'Spine'. Metrics of sensitivity, specificity, precision and accuracy were used to test performance.ResultsHand searching identified 77/1094 relevant articles for 2005 and 55/1199 for 2010. We developed a search hedge with 100% sensitivity and a precision of 30 and 29% for the 2005 and 2010 development datasets respectively. For the selected time periods, EXP Spine returned 2113 publications and 30 were considered relevant. The search filter identified all 30 relevant articles, with a specificity of 94% and precision of 20%. Of the 255 references listed in the narrative index reviews, 225 were indexed in MEDLINE and 165 (73%) were relevant articles. All relevant articles were identified and accuracy ranged from 67 to 97% over the three reviews. Of the 42 articles returned from 3 recent systematic reviews, all were identified by the filter.ConclusionsWe have developed a highly sensitive hedge for the research of DCM. Whilst precision is similarly low as other hedges, this search filter can be used as an adjunct for DCM search strategies.

Project description:BACKGROUND:Integrated care is an increasingly important principle for organising healthcare. Integrated care models show promise in reducing resource wastage and service fragmentation whilst improving the accessibility, patient-centredness and quality of care for patients. Those needing reliable access to the growing research evidence base for integrated care can be frustrated by search challenges reflective of the topic's complexity. The aim of this study is to report the empirical development and validation of two search filters for rapid and effective retrieval of integrated care evidence in PubMed. One filter is optimised for recall and the other for precision. METHODS:An Expert Advisory Group comprising international integrated care experts guided the study. A gold standard test set of citations was formed from screening Handbook Integrated Care chapter references for relevance. This set was divided into a Term Identification Set (20%) for determining candidate terms using frequency analysis; a Filter Development Set (40%) for testing performance of term combinations; and a Filter Validation Set (40%) reserved for confirming final filter performance. In developing the high recall filter, recall was steadily increased while maintaining precision at ?50%. Similarly, the high precision filter sought to maximise precision while keeping recall ?50%. For each term combination tested, an approximation of precision was obtained by reviewing the first 100 citations retrieved in Medline for relevance. RESULTS:The gold standard set comprised 534 citations. The search filter optimised for recall ('Broad Integrated Care Search') achieved 86.0-88.3% recall with corresponding low precision (47-53%). The search filter optimised for precise searching ('Narrow Integrated Care Search') demonstrated precision of 73-95% with recall reduced to between 55.9 and 59.8%. These filters are now available as one-click URL hyperlinks in the website of International Foundation for Integrated Care. CONCLUSIONS:The Broad and Narrow Integrated Care Search filters provide potential users, such as policy makers and researchers, seamless, reliable and ongoing access to integrated care evidence for decision making. These filters were developed according to a rigorous and transparent methodology designed to circumvent the challenges of information retrieval posed by this complex, multifaceted topic.

Project description:Objective:Schizophrenia clinical trials commonly measure observed changes in Positive and Negative Syndrome Scale (PANSS) total score. However, it is more intuitive to think of response vs nonresponse, a binary outcome. Assessing binary outcomes enables calculation of number needed to treat (NNT) for therapeutic outcomes, number needed to harm (NNH) for adverse outcomes, and likelihood to be helped or harmed (LHH) to demonstrate benefit/risk tradeoffs. Here, NNT, NNH, and LHH were used to evaluate the clinical usefulness of aripiprazole lauroxil in patients with an acute schizophrenia exacerbation. Methods:Categorical efficacy and tolerability data were taken from the pivotal Phase 3 trial evaluating aripiprazole lauroxil for treatment of an acute exacerbation of schizophrenia. NNT and NNH values, with 95% CIs, were calculated in this post hoc analysis. Results:Using the intent-to-treat population for the pooled doses of aripiprazole lauroxil (441 mg [n=196] and 882 mg [n=204] q4w), responder rates (?30% improvement from baseline PANSS total score) were 35.3% for aripiprazole lauroxil arms vs 18.4% for placebo (n=196), yielding a NNT of 6 (95% CI: 5-11). Discontinuation rates due to adverse events (AEs) were higher among patients randomized to placebo than to either aripiprazole lauroxil dose. Akathisia was the only AE with an incidence ?5% in each aripiprazole lauroxil group and at least twice that of placebo (11.6%, 11.5%, and 4.3% of the patients receiving aripiprazole lauroxil 441 mg, 882 mg, and placebo, respectively), producing a NNH of 14 (95% CI: 9-33) for pooled aripiprazole lauroxil doses vs placebo. Calculating LHH for therapeutic response vs akathisia, aripiprazole lauroxil was 2.3 times more likely to result in a therapeutic response than an incident of akathisia. Conclusion:Using metrics of NNT, NNH, and LHH, aripiprazole lauroxil was an efficacious and well-tolerated intervention in a pivotal study in patients with an acute schizophrenia exacerbation.

Dataset Information

Development and validation of a search filter to identify equity-focused studies: reducing the number needed to screen.

Publications

Development and validation of a search filter to identify equity-focused studies: reducing the number needed to screen.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets