Performance of a mixed filter to identify relevant studies for mixed studies reviews.
Ontology highlight
ABSTRACT: Objective
Mixed studies reviews include empirical studies with diverse designs. Given that identifying relevant studies for such reviews is time consuming, a mixed filter was developed.Methods
The filter was used for six journals from three disciplines. For each journal, database records were coded "empirical" (relevant) when they mentioned a research question or objective, data collection, analysis, and results. We measured precision (proportion of retrieved documents being relevant), sensitivity (proportion of relevant documents retrieved), and specificity (proportion of nonrelevant documents not retrieved).Results
Records were coded with and without the filter, and descriptive statistics were performed, suggesting the mixed filter has high sensitivity.
SUBMITTER: El Sherif R
PROVIDER: S-EPMC4722642 | biostudies-literature | 2016 Jan
REPOSITORIES: biostudies-literature
Publications
Performance of a mixed filter to identify relevant studies for mixed studies reviews.
El Sherif Reem R Pluye Pierre P Gore Genevieve G Granikov Vera V Hong Quan Nha QN
Journal of the Medical Library Association : JMLA 20160101 1
<h4>Objective</h4>Mixed studies reviews include empirical studies with diverse designs. Given that identifying relevant studies for such reviews is time consuming, a mixed filter was developed.<h4>Methods</h4>The filter was used for six journals from three disciplines. For each journal, database records were coded "empirical" (relevant) when they mentioned a research question or objective, data collection, analysis, and results. We measured precision (proportion of retrieved documents being rele ...[more]
Similar Datasets
Project description:Systematic reviews and meta-analyses are increasingly common. This article aims to provide guidance for people conducting systematic reviews relevant to the healthcare of older people. An awareness of these issues will also help people reading systematic reviews to determine whether the results will influence their clinical practice. It is essential that systematic reviews are performed by a team which includes the required technical and clinical expertise. Those performing reviews for the first time should ensure they have appropriate training and support. They must be planned and performed in a transparent and methodologically robust way: guidelines are available. The protocol should be written-and if possible published-before starting the review. Geriatricians will be interested in a table of baseline characteristics, which will help to determine if the studied samples or populations are similar to their patients. Reviews of studies of older people should consider how they will manage issues such as different age cut-offs; non-specific presentations; multiple predictors and outcomes; potential biases and confounders. Systematic reviews and meta-analyses may provide evidence to improve older people's care, or determine where new evidence is required. Newer methodologies, such as meta-analyses of individual level data, network meta-analyses and umbrella reviews, and realist synthesis, may improve the reliability and clinical utility of systematic reviews.
| S-EPMC5860219 | biostudies-literature
Project description:ObjectiveSystematic reviews are important in health care but are expensive to produce and maintain. The authors explore the use of automated transformations of Boolean queries to improve the identification of relevant studies for updates to systematic reviews.Materials and methodsA set of query transformations, including operator substitution, query expansion, and query reduction, were used to iteratively modify the Boolean query used for the original systematic review. The most effective transformation at each stage is identified using information about the studies included and excluded from the original review. A dataset consisting of 22 systematic reviews was used for evaluation. Updated queries were evaluated using the included and excluded studies from the updated version of the review. Recall and precision were used as evaluation measures.ResultsThe updated queries were more effective than the ones used for the original review, in terms of both precision and recall. The overall number of documents retrieved was reduced by more than half, while the number of relevant documents found increased by 10.3%.ConclusionsIdentification of relevant studies for updates to systematic reviews can be carried out more effectively by using information about the included and excluded studies from the original review to produce improved Boolean queries. These updated queries reduce the overall number of documents retrieved while also increasing the number of relevant documents identified, thereby representing a considerable reduction in effort required by systematic reviewers.
| S-EPMC7750994 | biostudies-literature
Project description:BackgroundHealth-evidence.ca is an online registry of systematic reviews evaluating the effectiveness of public health interventions. Extensive searching of bibliographic databases is required to keep the registry up to date. However, search filters have been developed to assist in searching the extensive amount of published literature indexed. Search filters can be designed to find literature related to a certain subject (i.e. content-specific filter) or particular study designs (i.e. methodological filter). The objective of this paper is to describe the development and validation of the health-evidence.ca Systematic Review search filter and to compare its performance to other available systematic review filters.MethodsThis analysis of search filters was conducted in MEDLINE, EMBASE, and CINAHL. The performance of thirty-one search filters in total was assessed. A validation data set of 219 articles indexed between January 2004 and December 2005 was used to evaluate performance on sensitivity, specificity, precision and the number needed to read for each filter.ResultsNineteen of 31 search filters were effective in retrieving a high level of relevant articles (sensitivity scores greater than 85%). The majority achieved a high degree of sensitivity at the expense of precision and yielded large result sets. The main advantage of the health-evidence.ca Systematic Review search filter in comparison to the other filters was that it maintained the same level of sensitivity while reducing the number of articles that needed to be screened.ConclusionsThe health-evidence.ca Systematic Review search filter is a useful tool for identifying published systematic reviews, with further screening to identify those evaluating the effectiveness of public health interventions. The filter that narrows the focus saves considerable time and resources during updates of this online resource, without sacrificing sensitivity.
| S-EPMC3515398 | biostudies-literature
Project description:As flattening filter-free (FFF) photon beams become readily available for treat-ment delivery in techniques such as SBRT, thorough investigation of skin dose from FFF photon beams is necessary under clinically relevant conditions. Using a parallel-plate PTW Markus chamber placed in a custom water-equivalent phantom, surface-dose measurements were taken at 2 × 2, 3 × 3, 4 × 4, 6 × 6, 8 × 8, 10 × 10, 20 × 20, and 30 × 30 cm2 field sizes, at 80, 90, and 100 cm source-to-surface distances (SSDs), and with fields defined by jaws and multileaf collimator (MLC) using multiple beam energies (6X, 6XFFF, 10X, and 10XFFF). The same set of measurements was repeated with the chamber at a reference depth of 10cm. Each surface measurement was normalized by its corresponding reference depth measurement for analysis. The FFF surface doses at 100 cm SSD were higher than flattened surface doses by 45% at 2 × 2 cm2 to 13% at 20 × 20 cm2 for 6MV energy. These surface dose differences varied to a greater degree as energy increased, ranging from +63% at 2 × 2 cm2 to -2% at 20 × 20 cm2 for 10 MV. At small field sizes, higher energy increased FFF surface dose relative to flattened surface dose; while at larger field sizes, relative FFF surface dose was higher for lower energies. At both energies investigated, decreasing SSD caused a decrease in the ratios of FFF-to-flattened surface dose. Variability with SSD of FFF-to-flattened surface dose differences increased with field size and ranged from 0% to 6%. The field size at which FFF and flattened beams gave the same skin dose increased with decreasing beam energy. Surface dose was higher with MLC fields compared to jaw fields under most conditions, with the difference reaching its maximum at a field size between 4 × 4 cm2 and 6 × 6 cm2 for a given energy and SSD. This study conveyed the magnitude of surface dose in a clinically meaning-ful manner by reporting results normalized to 10 cm depth dose instead of depth of dose maximum.
| S-EPMC5690509 | biostudies-literature
Project description:Systematic reviews (SRs) are considered an important tool for decision-making. There has been no recent comprehensive identification or description of child-relevant SRs. A description of existing child-relevant SRs would help to identify the extent of available child-relevant evidence available in SRs and gaps in the evidence base where SRs are required. The objective of this study was to describe child-relevant SRs from the Cochrane Database of Systematic Reviews (CDSR, Issue 2, 2009).SRs were assessed for relevance using pre-defined criteria. Data were extracted and entered into an electronic form. Univariate analyses were performed to describe the SRs overall and by topic area.The search yielded 1666 SRs; 793 met the inclusion criteria. 38% of SRs were last assessed as up-to-date prior to 2007. Corresponding authors were most often from the UK (41%). Most SRs (59%) examined pharmacological interventions. 53% had at least one external source of funding. SRs included a median of 7 studies (IQR 3, 15) and 679 participants (IQR 179, 2833). Of all studies, 48% included only children, and 27% only adults. 94% of studies were published in peer-reviewed journals. Primary outcomes were specified in 72% of SRs. Allocation concealment and the Jadad scale were used in 97% and 25% of SRs, respectively. Adults and children were analyzed separately in 12% of SRs and as a subgroup analysis in 14%. Publication bias was assessed in only 14% of SRs. A meta-analysis was conducted in 68% of SRs with a median of 5 trials (IQR 3, 9) each. Variations in these characteristics were observed across topic areas.We described the methodological characteristics and rigour of child-relevant reviews in the CDSR. Many SRs are not up-to-date according to Cochrane criteria. Our study describes variation in conduct and reporting across SRs and reveals clinicians' ability to access child-specific data.
| S-EPMC2881081 | biostudies-other
Project description:BACKGROUND:Health inequalities, worse health associated with social and economic disadvantage, are reported by a minority of research articles. Locating these studies when conducting an equity-focused systematic review is challenging due to a deficit in standardised terminology, indexing, and lack of validated search filters. Current reporting guidelines recommend not applying filters, meaning that increased resources are needed at the screening stage. METHODS:We aimed to design and test search filters to locate studies that reported outcomes by a social determinant of health. We developed and expanded a 'specific terms strategy' using keywords and subject headings compiled from recent systematic reviews that applied an equity filter. A 'non-specific strategy' was compiled from phrases used to describe equity analyses that were reported in titles and abstracts, and related subject headings. Gold standard evaluation and validation sets were compiled. The filters were developed in MEDLINE, adapted for Embase and tested in both. We set a target of 0.90 sensitivity (95% CI; 0.84, 0.94) in retrieving 150 gold standard validation papers. We noted the reduction in the number needed to screen in a proposed equity-focused systematic review and the proportion of equity-focused reviews we assessed in the project that applied an equity filter to their search strategy. RESULTS:The specific terms strategy filtered out 93-95% of all records, and retrieved a validation set of articles with a sensitivity of 0.84 in MEDLINE (0.77, 0.89), and 0.87 (0.81, 0.92) in Embase. When combined (Boolean 'OR') with the non-specific strategy sensitivity was 0.92 (0.86, 0.96) in MEDLINE (Embase 0.94; 0.89, 0.97). The number needed to screen was reduced by 77% by applying the specific terms strategy, and by 59.7% (MEDLINE) and 63.5% (Embase) by applying the combined strategy. Eighty-one per cent of systematic reviews filtered studies by equity. CONCLUSIONS:A combined approach of using specific and non-specific terms is recommended if systematic reviewers wish to filter studies for reporting outcomes by social determinants. Future research should concentrate on the indexing standardisation for equity studies and further development and testing of both specific and non-specific terms for accurate study retrieval.
| S-EPMC6186133 | biostudies-literature
Project description:BackgroundIn the context of the volume of mixed- and multi-methods studies in health services research, the present study sought to develop an appraisal tool to determine the methodological and reporting quality of such studies when included in systematic reviews. Evaluative evidence regarding the design and use of our existing Quality Assessment Tool for Studies with Diverse Designs (QATSDD) was synthesised to enhance and refine it for application across health services research.MethodsSecondary data were collected through a literature review of all articles identified using Google Scholar that had cited the QATSDD tool from its inception in 2012 to December 2019. First authors of all papers that had cited the QATSDD (n=197) were also invited to provide further evaluative data via a qualitative online survey. Evaluative findings from the survey and literature review were synthesised narratively and these data used to identify areas requiring refinement. The refined tool was subject to inter-rater reliability, face and content validity analyses.ResultsKey limitations of the QATSDD tool identified related to a lack of clarity regarding scope of use of the tool and in the ease of application of criteria beyond experimental psychological research. The Quality Appraisal for Diverse Studies (QuADS) tool emerged as a revised tool to address the limitations of the QATSDD. The QuADS tool demonstrated substantial inter-rater reliability (k=0.66), face and content validity for application in systematic reviews with mixed, or multi-methods health services research.ConclusionOur findings highlight the perceived value of appraisal tools to determine the methodological and reporting quality of studies in reviews that include heterogeneous studies. The QuADS tool demonstrates strong reliability and ease of use for application to multi or mixed-methods health services research.
| S-EPMC7885606 | biostudies-literature
Project description:BackgroundThe delivery of optimal medical care to children is dependent on the availability of child relevant research. Our objectives were to: i) systematically review and describe how children are handled in reviews of drug interventions published in the Cochrane Database of Systematic Reviews (CDSR); and ii) determine when effect sizes for the same drug interventions differ between children and adults.MethodsWe systematically identified all of the reviews relevant to child health in the CDSR 2002, Issue 4. Reviews were included if they investigated the efficacy or effectiveness of a drug intervention for a condition that occurs in both children and adults. Information was extracted on review characteristics including study methods, results, and conclusions.ResultsFrom 1496 systematic reviews, 408 (27%) were identified as relevant to both adult and child health; 52% (213) of these included data from children. No significant differences were found in effect sizes between adults and children for any of the drug interventions or conditions investigated. However, all of the comparisons lacked the power to detect a clinically significant difference and wide confidence intervals suggest important differences cannot be excluded. A large amount of data was unavailable due to inadequate reporting at the trial and systematic review level.ConclusionOverall, the findings of this study indicate there is a paucity of child-relevant and specific evidence generated from evidence syntheses of drug interventions. The results indicate a need for a higher standard of reporting for participant populations in studies of drug interventions.
| S-EPMC1261269 | biostudies-literature
Project description:Herein we report that the Thomson Standard and eXtreme/FV® filter vials (0.2??m polyvinylidene difluoride filter membrane) are as effective as gold standard microporous membrane-based syringe filters at removing bacteria, such as Klebsiella pneumonia, from media samples produced in the microbiological laboratory.
| S-EPMC6732000 | biostudies-literature
Project description:Fingerprint recognition plays an important role in many commercial applications and is used by millions of people every day, e.g. for unlocking mobile phones. Fingerprint image segmentation is typically the first processing step of most fingerprint algorithms and it divides an image into foreground, the region of interest, and background. Two types of error can occur during this step which both have a negative impact on the recognition performance: 'true' foreground can be labeled as background and features like minutiae can be lost, or conversely 'true' background can be misclassified as foreground and spurious features can be introduced. The contribution of this paper is threefold: firstly, we propose a novel factorized directional bandpass (FDB) segmentation method for texture extraction based on the directional Hilbert transform of a Butterworth bandpass (DHBB) filter interwoven with soft-thresholding. Secondly, we provide a manually marked ground truth segmentation for 10560 images as an evaluation benchmark. Thirdly, we conduct a systematic performance comparison between the FDB method and four of the most often cited fingerprint segmentation algorithms showing that the FDB segmentation method clearly outperforms these four widely used methods. The benchmark and the implementation of the FDB method are made publicly available.
| S-EPMC4865205 | biostudies-literature