Dataset Information

Methodological quality of systematic reviews on treatments for Alzheimer's disease: a cross-sectional study.

ABSTRACT:

Background

Carefully conducted systematic reviews (SRs) can provide reliable evidence on the effectiveness of treatment strategies for Alzheimer's disease (AD). Nevertheless, the reliability of SR results can be limited by methodological flaws. This cross-sectional study aimed to examine the methodological quality of SRs on AD treatments, along with potentially relevant factors.

Methods

To identify eligible SRs on AD treatments, four databases including the Cochrane Database of Systematic Reviews, MEDLINE, EMBASE, and PsycINFO were searched. The Assessing the Methodological Quality of Systematic Reviews 2 instrument was used for quality appraisal of SRs. Multivariable regression analyses were used to examine factors related to methodological quality.

Results

A total of 102 SRs were appraised. Four (3.90%) SRs were considered as high quality; 14 (13.7%), 48 (47.1%), and 36 (35.3%) were as moderate, low, and critically low quality, respectively. The following significant methodological limitations were identified: only 22.5% of SRs registered protocols a priori, 6.9% discussed the rationales of chosen study designs, 21.6% gave a list of excluded studies with reasons, and 23.5% documented funding sources of primary studies. Cochrane SRs (adjusted odds ratio (AOR): 31.9, 95% confidence interval (CI): 3.81-266.9) and SRs of pharmacological treatments (AOR: 3.96, 95%CI: 1.27-12.3) were related to the higher overall methodological quality of SRs.

Conclusion

Methodological quality of SRs on AD treatments is unsatisfactory, especially among non-Cochrane SRs and SRs of non-pharmacological interventions. Improvement in the following methodological domains requires particular attention due to poor performance: registering and publishing protocols a priori, justifying study design selection, providing a list of excluded studies, and reporting funding sources of primary studies.

SUBMITTER: Zhong CCW

PROVIDER: S-EPMC9617345 | biostudies-literature | 2022 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Methodological quality of systematic reviews on treatments for Alzheimer's disease: a cross-sectional study.

Zhong Claire C W CCW Zhao Jinglun J Wong Charlene H L CHL Wu Irene X Y IXY Mao Chen C Yeung Jerry W F JWF Chung Vincent C H VCH

Alzheimer's research & therapy 20221029 1

<h4>Background</h4>Carefully conducted systematic reviews (SRs) can provide reliable evidence on the effectiveness of treatment strategies for Alzheimer's disease (AD). Nevertheless, the reliability of SR results can be limited by methodological flaws. This cross-sectional study aimed to examine the methodological quality of SRs on AD treatments, along with potentially relevant factors.<h4>Methods</h4>To identify eligible SRs on AD treatments, four databases including the Cochrane Database of Sy ...[more]

PMID: 36309725

Similar Datasets

Project description:BackgroundWhile well-conducted systematic reviews (SRs) can provide the best evidence on the potential effectiveness of acupuncture, limitations on the methodological rigour of SRs may impact the trustworthiness of their conclusions. This cross-sectional study aimed to evaluate the methodological quality of a representative sample of SRs on acupuncture effectiveness.MethodsCochrane Database of Systematic Reviews, MEDLINE, and EMBASE were searched for SRs focusing on the treatment effect of manual acupuncture or electro-acupuncture published during January 2018 and March 2020. Eligible SRs must contain at least one meta-analysis and be published in English language. Two independent reviewers extracted the bibliographical characteristics of the included SRs with a pre-designed questionnaire and appraised the methodological quality of the studies with the validated AMSTAR 2 (A MeaSurement Tool to Assess systematic Reviews 2). The associations between bibliographical characteristics and methodological quality ratings were explored using Kruskal-Wallis rank tests and Spearman's rank correlation coefficients.ResultsA total of 106 SRs were appraised. Only one (0.9%) SR was of high overall methodological quality, zero (0%) was of moderate-quality, six (5.7%) and 99 (93.4%) were of low-quality and critically low-quality respectively. Among appraised SRs, only ten (9.4%) provided an a priori protocol, four (3.8%) conducted a comprehensive literature search, five (4.7%) provided a list of excluded studies, and six (5.7%) performed meta-analysis appropriately. Cochrane SRs, updated SRs, and SRs that did not search non-English databases had relatively higher overall quality.ConclusionsMethodological quality of SRs on acupuncture is unsatisfactory. Future reviewers should improve critical methodological aspects of publishing protocols, performing comprehensive search, providing a list of excluded studies with justifications for exclusion, and conducting appropriate meta-analyses. These recommendations can be implemented via enhancing the technical competency of reviewers in SR methodology through established education approaches as well as quality gatekeeping by journal editors and reviewers. Finally, for evidence users, skills in SR critical appraisal remain to be essential as relevant evidence may not be available in pre-appraised formats.

Project description:BackgroundHealthcare providers need reliable evidence for supporting the adoption of new interventions, of which the source of evidence often originates from systematic reviews (SRs). However, little assessment on the rigor of SRs related to osteoarthritis interventions has been conducted. This cross-sectional study aimed to evaluate the methodological quality and predictors among SRs on osteoarthritis interventions.MethodsFour electronic databases (Cochrane Database of Systematic Reviews, MEDLINE, Embase, and PsycINFO) were searched, from 1 January 2008 to 10 October 2019. An SR was eligible if it focused on osteoarthritis interventions, and we performed at least one meta-analysis. Methodological quality was assessed using the validated AMSTAR 2 instrument. Multivariate regression analyses were conducted to assess predictors of methodological quality.ResultsIn total, 167 SRs were included. The most SRs were non-Cochrane reviews (88.6%), and 54.5% investigated non-pharmacological interventions. Only seven (4.2%) had high methodological quality. Respectively, eight (4.8%), 25 (15.0%), and 127 (76.0%) SRs had moderate, low, and critically low quality. Main methodological weaknesses were as follows: only 16.8% registered protocol a priori, 4.2% searched literature comprehensively, 25.7% included lists of excluded studies with justifications, and 30.5% assessed risk of bias appropriately by considering allocation concealment, blinding of patients and assessors, random sequence generation and selective reported outcomes. Cochrane reviews [adjusted odds ratio (AOR) 251.5, 95% confidence interval (CI) 35.5-1782.6], being updates of previous SRs (AOR 3.9, 95% CI 1.1-13.7), and SRs published after 2017 (AOR 7.7, 95% CI 2.8-21.5) were positively related to higher methodological quality.ConclusionDespite signs of improvement in recent years, most of the SRs on osteoarthritis interventions have critically low methodological quality, especially among non-Cochrane reviews. Future SRs should be improved by conducting comprehensive literature search, justifying excluded studies, publishing a protocol, and assessing the risk of bias of included studies appropriately.

Project description:IntroductionReliable systematic reviews are essential to inform clinical practice guidelines, policies and further research priorities in Africa. For systematic review findings to be trustworthy, they need to be conducted with methodological rigour and reported transparently. We assessed the methodological quality of systematic reviews published in African emergency medicine journals, comparing them to those published in international emergency medicine journals. Additionally, we describe the types of review literature published in the African journals.MethodsWe performed a cross-sectional methodological study of systematic reviews published in selected African and international emergency medicine journals from 2012 to 2021. Studies were eligible if they were i) a systematic review on an emergency medicine topic, ii) published in one of the top five emergency medicine journals in the African region or internationally and iii) published between January 2012 and December 2021 in English or French. We searched PubMed, Web of Science and Scopus databases and hand-searched selected journals. Two authors screened titles, abstracts and full texts independently and in duplicate. Data extraction was performed by one reviewer, using a standardised form, after completing a calibration exercise. We described the characteristics of systematic reviews and assessed methodological quality using AMSTAR II.ResultsWe identified 34 (37%) African and 511 (54%) international systematic reviews from 92 and 948 review articles respectively across 10 journals. We included all 34 African and a random sample of 100 international systematic reviews. Methodological quality was low or critically low for all the African systematic reviews (n=34, 100%) and all but three international systematic reviews (n=97, 97%). The median number of critical domain weaknesses was 4 (IQR 4;5) and 2 (IQR 2;4) for African and international systematic reviews respectively. The most common weaknesses across both African and international systematic reviews were i) not establishing a priori review protocols, ii) unclear selection of study designs iii) not providing a list of excluded studies and iv) unclear reporting on funding sources for included studies.ConclusionEmergency medicine systematic reviews published in African and international journals are lacking in methodological quality. Reporting an a priori protocol, developing a comprehensive search strategy, appropriate evidence synthesis and adequate assessment of risk of bias, heterogeneity and evidence certainty may improve the quality of systematic reviews.

Project description:BackgroundThe overall confidence in the results of systematic reviews including animal models can be heterogeneous. We assessed the methodological quality of systematic reviews including animal models in dentistry as well as the overall confidence in the results of those systematic reviews.Material & methodsPubMed, Web of Science and Scopus were searched for systematic reviews including animal studies in dentistry published later than January 2010 until 18th of July 2022. Overall confidence in the results was assessed using a modified version of the A MeaSurement Tool to Assess systematic Reviews (AMSTAR-2) checklist. Checklist items were rated as yes, partial yes, no and not applicable. Linear regression analysis was used to investigate associations between systematic review characteristics and the overall adherence to the AMSTAR-2 checklist. The overall confidence in the results was calculated based on the number of critical and non-critical weaknesses presented in the AMSTAR-2 items and rated as high, moderate, low and critical low.ResultsOf initially 951 retrieved systematic reviews, 190 were included in the study. The overall confidence in the results was low in 43 (22.6%) and critically low in 133 (70.0%) systematic reviews. While some AMSTAR-2 items were regularly reported (e.g. conflict of interest, selection in duplicate), others were not (e.g.Fundingn = 1; 0.5%). Multivariable linear regression analysis showed that the adherence scores of AMSTAR-2 was significantly associated with publication year, journal impact factor (IF), topic, and the use of tools to assess risk of bias (RoB) of the systematic reviews.ConclusionAlthough the methodological quality of dental systematic reviews of animal models improved over the years, it is still suboptimal. The overall confidence in the results was mostly low or critically low. Systematic reviews, which were published later, published in a journal with a higher IF, focused on non-surgery topics, and used at least one tool to assess RoB correlated with greater adherence to the AMSTAR-2 guidelines.

Project description:BackgroundAn increasing number of systematic reviews assessed the safety of surgical interventions over time. How well these systematic reviews were designed and conducted determines the reliability of evidence. In this study, we aimed to assess the methodological quality of systematic reviews on the safety of surgical interventions.MethodsWe searched PubMed for systematic reviews of surgical interventions with safety as the exclusive outcome from 1st-Jan, 2015 to 1st-Jan, 2020. The methodological quality of eligible systematic reviews was evaluated according to the AMSTAR 2.0 instrument. The primary outcomes were the number of methodological weaknesses and the global methodological quality. The proportion of each methodological weakness among eligible systematic reviews was compared by three pre-defined stratification variables. The absolute difference of the proportion (PD) was used as the effect estimator, with the two-tailed z-test for the significance.ResultsWe identified 127 systematic reviews from 18,636 records. None (n = 0, 0.00%) of them could be rated as "high" in terms of the global methodological quality; in contrast, they were either rated as "low" (n = 18, 14.17%) or as "critically low" (n = 109, 85.83%). The median number of methodological weaknesses of these systematic reviews was 8 (interquartile range, IQR: 6 to 9), in which 4 (IQR: 2 to 4) were critical weaknesses. Systematic reviews that used any reporting guideline (e.g., domain 13, PD = -0.22, 95% CI: - 0.39, - 0.06; p = 0.01) and developed a protocol in advance (e.g., domain 6, PD = -0.20, 95% CI: - 0.39, - 0.01; p = 0.04) were less likely to have methodological weakness in some domains but not for the rest (e.g., domain 8, PD = 0.04, 95% CI: - 0.14, 0.21; p = 0.68; with protocol vs. without).ConclusionsThe methodological quality of current systematic reviews of adverse events with surgical interventions was poor. Further efforts, for example, encouraging researchers to develop a protocol in advance, are needed to enhance the methodological quality of these systematic reviews.

Dataset Information

Methodological quality of systematic reviews on treatments for Alzheimer's disease: a cross-sectional study.

Background

Methods

Results

Conclusion

Publications

Methodological quality of systematic reviews on treatments for Alzheimer's disease: a cross-sectional study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets