Dataset Information

Development and evaluation of an instrument for the critical appraisal of randomized controlled trials of natural products.

ABSTRACT:

Background

The efficacy of natural products (NPs) is being evaluated using randomized controlled trials (RCTs) with increasing frequency, yet a search of the literature did not identify a widely accepted critical appraisal instrument developed specifically for use with NPs. The purpose of this project was to develop and evaluate a critical appraisal instrument that is sufficiently rigorous to be used in evaluating RCTs of conventional medicines, and also has a section specific for use with single entity NPs, including herbs and natural sourced chemicals.

Methods

Three phases of the project included: 1) using experts and a Delphi process to reach consensus on a list of items essential in describing the identity of an NP; 2) compiling a list of non-NP items important for evaluating the quality of an RCT using systematic review methodology to identify published instruments and then compiling item categories that were part of a validated instrument and/or had empirical evidence to support their inclusion and 3) conducting a field test to compare the new instrument to a published instrument for usefulness in evaluating the quality of 3 RCTs of a NP and in applying results to practice.

Results

Two Delphi rounds resulted in a list of 15 items essential in describing NPs. Seventeen item categories fitting inclusion criteria were identified from published instruments for conventional medicines. The new assessment instrument was assembled based on content of the two lists and the addition of a Reviewer's Conclusion section. The field test of the new instrument showed good criterion validity. Participants found it useful in translating evidence from RCTs to practice.

Conclusion

A new instrument for the critical appraisal of RCTs of NPs was developed and tested. The instrument is distinct from other available assessment instruments for RCTs of NPs in its systematic development and validation. The instrument is ready to be used by pharmacy students, health care practitioners and academics and will continue to be refined as required.

SUBMITTER: Jurgens T

PROVIDER: S-EPMC2687413 | biostudies-literature | 2009 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and evaluation of an instrument for the critical appraisal of randomized controlled trials of natural products.

Jurgens Tannis T Whelan Anne Marie AM MacDonald Melissa M Lord Lindsay L

BMC complementary and alternative medicine 20090423

<h4>Background</h4>The efficacy of natural products (NPs) is being evaluated using randomized controlled trials (RCTs) with increasing frequency, yet a search of the literature did not identify a widely accepted critical appraisal instrument developed specifically for use with NPs. The purpose of this project was to develop and evaluate a critical appraisal instrument that is sufficiently rigorous to be used in evaluating RCTs of conventional medicines, and also has a section specific for use wi ...[more]

PMID: 19389240

Similar Datasets

Project description:ObjectivesThe objectives of this review are to: 1) appraise the methodological quality of clinical practice guidelines (CPGs) in juvenile idiopathic arthritis (JIA) providing pharmacological and/or non-pharmacological intervention recommendations, and 2) summarize the recommendations provided by the included CPGs and compare them where possible.MethodsA systematic search was performed. Three trained appraisers independently evaluated the methodological quality of the CPGs using a validated and reliable instrument, the Appraisal of Guidelines in Research and Evaluation II. Six domains were considered: 1) score and purpose; 2) stakeholder involvement; 3) rigor of development; 4) clarity of presentation; 5) applicability; and 6) editorial independence. The domains consist of a total of 23 items each scored on a 7-point scale. High quality CPGs were identified if they had a domain score above 60% in rigor of development, and two other domains.ResultsOf the three included CPGs, the Royal Australian College of General Practitioners (RACGP) and American College of Rheumatology (ACR) CPGs were considered to be of high quality, but the German Society for Pediatric Rheumatology was of lower quality. Domains one to four had high domain scores across the guidelines (mean (standard deviation)): 72.76 (13.80); 66.67 (9.81); 64.67 (7.77); and 87.00 (9.64), respectively. Lower scores were obtained for applicability (14.00 (5.57)) and editorial independence (43.44 (7.02)). Recommendations varied across CPGs due to differences in context, target audience (general practitioners, rheumatologists, and other multidisciplinary healthcare professionals) and patients' disease presentations. Despite this variability, progression of pharmacological treatment did not conflict between CPGs. Recommendations for non-pharmacological interventions were vague and the interventions considered varied between CPGs.ConclusionsOverall, recommendations were based on a paucity of evidence and weak study designs. Further research is needed on interventions in JIA, as well as higher quality CPGs to facilitate implementation of the best evidence-based recommendations in clinical practice.

Project description:IntroductionCritical appraisal skills are believed to play a central role in an evidence-based approach to health practice. The aim of this study was to evaluate the effectiveness and costs of a critical appraisal skills educational intervention aimed at health care professionals.MethodsThis prospective controlled trial randomized 145 self-selected general practitioners, hospital physicians, professions allied to medicine, and healthcare managers/administrators from the South West of England to a half-day critical appraisal skills training workshop (based on the model of problem-based small group learning) or waiting list control. The following outcomes were assessed at 6-months follow up: knowledge of the principles necessary for appraising evidence; attitudes towards the use of evidence about healthcare; evidence seeking behaviour; perceived confidence in appraising evidence; and ability to critically appraise a systematic review article.ResultsAt follow up overall knowledge score [mean difference: 2.6 (95% CI: 0.6 to 4.6)] and ability to appraise the results of a systematic review [mean difference: 1.2 (95% CI: 0.01 to 2.4)] were higher in the critical skills training group compared to control. No statistical significant differences in overall attitude towards evidence, evidence seeking behaviour, perceived confidence, and other areas of critical appraisal skills ability (methodology or generalizability) were observed between groups. Taking into account the workshop provision costs and costs of participants time and expenses of participants, the average cost of providing the critical appraisal workshops was approximately pound 250 per person.ConclusionsThe findings of this study challenge the policy of funding 'one-off' educational interventions aimed at enhancing the evidence-based practice of health care professionals. Future evaluations of evidence-based practice interventions need to take in account this trial's negative findings and methodological difficulties.

Project description:BackgroundTranscranial direct current stimulation (tDCS) could counteract the pathophysiological triggers of migraine attacks by modulating cortical excitability. Several pilot randomized controlled trials (RCTs) assessed the efficacy of tDCS for migraine prevention. We reviewed and summarized the state of the art of tDCS protocols for migraine prevention, discussing study results according to the stimulations parameters and patients' populations.Main bodyWe combined the keywords 'migraine', 'headache', 'transcranial direct current stimulation', and 'tDCS' and searched Pubmed, Scopus, and Web of Science, from the beginning of indexing to June 22, 2021. We only included RCTs comparing the efficacy of active tDCS with sham tDCS to decrease migraine frequency, intensity, and/or acute drug utilization. The risk of bias of each RCT was assessed by using the RoB-2 tool (Cochrane Collaboration). Thirteen RCTs (from 2011 to 2021) were included in the review. The included patients ranged from 13 to 135. RCTs included patients with any migraine (n=3), chronic migraine (n=6), episodic migraine (n=3) or menstrual migraine (n=1). Six RCTs used cathodal and five anodal tDCS, while two RCTs compared the efficacy of both cathodal and anodal tDCS with that of sham. In most of the cathodal stimulation trials, the target areas were the occipital regions, with reference on central or supraorbital areas. In anodal RCTs, the anode was usually placed above the motor cortical areas and the cathode on supraorbital areas. All RCTs adopted repeated sessions (from 5 to 28) at variable intervals, while the follow-up length spanned from 1 day up to 12 months. Efficacy results were variable but overall positive. According to the RoB-2 tool, only four of the 13 RCTs had a low risk of bias, while the others presented some concerns.ConclusionsBoth anodal and cathodal tDCS are promising for migraine prevention. However, there is a need for larger and rigorous RCTs and standardized procedures. Additionally, the potential benefits and targeted neurostimulation protocols should be assessed for specific subgroups of patients.

Project description:Percutaneous coronary intervention with bivalirudin plus bail-out glycoprotein IIb/IIIa inhibitors has been shown to be as effective as unfractionated heparin plus routine glycoprotein IIb/IIIa inhibitors in preventing cardiac ischemic events, but with a lower bleeding risk. It is unknown whether bivalirudin would have the same beneficial effects if compared with heparin when the use of glycoprotein IIb/IIIa inhibitors was similar between treatment arms. We searched the MEDLINE, Web of Science, and Cochrane databases from inception until March 2015 for randomized trials that compared bivalirudin to heparin in patients undergoing percutaneous coronary intervention. We required that the intended use of glycoprotein IIb/IIIa inhibitors was similar between the study groups. Summary estimates were principally constructed by the Peto method. Fifteen trials met our inclusion criteria, which yielded 25,824 patients. Bivalirudin versus heparin was associated with an increased hazard of stent thrombosis (odds ratio [OR] 1.49, 95% confidence interval [CI] 1.15-1.92, P = .002, I2 = 16.9%), with a similar hazard of myocardial infarction (OR 1.09, 95% CI 0.98-1.22, P = .11, I2 = 35.8%), all-cause mortality (OR 0.88, 95% CI 0.72-1.08, P = .21, I2 = 31.5%) and major adverse cardiac events (OR 1.04, 95% CI 0.94-1.14, P = .46, I2 = 53.9%). Bivalirudin was associated with a reduced hazard of major bleeding (OR 0.80, 95% CI 0.70-0.92, P = .001, I2 = 63.5%). The dose of heparin in the control arm modified this association; when the dose of unfractionated heparin in the control arm was ≥ 100 units/kg, bivalirudin was associated with a reduction in major bleeding (OR 0.55, 95% CI 0.45-0.68, P < .0001), but when the dose of unfractionated heparin was ≤ 75 units/kg, bivalirudin was not associated with reduction in bleeding (OR 1.09, 95% CI 0.91-1.31, P = .36). Among patients undergoing PCI, bivalirudin was associated with an increased hazard of stent thrombosis. Bivalirudin may be associated with a reduced hazard of major bleeding; however, this benefit was no longer apparent when compared with a dose of unfractionated heparin ≤ 75 units/kg.

Project description:We aimed to summarize the evidence from randomized clinical trials studies examining the efficacy of ischemic postconditioning (IPost) in ST-elevation myocardial infarction.The study was a systematic review and critical appraisal, with meta-analysis of randomized clinical trials.We searched the literature. A total of 21 randomized clinical trials were identified. Both fixed effect and random effects models were used to synthesize the results of individual studies. Heterogeneity between studies was examined by subgroup and random effects meta-regression analyses, considering ptient-related and study-level variables. Publication bias, or "small-study effect", was evaluated.Substantial heterogeneity was present. The random effects model pooled estimate for the outcome infarct size assessed by cardiac magnetic resonance was estimated by the standardized mean difference (SMD) =-0.06, 95% confidence interval (CI): -0.34 to 0.21, ie, no effect of IPost. For the end point infarct size, estimated by biomarkers of myocardial necrosis, an overall pooled effect was SMD =-0.58, 95% CI: -0.96 to -0.19. This effect disappeared in powered and nonbiased studies (SMD =0.03, 95% CI: -0.48 to 0.55). Finally, for the outcome left ventricular ejection fraction, SMD =0.47 95% CI: 0.20 to 0.74. Unfortunately, selection bias (small-study effect) was present. For this outcome, the meta-regression showed that both presence of hypertension and the inclusion of nonbiased studies explained 28.3% of the heterogeneity among the studies. Simulation by the "trim and fill" method, which controlled for selection bias using random effects model, diluted the effect (SMD =0.17 95% CI: -0.13 to 0.48). No effects by IPost on ST-segment resolution or on the majority of adverse clinical events were observed during follow up, except the incidence of congestive heart failure was found.Evidence from this study suggests no cardioprotection from IPost, on surrogate and the majority of clinical end points. A possible beneficial effect on the incidence of congestive heart failure needs to be replicated by a large clinical trial.

Project description:IntroductionEvidence from randomized controlled trials (RCTs) is required to guide treatment of critically ill children, but the number of RCTs available is limited and the publications are often difficult to find. The objectives of this review were to systematically identify RCTs in pediatric critical care and describe their methods and reporting.MethodsWe searched MEDLINE, EMBASE, LILACS and CENTRAL (from inception to April 16, 2013) and reference lists of included RCTs and relevant systematic reviews. We included published RCTs administering any intervention to children in a pediatric ICU. We excluded trials conducted in neonatal ICUs, those enrolling exclusively preterm infants, and individual patient crossover trials. Pairs of reviewers independently screened studies for eligibility, assessed risk of bias, and abstracted data. Discrepancies were resolved by consensus.ResultsWe included 248 RCTs: 45 (18%) were multicentered and 14 (6%) were multinational. Trials most frequently enrolled both medical and surgical patients (43%) but postoperative cardiac surgery was the single largest population studied (19%). The most frequently evaluated types of intervention were medications (63%), devices (11%) and nutrition (8%). Laboratory or physiological measurements were the most frequent type of primary outcomes (18%). Half of these trials (50%) reported blinding. Of the 107 (43%) trials that reported an a priori sample size, 34 (32%) were stopped early. The median number of children randomized per trial was 49 and ranged from 6 to 4,947. The frequency of RCT publications increased at a mean rate of 0.7 RCTs per year (P<0.001) from 1 to 20 trials per year.ConclusionsThis scoping review identified the available RCTs in pediatric critical care and made them accessible to clinicians and researchers (http://epicc.mcmaster.ca). Most focused on medications and intermediate or surrogate outcomes, were single-centered and were conducted in North America and Western Europe. The results of this review underscore the need for trials with rigorous methodology, appropriate outcome measures, and improved quality of reporting to ensure that high quality evidence exists to support clinical decision-making in this vulnerable population.

Dataset Information

Development and evaluation of an instrument for the critical appraisal of randomized controlled trials of natural products.

Background

Methods

Results

Conclusion

Publications

Development and evaluation of an instrument for the critical appraisal of randomized controlled trials of natural products.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets