Frequent fragility of randomized controlled trials for HCC treatment.
Ontology highlight
ABSTRACT: Background
The fragility index (FI) of trial results can provide a measure of confidence in the positive effects reported in randomized controlled trials (RCTs). The aim of this study was to calculate the FI of RCTs supporting HCC treatments.Methods
A methodological systematic review of RCTs in HCC treatments was conducted. Two-arm studies with randomized and positive results for a time-to-event outcome were eligible for the FI calculation.Results
A total of 6 trails were included in this analysis. The median FI was 0.5 (IQR 0-10). FI was ≤7 in 4 (66.7%) of 6 trials; in those trials the fragility quotient was ≤1%.Conclusion
Many phase 3 RCTs supporting HCC treatments have a low FI, which challenges the confidence in concluding the superiority of these drugs over control treatments.
SUBMITTER: Zhang H
PROVIDER: S-EPMC8034173 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundAs a metric to determine the robustness of trial results, the fragility index (FI) is the number indicating how many patients would be required to reverse the significant results. This study aimed to calculate the FI in randomized controlled trials (RCTs) involving premature.MethodsTrials were included if they had a 1:1 study design, reported statistically significant dichotomous outcomes, and had an explicitly stated sample size or power calculation. The FI was calculated for binary outcomes using Fisher's exact test, and the FIs of subgroups were compared. Spearman's correlation was applied to determine correlations between the FI and study characteristics.ResultsFinally, 66 RCTs were included in the analyses. The median FI for these trials was 3.00 (interquartile range [IQR]: 1.00-5.00), with a median fragility quotient of 0.014 (IQR: 0.008-0.028). FI was ≤ 3 in 42 of these 66 RCTs (63.6%), and in 42.4% (28/66) of the studies, the number of patients lost to follow-up was greater than that of the FI. Significant differences were found in the FI among journals (p = 0.011). We observed that FI was associated with the sample size, total number of events, and reported p-values (r s = 0.437, 0.495, and -0.857, respectively; all p < 0.001).ConclusionFor RCTs in the premature population, a median of only three events was needed to change from a "non-event" to "event" to render a significant result non-significant, indicating that the significance may hinge on a small number of events.
| S-EPMC9124941 | biostudies-literature
Project description: Not available
| S-EPMC8753221 | biostudies-literature
Project description:HIV/AIDS is associated with significant morbidity, mortality, and financial burden. For these reasons, robust clinical evidence is critical. We aim to investigate the fragility index, fragility quotient, and risk of bias of clinical trial endpoints in HIV medicine. The fragility index represents the minimum amount of trial endpoint "nonevents" changed to "events" in one trial arm required to nullify statistical significance. The fragility quotient contextualized the fragility index by dividing the index by the total trial sample size. We selected eligible trials from the Department of Health and Human Services guideline for the use of antiretroviral agents in HIV-1-infected adults and adolescents. We calculated the fragility index and fragility quotient for all included trials. The Cochrane "risk of bias" Tool 2.0 was used to evaluate the likelihood and sources of bias in the included trials. Thirty-nine RCTs were included for our analysis of fragility. Thirty-six were included for our analysis of the risk of bias. The median fragility index was 5. Three RCTs were at high risk of bias, all due to the selection of the endpoint or statistical test. Twenty had some concerns for risk of bias. The analyzed HIV medicine RCT endpoints were fragile, overall. This indicates that a median of 5 patients across all included studies would nullify the statistical significance of the endpoints. Furthermore, we found evidence that concerns for bias are present at a high rate.
| S-EPMC6614212 | biostudies-literature
Project description:The effectiveness of corticosteroids in acute respiratory distress syndrome (ARDS) and COVID-19 still remains uncertain. Since ARDS is due to a hyperinflammatory response to a direct injury, we decided to perform a meta-analysis and an evaluation of robustness of randomised clinical trials (RCTs) investigating the impact of corticosteroids on mortality in ARDS in both COVID-19 and non-COVID-19 patients. We conducted a systematic search of the literature from inception up to 30 October 2020, using the MEDLINE database and the PubMed interface. We evaluated the fragility index (FI) of the included RCTs using a two-by-two contingency table and the p-value produced by the Fisher exact test; the fragility quotient (FQ) was calculated by dividing the FI score by the total sample size of the trial. Thirteen RCTs were included in the analysis; five of them were conducted in COVID-19 ARDS, including 7692 patients, while 8 RCTS were performed in non-COVID ARDS with 1091 patients evaluated. Three out of eight RCTs in ARDS had a FI > 0 while 2 RCTs out of five in COVID-19 had FI > 0. The median of FI for ARDS was 0.625 (0.47) while the median of FQ was 0.03 (0.014). The median of FI for COVID-19 was 6 (2) while the median of FQ was 0.059 (0.055). In this systematic review, we found that FI and FQ of RCTs evaluating the use of corticosteroids in ARDS and COVID-19 were low.
| S-EPMC8624335 | biostudies-literature
Project description:ObjectiveTo explore how patients' treatment preferences were expressed and justified during recruitment to a randomized controlled trial (RCT) and how they influenced participation and treatment decisions.Study design and settingQualitative analysis of audio recordings of recruitment appointments with 93 participants aged 51-70 years in a UK multicenter RCT of localized prostate cancer treatments.ResultsTreatment preferences at recruitment were more complex and dynamic than previously assumed. Most participants expressed views about treatments early in appointments, ranging on a continuum from hesitant to well-formed opinions. As recruiters elicited men's views and provided detailed evidence-based treatment and study information, some opted for their preference, but many became uncertain and open to RCT recruitment, often accepting a different treatment from their original "preference." Discussion of treatment preferences did not act as the expected barrier to recruitment but actively enabled many to express their concerns and reach an informed decision that often included RCT participation.ConclusionExploring treatment preferences and providing evidence-based information can improve levels of informed decision making and facilitate RCT participation. Treatment preferences should be reconceptualized from a barrier to recruitment to an integral part of the information exchange necessary for informed decision making about treatments and RCT participation.
| S-EPMC3167372 | biostudies-literature
Project description:BackgroundEvidence-based care relies on robust research. The fragility index (FI) is used to assess the robustness of statistically significant findings in randomized controlled trials (RCTs). While the traditional FI is limited to dichotomous outcomes, a novel tool, the continuous fragility index (CFI), allows for the assessment of the robustness of continuous outcomes.PurposeTo calculate the CFI of statistically significant continuous outcomes in RCTs evaluating interventions for managing anterior shoulder instability (ASI).Study designMeta-analysis; Level of evidence, 2.MethodsA search was conducted across the MEDLINE, Embase, and CENTRAL databases for RCTs assessing management strategies for ASI from inception to October 6, 2022. Studies that reported a statistically significant difference between study groups in ≥1 continuous outcome were included. The CFI was calculated and applied to all available RCTs reporting interventions for ASI. Multivariable linear regression was performed between the CFI and various study characteristics as predictors.ResultsThere were 27 RCTs, with a total of 1846 shoulders, included. The median sample size was 61 shoulders (IQR, 43). The median CFI across 27 RCTs was 8.2 (IQR, 17.2; 95% CI, 3.6-15.4). The median CFI was 7.9 (IQR, 21; 95% CI, 1-22) for 11 studies comparing surgical methods, 22.6 (IQR, 16; 95% CI, 8.2-30.4) for 6 studies comparing nonsurgical reduction interventions, 2.8 for 3 studies comparing immobilization methods, and 2.4 for 3 studies comparing surgical versus nonsurgical interventions. Significantly, 22 of 57 included outcomes (38.6%) from studies with completed follow-up data had a loss to follow-up exceeding their CFI. Multivariable regression demonstrated that there was a statistically significant positive correlation between a trial's sample size and the CFI of its outcomes (r = 0.23 [95% CI, 0.13-0.33]; P < .001).ConclusionMore than a third of continuous outcomes in ASI trials had a CFI less than the reported loss to follow-up. This carries the significant risk of reversing trial findings and should be considered when evaluating available RCT data. We recommend including the FI, CFI, and loss to follow-up in the abstracts of future RCTs.
| S-EPMC11344964 | biostudies-literature
Project description:ObjectiveThe aim of the study was to investigate how doctors considered and experienced the concept of equipoise while recruiting patients to randomized controlled trials (RCTs).Study design and settingIn-depth interviews with 32 doctors in six publicly funded pragmatic RCTs explored their perceptions of equipoise as they undertook RCT recruitment. The RCTs varied in size, duration, type of complex intervention, and clinical specialties. Interview data were analyzed using qualitative content and thematic analytical methods derived from grounded theory and synthesized across six RCTs.ResultsAll six RCTs suffered from poor recruitment. Doctors wanted to gather robust evidence but experienced considerable discomfort and emotion in relation to their clinical instincts and concerns about patient eligibility and safety. Although they relied on a sense of community equipoise to justify participation, most acknowledged having "hunches" about particular treatments and patients, some of which undermined recruitment. Surgeons experienced these issues most intensely. Training and support promoted greater confidence in equipoise and improved engagement and recruitment.ConclusionRecruitment to RCTs is a fragile process and difficult for doctors intellectually and emotionally. Training and support can enable most doctors to become comfortable with key RCT concepts including equipoise, uncertainty, patient eligibility, and randomization, promoting a more resilient recruitment process in partnership with patients.
| S-EPMC4067744 | biostudies-literature
Project description:Hypertension is a common complication of chronic kidney disease and persists among most patients with end-stage renal disease despite the provision of conventional thrice weekly hemodialysis (HD). We analyzed the effects of frequent HD on blood pressure in the randomized controlled Frequent Hemodialysis Network trials. The daily trial randomized 245 patients to 12 months of 6× ("frequent") vs. 3× ("conventional") weekly in-center hemodialysis; the nocturnal trial randomized 87 patients to 12 months of 6× weekly nocturnal HD vs. 3× weekly predominantly home-based hemodialysis. In the daily trial, compared with 3× weekly HD, 2 months of frequent HD lowered predialysis systolic blood pressure by -7.7 mmHg [95% confidence interval (CI): -11.9 to -3.5] and diastolic blood pressure by -3.9 mmHg [95% CI: -6.5 to -1.3]. In the nocturnal trial, compared with 3× weekly HD, 2 months of frequent HD lowered systolic blood pressure by -7.3 mmHg [95% CI: -14.2 to -0.3] and diastolic blood pressure by -4.2 mmHg [95% CI: -8.3 to -0.1]. In both trials, blood pressure treatment effects were sustained until month 12. Frequent HD resulted in significantly fewer antihypertensive medications (daily: -0.36 medications [95% CI: -0.65 to -0.08]; nocturnal: -0.44 mediations [95% CI: -0.89 to -0.03]). In the daily trial, the relative risk per dialysis session for intradialytic hypotension was lower with 6×/week HD but given the higher number of sessions per week, there was a higher relative risk for intradialytic hypotensive requiring saline administration. In summary, frequent HD reduces blood pressure and the number of prescribed antihypertensive medications.
| S-EPMC4490029 | biostudies-literature
Project description:The clinical development of systemic treatments for hepatocellular carcinoma (HCC) has gained significant momentum in recent years. After the unexpected failure of the phase 3 trials testing the PD1-inhibitors nivolumab and pembrolizumab as monotherapy in advanced HCC, a multitude of trials employing different agents in various combinations and at different disease stages have been initiated. The first positive results reported for the combination of atezolizumab and bevacizumab, as the first line treatment of advanced HCC, will bring lasting change to the management of HCC and has increased the odds of success for alternative combination therapies. This review article seeks to provide clarity on the complex and evolving landscape of clinical trials on systemic treatments of HCC. It covers current trials which test various systemic treatments (i) in the first and second line in advanced HCC, (ii) in intermediate HCC, (iii) as adjuvant as well as (iv) neoadjuvant strategies, and (v) including immune interventions other than immune checkpoint inhibition.
| S-EPMC8073471 | biostudies-literature
Project description:Biomarkers associated with treatment-effect heterogeneity can be used to make treatment recommendations that optimize individual clinical outcomes. To accomplish this, statistical methods are needed to generate marker-based treatment-selection rules that can most effectively reduce the population burden due to disease and treatment. Compared to the standard approach of risk modeling to derive treatment-selection rules, a more robust approach is to directly minimize an unbiased estimate of total disease and treatment burden among a pre-specified class of rules. This problem is one of minimizing a weighted sum of 0-1 loss function, which is computationally challenging to solve due to the nonsmoothness of 0-1 loss. Huang and Fong, among others, proposed a method that uses the Ramp loss to approximate the 0-1 loss and solves the minimization problem through repetitive constrained optimizations. The algorithm was shown to have comparable or better performance than other comparative estimators in various settings. Our aim in this article is to further extend the algorithm to allow for variable selection in the presence of a large number of candidate markers.We develop an alternative method to derive marker combinations to minimize the weighted sum of Ramp loss in Huang and Fong, based on data from randomized trials. The new algorithm estimates treatment-selection rules by repetitively minimizing a smooth and differentiable objective function. Through the use of an L1 penalty, we expand the method to allow for feature selection and develop an algorithm based on the coordinate descent method to build the treatment-selection rule.Through extensive simulation studies, we compared performance of the proposed estimator to four existing approaches: (1) a logistic regression risk modeling approach, and three other "direct optimizing" approaches including (2) the estimator in Huang and Fong, (3) the weighted support vector machine, and (4) the weighted logistic regression. The proposed estimator performs comparably to that of Huang and Fong, and comparably or better than other estimators. Allowing for variable selection using the proposed estimator in the presence of a large number of markers further improves treatment-selection performance. The proposed estimator is also advantageous for selecting variables relevant to treatment selection compared to L1 penalized logistic regression and weighted logistic regression. We illustrate the application of the proposed methods in host-genetics data from an HIV vaccine trial.The proposed estimator is appealing considering its effectiveness and conceptual simplicity. It has significant potential to contribute to the selection and combination of biomarkers for treatment selection in clinical practice.
| S-EPMC4506270 | biostudies-literature