Browse
Submit Data
Databases
API
Help

Dataset Information

7 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

How subgroup analyses can miss the trees for the forest plots: A simulation study.

ABSTRACT:

Objectives

Subgroup analyses of clinical trial data can be an important tool for understanding when treatment effects differ across populations. That said, even effect estimates from prespecified subgroups in well-conducted trials may not apply to corresponding subgroups in the source population. While this divergence may simply reflect statistical imprecision, there has been less discussion of systematic or structural sources of misleading subgroup estimates.

Study design and setting

We use directed acyclic graphs to show how selection bias caused by associations between effect measure modifiers and trial selection, whether explicit (e.g., eligibility criteria) or implicit (e.g., self-selection based on race), can result in subgroup estimates that do not correspond to subgroup effects in the source population. To demonstrate this point, we provide a hypothetical example illustrating the sorts of erroneous conclusions that can result, as well as their potential consequences. We also provide a tool for readers to explore additional cases.

Conclusion

Treating subgroups within a trial essentially as random samples of the corresponding subgroups in the wider population can be misleading, even when analyses are conducted rigorously and all findings are internally valid. Researchers should carefully examine associations between (and consider adjusting for) variables when attempting to identify heterogeneous treatment effects.

SUBMITTER: Webster-Clark M

PROVIDER: S-EPMC7529905 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Missing the trees for the forest: most subgroup analyses using forest plots at the ASCO annual meeting are inconclusive.

Project description:BackgroundOncologists often refer to forest plots to determine which patient subgroups may be more likely to benefit from a therapy tested in a randomized clinical trial (RCT). We sought to empirically determine the information content of subgroup comparisons from forest plots of RCTs.MethodsWe assessed all forest plots from RCTs of therapeutic interventions presented orally at the American Society of Clinical Oncology Annual Meetings in 2020 and 2021. Subgroups were considered as showing evidence of treatment effect heterogeneity in forest plots when their confidence intervals (CIs) did not overlap with the vertical line corresponding to the main effect observed in the overall RCT cohort. Subgroups were considered as showing evidence of treatment effect homogeneity in forest plots when their CIs did not meaningfully differ, within 80-125% equivalence range, with the values compatible with the main effect. All other subgroups were considered as inconclusive.ResultsA total of 99 forest plots were presented, and only 24.2% contained one or more subgroups suggestive of treatment effect heterogeneity. A total of 81 forest plots provided enough information to evaluate treatment effect heterogeneity and homogeneity. These 81 forest plots represented a total of 1344 individual subgroups, of which 57.2% were inconclusive, 41.1% showed evidence of treatment effect homogeneity, and 1.6% yielded evidence suggestive of treatment effect heterogeneity.ConclusionThe majority of subgroup comparisons were inconclusive in this empirical analysis of forest plots used in oncology RCTs. Different strategies should be considered to improve the estimation and representation of subgroup-specific effects.

| S-EPMC9168942 | biostudies-literature

Exploring the diversity of coronavirus in sewage during COVID-19 pandemic: Don't miss the forest for the trees.

Project description:In the wake of the COVID-19 pandemic, the use of next generation sequencing (NGS) has proved to be an important tool for the genetic characterization of SARS-CoV-2 from clinical samples. The use of different available NGS tools applied to wastewater samples could be the key for an in-depth study of the excreted virome, not only focusing on SARS-CoV-2 circulation and typing, but also to detect other potentially pandemic viruses within the same family. With this aim, 24-hours composite wastewater samples from March and July 2020 were sequenced by applying specific viral NGS as well as target enrichment NGS. The full virome of the analyzed samples was obtained, with human Coronaviridae members (CoV) present in one of those samples after applying the enrichment. One contig was identified as HCoV-OC43 and 8 contigs as SARS-CoV-2. CoVs from other animal hosts were also detected when applying this technique. These contigs were compared with those obtained from contemporary clinical specimens by applying the same target enrichment approach. The results showed that there is a co-circulation in urban areas of human and animal coronaviruses infecting domestic animals and rodents. NGS enrichment-based protocols might be crucial to describe the occurrence and genetic characteristics of SARS-CoV-2 and other Coronaviridae family members within the excreted virome present in wastewater.

| S-EPMC8349739 | biostudies-literature

Meta-analyses and Forest plots using a microsoft excel spreadsheet: step-by-step guide focusing on descriptive data analysis.

Project description:BackgroundMeta-analyses are necessary to synthesize data obtained from primary research, and in many situations reviews of observational studies are the only available alternative. General purpose statistical packages can meta-analyze data, but usually require external macros or coding. Commercial specialist software is available, but may be expensive and focused in a particular type of primary data. Most available softwares have limitations in dealing with descriptive data, and the graphical display of summary statistics such as incidence and prevalence is unsatisfactory. Analyses can be conducted using Microsoft Excel, but there was no previous guide available.FindingsWe constructed a step-by-step guide to perform a meta-analysis in a Microsoft Excel spreadsheet, using either fixed-effect or random-effects models. We have also developed a second spreadsheet capable of producing customized forest plots.ConclusionsIt is possible to conduct a meta-analysis using only Microsoft Excel. More important, to our knowledge this is the first description of a method for producing a statistically adequate but graphically appealing forest plot summarizing descriptive data, using widely available software.

| S-EPMC3296675 | biostudies-literature

Simulation study - Oral Microbiome

Project description:Simulated oral microbiome with human contamination.

| PRJEB25791 | ENA

Simulation study - Oral Microbiome

Project description:Simulated oral microbiome with artificial duplicates

| PRJEB26333 | ENA

The flowering of Atlantic Forest Pleroma trees.

Project description:Mapping the spatial distribution of a plant is a current challenge in ecology. Here, a convolutional neural network (CNN) and 33,798 Sentinel-2 satellite images were used to detect and map forest stands dominated by trees of the genus Pleroma by their magenta-to-deep-purple blossoms in the entire Brazilian Atlantic Forest domain, from June 2016 to July 2020. The Pleroma genus, known for its pioneer behaviour, was detected in an area representing 10.8% of the Atlantic Forest, associated negatively with temperature and positively with elevation, slope, tree cover and precipitation. The detection of another genus by the model, 18% of all the detections contained only pink blooming Handroanthus trees, highlighted that botanical identification from space must be taken with caution, particularly outside the known distribution range of the species. The Pleroma blossom seasonality occurred over a period of ~5-6 months centered on the March equinox and populations with distinct blossom timings were found. Our results indicate that in the Atlantic Forest, the remaining natural forest is less diverse than expected but is at least recovering from degradation. Our study suggests a method to produce ecological-domain scale maps of tree genera and species based on their blossoms that could be used for tree studies and biodiversity assessments.

| S-EPMC8517022 | biostudies-literature

Nonparametric Subgroup Identification by PRIM and CART: A Simulation and Application Study.

Project description:Two nonparametric methods for the identification of subgroups with outstanding outcome values are described and compared to each other in a simulation study and an application to clinical data. The Patient Rule Induction Method (PRIM) searches for box-shaped areas in the given data which exceed a minimal size and average outcome. This is achieved via a combination of iterative peeling and pasting steps, where small fractions of the data are removed or added to the current box. As an alternative, Classification and Regression Trees (CART) prediction models perform sequential binary splits of the data to produce subsets which can be interpreted as subgroups of heterogeneous outcome. PRIM and CART were compared in a simulation study to investigate their strengths and weaknesses under various data settings, taking different performance measures into account. PRIM was shown to be superior in rather complex settings such as those with few observations, a smaller signal-to-noise ratio, and more than one subgroup. CART showed the best performance in simpler situations. A practical application of the two methods was illustrated using a clinical data set. For this application, both methods produced similar results but the higher amount of user involvement of PRIM became apparent. PRIM can be flexibly tuned by the user, whereas CART, although simpler to implement, is rather static.

| S-EPMC5458436 | biostudies-literature

Assessing model adequacy for Bayesian Skyline plots using posterior predictive simulation.

Project description:Bayesian skyline plots (BSPs) are a useful tool for making inferences about demographic history. For example, researchers typically apply BSPs to test hypotheses regarding how climate changes have influenced intraspecific genetic diversity over time. Like any method, BSP has assumptions that may be violated in some empirical systems (e.g., the absence of population genetic structure), and the naïve analysis of data collected from these systems may lead to spurious results. To address these issues, we introduce P2C2M.Skyline, an R package designed to assess model adequacy for BSPs using posterior predictive simulation. P2C2M.Skyline uses a phylogenetic tree and the log file output from Bayesian Skyline analyses to simulate posterior predictive datasets and then compares this null distribution to statistics calculated from the empirical data to check for model violations. P2C2M.Skyline was able to correctly identify model violations when simulated datasets were generated assuming genetic structure, which is a clear violation of BSP model assumptions. Conversely, P2C2M.Skyline showed low rates of false positives when models were simulated under the BSP model. We also evaluate the P2C2M.Skyline performance in empirical systems, where we detected model violations when DNA sequences from multiple populations were lumped together. P2C2M.Skyline represents a user-friendly and computationally efficient resource for researchers aiming to make inferences from BSP.

| S-EPMC9312427 | biostudies-literature

A natural expression variant reveals a novel mechanism of insect resistance in boreal forest trees.

Project description:We report the discovery of a beta-glucosidase gene (PgM-NM-2glu-1) whose expression underpins natural resistance to a major forest pest, the spruce budworm (SBW) in white spruce (Picea glauca (Voss.) Moench). We performed a microarray experiment to compare resistant (R) and non-resistant (N-R) trees. PgM-NM-2glu-1 transcripts levels uniquely were up to 1000 times higher in phenotypically resistant trees and correlated with accumulation of acetophenones compounds that reduce SBW development. These resistance traits were heritable, temporally correlated with the emergence of the most damaging larval stages and were highly variable in the natural population across a large geographic area. The recombinant gene product specifically catalyzed the release of biologically active acetophenones from their glucoside precursors. SBW outbreaks have become more frequent and intense; therefore, the phenotypic diversity resulting from variation in PgM-NM-2glu-1 expression may be a key for the adaptability of spruce populations. Transcriptome profiling was carried out with needles from 7 resistant and 7 non-resistant trees (harvested on June 17th, 2010), and 3 samples per tree (n=42) with a custom microarray developed for spruce species and comprising oligonucleotide probes for 23,853 unique P. glauca gene sequences (Raherison et al., 2012).

2014-05-06 | E-GEOD-57301 | biostudies-arrayexpress

A natural expression variant reveals a novel mechanism of insect resistance in boreal forest trees.

Project description:We report the discovery of a beta-glucosidase gene (Pgβglu-1) whose expression underpins natural resistance to a major forest pest, the spruce budworm (SBW) in white spruce (Picea glauca (Voss.) Moench). We performed a microarray experiment to compare resistant (R) and non-resistant (N-R) trees. Pgβglu-1 transcripts levels uniquely were up to 1000 times higher in phenotypically resistant trees and correlated with accumulation of acetophenones compounds that reduce SBW development. These resistance traits were heritable, temporally correlated with the emergence of the most damaging larval stages and were highly variable in the natural population across a large geographic area. The recombinant gene product specifically catalyzed the release of biologically active acetophenones from their glucoside precursors. SBW outbreaks have become more frequent and intense; therefore, the phenotypic diversity resulting from variation in Pgβglu-1 expression may be a key for the adaptability of spruce populations.

2014-05-06 | GSE57301 | GEO

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data