Detecting Heterogeneity of Intervention Effects Using Analysis and Meta-analysis of Differences in Variance Between Trial Arms.
Ontology highlight
ABSTRACT: Background
Randomized controlled trials (RCTs) with continuous outcomes usually only examine mean differences in response between trial arms. If the intervention has heterogeneous effects, then outcome variances will also differ between arms. Power of an individual trial to assess heterogeneity is lower than the power to detect the same size of main effect.Methods
We describe several methods for assessing differences in variance in trial arms and apply them to a single trial with individual patient data and to meta-analyses using summary data. Where individual data are available, we use regression-based methods to examine the effects of covariates on variation. We present an additional method to meta-analyze differences in variances with summary data.Results
In the single trial, there was agreement between methods, and the difference in variance was largely due to differences in prevalence of depression at baseline. In two meta-analyses, most individual trials did not show strong evidence of a difference in variance between arms, with wide confidence intervals. However, both meta-analyses showed evidence of greater variance in the control arm, and in one example, this was perhaps because mean outcome in the control arm was higher.Conclusions
Using meta-analysis, we overcame low power of individual trials to examine differences in variance using meta-analysis. Evidence of differences in variance should be followed up to identify potential effect modifiers and explore other possible causes such as varying compliance.
SUBMITTER: Mills HL
PROVIDER: S-EPMC8478324 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Recent research has revealed loci that display variance heterogeneity through various means such as biological disruption, linkage disequilibrium (LD), gene-by-gene (G × G), or gene-by-environment interaction. We propose a versatile likelihood ratio test that allows joint testing for mean and variance heterogeneity (LRT(MV)) or either effect alone (LRT(M) or LRT(V)) in the presence of covariates. Using extensive simulations for our method and others, we found that all parametric tests were sensitive to nonnormality regardless of any trait transformations. Coupling our test with the parametric bootstrap solves this issue. Using simulations and empirical data from a known mean-only functional variant, we demonstrate how LD can produce variance-heterogeneity loci (vQTL) in a predictable fashion based on differential allele frequencies, high D', and relatively low r² values. We propose that a joint test for mean and variance heterogeneity is more powerful than a variance-only test for detecting vQTL. This takes advantage of loci that also have mean effects without sacrificing much power to detect variance only effects. We discuss using vQTL as an approach to detect G × G interactions and also how vQTL are related to relationship loci, and how both can create prior hypothesis for each other and reveal the relationships between traits and possibly between components of a composite trait.
| S-EPMC4019404 | biostudies-literature
Project description:Meta-analysis is a commonly used approach to increase the sample size for genome-wide association searches when individual studies are otherwise underpowered. Here, we present a meta-analysis procedure to estimate the heterogeneity of the quantitative trait variance attributable to genetic variants using Levene's test without needing to exchange individual-level data. The meta-analysis of Levene's test offers the opportunity to combine the considerable sample size of a genome-wide meta-analysis to identify the genetic basis of phenotypic variability and to prioritize single-nucleotide polymorphisms (SNPs) for gene-gene and gene-environment interactions. The use of Levene's test has several advantages, including robustness to departure from the normality assumption, freedom from the influence of the main effects of SNPs, and no assumption of an additive genetic model. We conducted a meta-analysis of the log-transformed body mass index of 5892 individuals and identified a variant with a highly suggestive Levene's test P-value of 4.28E-06 near the NEGR1 locus known to be associated with extreme obesity.
| S-EPMC3925287 | biostudies-literature
Project description:MotivationIdentifying variants, both discrete and continuous, that are associated with quantitative traits, or QTs, is the primary focus of quantitative genetics. Most current methods are limited to identifying mean effects, or associations between genotype or covariates and the mean value of a quantitative trait. It is possible, however, that a variant may affect the variance of the quantitative trait in lieu of, or in addition to, affecting the trait mean. Here, we develop a general methodology to identify covariates with variance effects on a quantitative trait using a Bayesian heteroskedastic linear regression model (BTH). We compare BTH with existing methods to detect variance effects across a large range of simulations drawn from scenarios common to the analysis of quantitative traits.ResultsWe find that BTH and a double generalized linear model (dglm) outperform classical tests used for detecting variance effects in recent genomic studies. We show BTH and dglm are less likely to generate spurious discoveries through simulations and application to identifying methylation variance QTs and expression variance QTs. We identify four variance effects of sex in the Cardiovascular and Pharmacogenetics study. Our work is the first to offer a comprehensive view of variance identifying methodology. We identify shortcomings in previously used methodology and provide a more conservative and robust alternative. We extend variance effect analysis to a wide array of covariates that enables a new statistical dimension in the study of sex and age specific quantitative trait effects.Availability and implementationhttps://github.com/b2du/bth.Supplementary informationSupplementary data are available at Bioinformatics online.
| S-EPMC6330007 | biostudies-literature
Project description:For estimation of heterogeneity variance τ2 in meta-analysis of log-odds-ratio, we derive new mean- and median-unbiased point estimators and new interval estimators based on a generalized Q statistic, QF , in which the weights depend on only the studies' effective sample sizes. We compare them with familiar estimators based on the inverse-variance-weights version of Q , QIV. In an extensive simulation, we studied the bias (including median bias) of the point estimators and the coverage (including left and right coverage error) of the confidence intervals. Most estimators add 0.5 to each cell of the 2×2 table when one cell contains a zero count; we include a version that always adds 0.5 . The results show that: two of the new point estimators and two of the familiar point estimators are almost unbiased when the total sample size n≥250 and the probability in the Control arm ( piC ) is 0.1, and when n≥100 and piC is 0.2 or 0.5; for 0.1≤τ2≤1 , all estimators have negative bias for small to medium sample sizes, but for larger sample sizes some of the new median-unbiased estimators are almost median-unbiased; choices of interval estimators depend on values of parameters, but one of the new estimators is reasonable when piC=0.1 and another, when piC=0.2 or piC=0.5 ; and lack of balance between left and right coverage errors for small n and/or piC implies that the available approximations for the distributions of QIV and QF are accurate only for larger sample sizes.
| S-EPMC10946484 | biostudies-literature
Project description:Despite the observed distribution of variable individual phenotypes, survival and reproductive performance in wild populations, models of population dynamics often focus on mean demographic rates. Populations are constituted by individuals with different phenotypes and thus different performances. However, many models of population dynamics provide no understanding of the influence of this phenotypic variation on population dynamics. In this paper, we investigate how the relationships between demographic rates and phenotype distribution influence the transmission and the upholding of phenotypic variation, and population dynamics. We used integral projection models to measure associations between differences of phenotypic trait (size or mass) among individuals and demographic rates, growth and inheritance, and then quantify the influence of phenotypic variation on population dynamics. We build an analytical and general model resulting from simplifications assuming small phenotypic variance. We illustrate our model with two case studies: a short- and a long-lived life history. Population growth rate r is determined by a Lotka style equation in which survival and fertility are averaged over a phenotypic distribution that changes with age. Here, we further decomposed r to show how much it is affected by shifts in phenotypic average as well as variance. We derived the elasticities of r to the first and second derivative of each demographic rate. In particular, we show that the nonlinearity of change in selective pressure with phenotype matters more to population dynamics than the strength of this selection. In other words, the variance of a given trait will be most important when the strength of selection increases (or decreases) nonlinearly with that trait. Inheritance shapes the distribution of newborn phenotypes. Even if newborns have a fixed average phenotype, the variance among newborns increases with phenotypic variance among mothers, strength of inheritance and developmental variation. We explain how the components of inheritance can influence phenotypic variance and thus the demographic rates and population dynamics. In particular, when mothers of different ages produce offspring of different mean phenotype, the inheritance function can have a large influence on both the mean and variance of the trait at different ages and thus on the population growth rate. We provide new tools to understand how phenotypic variation influences population dynamics and discuss in which life histories we expect this influence to be large. For instance, in our short-lived life history, individual variability has larger effect than in our long-lived life history. We conclude by indicating future directions of analysis.
| S-EPMC6761928 | biostudies-literature
Project description:BackgroundFluorescence-based methods have been proposed to aid caries lesion detection. Summarizing and analysing findings of studies about fluorescence-based methods could clarify their real benefits.ObjectiveWe aimed to perform a comprehensive systematic review and meta-analysis to evaluate the accuracy of fluorescence-based methods in detecting caries lesions.Data sourceTwo independent reviewers searched PubMed, Embase and Scopus through June 2012 to identify papers/articles published. Other sources were checked to identify non-published literature. STUDY ELIGIBILITY CRITERIA, PARTICIPANTS AND DIAGNOSTIC METHODS: The eligibility criteria were studies that: (1) have assessed the accuracy of fluorescence-based methods of detecting caries lesions on occlusal, approximal or smooth surfaces, in both primary or permanent human teeth, in the laboratory or clinical setting; (2) have used a reference standard; and (3) have reported sufficient data relating to the sample size and the accuracy of methods.Study appraisal and synthesis methodsA diagnostic 2×2 table was extracted from included studies to calculate the pooled sensitivity, specificity and overall accuracy parameters (Diagnostic Odds Ratio and Summary Receiver-Operating curve). The analyses were performed separately for each method and different characteristics of the studies. The quality of the studies and heterogeneity were also evaluated.ResultsSeventy five studies met the inclusion criteria from the 434 articles initially identified. The search of the grey or non-published literature did not identify any further studies. In general, the analysis demonstrated that the fluorescence-based method tend to have similar accuracy for all types of teeth, dental surfaces or settings. There was a trend of better performance of fluorescence methods in detecting more advanced caries lesions. We also observed moderate to high heterogeneity and evidenced publication bias.ConclusionsFluorescence-based devices have similar overall performance; however, better accuracy in detecting more advanced caries lesions has been observed.
| S-EPMC3617206 | biostudies-literature
Project description:BACKGROUND:Childhood obesity is a serious public health concern. School-based interventions hold great promise to combat the rising trend of childhood obesity. This systematic review aimed to assess the overall effects of school-based obesity prevention interventions, and to investigate characteristics of intervention components that are potentially effective for preventing childhood obesity. METHODS:We systematically searched MEDLINE, CENTRAL and Embase databases to identify randomized- or cluster randomized- controlled trials of school-based obesity interventions published between 1990 and 2019. We conducted meta-analyses and subgroup analyses to determine the overall effects of obesity prevention programs and effect differences by various characteristics of intervention components on body mass index (BMI) or BMI Z-score of children. RESULTS:This systematic review included a total of 50 trials (reported by 56 publications). Significant differences were found between groups on BMI (- 0.14 kg/m2 (95% confidence interval: - 0.21, - 0.06)) and BMI Z-score (- 0.05 (- 0.10, - 0.01)) for single-component interventions; significant differences were also found between groups on BMI (- 0.32 (- 0.54, - 0.09) kg/m2) and BMI Z-score (- 0.07 (- 0.14, - 0.001)) for multi-component interventions. Subgroup analyses consistently demonstrated that effects of single-component (physical activity) interventions including curricular sessions (- 0.30 (- 0.51, - 0.10) kg/m2 in BMI) were stronger than those without curricular sessions (- 0.04 (- 0.17, 0.09) kg/m2 in BMI); effects of single-component (physical activity) interventions were also strengthened if physical activity sessions emphasized participants' enjoyment (- 0.19 (- 0.33, - 0.05) kg/m2 in BMI for those emphasizing participants' enjoyment; - 0.004 (- 0.10, 0.09) kg/m2 in BMI for those not emphasizing participants' enjoyment). The current body of evidence did not find specific characteristics of intervention components that were consistently associated with improved efficacy for multi-component interventions (P > 0.05). CONCLUSIONS:School-based interventions are generally effective in reducing excessive weight gain of children. Our findings contribute to increased understandings of potentially effective intervention characteristics for single-component (physical activity) interventions. The impact of combined components on effectiveness of multi-component interventions should be the topic of further research. More high-quality studies are also needed to confirm findings of this review.
| S-EPMC6819386 | biostudies-other
Project description:In a network meta-analysis, between-study heterogeneity variances are often very imprecisely estimated because data are sparse, so standard errors of treatment differences can be highly unstable. External evidence can provide informative prior distributions for heterogeneity and, hence, improve inferences. We explore approaches for specifying informative priors for multiple heterogeneity variances in a network meta-analysis. First, we assume equal heterogeneity variances across all pairwise intervention comparisons (approach 1); incorporating an informative prior for the common variance is then straightforward. Models allowing unequal heterogeneity variances are more realistic; however, care must be taken to ensure implied variance-covariance matrices remain valid. We consider three strategies for specifying informative priors for multiple unequal heterogeneity variances. Initially, we choose different informative priors according to intervention comparison type and assume heterogeneity to be proportional across comparison types and equal within comparison type (approach 2). Next, we allow all heterogeneity variances in the network to differ, while specifying a common informative prior for each. We explore two different approaches to this: placing priors on variances and correlations separately (approach 3) or using an informative inverse Wishart distribution (approach 4). Our methods are exemplified through application to two network metaanalyses. Appropriate informative priors are obtained from previously published evidence-based distributions for heterogeneity. Relevant prior information on between-study heterogeneity can be incorporated into network meta-analyses, without needing to assume equal heterogeneity across treatment comparisons. The approaches proposed will be beneficial in sparse data sets and provide more appropriate intervals for treatment differences than those based on imprecise heterogeneity estimates.
| S-EPMC6492109 | biostudies-literature
Project description:Macromolecular structure determination by cryo-electron microscopy (EM) and single-particle analysis are based on the assumption that imaged molecules have identical structure. With the increased size of processed data sets, it becomes apparent that many complexes coexist in a mixture of conformational states or contain flexible regions. We describe an implementation of the bootstrap resampling technique that yields estimates of voxel-by-voxel variance of a structure reconstructed from the set of its projections. We introduce a highly efficient reconstruction algorithm that is based on direct Fourier inversion and that incorporates correction for the transfer function of the microscope, thus extending the resolution limits of variance estimation. We also describe a validation method to determine the number of resampled volumes required to achieve stable estimate of the variance. The proposed bootstrap method was applied to a data set of 70S ribosome complexed with tRNA and the elongation factor G. The proposed method of variance estimation opens new possibilities for single-particle analysis, by extending applicability of the technique to heterogeneous data sets of macromolecules and to complexes with significant conformational variability.
| S-EPMC2642923 | biostudies-literature
Project description:We consider a study-level meta-analysis with a normally distributed outcome variable and possibly unequal study-level variances, where the object of inference is the difference in means between a treatment and control group. A common complication in such an analysis is missing sample variances for some studies. A frequently used approach is to impute the weighted (by sample size) mean of the observed variances (mean imputation). Another approach is to include only those studies with variances reported (complete case analysis). Both mean imputation and complete case analysis are only valid under the missing-completely-at-random assumption, and even then the inverse variance weights produced are not necessarily optimal. We propose a multiple imputation method employing gamma meta-regression to impute the missing sample variances. Our method takes advantage of study-level covariates that may be used to provide information about the missing data. Through simulation studies, we show that multiple imputation, when the imputation model is correctly specified, is superior to competing methods in terms of confidence interval coverage probability and type I error probability when testing a specified group difference. Finally, we describe a similar approach to handling missing variances in cross-over studies. Copyright © 2016 John Wiley & Sons, Ltd.
| S-EPMC4931964 | biostudies-literature