Partial identification in the statistical matching problem.
Ontology highlight
ABSTRACT:
SUBMITTER: Ahfock D
PROVIDER: S-EPMC5423529 | biostudies-literature | 2016 Dec
REPOSITORIES: biostudies-literature
Publications
Partial identification in the statistical matching problem.
Ahfock Daniel D Pyne Saumyadipta S Lee Sharon X SX McLachlan Geoffrey J GJ
Computational statistics & data analysis 20161201
The statistical matching problem involves the integration of multiple datasets where some variables are not observed jointly. This missing data pattern leaves most statistical models unidentifiable. Statistical inference is still possible when operating under the framework of partially identified models, where the goal is to bound the parameters rather than to estimate them precisely. In many matching problems, developing feasible bounds on the parameters is equivalent to finding the set of posi ...[more]
Similar Datasets
Project description:In recent years, intelligent robots have facilitated intelligent production, and a new type of problem (personnel-robot-position matching (PRPM)) has been encountered in personnel-position matching (PPM). In this study, a dynamic three-sided matching model is proposed to solve the PRPM problem in an intelligent production line based on man-machine collaboration. The first issue considered is setting the dynamic reference point, which is addressed in the information evaluation phase by proposing a method for setting the dynamic reference point based on the prospect theory. Another important issue involves multistage preference information integration, wherein a probability density function and a value function are introduced. Considering the attenuation of preference information in a time series, the attenuation index model is introduced to calculate the satisfaction matrix. Furthermore, a dynamic three-sided matching model is established. Additionally, a multi-objective decision-making model is established to optimize the matching of multiple sides (personnel, intelligent robots, and positions). Subsequently, the model is transformed into a single objective model using the triangular balance principle, which is introduced to obtain the final optimisation results in this modelling process. A case study is presented to illustrate the practicality of the dynamic three-sided matching model in intelligent environments. The results indicate that this model can solve the PRPM problem in an intelligent production line.
| S-EPMC10081803 | biostudies-literature
Project description:A method for improving crystallographic phases is presented that is based on the preferential occurrence of certain local patterns of electron density in macromolecular electron-density maps. The method focuses on the relationship between the value of electron density at a point in the map and the pattern of density surrounding this point. Patterns of density that can be superimposed by rotation about the central point are considered equivalent. Standard templates are created from experimental or model electron-density maps by clustering and averaging local patterns of electron density. The clustering is based on correlation coefficients after rotation to maximize the correlation. Experimental or model maps are also used to create histograms relating the value of electron density at the central point to the correlation coefficient of the density surrounding this point with each member of the set of standard patterns. These histograms are then used to estimate the electron density at each point in a new experimental electron-density map using the pattern of electron density at points surrounding that point and the correlation coefficient of this density to each of the set of standard templates, again after rotation to maximize the correlation. The method is strengthened by excluding any information from the point in question from both the templates and the local pattern of density in the calculation. A function based on the origin of the Patterson function is used to remove information about the electron density at the point in question from nearby electron density. This allows an estimation of the electron density at each point in a map, using only information from other points in the process. The resulting estimates of electron density are shown to have errors that are nearly independent of the errors in the original map using model data and templates calculated at a resolution of 2.6 A. Owing to this independence of errors, information from the new map can be combined in a simple fashion with information from the original map to create an improved map. An iterative phase-improvement process using this approach and other applications of the image-reconstruction method are described and applied to experimental data at resolutions ranging from 2.4 to 2.8 A.
| S-EPMC2745877 | biostudies-literature
Project description:BACKGROUND AND PURPOSE: This paper is intended to assist pharmacologists in making the most of statistical analysis and in avoiding common errors that can lead to false conclusions. APPROACH: A scenario is presented where a pathway inhibitor increased blood pressure responses to an agonist by about one third. The fictional experimenter concludes that the inhibitor enhanced the responses to the agonist, but has not applied any statistical analysis. Questions are asked of the reader, and a discussion of the author's answers is presented. RESULTS: The agonist responses have unequal standard errors, as often seen in data like these concentration-response curves with responses expressed as change from baseline. The uneven variability (heteroscedasticity) violates an assumption of conventional parametric statistical analyses, but can be corrected by data transformation. Expressing the data as absolute blood pressure and then transforming it to log blood pressure eliminated the heteroscedasticity, but made evident an effect of the inhibitor on baseline blood pressure. CONCLUSIONS AND IMPLICATIONS: Statistical analysis is a sensible precaution against mistakes, but cannot protect against all erroneous conclusions. In this scenario, the inhibitor reduced the blood pressure and increased responses to the agonist. However, it is likely that the latter effect was a consequence of the former and thus no conclusion can be safely drawn about any direct interaction between the agonist and the pathway inhibitor from this experiment. Where results are awkward to interpret because of confounding factors such as an altered baseline, statistical analysis may not be very useful in supporting a safe conclusion.
| S-EPMC2042955 | biostudies-other
Project description:BACKGROUND AND PURPOSE: This paper is intended to assist pharmacologists to make the most of statistical analysis and in avoid common errors. APPROACH: A scenario is presented where an experimenter performed an experiment to test the effects of two drugs on cultured cells. Analysis of the results, expressed as percentage of control, by a one-way ANOVA yielded P=0.058 and the experimenter concluded that neither drug was effective. The data were expressed as percentage of control because of pairing of the data within each experimental run, a common feature in cell culture experiments. Such data can be analysed with potentially more powerful ANOVA methods equivalent to the paired t-test. Monte Carlo simulations are presented to compare the power of relevant analyses. RESULTS: For data correlated within experimental run (i.e. paired values), transformation to percentage of control improved the power of a one-way ANOVA to detect a real effect, but a randomized block ANOVA (equivalent to a 2-way ANOVA with experiment and treatment as factors) using the raw values was substantially more powerful. The randomized block ANOVA performed well even with uncorrelated data, being only marginally less powerful than the one-way ANOVA. CONCLUSIONS AND IMPLICATIONS: A randomized block ANOVA is far superior to the one-way ANOVA with correlated data, and with uncorrelated data it is only marginally less powerful. Thus where there is, or might reasonably be, such a correlation (e.g. relatedness among the data within a single experimental run, or within a multi-well culture plate, or within an animal, et cetera), use the more powerful randomized block ANOVA rather than one-way ANOVA.
| S-EPMC2042947 | biostudies-other
Project description:Elastic Riemannian metrics have been used successfully for statistical treatments of functional and curve shape data. However, this usage suffers from a significant restriction: the function boundaries are assumed to be fixed and matched. In practice, functional data often comes with unmatched boundaries. It happens, for example, in dynamical systems with variable evolution rates, such as COVID-19 infection rate curves associated with different geographical regions. Here, we develop a Riemannian framework that allows for partial matching, comparing, and clustering of functions with phase variability and uncertain boundaries. We extend past work by (1) Defining a new diffeomorphism group G over the positive reals that is the semidirect product of a time-warping group and a time-scaling group; (2) Introducing a metric that is invariant to the action of G; (3) Imposing a Riemannian Lie group structure on G to allow for an efficient gradient-based optimization for elastic partial matching; and (4) Presenting a modification that, while losing the metric property, allows one to control the amount of boundary disparity in the registration. We illustrate this framework by registering and clustering shapes of COVID-19 rate curves, identifying basic patterns, minimizing mismatch errors, and reducing variability within clusters compared to previous methods.
| S-EPMC9714315 | biostudies-literature
Project description:The ability to acquire abstract knowledge is a hallmark of human intelligence and is believed by many to be one of the core differences between humans and neural network models. Agents can be endowed with an inductive bias towards abstraction through meta-learning, where they are trained on a distribution of tasks that share some abstract structure that can be learned and applied. However, because neural networks are hard to interpret, it can be difficult to tell whether agents have learned the underlying abstraction, or alternatively statistical patterns that are characteristic of that abstraction. In this work, we compare the performance of humans and agents in a meta-reinforcement learning paradigm in which tasks are generated from abstract rules. We define a novel methodology for building "task metamers" that closely match the statistics of the abstract tasks but use a different underlying generative process, and evaluate performance on both abstract and metamer tasks. We find that humans perform better at abstract tasks than metamer tasks whereas common neural network architectures typically perform worse on the abstract tasks than the matched metamers. This work provides a foundation for characterizing differences between humans and machine learning that can be used in future work towards developing machines with more human-like behavior.
| S-EPMC10497163 | biostudies-literature
Project description:An unfolded state ensemble is generated by using a self-avoiding statistical coil model that is based on backbone conformational frequencies in a coil library, a subset of the Protein Data Bank. The model reproduces two apparently contradicting behaviors observed in the chemically denatured state for a variety of proteins, random coil scaling of the radius of gyration and the presence of significant amounts of local backbone structure (NMR residual dipolar couplings). The most stretched members of our unfolded ensemble dominate the residual dipolar coupling signal, whereas the uniformity of the sign of the couplings follows from the preponderance of polyproline II and beta conformers in the coil library. Agreement with the NMR data substantially improves when the backbone conformational preferences include correlations arising from the chemical and conformational identity of neighboring residues. Although the unfolded ensembles match the experimental observables, they do not display evidence of native-like topology. By providing an accurate representation of the unfolded state, our statistical coil model can be used to improve thermodynamic and kinetic modeling of protein folding.
| S-EPMC1201606 | biostudies-literature
Project description:Functional elucidation of uncharacterized protein structures is an important task in bioinformatics. We report our new approach for structure-based function prediction which captures local surface features of ligand binding pockets. Function of proteins, specifically, binding ligands of proteins, can be predicted by finding similar local surface regions of known proteins. To enable partial comparison of binding sites in proteins, a weighted bipartite matching algorithm is used to match pairs of surface patches. The surface patches are encoded with the 3D Zernike descriptors. Unlike the existing methods which compare global characteristics of the protein fold or the global pocket shape, the local surface patch method can find functional similarity between non-homologous proteins and binding pockets for flexible ligand molecules. The proposed method improves prediction results over global pocket shape-based method which was previously developed by our group.
| S-EPMC3100846 | biostudies-literature
Project description:Given a randomized treatment Z, a clinical outcome Y, and a biomarker S measured some fixed time after Z is administered, we may be interested in addressing the surrogate endpoint problem by evaluating whether S can be used to reliably predict the effect of Z on Y. Several recent proposals for the statistical evaluation of surrogate value have been based on the framework of principal stratification. In this article, we consider two principal stratification estimands: joint risks and marginal risks. Joint risks measure causal associations (CAs) of treatment effects on S and Y, providing insight into the surrogate value of the biomarker, but are not statistically identifiable from vaccine trial data. Although marginal risks do not measure CAs of treatment effects, they nevertheless provide guidance for future research, and we describe a data collection scheme and assumptions under which the marginal risks are statistically identifiable. We show how different sets of assumptions affect the identifiability of these estimands; in particular, we depart from previous work by considering the consequences of relaxing the assumption of no individual treatment effects on Y before S is measured. Based on algebraic relationships between joint and marginal risks, we propose a sensitivity analysis approach for assessment of surrogate value, and show that in many cases the surrogate value of a biomarker may be hard to establish, even when the sample size is large.
| S-EPMC3597127 | biostudies-literature
Project description:BackgroundPartial factorial trials compare two or more pairs of treatments on overlapping patient groups, randomising some (but not all) patients to more than one comparison. The aims of this research were to compare different methods for conducting and analysing economic evaluations on partial factorial trials and assess the implications of considering factors simultaneously rather than drawing independent conclusions about each comparison.MethodsWe estimated total costs and quality-adjusted life years (QALYs) within 10 years of surgery for 2252 patients in the Knee Arthroplasty Trial who were randomised to one or more comparisons of different surgical types. We compared three analytical methods: an "at-the-margins" analysis including all patients randomised to each comparison (assuming no interaction); an "inside-the-table" analysis that included interactions but focused on those patients randomised to two comparisons; and a Bayesian vetted bootstrap, which used results from patients randomised to one comparison as priors when estimating outcomes for patients randomised to two comparisons. Outcomes comprised incremental costs, QALYs and net benefits.ResultsQualitative interactions were observed for costs, QALYs and net benefits. Bayesian bootstrapping generally produced smaller standard errors than inside-the-table analysis and gave conclusions that were consistent with at-the-margins analysis, while allowing for these interactions. By contrast, inside-the-table gave different conclusions about which intervention had the highest net benefits compared with other analyses.ConclusionsAll analyses of partial factorial trials should explore interactions and assess whether results are sensitive to assumptions about interactions, either as a primary analysis or as a sensitivity analysis. For partial factorial trials closely mirroring routine clinical practice, at-the-margins analysis may provide a reasonable estimate of average costs and benefits for the whole trial population, even in the presence of interactions. However, such conclusions will be misleading if there are large interactions or if the proportion of patients allocated to different treatments differs markedly from what occurs in clinical practice. The Bayesian bootstrap provides an alternative to at-the-margins analysis for analysing clinical or economic endpoints from partial factorial trials, which allows for interactions while making use of the whole sample. The same techniques could be applied to analyses of clinical endpoints.Trial registrationISRCTN, ISRCTN45837371 . Registered on 25 April 2003.
| S-EPMC6097309 | biostudies-literature