Browse
Submit Data
Databases
API
Help

Dataset Information

12 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Inference with Transposable Data: Modeling the Effects of Row and Column Correlations.

ABSTRACT: We consider the problem of large-scale inference on the row or column variables of data in the form of a matrix. Many of these data matrices are transposable meaning that neither the row variables nor the column variables can be considered independent instances. An example of this scenario is detecting significant genes in microarrays when the samples may be dependent due to latent variables or unknown batch effects. By modeling this matrix data using the matrix-variate normal distribution, we study and quantify the effects of row and column correlations on procedures for large-scale inference. We then propose a simple solution to the myriad of problems presented by unanticipated correlations: We simultaneously estimate row and column covariances and use these to sphere or de-correlate the noise in the underlying data before conducting inference. This procedure yields data with approximately independent rows and columns so that test statistics more closely follow null distributions and multiple testing procedures correctly control the desired error rates. Results on simulated models and real microarray data demonstrate major advantages of this approach: (1) increased statistical power, (2) less bias in estimating the false discovery rate, and (3) reduced variance of the false discovery rate estimators.

SUBMITTER: Allen GI

PROVIDER: S-EPMC8649963 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Inference of transposable element ancestry.

Project description:Most common methods for inferring transposable element (TE) evolutionary relationships are based on dividing TEs into subfamilies using shared diagnostic nucleotides. Although originally justified based on the "master gene" model of TE evolution, computational and experimental work indicates that many of the subfamilies generated by these methods contain multiple source elements. This implies that subfamily-based methods give an incomplete picture of TE relationships. Studies on selection, functional exaptation, and predictions of horizontal transfer may all be affected. Here, we develop a Bayesian method for inferring TE ancestry that gives the probability that each sequence was replicative, its frequency of replication, and the probability that each extant TE sequence came from each possible ancestral sequence. Applying our method to 986 members of the newly-discovered LAVA family of TEs, we show that there were far more source elements in the history of LAVA expansion than subfamilies identified using the CoSeg subfamily-classification program. We also identify multiple replicative elements in the AluSc subfamily in humans. Our results strongly indicate that a reassessment of subfamily structures is necessary to obtain accurate estimates of mutation processes, phylogenetic relationships and historical times of activity.

| S-EPMC4133154 | biostudies-literature

Effects of row direction and row spacing on maize leaf senescence.

Project description:To analyze three row orientations (south-north, east-west, southwestern 20°) and two row spacings ('65 + 65', '160 + 40'), we investigated the effect of row orientation and planting pattern on photosynthetic performance, physiological and biochemical indicators related to the aging of leaves. Results revealed that during maturity stage, in north-south and east-west, the initial fluorescence (Fo) at '65 + 65' were higher than those under'160 + 40'; the maximum quantum yield of PS2 photochemistry(ΦP0), basal quantum yield of non-photochemical processes in PS2(ΦN0)of the lower leaves and photosynthetic rate of the upper and ear leaves under'160 + 40'were higher than those under'65 + 65'. The polyphenoloxidase (POD) activities of leaves at different positions under '160 + 40' were higher than that under'65 + 65', while the malondialdehyde (MDA) content was lower. The photosynthesis rate, superoxide dismutase (SOD) and catalase (CAT) activity of leaves at different positions under southwestern 20° '160 + 40' were higher than others. Whilst MDA content '160 + 40' were lower. Therefore, in De Hui City, Jilin Province, southwestern 20° '160 + 40' delayed leaf senescence at the late stage of growth of maize, as well as the effect of increasing maize yield was most obvious.

| S-EPMC6472738 | biostudies-literature

A double scrambling-DNA row and column closed loop image encryption algorithm based on chaotic system.

Project description:In this paper, a dynamic update algorithm of double scrambling-DNA row and column closed loop based on chaotic system is proposed. The classical scrambling and diffusion structure are used in the whole process. In the scrambling stage, a new pixel reconstruction method is proposed by combining the Hilbert curve with Knuth-Durstenfeld shuffle algorithm to overcome the shortcoming of nearby storage of Hilbert curve. This method reconstructs the pixel matrix of one-dimensional vector according to the Hilbert curve coding method, and achieves good scrambling effect, while reducing its time complexity and space complexity. In the diffusion stage, combining the plaintext row, the ciphertext row and the key row, and taking advantage of the parallel computing power and high storage density of the DNA encoding, the existing block diffusion operation is improved, and the two-round diffusion of the DNA encoding is proposed. When the last line of ciphertext is generated, the first line of ciphertext is updated and the closed-loop dynamic update of the encryption system is realized. Finally, SHA-256 is used to give the secret key and calculate the initial value of the chaotic system. The simulation results show that the "double scrambling-DNA row and column closed loop dynamic" update algorithm proposed in this paper can effectively improve the efficiency of information transmission and have high security.

| S-EPMC9275730 | biostudies-literature

Selection Sampling from Large Data Sets for Targeted Inference in Mixture Modeling.

Project description:One of the challenges in using Markov chain Monte Carlo for model analysis in studies with very large datasets is the need to scan through the whole data at each iteration of the sampler, which can be computationally prohibitive. Several approaches have been developed to address this, typically drawing computationally manageable subsamples of the data. Here we consider the specific case where most of the data from a mixture model provides little or no information about the parameters of interest, and we aim to select subsamples such that the information extracted is most relevant. The motivating application arises in flow cytometry, where several measurements from a vast number of cells are available. Interest lies in identifying specific rare cell subtypes and characterizing them according to their corresponding markers. We present a Markov chain Monte Carlo approach where an initial subsample of the full dataset is used to guide selection sampling of a further set of observations targeted at a scientifically interesting, low probability region. We define a Sequential Monte Carlo strategy in which the targeted subsample is augmented sequentially as estimates improve, and introduce a stopping rule for determining the size of the targeted subsample. An example from flow cytometry illustrates the ability of the approach to increase the resolution of inferences for rare cell subtypes.

| S-EPMC2943396 | biostudies-literature

BAYESIAN HIERARCHICAL MODELING FOR SIGNALING PATHWAY INFERENCE FROM SINGLE CELL INTERVENTIONAL DATA.

Project description:Recent technological advances have made it possible to simultaneously measure multiple protein activities at the single cell level. With such data collected under different stimulatory or inhibitory conditions, it is possible to infer the causal relationships among proteins from single cell interventional data. In this article we propose a Bayesian hierarchical modeling framework to infer the signaling pathway based on the posterior distributions of parameters in the model. Under this framework, we consider network sparsity and model the existence of an association between two proteins both at the overall level across all experiments and at each individual experimental level. This allows us to infer the pairs of proteins that are associated with each other and their causal relationships. We also explicitly consider both intrinsic noise and measurement error. Markov chain Monte Carlo is implemented for statistical inference. We demonstrate that this hierarchical modeling can effectively pool information from different interventional experiments through simulation studies and real data analysis.

| S-EPMC3233205 | biostudies-literature

Test-statistic correlation and data-row correlation.

Project description:When a statistical test is repeatedly applied to rows of a data matrix, correlations among data rows will give rise to correlations among corresponding test statistics. We investigate the relationship between test-statistic correlation and data-row correlation and discuss its implications.

| S-EPMC7723344 | biostudies-literature

Skin-Inspired Piezoelectric Tactile Sensor Array with Crosstalk-Free Row+Column Electrodes for Spatiotemporally Distinguishing Diverse Stimuli.

Project description:Real-time detection and differentiation of diverse external stimuli with one tactile senor remains a huge challenge and largely restricts the development of electronic skins. Although different sensors have been described based on piezoresistivity, capacitance, and triboelectricity, and these devices are promising for tactile systems, there are few, if any, piezoelectric sensors to be able to distinguish diverse stimuli in real time. Here, a human skin-inspired piezoelectric tactile sensor array constructed with a multilayer structure and row+column electrodes is reported. Integrated with a signal processor and a logical algorithm, the tactile sensor array achieves to sense and distinguish the magnitude, positions, and modes of diverse external stimuli, including gentle slipping, touching, and bending, in real time. Besides, the unique design overcomes the crosstalk issues existing in other sensors. Pressure sensing and bending sensing tests show that the proposed tactile sensor array possesses the characteristics of high sensitivity (7.7 mV kPa-1), long-term durability (80 000 cycles), and rapid response time (10 ms) (less than human skin). The tactile sensor array also shows a superior scalability and ease of massive fabrication. Its ability of real-time detection and differentiation of diverse stimuli for health monitoring, detection of animal movements, and robots is demonstrated.

| S-EPMC7856889 | biostudies-literature

Bayesian modeling and inference for clinical trials with partial retrieved data following dropout.

Project description:In randomized clinical trials, it is common that patients may stop taking their assigned treatments and then switch to a standard treatment (standard of care available to the patient) but not the treatments under investigation. Although the availability of limited retrieved data on patients who switch to standard treatment, called off-protocol data, could be highly valuable in assessing the associated treatment effect with the experimental therapy, it leads to a complex data structure requiring the development of models that link the information of per-protocol data with the off-protocol data. In this paper, we develop a novel Bayesian method to jointly model longitudinal treatment measurements under various dropout scenarios. Specifically, we propose a multivariate normal mixed-effects model for repeated measurements from the assigned treatments and the standard treatment, a multivariate logistic regression model for those stopping the assigned treatments, logistic regression models for those starting a standard treatment off protocol, and a conditional multivariate logistic regression model for completely withdrawing from the study. We assume that withdrawing from the study is non-ignorable, but intermittent missingness is assumed to be at random. We examine various properties of the proposed model. We develop an efficient Markov chain Monte Carlo sampling algorithm. We analyze in detail via the proposed method a real dataset from a clinical trial.

| S-EPMC3796028 | biostudies-literature

Bayesian inference for longitudinal data with non-parametric treatment effects.

Project description:We consider inference for longitudinal data based on mixed-effects models with a non-parametric Bayesian prior on the treatment effect. The proposed non-parametric Bayesian prior is a random partition model with a regression on patient-specific covariates. The main feature and motivation for the proposed model is the use of covariates with a mix of different data formats and possibly high-order interactions in the regression. The regression is not explicitly parameterized. It is implied by the random clustering of subjects. The motivating application is a study of the effect of an anticancer drug on a patient's blood pressure. The study involves blood pressure measurements taken periodically over several 24-h periods for 54 patients. The 24-h periods for each patient include a pretreatment period and several occasions after the start of therapy.

| S-EPMC3944972 | biostudies-literature

Simple group fMRI modeling and inference.

Project description:While many advanced mixed-effects models have been proposed and are used in fMRI, the simplest, ordinary least squares (OLS), is still the one that is most widely used. A survey of 90 papers found that 92% of group fMRI analyses used OLS. Despite the widespread use, this simple approach has never been thoroughly justified and evaluated; for example, the typical reference for the method is a conference abstract, (Holmes, A., Friston, K., 1998. Generalisability, random effects & population inference. NeuroImage 7 (4 (2/3)), S754, proceedings of Fourth International Conference on Functional Mapping of the Human Brain, June 7-12, 1998, Montreal, Canada.), which has been referenced over 400 times. In this work we fully derive the simplified method in a general setting and carefully identify the homogeneity assumptions it is based on. We examine the specificity (Type I error rate) of the OLS method under heterogeneity in the one-sample case and find that the OLS method is valid, with only slight conservativeness. Surprisingly, a Satterthwaite approximation for effective degrees of freedom only makes the method more conservative, instead of more accurate. While other authors have highlighted the inferior power of the OLS method relative to optimal mixed-effects methods under heterogeneity, we revisit these results and find the power differences very modest. While statistical methods that make the best use of the data are always to be preferred, software or other practical concerns may require the use of the simple OLS group modeling. In such cases, we find that group mean inferences will be valid under the null hypothesis and will have nearly optimal sensitivity under the alternative.

| S-EPMC2719771 | biostudies-other

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data