Interpreting Potts and Transformer Protein Models Through the Lens of Simplified Attention.
Ontology highlight
ABSTRACT:
SUBMITTER: Bhattacharya N
PROVIDER: S-EPMC8752338 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Most methods for biological sequence homology search and alignment work with primary sequence alone, neglecting higher-order correlations. Recently, statistical physics models called Potts models have been used to infer all-by-all pairwise correlations between sites in deep multiple sequence alignments, and these pairwise couplings have improved 3D structure predictions. Here we extend the use of Potts models from structure prediction to sequence alignment and homology search by developing what we call a hidden Potts model (HPM) that merges a Potts emission process to a generative probability model of insertion and deletion. Because an HPM is incompatible with efficient dynamic programming alignment algorithms, we develop an approximate algorithm based on importance sampling, using simpler probabilistic models as proposal distributions. We test an HPM implementation on RNA structure homology search benchmarks, where we can compare directly to exact alignment methods that capture nested RNA base-pairing correlations (stochastic context-free grammars). HPMs perform promisingly in these proof of principle experiments.
| S-EPMC7728182 | biostudies-literature
Project description:Potts Hamiltonian models of protein sequence co-variation are statistical models constructed from the pair correlations observed in a multiple sequence alignment (MSA) of a protein family. These models are powerful because they capture higher order correlations induced by mutations evolving under constraints and help quantify the connections between protein sequence, structure, and function maintained through evolution. We review recent work with Potts models to predict protein structure and sequence-dependent conformational free energy landscapes, to survey protein fitness landscapes and to explore the effects of epistasis on fitness. We also comment on the numerical methods used to infer these models for each application.
| S-EPMC5869684 | biostudies-literature
Project description:Diabetes is one of the most challenging health concerns facing society. Available drugs treat the symptoms but there is no cure. This presents an urgent need to better understand human diabetes in order to develop improved treatments or target remission. New disease models need to be developed that more accurately describe the pathology of diabetes. Organoid technology provides an opportunity to fill this knowledge gap. Organoids are 3D structures, established from pluripotent stem cells or adult stem/progenitor cells, that recapitulate key aspects of the in vivo tissues they mimic. In this review we briefly introduce organoids and their benefits; we focus on organoids generated from tissues important for glucose homeostasis and tissues associated with diabetic complications. We hope this review serves as a touchstone to demonstrate how organoid technology extends the research toolbox and can deliver a step change of discovery in the field of diabetes.
| S-EPMC7228904 | biostudies-literature
Project description:Global coevolutionary models of protein families have become increasingly popular due to their capacity to predict residue–residue contacts from sequence information, but also to predict fitness effects of amino acid substitutions or to infer protein–protein interactions. The central idea in these models is to construct a probability distribution, a Potts model, that reproduces single and pairwise frequencies of amino acids found in natural sequences of the protein family. This approach treats sequences from the family as independent samples, completely ignoring phylogenetic relations between them. This simplification is known to lead to potentially biased estimates of the parameters of the model, decreasing their biological relevance. Current workarounds for this problem, such as reweighting sequences, are poorly understood and not principled. Here, we propose an inference scheme that takes the phylogeny of a protein family into account in order to correct biases in estimating the frequencies of amino acids. Using artificial data, we show that a Potts model inferred using these corrected frequencies performs better in predicting contacts and fitness effect of mutations. First, only partially successful tests on real protein data are presented, too.
| S-EPMC7514434 | biostudies-literature
Project description:We analyze the role of different physicochemical factors in protein/DNA binding and recognition by comparing the results from all-atom molecular dynamics simulations with simulations using simplified protein models. These models enable us to separate the role of specific amino acid side chains, formal amino acid charges and hydrogen bonding from the effects of the low-dielectric volume occupied by the protein. Comparisons are made on the basis of the conformation of DNA after protein binding, the ionic distribution around the complex and the sequence specificity. The results for four transcription factors, binding in either the minor or major grooves of DNA, show that the protein volume and formal charges, with one exception, play a predominant role in binding. Adding hydrogen bonding and a very small number of key amino acid side chains at the all-atom level yields results in DNA conformations and sequence recognition close to those seen in the reference all-atom simulations.
| S-EPMC5622342 | biostudies-literature
Project description:BackgroundMosquito-borne pathogens contribute significantly to the global burden of disease, infecting millions of people each year. Mosquito feeding is critical to the transmission dynamics of pathogens, and thus it is important to understanding and interpreting mosquito feeding patterns. In this paper we explore mosquito feeding patterns and their implications for disease ecology through a meta-analysis of published blood meal results collected across Australia from more than 12,000 blood meals from 22 species. To assess mosquito-vertebrate associations and identify mosquitoes on a spectrum of generalist or specialist feeders, we analysed blood meal data in two ways; first using a novel odds ratio analysis, and secondly by calculating Shannon's diversity scores.ResultsWe find that each mosquito species had a unique feeding association with different vertebrates, suggesting species-specific feeding patterns. Broadly, mosquito species could be grouped broadly into those that were primarily ornithophilic and those that fed more often on livestock. Aggregated feeding patterns observed across Australia were not explained by intrinsic variables such as mosquito genetics or larval habitats. We discuss the implications for disease transmission by vector mosquito species classified as generalist-feeders (such as Aedes vigilax and Culex annulirostris), or specialists (such as Aedes aegypti) in light of potential influences on mosquito host choice.ConclusionsOverall, we find that whilst existing blood meal studies in Australia are useful for investigating mosquito feeding patterns, standardisation of blood meal study methodologies and analyses, including the incorporation of vertebrate surveys, would improve predictions of the impact of vector-host interactions on disease ecology. Our analysis can also be used as a framework to explore mosquito-vertebrate associations, in which host availability data is unavailable, in other global systems.
| S-EPMC6448275 | biostudies-literature
Project description:Protein structure prediction (PSP) has been one of the most challenging problems in computational biology for several decades. The challenge is largely due to the complexity of the all-atomic details and the unknown nature of the energy function. Researchers have therefore used simplified energy models that consider interaction potentials only between the amino acid monomers in contact on discrete lattices. The restricted nature of the lattices and the energy models poses a twofold concern regarding the assessment of the models. Can a native or a very close structure be obtained when structures are mapped to lattices? Can the contact based energy models on discrete lattices guide the search towards the native structures? In this paper, we use the protein chain lattice fitting (PCLF) problem to address the first concern; we developed a constraint-based local search algorithm for the PCLF problem for cubic and face-centered cubic lattices and found very close lattice fits for the native structures. For the second concern, we use a number of techniques to sample the conformation space and find correlations between energy functions and root mean square deviation (RMSD) distance of the lattice-based structures with the native structures. Our analysis reveals weakness of several contact based energy models used that are popular in PSP.
| S-EPMC4022063 | biostudies-literature
Project description:The effectiveness of deep learning methods can be largely attributed to the automated extraction of relevant features from raw data. In the field of functional genomics, this generally concerns the automatic selection of relevant nucleotide motifs from DNA sequences. To benefit from automated learning methods, new strategies are required that unveil the decision-making process of trained models. In this paper, we present a new approach that has been successful in gathering insights on the transcription process in Escherichia coli. This work builds upon a transformer-based neural network framework designed for prokaryotic genome annotation purposes. We find that the majority of subunits (attention heads) of the model are specialized towards identifying transcription factors and are able to successfully characterize both their binding sites and consensus sequences, uncovering both well-known and potentially novel elements involved in the initiation of the transcription process. With the specialization of the attention heads occurring automatically, we believe transformer models to be of high interest towards the creation of explainable neural networks in this field.
| S-EPMC8425421 | biostudies-literature
Project description:We show that occupancy models are more difficult to fit than is generally appreciated because the estimating equations often have multiple solutions, including boundary estimates which produce fitted probabilities of zero or one. The estimates are unstable when the data are sparse, making them difficult to interpret, and, even in ideal situations, highly variable. As a consequence, making accurate inference is difficult. When abundance varies over sites (which is the general rule in ecology because we expect spatial variance in abundance) and detection depends on abundance, the standard analysis suffers bias (attenuation in detection, biased estimates of occupancy and potentially finding misleading relationships between occupancy and other covariates), asymmetric sampling distributions, and slow convergence of the sampling distributions to normality. The key result of this paper is that the biases are of similar magnitude to those obtained when we ignore non-detection entirely. The fact that abundance is subject to detection error and hence is not directly observable, means that we cannot tell when bias is present (or, equivalently, how large it is) and we cannot adjust for it. This implies that we cannot tell which fit is better: the fit from the occupancy model or the fit ignoring the possibility of detection error. Therefore trying to adjust occupancy models for non-detection can be as misleading as ignoring non-detection completely. Ignoring non-detection can actually be better than trying to adjust for it.
| S-EPMC3542396 | biostudies-literature
Project description:BACKGROUND:Tuberculosis (TB) is a persistent major public health challenge in South Africa. This article examines the social determinants and demographic factors associated with TB loss to follow-up through the lens of intersectionality. AIM:The aim of this study was to describe and interpret the social determinants and demographic factors associated with TB patients lost to follow-up (LTFU). SETTING:Mamelodi, an urban settlement in the South African District of Tshwane. METHODS:AitaHealth™ is an Information and Communications Technology (ICT) mobile and web application that is used by community health workers. Data from patients with TB were extracted from the 64 319 households registered on AitaHealth™ over a 3-year period. Univariate and multivariate analyses were used to compare patients who were adherent to TB treatment and those LTFU. RESULTS:Of the 184 351 individuals screened for TB, 788 reported that they were diagnosed with TB (an incidence of 427 cases per 100 000). Of the 704 eligible for inclusion in this analysis, 540 (77%) were on treatment and 164 (23%) were LTFU. The factors associated with LTFU were aged over 60, not having a South African identification document, migration and death in the household, and higher mean household income. CONCLUSION:The results of this study serve as a reminder to clinicians of the importance of the three-stage assessment (biopsychosocial) in the approach to patients with TB. Understanding the intersection of social determinants and demographic factors helps clinicians and others identify and respond to the specificity of patient, health system and non-health policy issues at play in LTFU.
| S-EPMC7061220 | biostudies-literature