A brief review of molecular information theory.
Ontology highlight
ABSTRACT:
SUBMITTER: Schneider TD
PROVIDER: S-EPMC3220916 | biostudies-other | 2010 Sep
REPOSITORIES: biostudies-other
Publications
A brief review of molecular information theory.
Nano communication networks 20100901 3
The idea that we could build molecular communications systems can be advanced by investigating how actual molecules from living organisms function. Information theory provides tools for such an investigation. This review describes how we can compute the average information in the DNA binding sites of any genetic control protein and how this can be extended to analyze its individual sites. A formula equivalent to Claude Shannon's channel capacity can be applied to molecular systems and used to co ...[more]
Similar Datasets
Project description:We propose a theory to characterize the information and information processing abilities of metasurfaces, and demonstrate the relation between the information of the metasurface and its radiation pattern in the far-field region. By incorporating a general aperture model with uncertainty relation in L 2-space, we propose a theory to predict the upper bound of information contained in the radiation pattern of a metasurface, and reveal the theoretical upper limit of orthogonal radiation states. The proposed theory also provides guidance for inverse design of the metasurface with respect to given functionalities. Through investigation of the information of disordered-phase modulated metasurfaces, we find the information invariance (1-γ, where γ is Euler's constant) of chaotic radiation patterns. That is to say, the information of the disordered-phase modulated radiation patterns is always equal to 1-γ, regardless of variations in size, the number of elements and the phase pattern of metasurface. This value might be the lower bound of radiation-pattern information of the metasurface, which can provide a theoretical limit for information modulation applications, including computational imaging, stealth technologies and wireless communications.
| S-EPMC8289013 | biostudies-literature
Project description:The fundamental information theory functions of entropy, relative entropy, and mutual information are directly applicable to clinical diagnostic testing. This is a consequence of the fact that an individual's disease state and diagnostic test result are random variables. In this paper, we review the application of information theory to the quantification of diagnostic uncertainty, diagnostic information, and diagnostic test performance. An advantage of information theory functions over more established test performance measures is that they can be used when multiple disease states are under consideration as well as when the diagnostic test can yield multiple or continuous results. Since more than one diagnostic test is often required to help determine a patient's disease state, we also discuss the application of the theory to situations in which more than one diagnostic test is used. The total diagnostic information provided by two or more tests can be partitioned into meaningful components.
| S-EPMC7516534 | biostudies-literature
Project description:Structurally diverse, specialized lipids are crucial components of microbial membranes and other organelles and play essential roles in ecological functioning. The detection of such lipids in the environment can reveal not only the occurrence of specific microbes but also the physicochemical conditions to which they are adapted to. Traditionally, liquid chromatography coupled with mass spectrometry allowed for the detection of lipids based on chromatographic separation and individual peak identification, resulting in a limited data acquisition and targeting of certain lipid groups. Here, we explored a comprehensive profiling of microbial lipids throughout the water column of a marine euxinic basin (Black Sea) using ultra high-pressure liquid chromatography coupled with high-resolution tandem mass spectrometry (UHPLC-HRMS/MS). An information theory framework combined with molecular networking based on the similarity of the mass spectra of lipids enabled us to capture lipidomic diversity and specificity in the environment, identify novel lipids, differentiate microbial sources within a lipid group, and discover potential biomarkers for biogeochemical processes. The workflow presented here allows microbial ecologists and biogeochemists to process quickly and efficiently vast amounts of lipidome data to understand microbial lipids characteristics in ecosystems.
| S-EPMC8311935 | biostudies-literature
Project description:Networks distribute energy, materials and information to the components of a variety of natural and human-engineered systems, including organisms, brains, the Internet and microprocessors. Distribution networks enable the integrated and coordinated functioning of these systems, and they also constrain their design. The similar hierarchical branching networks observed in organisms and microprocessors are striking, given that the structure of organisms has evolved via natural selection, while microprocessors are designed by engineers. Metabolic scaling theory (MST) shows that the rate at which networks deliver energy to an organism is proportional to its mass raised to the 3/4 power. We show that computational systems are also characterized by nonlinear network scaling and use MST principles to characterize how information networks scale, focusing on how MST predicts properties of clock distribution networks in microprocessors. The MST equations are modified to account for variation in the size and density of transistors and terminal wires in microprocessors. Based on the scaling of the clock distribution network, we predict a set of trade-offs and performance properties that scale with chip size and the number of transistors. However, there are systematic deviations between power requirements on microprocessors and predictions derived directly from MST. These deviations are addressed by augmenting the model to account for decentralized flow in some microprocessor networks (e.g. in logic networks). More generally, we hypothesize a set of constraints between the size, power and performance of networked information systems including transistors on chips, hosts on the Internet and neurons in the brain.
| S-EPMC2607348 | biostudies-literature
Project description:BackgroundAdolescence is a unique developmental period characterized by biological, social, and cognitive changes, as well as an interest in managing one's own health care. Many adolescents use the internet to seek health care information. However, young people face barriers before they can understand and apply the health information that they access on the web. It is essential that usability of adolescent health websites on the internet is improved to help adolescents overcome these barriers and allow them to engage successfully with web-based health care content.ObjectiveThe aim of this review was to synthesize the usability of specific health information websites. These findings were mapped onto the adolescent neurodevelopmental profile, and a design brief based on the findings was developed to tailor future websites for specific adolescent requirements.MethodsA systematic search conducted using PubMed, PsycINFO, and Education Resources Information Center (ERIC) identified 25 studies that assessed the usability of health information websites. Adolescent feedback was collected by a mixture of surveys, focus groups, interviews, and think-aloud procedures.ResultsA majority of the information websites were developed for specific health issues that may be relevant to adolescents. The most preferred website features were interactive content such as games and quizzes, as well as videos, images, audio clips, and animations. Participants also preferred communicating with other adolescents with similar conditions or learning about their experience through real stories and testimonials. Adolescents found it difficult to use health information websites if they contained too much text, were too cluttered, or had features that made it difficult to access. The findings are considered in the context of adolescent social processes, low tolerance of delayed gratification, and attraction to novelty and mapped onto a neurodevelopmental model of adolescence.ConclusionsYoung people's feedback can determine usability and content that make a health information website easy or informative to use. Neurodevelopmental profiles and the users' specific preferences and skills should be addressed in future development of health information websites for adolescents.
| S-EPMC6658246 | biostudies-literature
Project description:In this paper we provide a review of selected mathematical ideas that can help us better understand the boundary between living and non-living systems. We focus on group theory and abstract algebra applied to molecular systems biology. Throughout this paper we briefly describe possible open problems. In connection with the genetic code we propose that it may be possible to use perturbation theory to explore the adjacent possibilities in the 64-dimensional space-time manifold of the evolving genome. With regards to algebraic graph theory, there are several minor open problems we discuss. In relation to network dynamics and groupoid formalism we suggest that the network graph might not be the main focus for understanding the phenotype but rather the phase space of the network dynamics. We show a simple case of a C6 network and its phase space network. We envision that the molecular network of a cell is actually a complex network of hypercycles and feedback circuits that could be better represented in a higher-dimensional space. We conjecture that targeting nodes in the molecular network that have key roles in the phase space, as revealed by analysis of the automorphism decomposition, might be a better way to drug discovery and treatment of cancer.
| S-EPMC3149578 | biostudies-literature
Project description:How difficult is it to 'discover' an evolutionary adaptation or innovation? I here suggest that information theory, in combination with high-throughput DNA sequencing, can help answer this question by quantifying a new phenotype's information content. I apply this framework to compute the phenotypic information associated with novel gene regulation and with the ability to use novel carbon sources. The framework can also help quantify how DNA duplications affect evolvability, estimate the complexity of phenotypes and clarify the meaning of 'progress' in Darwinian evolution.This article is part of the themed issue 'Process and pattern in innovations from cells to societies'.
| S-EPMC5665804 | biostudies-literature
Project description:Extracting relevant information from data is crucial for all forms of learning. The information bottleneck (IB) method formalizes this, offering a mathematically precise and conceptually appealing framework for understanding learning phenomena. However the nonlinearity of the IB problem makes it computationally expensive and analytically intractable in general. Here we derive a perturbation theory for the IB method and report the first complete characterization of the learning onset-the limit of maximum relevant information per bit extracted from data. We test our results on synthetic probability distributions, finding good agreement with the exact numerical solution near the onset of learning. We explore the difference and subtleties in our derivation and previous attempts at deriving a perturbation theory for the learning onset and attribute the discrepancy to a flawed assumption. Our work also provides a fresh perspective on the intimate relationship between the IB method and the strong data processing inequality.
| S-EPMC9806839 | biostudies-literature
Project description:Providing objective metrics of conscious state is of great interest across multiple research and clinical fields-from neurology to artificial intelligence. Here we approach this challenge by proposing plausible mechanisms for the phenomenon of structured experience. In earlier work, we argued that the experience we call reality is a mental construct derived from information compression. Here we show that algorithmic information theory provides a natural framework to study and quantify consciousness from neurophysiological or neuroimaging data, given the premise that the primary role of the brain is information processing. We take as an axiom that "there is consciousness" and focus on the requirements for structured experience: we hypothesize that the existence and use of compressive models by cognitive systems, e.g. in biological recurrent neural networks, enables and provides the structure to phenomenal experience. Self-awareness is seen to arise naturally (as part of a better model) in cognitive systems interacting bidirectionally with the external world. Furthermore, we argue that by running such models to track data, brains can give rise to apparently complex (entropic but hierarchically organized) data. We compare this theory, named KT for its basis on the mathematical theory of Kolmogorov complexity, to other information-centric theories of consciousness. We then describe methods to study the complexity of the brain's output streams or of brain state as correlates of conscious state: we review methods such as (i) probing the brain through its input streams (e.g. event-related potentials in oddball paradigms or mutual algorithmic information between world and brain), (ii) analyzing spontaneous brain state, (iii) perturbing the brain by non-invasive transcranial stimulation, and (iv) quantifying behavior (e.g. eye movements or body sway).
| S-EPMC6007168 | biostudies-literature
Project description:Introduction: Patient information leaflets (PILs) of medicinal products are informative documents that accompany medicines and explain their components, modes of use, interactions with other medicines, and other relevant issues. When patients do not adequately understand the information in the leaflets, they may engage in behaviors that affect their health (e.g., self-medication). Objective: To identify patient-related factors and characteristics of PILs that can promote cognitive, emotional, and behavioral changes that lead to appropriate drug use practices. Additionally, we aimed to determine strategies that could be implemented to design leaflets that convey adequate information and are easier to understand. Method and Results: We evaluated scientific articles published in databases and containing information on PILs suitability to be used in a patient population. A total of 51 articles were selected as the sample. Certain leaflet factors that favored or hindered understanding were identified (e.g., format in which the leaflets are presented, their structure, their adaptation to the sociodemographic and linguistic characteristics of the population, their wording…). Similarly, we also identified patient factors, such as previous experience taking the drugs referred to in the leaflet; the type of emotions experienced when reading the leaflets; the emphasis on the adverse effects of the medications; sociodemographic variables (i.e., age or educational level); and degree of interest in their own healthcare. Conclusion: Patient and leaflet factors influence the comprehension of information in the PIL; hence, emphasis should be placed on these factors to increase treatment and medication adherence and to reduce health-risk behaviors.
| S-EPMC8631714 | biostudies-literature