Learning to use past evidence in a sophisticated world model.
Ontology highlight
ABSTRACT:
SUBMITTER: Ahilan S
PROVIDER: S-EPMC6611652 | biostudies-literature | 2019 Jun
REPOSITORIES: biostudies-literature
Publications
Learning to use past evidence in a sophisticated world model.
Ahilan Sanjeevan S Solomon Rebecca B RB Breton Yannick-André YA Conover Kent K Niyogi Ritwik K RK Shizgal Peter P Dayan Peter P
PLoS computational biology 20190624 6
Humans and other animals are able to discover underlying statistical structure in their environments and exploit it to achieve efficient and effective performance. However, such structure is often difficult to learn and use because it is obscure, involving long-range temporal dependencies. Here, we analysed behavioural data from an extended experiment with rats, showing that the subjects learned the underlying statistical structure, albeit suffering at times from immediate inferential imperfecti ...[more]
Similar Datasets
Project description:Optical implementations of neural networks (ONNs) herald the next-generation high-speed and energy-efficient deep learning computing by harnessing the technical advantages of large bandwidth and high parallelism of optics. However, due to the problems of the incomplete numerical domain, limited hardware scale, or inadequate numerical accuracy, the majority of existing ONNs were studied for basic classification tasks. Given that regression is a fundamental form of deep learning and accounts for a large part of current artificial intelligence applications, it is necessary to master deep learning regression for further development and deployment of ONNs. Here, we demonstrate a silicon-based optical coherent dot-product chip (OCDC) capable of completing deep learning regression tasks. The OCDC adopts optical fields to carry out operations in the complete real-value domain instead of in only the positive domain. Via reusing, a single chip conducts matrix multiplications and convolutions in neural networks of any complexity. Also, hardware deviations are compensated via in-situ backpropagation control provided the simplicity of chip architecture. Therefore, the OCDC meets the requirements for sophisticated regression tasks and we successfully demonstrate a representative neural network, the AUTOMAP (a cutting-edge neural network model for image reconstruction). The quality of reconstructed images by the OCDC and a 32-bit digital computer is comparable. To the best of our knowledge, there is no precedent of performing such state-of-the-art regression tasks on ONN chips. It is anticipated that the OCDC can promote the novel accomplishment of ONNs in modern AI applications including autonomous driving, natural language processing, and scientific study.
| S-EPMC8560900 | biostudies-literature
Project description:BackgroundPre-travel consultation and chemoprophylaxis measures for malaria are a key component in the prevention of imported malaria in travelers. In this study we report a predictive tool for assessing personalized malaria risk in travelers based on the analysis of electronic medical records from travel consultations. The tool aims to guide physicians in the recommendation of appropriate prophylaxis prior to their trip. We also provide best-practice recommendations for pre-processing noisy and highly sparse real world evidence data.MethodsWe leveraged a large EMR dataset, containing demographic information about travelers and their destination. The data has been previously preprocessed using various strategies to handle missing and unbalanced data. We compared multiple machine learning approaches to assess the risk of malaria acquisition in travelers during their travels. Additionally, a feature importance analysis was performed using SHAP (SHapley Additive Explanations) values to identify patterns associated with malaria risk.ResultsOur study revealed that our XGB models achieved high predictive capacity (AUC >0.80). The most significant features predicting malaria infection during travel included travel destinations with low malaria risk, vaccination history, number of countries visited, age, and trip duration. Remarkably, we were able to obtain a reduced model with only five features. When comparing this model with a population of travelers recommended for malaria chemoprophylaxis, we observed that it was deemed necessary in only 40% of these travelers. This suggests that 60% received chemoprophylaxis despite having a low personalized risk of malaria.ConclusionWe have developed an algorithmic tool that utilizes a concise survey to generate a personalized travel risk assessment, effectively minimizing the prescription of unnecessary malaria chemoprophylaxis. Through the identification of patterns linked to predictions, our model significantly enhances the efficacy of pre-travel consultations.
| S-EPMC10979204 | biostudies-literature
Project description:Journal club (JC), as a pedagogical strategy, has long been used in graduate medical education (GME). As evidence-based medicine (EBM) becomes a mainstay in GME, traditional models of JC present a number of insufficiencies and call for novel models of instruction. A flipped classroom model appears to be an ideal strategy to meet the demands to connect evidence to practice while creating engaged, culturally competent, and technologically literate physicians. In this article, we describe a novel model of flipped classroom in JC. We present the flow of learning activities during the online and face-to-face instruction, and then we highlight specific considerations for implementing a flipped classroom model. We show that implementing a flipped classroom model to teach EBM in a residency program not only is possible but also may constitute improved learning opportunity for residents. Follow-up work is needed to evaluate the effectiveness of this model on both learning and clinical practice.
| S-EPMC5587016 | biostudies-literature
Project description:Constipation is a highly prevalent gastrointestinal disorder in patients with chronic kidney disease (CKD). However, our understanding of its epidemiology and management in CKD is limited. We aimed to explore real-world data on constipation and laxative use in patients with CKD in a nationwide population-based cohort from the Korean Health Insurance Review and Assessment-National Patient Sample database. This study analyzed retrospective health claims data in Korea from 2012 to 2017 that were transformed into the Observational Medical Outcomes Partnership Common Data Model. The pooled proportion of constipation diagnoses was 30.5% in all patients with CKD and 15.9%, 16.5%, 17.4%, 29.9%, and 43.3% in patients with CKD stages 1-5, respectively, suggesting a higher prevalence in advanced CKD. Patients receiving peritoneal dialysis or hemodialysis had the highest prevalence of constipation, while transplant recipients showed a prevalence comparable to that of patients with early CKD. Patients with CKD had a significantly higher risk of constipation than age- and sex-matched non-CKD individuals (range of odds ratio [OR]:1.66-1.90). Laxative prescribing patterns differed by CKD severity. Osmotic agents were prescribed in more than half of patients with advanced CKD, while magnesium salts and bulking agents were prescribed less frequently. The CKD patients with constipation were more likely to be prescribed constipation-inducing medications, including antipsychotic and neurological medications. Our findings provide real-world constipation and laxative prescription status in the Korean CKD population, revealing a significantly higher risk of constipation and different laxative prescribing patterns in patients with CKD.
| S-EPMC10951406 | biostudies-literature
Project description:If we try to draw conclusions about events, analyse data or results (in one or a certain area) and clarify our unknown points in standard or non-standard ways, this leads to the transfer of experience from one area to another. How do we want to follow guidelines, while the most of the obligatory laws are not followed, for example? The aim of prescriptions or recommendations in medicine, for example, (or the laws of a country that do not usually apply to particular classes or castes, as well as business rules) is to give guidance on how it would be appropriate to help people or ourselves (as we have already mentioned) and the people themselves. Unfortunately, this behaviour is also characteristic of developed societies that dictate the rules and try to help … to people, as well. If we come deeper into the system of mutual aid in medicine, it is unfortunate that sometimes the condition of this kind of "ecosystem" (or any of the ecosystems described) is worse than the best tragic-comedy. Unfortunately, the "ecosystem of medicine" is also subordinate and slaves somehow to the stronger "ecosystems" as politics and business and is dependent on them, but for evil or good, these ecosystems have glimpsed at times, no matter what are the motives, which provoke them! And they are most often … once again personal. Although in a number of Eastern European countries, it was unthinkable to even undesirable until recently, that dermasurgery and dermatooncology to be part of modern dermatological societies, the insatiable thirst for growth of young specialists, as well as the impact of Western schools, on their formation as a kind of new hope proved to be stronger in the formation of dermatosurgery, not only all over the world, but also in particular in the Balkans and Bulgaria. These units are gradually being introduced as an indispensable part of any modern clinic, and this part guarantees the best results (in patients with dermatosurgical or dermatooncological needs). The globalisation of dermatology and dermatological science has led to the introduction and involvement of additional auxiliary units, based on a more global concept of the interdisciplinary concept that encompasses psycho-neuroendocrine dermatology which provides a good explanation for some unexplained diseases, such as vitiligo, for example.
| S-EPMC5535643 | biostudies-other
Project description:The recently developed 'two-step' behavioural task promises to differentiate model-based from model-free reinforcement learning, while generating neurophysiologically-friendly decision datasets with parametric variation of decision variables. These desirable features have prompted its widespread adoption. Here, we analyse the interactions between a range of different strategies and the structure of transitions and outcomes in order to examine constraints on what can be learned from behavioural performance. The task involves a trade-off between the need for stochasticity, to allow strategies to be discriminated, and a need for determinism, so that it is worth subjects' investment of effort to exploit the contingencies optimally. We show through simulation that under certain conditions model-free strategies can masquerade as being model-based. We first show that seemingly innocuous modifications to the task structure can induce correlations between action values at the start of the trial and the subsequent trial events in such a way that analysis based on comparing successive trials can lead to erroneous conclusions. We confirm the power of a suggested correction to the analysis that can alleviate this problem. We then consider model-free reinforcement learning strategies that exploit correlations between where rewards are obtained and which actions have high expected value. These generate behaviour that appears model-based under these, and also more sophisticated, analyses. Exploiting the full potential of the two-step task as a tool for behavioural neuroscience requires an understanding of these issues.
| S-EPMC4686094 | biostudies-literature
Project description:There is growing interest in regulatory use of randomized pragmatic trials and noninterventional real-world (RW) studies of effectiveness and safety, but there is no agreed-on framework for assessing when this type of evidence is sufficiently reliable. Rather than impose a clinical trial-like paradigm on RW evidence, like blinded treatments or complete, source-verified data, the framework for assessing the utility of RW evidence should be grounded in the context of specific study objectives, clinical events that are likely to be detected in routine care, and the extent to which systematic error (bias) is likely to impact effect estimation. Whether treatment is blinded should depend on how well the outcome can be measured objectively. Qualification of a data source should be based on (1) numbers of patients of interest available for study; (2) if "must-have" data are likely to be recorded, and if so, how and where; (3) the accessibility of systematic follow-up data for the time period of interest; and (4) the potential for systematic errors (bias) in data collection and the likely magnitude of any such bias. Accessible data may not be representative of an entire population, but still may provide reliable evidence about the experience of typical patients treated under conditions of conventional care. Similarly, RW data that falls short of optimal length of follow-up or study size may still be useful in terms of its ability to provide evidence for regulators for subgroups of special interest. Developing a framework to qualify RW evidence in the context of a particular study purpose and data asset will enable broader regulatory use of RW data for approval of new molecular entities and label changes. Reliable information about diverse populations and settings should also help us move closer to more affordable, effective health care.
| S-EPMC5944086 | biostudies-other
Project description:Understanding the influences of climatic changes on water use efficiency (WUE) of Tibetan alpine meadows is important for predicting their long-term net primary productivity (NPP) because they are considered very sensitive to climate change. Here, we collected wool materials produced from 1962 to 2010 and investigated the long-term WUE of an alpine meadow in Tibet on basis of the carbon isotope values of vegetation (?13Cveg). The values of ?13Cveg decreased by 1.34‰ during 1962-2010, similar to changes in ?13C values of atmospheric CO2. Carbon isotope discrimination was highly variable and no trend was apparent in the past half century. Intrinsic water use efficiency (Wi) increased by 18 ?mol·mol-1 (approximately 23.5%) during 1962-2010 because the increase in the intercellular CO2 concentration (46 ?mol·mol-1) was less than that in the atmospheric CO2 concentration (Ca, 73 ?mol·mol-1). In addition, Wi increased significantly with increasing growing season temperature and Ca. However, effective water use efficiency (We) remained relatively stable, because of increasing vapor pressure deficit. Ca, precipitation, and growing season temperature collectively explained 45% of the variation of We. Our findings indicate that the We of alpine meadows in the Tibetan Plateau remained relatively stable by physiological adjustment to elevated Ca and growing season temperature. These findings improve our understanding and the capacity to predict NPP of these ecosystems under global change scenarios.
| S-EPMC4676705 | biostudies-literature
Project description:A classic debate in cognitive science revolves around understanding how children learn complex linguistic patterns, such as restrictions on verb alternations and contractions, without negative evidence. Recently, probabilistic models of language learning have been applied to this problem, framing it as a statistical inference from a random sample of sentences. These probabilistic models predict that learners should be sensitive to the way in which sentences are sampled. There are two main types of sampling assumptions that can operate in language learning: strong and weak sampling. Strong sampling, as assumed by probabilistic models, assumes the learning input is drawn from a distribution of grammatical samples from the underlying language and aims to learn this distribution. Thus, under strong sampling, the absence of a sentence construction from the input provides evidence that it has low or zero probability of grammaticality. Weak sampling does not make assumptions about the distribution from which the input is drawn, and thus the absence of a construction from the input as not used as evidence of its ungrammaticality. We demonstrate in a series of artificial language learning experiments that adults can produce behavior consistent with both sets of sampling assumptions, depending on how the learning problem is presented. These results suggest that people use information about the way in which linguistic input is sampled to guide their learning.
| S-EPMC4911062 | biostudies-literature
Project description:Semen limitation (lack of semen to fertilize all of a female's eggs) imposes high fitness costs to female partners. Females should therefore avoid mating with semen-limited males. This can be achieved by using public information extracted from watching individual males' previous copulating activities. This adaptive preference should be flexible given that semen limitation is temporary. We first demonstrate that the number of offspring produced by males Drosophila melanogaster gradually decreases over successive copulations. We then show that females avoid mating with males they just watched copulating and that visual public cues are sufficient to elicit this response. Finally, after males were given the time to replenish their sperm reserves, females did not avoid the males they previously saw copulating anymore. These results suggest that female fruit flies may have evolved sophisticated behavioural processes of resistance to semen-limited males, and demonstrate unsuspected adaptive context-dependent mate choice in an invertebrate.
| S-EPMC3480809 | biostudies-other