Dataset Information

Delayed matching to sample: reinforcement has opposite effects on resistance to change in two related procedures.

ABSTRACT: The effects of reinforcement on delayed matching to sample (DMTS) have been studied in two within-subjects procedures. In one, reinforcer magnitudes or probabilities vary from trial to trial and are signaled within trials (designated signaled DMTS trials). In the other, reinforcer probabilities are consistent for a series of trials produced by responding on variable-interval (VI) schedules within multiple-schedule components (designated multiple VI DMTS). In both procedures, forgetting functions in rich trials or components are higher than and roughly parallel to those in lean trials or components. However, during disruption, accuracy has been found to decrease more in rich than in lean signaled DMTS trials and, conversely, to decrease more in lean than in rich multiple VI DMTS components. In the present study, we compared these procedures in two groups of pigeons. In baseline, forgetting functions in rich trials or components were higher than and roughly parallel to those in lean trials or components, and were similar between the procedures. During disruption by prefeeding or extinction, accuracy decreased more in rich signaled DMTS trials, whereas accuracy decreased more in lean multiple VI DMTS components. These results replicate earlier studies and are predicted by a model of DMTS from Nevin, Davison, Odum, and Shahan (2007).

SUBMITTER: Nevin JA

PROVIDER: S-EPMC3356492 | biostudies-literature | 2012 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Delayed matching to sample: reinforcement has opposite effects on resistance to change in two related procedures.

Nevin John A JA Shahan Timothy A TA Odum Amy L AL Ward Ryan R

Learning & behavior 20121201 4

The effects of reinforcement on delayed matching to sample (DMTS) have been studied in two within-subjects procedures. In one, reinforcer magnitudes or probabilities vary from trial to trial and are signaled within trials (designated signaled DMTS trials). In the other, reinforcer probabilities are consistent for a series of trials produced by responding on variable-interval (VI) schedules within multiple-schedule components (designated multiple VI DMTS). In both procedures, forgetting functions ...[more]

PMID: 22205622

Similar Datasets

Project description:The glycopeptide A40926, produced by the actinomycete Nonomuraea gerenzanensis, is the precursor of dalbavancin, a second-generation glycopeptide antibiotic approved for clinical use in the USA and Europe in 2014 and 2015, respectively. The final product of the biosynthetic pathway is an O-acetylated form of A40926 (acA40926). Glycopeptide biosynthesis in N. gerenzanensis is dependent upon the dbv gene cluster that encodes, in addition to the two essential positive regulators Dbv3 and Dbv4, the putative members of a two-component signal transduction system, specifically the response regulator Dbv6 and the sensor kinase Dbv22. The aim of this work was to assign a role to these two genes. Our results demonstrate that deletion of dbv22 leads to an increased antibiotic production with a concomitant reduction in glycopeptide resistance. Deletion of dbv6 results in a similar phenotype, although the effects are not as strong as in the Δdbv22 mutant. Consistently, quantitative RT-PCR analysis showed that Dbv6 and Dbv22 negatively regulate the regulatory genes (dbv3 and dbv4), as well as some dbv biosynthetic genes (dbv23 and dbv24), whereas Dbv6 and Dbv22 positively regulate transcription of the single, cluster-associated resistance gene. Finally, we demonstrate that exogenously added acA40926 and its precursor A40926 can modulate transcription of dbv genes but with an opposite extent: A40926 strongly stimulates transcription of the Dbv6/Dbv22 target genes while acA40926 has a neutral or negative effect on transcription of those genes. We propose a model in which glycopeptide biosynthesis in N. gerenzanensis is modulated through a positive feedback by the biosynthetic precursor A40926 and a negative feedback by the final product acA40926. In addition to previously reported control systems, this sophisticated control loop might help the producing strain cope with the toxicity of its own product. This work, besides leading to improved glycopeptide producing strains, enlarges our knowledge on the regulation of glycopeptide biosynthesis in actinomycetes, setting N. gerenzanensis and its two-component system Dbv6-Dbv22 apart from other glycopeptide producers.

Project description:Reinforcement learning (RL) is a powerful and flexible paradigm for searching for solutions in high-dimensional action spaces. However, bridging the gap between playing computer games with thousands of simulated episodes and solving real scientific problems with complex and involved environments (up to actual laboratory experiments) requires improvements in terms of sample efficiency to make the most of expensive information. The discovery of new drugs is a major commercial application of RL, motivated by the very large nature of the chemical space and the need to perform multiparameter optimization (MPO) across different properties. In silico methods, such as virtual library screening (VS) and de novo molecular generation with RL, show great promise in accelerating this search. However, incorporation of increasingly complex computational models in these workflows requires increasing sample efficiency. Here, we introduce an active learning system linked with an RL model (RL-AL) for molecular design, which aims to improve the sample-efficiency of the optimization process. We identity and characterize unique challenges combining RL and AL, investigate the interplay between the systems, and develop a novel AL approach to solve the MPO problem. Our approach greatly expedites the search for novel solutions relative to baseline-RL for simple ligand- and structure-based oracle functions, with a 5-66-fold increase in hits generated for a fixed oracle budget and a 4-64-fold reduction in computational time to find a specific number of hits. Furthermore, compounds discovered through RL-AL display substantial enrichment of a multi-parameter scoring objective, indicating superior efficacy in curating high-scoring compounds, without a reduction in output diversity. This significant acceleration improves the feasibility of oracle functions that have largely been overlooked in RL due to high computational costs, for example free energy perturbation methods, and in principle is applicable to any RL domain.

Dataset Information

Delayed matching to sample: reinforcement has opposite effects on resistance to change in two related procedures.

Publications

Delayed matching to sample: reinforcement has opposite effects on resistance to change in two related procedures.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets