Model Learning and Knowledge Sharing for Cooperative Multiagent Systems in Stochastic Environment.
Ontology highlight
ABSTRACT:
SUBMITTER: Jiang WC
PROVIDER: S-EPMC7338261 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The social environment in which individuals live affects their fitness and in turn population dynamics as a whole. Birds with facultative cooperative breeding can live in social groups with dominants, subordinate helpers that assist with the breeding of others, and subordinate non-helpers. Helping behaviour benefits dominants through increased reproductive rates and reduced extrinsic mortality, such that cooperative breeding might have evolved in response to unpredictable, harsh conditions affecting reproduction and/or survival of the dominants. Additionally, there may be different costs and benefits to both helpers and non-helpers, depending on the time-scale. For example, early-life costs might be compensated by later-life benefits. These differential effects are rarely analysed in the same study. We examined whether helping behaviour affects population persistence in a stochastic environment and whether there are direct fitness consequences of different life-history tactics adopted by helpers and non-helpers. We parameterised a matrix population model describing the population dynamics of female Seychelles warblers Acrocephalus sechellensis, birds that display facultative cooperative breeding. The stochastic density-dependent model is defined by a (st)age structure that includes life-history differences between helpers and non-helpers and thus can estimate the demographic mechanisms of direct benefits of helping behaviour. We found that population dynamics are strongly influenced by stochastic variation in the reproductive rates of the dominants, that helping behaviour promotes population persistence and that there are only early-life differences in the direct fitness of helpers and non-helpers. Through a matrix population model, we captured multiple demographic rates simultaneously and analysed their relative importance in determining population dynamics of these cooperative breeders. Disentangling early-life versus lifetime effects of individual tactics sheds new light on the costs and benefits of helping behaviour. For example, the finding that helpers and non-helpers have similar lifetime reproductive outputs and that differences in reproductive values between the two life-history tactics arise only in early life suggests that overall, helpers and non-helpers have a similar balance of costs and benefits when analysing direct benefits. We recommend analysing the consequence of different life-history tactics, during both early life and over the lifetime, as analyses of these different time frames may produce conflicting results.
| S-EPMC9299144 | biostudies-literature
Project description:Autonomous agents perform on behalf of the user to achieve defined goals or objectives. They are situated in dynamic environment and are able to operate autonomously to achieve their goals. In a multiagent system, agents cooperate with each other to achieve a common goal. Testing of multiagent systems is a challenging task due to the autonomous and proactive behavior of agents. However, testing is required to build confidence into the working of a multiagent system. Prometheus methodology is a commonly used approach to design multiagents systems. Systematic and thorough testing of each interaction is necessary. This paper proposes a novel approach to testing of multiagent systems based on Prometheus design artifacts. In the proposed approach, different interactions between the agent and actors are considered to test the multiagent system. These interactions include percepts and actions along with messages between the agents which can be modeled in a protocol diagram. The protocol diagram is converted into a protocol graph, on which different coverage criteria are applied to generate test paths that cover interactions between the agents. A prototype tool has been developed to generate test paths from protocol graph according to the specified coverage criterion.
| S-EPMC4385681 | biostudies-other
Project description:Large scale operational areas often require multiple service robots for coverage and task parallelism. In such scenarios, each robot keeps its individual map of the environment and serves specific areas of the map at different times. We propose a knowledge sharing mechanism for multiple robots in which one robot can inform other robots about the changes in map, like path blockage, or new static obstacles, encountered at specific areas of the map. This symbiotic information sharing allows the robots to update remote areas of the map without having to explicitly navigate those areas, and plan efficient paths. A node representation of paths is presented for seamless sharing of blocked path information. The transience of obstacles is modeled to track obstacles which might have been removed. A lazy information update scheme is presented in which only relevant information affecting the current task is updated for efficiency. The advantages of the proposed method for path planning are discussed against traditional method with experimental results in both simulation and real environments.
| S-EPMC5539694 | biostudies-literature
Project description:Calmodulin (CaM) is a major Ca(2+) binding protein involved in two opposing processes of synaptic plasticity of CA1 pyramidal neurons: long-term potentiation (LTP) and depression (LTD). The N- and C-terminal lobes of CaM bind to its target separately but cooperatively and introduce complex dynamics that cannot be well understood by experimental measurement. Using a detailed stochastic model constructed upon experimental data, we have studied the interaction between CaM and Ca(2+)-CaM-dependent protein kinase II (CaMKII), a key enzyme underlying LTP. The model suggests that the accelerated binding of one lobe of CaM to CaMKII, when the opposing lobe is already bound to CaMKII, is a critical determinant of the cooperative interaction between Ca(2+), CaM, and CaMKII. The model indicates that the target-bound Ca(2+) free N-lobe has an extended lifetime and may regulate the Ca(2+) response of CaMKII during LTP induction. The model also reveals multiple kinetic pathways which have not been previously predicted for CaM-dissociation from CaMKII.
| S-EPMC3617043 | biostudies-literature
Project description:Evolution of cooperation and competition can appear when multiple adaptive agents share a biological, social, or technological niche. In the present work we study how cooperation and competition emerge between autonomous agents that learn by reinforcement while using only their raw visual input as the state representation. In particular, we extend the Deep Q-Learning framework to multiagent environments to investigate the interaction between two learning agents in the well-known video game Pong. By manipulating the classical rewarding scheme of Pong we show how competitive and collaborative behaviors emerge. We also describe the progression from competitive to collaborative behavior when the incentive to cooperate is increased. Finally we show how learning by playing against another adaptive agent, instead of against a hard-wired algorithm, results in more robust strategies. The present work shows that Deep Q-Networks can become a useful tool for studying decentralized learning of multiagent systems coping with high-dimensional environments.
| S-EPMC5381785 | biostudies-literature
Project description:Recent research in neuroeconomics has demonstrated that the reinforcement learning model of reward learning captures the patterns of both behavioral performance and neural responses during a range of economic decision-making tasks. However, this powerful theoretical model has its limits. Trial-and-error is only one of the means by which individuals can learn the value associated with different decision options. Humans have also developed efficient, symbolic means of communication for learning without the necessity for committing multiple errors across trials. In the present study, we observed that instructed knowledge of cue-reward probabilities improves behavioral performance and diminishes reinforcement learning-related blood-oxygen level-dependent (BOLD) responses to feedback in the nucleus accumbens, ventromedial prefrontal cortex, and hippocampal complex. The decrease in BOLD responses in these brain regions to reward-feedback signals was functionally correlated with activation of the dorsolateral prefrontal cortex (DLPFC). These results suggest that when learning action values, participants use the DLPFC to dynamically adjust outcome responses in valuation regions depending on the usefulness of action-outcome information.
| S-EPMC3017128 | biostudies-other
Project description:Knowledge sharing between individuals is a key process for knowledge-intensive organizations to create value and gain a competitive edge. An individual is in the center of a complex set of factors, which are conducive to the knowledge-sharing process. The purpose of this empirical study is to explain the interaction mechanisms between personality and knowledge-sharing behavior and to examine the mediating effects of willingness to share knowledge and subjective norm. The theory of planned behavior, the social exchange theory, and the big five personality traits theory are combined to explain tacit knowledge-sharing behavior. A survey strategy and purposive sampling was applied, and the analysis was conducted on a sample of 288 employees from Croatia working on knowledge-intensive tasks for which high levels of tacit knowledge sharing are characteristic. A standard online questionnaire consisted of items evaluated on a 7-point Likert-scale, ranging from strongly agree (7) to strongly disagree (1). In the structural model, relationships between altruism, willingness, subjective norm, and tacit knowledge sharing were tested. Confirmatory factor analysis with maximum likelihood estimation was performed by using SEM software AMOS version 23. The findings of the study suggest that altruism has a direct impact on tacit knowledge sharing, reaffirming a relationship with knowledge sharing but distinguishing between sharing of different types of knowledge, assessing tacit knowledge sharing as a construct separate from general knowledge sharing. Our findings suggest that willingness to share is a predictive factor of knowledge sharing behavior between employees, having both direct impact on tacit knowledge sharing and being a mediator between the trait of altruism and tacit knowledge sharing. The mediation test also indicates that altruism has an indirect influence on tacit knowledge sharing when subjective norm was a mediator. The findings suggest that personality traits relying on social capital, such as altruism, have more influence on tacit knowledge sharing compared to personality traits that have accentuated intrinsic components. The study contributes to the better understanding of factors stimulating knowledge-sharing behaviors and provides recommendations based on empirical evidence, which may later be applied in the development of knowledge-sharing leadership styles, employee hiring, and auxiliary initiatives.
| S-EPMC7378797 | biostudies-literature
Project description:Norms and normative multiagent systems have become the subjects of interest for many researchers. Such interest is caused by the need for agents to exploit the norms in enhancing their performance in a community. The term norm is used to characterize the behaviours of community members. The concept of normative multiagent systems is used to facilitate collaboration and coordination among social groups of agents. Many researches have been conducted on norms that investigate the fundamental concepts, definitions, classification, and types of norms and normative multiagent systems including normative architectures and normative processes. However, very few researches have been found to comprehensively study and analyze the literature in advancing the current state of norms and normative multiagent systems. Consequently, this paper attempts to present the current state of research on norms and normative multiagent systems and propose a norm's life cycle model based on the review of the literature. Subsequently, this paper highlights the significant areas for future work.
| S-EPMC4119705 | biostudies-other
Project description:In this commentary, we work out the specific desired functions required for sharing knowledge objects (based on statistical models) presumably to be used for clinical decision support derived from a learning health system, and, in so doing, discuss the implications for novel knowledge architectures. We will demonstrate how decision models, implemented as influence diagrams, satisfy the desiderata. The desiderata include locally validate discrimination, locally validate calibration, locally recalculate thresholds by incorporating local preferences, provide explanation, enable monitoring, enable debiasing, account for generalizability, account for semantic uncertainty, shall be findable, and others as necessary and proper. We demonstrate how formal decision models, especially when implemented as influence diagrams based on Bayesian networks, support both the knowledge artifact itself (the "primary decision") and the "meta-decision" of whether to deploy the knowledge artifact. We close with a research and development agenda to put this framework into place.
| S-EPMC6508769 | biostudies-literature
Project description:The measured induction times in droplet-based microfluidic systems are stochastic and are not described by the deterministic population balances or moment equations commonly used to model the crystallization of amino acids, proteins, and active pharmaceutical ingredients. A stochastic model in the form of a Master equation is formulated for crystal nucleation in droplet-based microfluidic systems for any form of nucleation rate expression under conditions of time-varying supersaturation. An analytical solution is provided to describe the (1) time evolution of the probability of crystal nucleation, (2) the average number of crystals that will form at time t for a large number of droplets, (3) the induction time distribution, and (4) the mean, most likely, and median induction times. These expressions are used to develop methods for determining the nucleation kinetics. Nucleation kinetics are determined from induction times measured for paracetamol and lysozyme at high supersaturation in an evaporation-based high-throughput crystallization platform, which give low prediction errors when the nucleation kinetics were used to predict induction times for other experimental conditions. The proposed stochastic model is relevant to homogeneous and heterogeneous crystal nucleation in a wide range of droplet-based and microfluidic crystallization platforms.
| S-EPMC2953805 | biostudies-literature