The network architecture of value learning.
Ontology highlight
ABSTRACT:
SUBMITTER: Mattar MG
PROVIDER: S-EPMC6130435 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Human behavior and cognition result from a complex pattern of interactions between brain regions. The flexible reconfiguration of these patterns enables behavioral adaptation, such as the acquisition of a new motor skill. Yet, the degree to which these reconfigurations depend on the brain's baseline sensorimotor integration is far from understood. Here, we asked whether spontaneous fluctuations in sensorimotor networks at baseline were predictive of individual differences in future learning. We analyzed functional MRI data from 19 participants prior to six weeks of training on a new motor skill. We found that visual-motor connectivity was inversely related to learning rate: sensorimotor autonomy at baseline corresponded to faster learning in the future. Using three additional scans, we found that visual-motor connectivity at baseline is a relatively stable individual trait. These results suggest that individual differences in motor skill learning can be predicted from sensorimotor autonomy at baseline prior to task execution.
| S-EPMC5910215 | biostudies-literature
Project description:The performance of information processing systems, from artificial neural networks to natural neuronal ensembles, depends heavily on the underlying system architecture. In this study, we compare the performance of parallel and layered network architectures during sequential tasks that require both acquisition and retention of information, thereby identifying tradeoffs between learning and memory processes. During the task of supervised, sequential function approximation, networks produce and adapt representations of external information. Performance is evaluated by statistically analyzing the error in these representations while varying the initial network state, the structure of the external information, and the time given to learn the information. We link performance to complexity in network architecture by characterizing local error landscape curvature. We find that variations in error landscape structure give rise to tradeoffs in performance; these include the ability of the network to maximize accuracy versus minimize inaccuracy and produce specific versus generalizable representations of information. Parallel networks generate smooth error landscapes with deep, narrow minima, enabling them to find highly specific representations given sufficient time. While accurate, however, these representations are difficult to generalize. In contrast, layered networks generate rough error landscapes with a variety of local minima, allowing them to quickly find coarse representations. Although less accurate, these representations are easily adaptable. The presence of measurable performance tradeoffs in both layered and parallel networks has implications for understanding the behavior of a wide variety of natural and artificial learning systems.
| S-EPMC3127797 | biostudies-literature
Project description:Most humans have the good fortune to live their lives embedded in richly structured social groups. Yet, it remains unclear how humans acquire knowledge about these social structures to successfully navigate social relationships. Here we address this knowledge gap with an interdisciplinary neuroimaging study drawing on recent advances in network science and statistical learning. Specifically, we collected BOLD MRI data while participants learned the community structure of both social and non-social networks, in order to examine whether the learning of these two types of networks was differentially associated with functional brain network topology. We found that participants learned the community structure of the networks, as evidenced by a slower reaction time when a trial moved between communities than when a trial moved within a community. Learning the community structure of social networks was also characterized by significantly greater functional connectivity of the hippocampus and temporoparietal junction when transitioning between communities than when transitioning within a community. Furthermore, temporoparietal regions of the default mode were more strongly connected to hippocampus, somatomotor, and visual regions for social networks than for non-social networks. Collectively, our results identify neurophysiological underpinnings of social versus non-social network learning, extending our knowledge about the impact of social context on learning processes. More broadly, this work offers an empirical approach to study the learning of social network structures, which could be fruitfully extended to other participant populations, various graph architectures, and a diversity of social contexts in future studies.
| S-EPMC8740914 | biostudies-literature
Project description:Background?A national imperative to provide value-based care requires new strategies to teach clinicians about high-value care.Objective?We developed a virtual online learning network aimed at disseminating emerging strategies in teaching value-based care.Methods?The online Teaching Value in Health Care Learning Network includes monthly webinars that feature selected innovators, online discussion forums, and a repository for sharing tools. The learning network comprises clinician-educators and health system leaders across North America. We conducted a cross-sectional online survey of all webinar presenters and the active members of the network, and we assessed program feasibility.Results?Six months after the program launched, there were 277 learning community members in 22 US states. Of the 74 active members, 50 (68%) completed the evaluation. Active members represented independently practicing physicians and trainees in 7 specialties, nurses, educators, and health system leaders. Nearly all speakers reported that the learning network provided them with a unique opportunity to connect with a different audience and achieve greater recognition for their work. Of the members who were active in the learning network, most reported that strategies gleaned from the network were helpful, and some adopted or adapted these innovations at their home institutions. One year after the program launched, the learning network had grown to 364 total members.Conclusions?The learning network helped participants share and implement innovations to promote high-value care. The model can help disseminate innovations in emerging areas of health care transformation, and is sustainable without ongoing support after a period of start-up funding.
| S-EPMC5559249 | biostudies-literature
Project description:Familiarity of marketing stimuli may affect consumer behaviour at a peri-perceptual processing level. The current study introduces a method for deep learning of electroencephalogram (EEG) data using a spiking neural network (SNN) approach that reveals the complexity of peri-perceptual processes of familiarity. The method is applied to data from 20 participants viewing familiar and unfamiliar logos. The results support the potential of SNN models as novel tools in the exploration of peri-perceptual mechanisms that respond differentially to familiar and unfamiliar stimuli. Specifically, the activation pattern of the time-locked response identified by the proposed SNN model at approximately 200 milliseconds post-stimulus suggests greater connectivity and more widespread dynamic spatio-temporal patterns for familiar than unfamiliar logos. The proposed SNN approach can be applied to study other peri-perceptual or perceptual brain processes in cognitive and computational neuroscience.
| S-EPMC5995966 | biostudies-literature
Project description:Faced with a new concept to learn, our brain does not work in isolation. It uses all previously learned knowledge. In addition, the brain is able to isolate the knowledge that does not benefit us, and to use what is actually useful. In machine learning, we do not usually benefit from the knowledge of other learned tasks. However, there is a methodology called Multitask Learning (MTL), which is based on the idea that learning a task along with other related tasks produces a transfer of information between them, what can be advantageous for learning the first one. This paper presents a new method to completely design MTL architectures, by including the selection of the most helpful subtasks for the learning of the main task, and the optimal network connections. In this sense, the proposed method realizes a complete design of the MTL schemes. The method is simple and uses the advantages of the Extreme Learning Machine to automatically design a MTL machine, eliminating those factors that hinder, or do not benefit, the learning process of the main task. This architecture is unique and it is obtained without testing/error methodologies that increase the computational complexity. The results obtained over several real problems show the good performances of the designed networks with this method.
| S-EPMC5480319 | biostudies-other
Project description:While impairments in memory recall are apparent in aging, older adults show a remarkably preserved ability to selectively remember information deemed valuable. Here, we use fMRI to compare brain activation in healthy older and younger adults during encoding of high and low value words to determine whether there are differences in how older adults achieve value-directed memory selectivity. We find that memory selectivity in older adults is associated with value-related changes in activation during word presentation in left hemisphere regions that are involved in semantic processing, similar to young adults. However, highly selective young adults show a relatively greater increase in semantic network activity during encoding of high-value items, whereas highly selective older adults show relatively diminished activity during encoding of low-value items. Additionally, only younger adults showed value-related increases in activity in semantic and reward processing regions during presentation of the value cue preceding each to-be-remembered word. Young adults therefore respond to cue value more proactively than do older adults, yet the magnitude of value-related differences in cue period brain activity did not predict individual differences in memory selectivity. Thus, our data also show that age-related reductions in prestimulus activity do not always lead to inefficient performance.
| S-EPMC4794448 | biostudies-literature
Project description:Our decisions are guided by information learnt from our environment. This information may come via personal experiences of reward, but also from the behaviour of social partners. Social learning is widely held to be distinct from other forms of learning in its mechanism and neural implementation; it is often assumed to compete with simpler mechanisms, such as reward-based associative learning, to drive behaviour. Recently, neural signals have been observed during social exchange reminiscent of signals seen in studies of associative learning. Here we demonstrate that social information may be acquired using the same associative processes assumed to underlie reward-based learning. We find that key computational variables for learning in the social and reward domains are processed in a similar fashion, but in parallel neural processing streams. Two neighbouring divisions of the anterior cingulate cortex were central to learning about social and reward-based information, and for determining the extent to which each source of information guides behaviour. When making a decision, however, the information learnt using these parallel streams was combined within ventromedial prefrontal cortex. These findings suggest that human social valuation can be realized by means of the same associative processes previously established for learning other, simpler, features of the environment.
| S-EPMC2605577 | biostudies-literature
Project description:Brain connectivity shows protracted development throughout childhood and adolescence, and, as such, the topology of brain networks changes during this period. The complexity of these changes with development is reflected by regional differences in maturation. This study explored age-related changes in network topology and regional developmental patterns during childhood and adolescence. We acquired two sets of Diffusion Weighted Imaging-scans and anatomical T1-weighted scans. The first dataset included 85 typically developing individuals (53 males; 32 females), aged between 7 and 23 years and was acquired on a Philips Achieva 1.5 Tesla scanner. A second dataset (N?=?38) was acquired on a different (but identical) 1.5 T scanner and was used for independent replication of our results. We reconstructed whole brain networks using tractography. We operationalized fiber tract development as changes in mean diffusivity and radial diffusivity with age. Most fibers showed maturational changes in mean and radial diffusivity values throughout childhood and adolescence, likely reflecting increasing white matter integrity. The largest age-related changes were observed in association fibers within and between the frontal and parietal lobes. Furthermore, there was a simultaneous age-related decrease in average path length (P?<?0.0001), increase in node strength (P?<?0.0001) as well as network clustering (P?=?0.001), which may reflect fine-tuning of topological organization. These results suggest a sequential maturational model where connections between unimodal regions strengthen in childhood, followed by connections from these unimodal regions to association regions, while adolescence is characterized by the strengthening of connections between association regions within the frontal and parietal cortex. Hum Brain Mapp 37:717-729, 2016. © 2015 Wiley Periodicals, Inc.
| S-EPMC6867575 | biostudies-literature
Project description:In recent years, deep learning models have demonstrated an inherently better ability to tackle non-linear classification tasks, due to advances in deep learning architectures. However, much remains to be achieved, especially in designing deep convolutional neural network (CNN) configurations. The number of hyper-parameters that need to be optimized to achieve accuracy in classification problems increases with every layer used, and the selection of kernels in each CNN layer has an impact on the overall CNN performance in the training stage, as well as in the classification process. When a popular classifier fails to perform acceptably in practical applications, it may be due to deficiencies in the algorithm and data processing. Thus, understanding the feature extraction process provides insights to help optimize pre-trained architectures, better generalize the models, and obtain the context of each layer's features. In this work, we aim to improve feature extraction through the use of a texture amortization map (TAM). An algorithm was developed to obtain characteristics from the filters amortizing the filter's effect depending on the texture of the neighboring pixels. From the initial algorithm, a novel geometric classification score (GCS) was developed, in order to obtain a measure that indicates the effect of one class on another in a classification problem, in terms of the complexity of the learnability in every layer of the deep learning architecture. For this, we assume that all the data transformations in the inner layers still belong to a Euclidean space. In this scenario, we can evaluate which layers provide the best transformations in a CNN, allowing us to reduce the weights of the deep learning architecture using the geometric hypothesis.
| S-EPMC8870362 | biostudies-literature