Dataset Information

A Cognitive Neural Architecture Able to Learn and Communicate through Natural Language.

ABSTRACT: Communicative interactions involve a kind of procedural knowledge that is used by the human brain for processing verbal and nonverbal inputs and for language production. Although considerable work has been done on modeling human language abilities, it has been difficult to bring them together to a comprehensive tabula rasa system compatible with current knowledge of how verbal information is processed in the brain. This work presents a cognitive system, entirely based on a large-scale neural architecture, which was developed to shed light on the procedural knowledge involved in language elaboration. The main component of this system is the central executive, which is a supervising system that coordinates the other components of the working memory. In our model, the central executive is a neural network that takes as input the neural activation states of the short-term memory and yields as output mental actions, which control the flow of information among the working memory components through neural gating mechanisms. The proposed system is capable of learning to communicate through natural language starting from tabula rasa, without any a priori knowledge of the structure of phrases, meaning of words, role of the different classes of words, only by interacting with a human through a text-based interface, using an open-ended incremental learning process. It is able to learn nouns, verbs, adjectives, pronouns and other word classes, and to use them in expressive language. The model was validated on a corpus of 1587 input sentences, based on literature on early language assessment, at the level of about 4-years old child, and produced 521 output sentences, expressing a broad range of language processing functionalities.

SUBMITTER: Golosio B

PROVIDER: S-EPMC4641699 | biostudies-literature | 2015

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Cognitive Neural Architecture Able to Learn and Communicate through Natural Language.

Golosio Bruno B Cangelosi Angelo A Gamotina Olesya O Masala Giovanni Luca GL

PloS one 20151111 11

Communicative interactions involve a kind of procedural knowledge that is used by the human brain for processing verbal and nonverbal inputs and for language production. Although considerable work has been done on modeling human language abilities, it has been difficult to bring them together to a comprehensive tabula rasa system compatible with current knowledge of how verbal information is processed in the brain. This work presents a cognitive system, entirely based on a large-scale neural arc ...[more]

PMID: 26560154

Similar Datasets

Project description:The cognitive approach to psychotherapy aims to change patients' maladaptive schemas, that is, overly negative views on themselves, the world, or the future. To obtain awareness of these views, they record their thought processes in situations that caused pathogenic emotional responses. The schemas underlying such thought records have, thus far, been largely manually identified. Using recent advances in natural language processing, we take this one step further by automatically extracting schemas from thought records. To this end, we asked 320 healthy participants on Amazon Mechanical Turk to each complete five thought records consisting of several utterances reflecting cognitive processes. Agreement between two raters on manually scoring the utterances with respect to how much they reflect each schema was substantial (Cohen's κ = 0.79). Natural language processing software pretrained on all English Wikipedia articles from 2014 (GLoVE embeddings) was used to represent words and utterances, which were then mapped to schemas using k-nearest neighbors algorithms, support vector machines, and recurrent neural networks. For the more frequently occurring schemas, all algorithms were able to leverage linguistic patterns. For example, the scores assigned to the Competence schema by the algorithms correlated with the manually assigned scores with Spearman correlations ranging between 0.64 and 0.76. For six of the nine schemas, a set of recurrent neural networks trained separately for each of the schemas outperformed the other algorithms. We present our results here as a benchmark solution, since we conducted this research to explore the possibility of automatically processing qualitative mental health data and did not aim to achieve optimal performance with any of the explored models. The dataset of 1600 thought records comprising 5747 utterances is published together with this article for researchers and machine learning enthusiasts to improve upon our outcomes. Based on our promising results, we see further opportunities for using free-text input and subsequent natural language processing in other common therapeutic tools, such as ecological momentary assessments, automated case conceptualizations, and, more generally, as an alternative to mental health scales.

Project description:In order to gain a better understanding of aphasia one must consider the complex combinations of language impairments along with the pattern of paraphasias. Despite the fact that both deficits and paraphasias feature in diagnostic criteria, most research has focused only on the lesion correlates of language deficits, with minimal attention on the pattern of patients' paraphasias. In this study, we used a data-driven approach (principal component analysis - PCA) to fuse patient impairments and their pattern of errors into one unified model of chronic post-stroke aphasia. This model was subsequently mapped onto the patients' lesion profiles to generate the triangulation of language-cognitive impairments, naming errors and their neural correlates. Specifically, we established the pattern of co-occurrence between fifteen error types, which avoids focussing on a subset of errors or the use of experimenter-derived methods to combine across error types. We obtained five principal components underlying the patients' errors: omission errors; semantically-related responses; phonologically-related responses; dysfluent responses; and a combination of circumlocutions with mixed errors. In the second step, we aligned these paraphasia-related principal components with the patients' performance on a detailed language and cognitive assessment battery, utilising an additional PCA. This omnibus PCA revealed seven unique fused impairment-paraphasia factors: output phonology; semantics; phonological working memory; speech quanta; executive-cognitive skill; phonological (input) discrimination; and the production of circumlocution errors. In doing so we were able to resolve the complex relationships between error types and impairments. Some are relatively straightforward: circumlocution errors formed their own independent factor; there was a one-to-one mapping for phonological errors with expressive phonological abilities and for dysfluent errors with speech fluency. In contrast, omission-type errors loaded across both semantic and phonological working memory factors, whilst semantically-related errors had the most complex relationship by loading across four factors (phonological ability, speech quanta, executive-cognitive skills and circumlocution-type errors). Three components had unique lesion correlates: phonological working memory with the primary auditory region; semantics with the anterior temporal region; and fluency with the pre-central gyrus, converging with existing literature. In conclusion, the data-driven approach allowed derivation of the triangulation of deficits, error types and lesion correlates in post-stroke aphasia.

Dataset Information

A Cognitive Neural Architecture Able to Learn and Communicate through Natural Language.

Publications

A Cognitive Neural Architecture Able to Learn and Communicate through Natural Language.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets