Dataset Information

Visual behavior modelling for robotic theory of mind.

ABSTRACT: Behavior modeling is an essential cognitive ability that underlies many aspects of human and animal social behavior (Watson in Psychol Rev 20:158, 1913), and an ability we would like to endow robots. Most studies of machine behavior modelling, however, rely on symbolic or selected parametric sensory inputs and built-in knowledge relevant to a given task. Here, we propose that an observer can model the behavior of an actor through visual processing alone, without any prior symbolic information and assumptions about relevant inputs. To test this hypothesis, we designed a non-verbal non-symbolic robotic experiment in which an observer must visualize future plans of an actor robot, based only on an image depicting the initial scene of the actor robot. We found that an AI-observer is able to visualize the future plans of the actor with 98.5% success across four different activities, even when the activity is not known a-priori. We hypothesize that such visual behavior modeling is an essential cognitive ability that will allow machines to understand and coordinate with surrounding agents, while sidestepping the notorious symbol grounding problem. Through a false-belief test, we suggest that this approach may be a precursor to Theory of Mind, one of the distinguishing hallmarks of primate social cognition.

SUBMITTER: Chen B

PROVIDER: S-EPMC7801744 | biostudies-literature | 2021 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Visual behavior modelling for robotic theory of mind.

Chen Boyuan B Vondrick Carl C Lipson Hod H

Scientific reports 20210111 1

Behavior modeling is an essential cognitive ability that underlies many aspects of human and animal social behavior (Watson in Psychol Rev 20:158, 1913), and an ability we would like to endow robots. Most studies of machine behavior modelling, however, rely on symbolic or selected parametric sensory inputs and built-in knowledge relevant to a given task. Here, we propose that an observer can model the behavior of an actor through visual processing alone, without any prior symbolic information an ...[more]

PMID: 33431917

Similar Datasets

Project description:Background: Several meta-analyses highlight pronounced problems in general Theory of Mind (ToM), the ability to infer other persons' mental states, in patients with psychosis in comparison to non-clinical controls. In addition, first studies suggest associations between Hyper-ToM, an exaggerated inference of mental states to others, and delusions. Research on different ToM subtypes (Cognitive ToM, Affective ToM, and Hyper-ToM) and symptom clusters of psychosis (positive, negative, and disorganized symptoms) have gathered conflicting findings. Thus, the present study examined group differences between patients with psychosis and non-clinical controls concerning Cognitive ToM/Affective ToM and Hyper-ToM. Further, the association between ToM subtypes and symptom clusters (positive, negative, and disorganized symptoms) were examined. Methods: Patients with psychotic disorders (n = 64, 1/3 with present delusions indicated by a minimum score of four in the PANSS P1 item) and non-clinical controls (n = 21) were examined with assessments of Cognitive ToM and Affective ToM abilities and Hyper-ToM errors using the Frith-Happé animations. Psychopathology was assessed using the Positive and Negative Syndrome Scale. Results: Patients with psychosis presented more pronounced problems in Cognitive and Affective ToM in comparison to non-clinical controls, whereas there were no group differences with regard to Hyper-ToM errors. Furthermore, deficits in Cognitive ToM were associated with general delusions, whereas problems in Affective ToM were associated with negative and disorganized symptoms. In addition, there was no association between Hyper-ToM errors and any symptoms when controlling for years of education. Conclusions: Our findings suggest that deficits in ToM subtypes might not be directly related to delusions and positive symptoms and are in line with more recently developed cognitive models of delusions. In addition, our results support the well-established finding of associations between ToM alterations and negative or disorganized symptoms. Our results shed light on the role of different dimensions of ToM in specific symptoms of psychosis.

Dataset Information

Visual behavior modelling for robotic theory of mind.

Publications

Visual behavior modelling for robotic theory of mind.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets