Dataset Information

Unimodal statistical learning produces multimodal object-like representations.

ABSTRACT: The concept of objects is fundamental to cognition and is defined by a consistent set of sensory properties and physical affordances. Although it is unknown how the abstract concept of an object emerges, most accounts assume that visual or haptic boundaries are crucial in this process. Here, we tested an alternative hypothesis that boundaries are not essential but simply reflect a more fundamental principle: consistent visual or haptic statistical properties. Using a novel visuo-haptic statistical learning paradigm, we familiarised participants with objects defined solely by across-scene statistics provided either visually or through physical interactions. We then tested them on both a visual familiarity and a haptic pulling task, thus measuring both within-modality learning and across-modality generalisation. Participants showed strong within-modality learning and 'zero-shot' across-modality generalisation which were highly correlated. Our results demonstrate that humans can segment scenes into objects, without any explicit boundary cues, using purely statistical information.

SUBMITTER: Lengyel G

PROVIDER: S-EPMC6529220 | biostudies-literature | 2019 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Unimodal statistical learning produces multimodal object-like representations.

Lengyel Gábor G Žalalytė Goda G Pantelides Alexandros A Ingram James N JN Fiser József J Lengyel Máté M Wolpert Daniel M DM

eLife 20190501

The concept of objects is fundamental to cognition and is defined by a consistent set of sensory properties and physical affordances. Although it is unknown how the abstract concept of an object emerges, most accounts assume that visual or haptic boundaries are crucial in this process. Here, we tested an alternative hypothesis that boundaries are not essential but simply reflect a more fundamental principle: consistent visual or haptic statistical properties. Using a novel visuo-haptic statistic ...[more]

PMID: 31042148

Similar Datasets

Project description:Recent experience identifying objects leads to later improvements in both speed and accuracy ("repetition priming"), along with simultaneous reductions of neural activity ("repetition suppression"). A popular interpretation of these joint behavioral and neural phenomena is that object representations become perceptually "sharper" with stimulus repetition, eliminating cells that are poorly stimulus-selective and responsive and reducing support for competing representations downstream. Here, we test this hypothesis in an fMRI-adaptation experiment using pictures of objects. Prior to fMRI, participants repeatedly named a set of object pictures. During fMRI, participants viewed adaptation sequences composed of rapidly repeated objects (3-6 repetitions over several seconds) that were either named previously or that were new for the fMRI session, followed by single "deviant" object pictures used to measure recovery from adaptation and that shared a relationship to the adapted picture (a different exemplar of the same object, a conceptual associate, or an unrelated picture). Effects of adaptation and recovery were found throughout visually responsive brain regions. Occipitotemporal cortical regions displayed repetition suppression to previously named relative to new adapters but failed to exhibit pronounced changes in neural tuning. In contrast, changes in the slope of the recovery curves were found in the left lateral prefrontal cortex: Greater residual adaptation was observed to exemplar stimuli and conceptual associates following previously named adapting stimuli, consistent with greater rather than reduced neural overlap among representations of conceptually related objects. Furthermore, this change in neural tuning was directly related to the proportion of conceptual errors made by participants in the naming sessions pre- and post-fMRI, establishing that the experience-dependent conceptual broadening of object representations seen in fMRI is also manifest in behavior. In a follow-up behavioral experiment, we further show that recent naming experience leads to greater semantic priming when using the previously named pictures as briefly presented primes. Taken together, our results fail to support perceptual sharpening as the primary mediator between repetition suppression and behavioral priming at durations typically used to study priming and instead highlight an experience-dependent broadening of conceptual representations. We suggest that alternative mechanisms, such as increases in neural synchronization, are more promising in explaining priming in the face of repetition suppression.

Project description:A number of studies have explored the role of associative/event-based (thematic) and categorical (taxonomic) relations in the organization of object representations. Recent evidence suggests that thematic information may be particularly important in determining relationships between manipulable artifacts. However, although sensorimotor information is on many accounts an important component of manipulable artifact representations, little is known about the role that action may play during the processing of semantic relationships (particularly thematic relationships) between multiple objects. In this study, we assessed healthy and left hemisphere stroke participants to explore three questions relevant to object relationship processing. First, we assessed whether participants tended to favor thematic relations including action (Th+A, e.g., wine bottle-corkscrew), thematic relationships without action (Th-A, e.g., wine bottle-cheese), or taxonomic relationships (Tax, e.g., wine bottle-water bottle) when choosing between them in an association judgment task with manipulable artifacts. Second, we assessed whether the underlying constructs of event relatedness, action relatedness, and categorical relatedness determined the choices that participants made. Third, we assessed the hypothesis that degraded action knowledge and/or damage to temporo-parietal cortex, a region of the brain associated with the representation of action knowledge, would reduce the influence of action on the choice task. Experiment 1 showed that explicit ratings of event, action, and categorical relatedness were differentially predictive of healthy participants' choices, with action relatedness determining choices between Th+A and Th-A associations above and beyond event and categorical ratings. Experiment 2 focused more specifically on these Th+A vs. Th-A choices and demonstrated that participants with left temporo-parietal lesions, a brain region known to be involved in sensorimotor processing, were less likely than controls and tended to be less likely than patients with lesions sparing that region to use action relatedness in determining their choices. These data indicate that action knowledge plays a critical role in processing of thematic relations for manipulable artifacts.

Dataset Information

Unimodal statistical learning produces multimodal object-like representations.

Publications

Unimodal statistical learning produces multimodal object-like representations.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets