Dataset Information

Unimodal statistical learning produces multimodal object-like representations.

ABSTRACT: The concept of objects is fundamental to cognition and is defined by a consistent set of sensory properties and physical affordances. Although it is unknown how the abstract concept of an object emerges, most accounts assume that visual or haptic boundaries are crucial in this process. Here, we tested an alternative hypothesis that boundaries are not essential but simply reflect a more fundamental principle: consistent visual or haptic statistical properties. Using a novel visuo-haptic statistical learning paradigm, we familiarised participants with objects defined solely by across-scene statistics provided either visually or through physical interactions. We then tested them on both a visual familiarity and a haptic pulling task, thus measuring both within-modality learning and across-modality generalisation. Participants showed strong within-modality learning and 'zero-shot' across-modality generalisation which were highly correlated. Our results demonstrate that humans can segment scenes into objects, without any explicit boundary cues, using purely statistical information.

SUBMITTER: Lengyel G

PROVIDER: S-EPMC6529220 | biostudies-literature | 2019 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Unimodal statistical learning produces multimodal object-like representations.

Lengyel Gábor G Žalalytė Goda G Pantelides Alexandros A Ingram James N JN Fiser József J Lengyel Máté M Wolpert Daniel M DM

eLife 20190501

The concept of objects is fundamental to cognition and is defined by a consistent set of sensory properties and physical affordances. Although it is unknown how the abstract concept of an object emerges, most accounts assume that visual or haptic boundaries are crucial in this process. Here, we tested an alternative hypothesis that boundaries are not essential but simply reflect a more fundamental principle: consistent visual or haptic statistical properties. Using a novel visuo-haptic statistic ...[more]

PMID: 31042148

Similar Datasets

Project description:Language comprehension involves multiple hierarchical processing stages across time, space, and levels of representation. When processing a word, the sensory input is transformed into increasingly abstract representations that need to be integrated with the linguistic context. Thus, language comprehension involves both input-driven as well as context-dependent processes. While neuroimaging research has traditionally focused on mapping individual brain regions to the distinct underlying processes, recent studies indicate that whole-brain distributed patterns of cortical activation might be highly relevant for cognitive functions, including language. One such pattern, based on resting-state connectivity, is the 'principal cortical gradient', which dissociates sensory from heteromodal brain regions. The present study investigated the extent to which this gradient provides an organizational principle underlying language function, using a multimodal neuroimaging dataset of functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG) recordings from 102 participants during sentence reading. We found that the brain response to individual representations of a word (word length, orthographic distance, and word frequency), which reflect visual; orthographic; and lexical properties, gradually increases towards the sensory end of the gradient. Although these properties showed opposite effect directions in fMRI and MEG, their association with the sensory end of the gradient was consistent across both neuroimaging modalities. In contrast, MEG revealed that properties reflecting a word's relation to its linguistic context (semantic similarity and position within the sentence) involve the heteromodal end of the gradient to a stronger extent. This dissociation between individual word and contextual properties was stable across earlier and later time windows during word presentation, indicating interactive processing of word representations and linguistic context at opposing ends of the principal gradient. To conclude, our findings indicate that the principal gradient underlies the organization of a range of linguistic representations while supporting a gradual distinction between context-independent and context-dependent representations. Furthermore, the gradient reveals convergent patterns across neuroimaging modalities (similar location along the gradient) in the presence of divergent responses (opposite effect directions).

Project description:Recent experience identifying objects leads to later improvements in both speed and accuracy ("repetition priming"), along with simultaneous reductions of neural activity ("repetition suppression"). A popular interpretation of these joint behavioral and neural phenomena is that object representations become perceptually "sharper" with stimulus repetition, eliminating cells that are poorly stimulus-selective and responsive and reducing support for competing representations downstream. Here, we test this hypothesis in an fMRI-adaptation experiment using pictures of objects. Prior to fMRI, participants repeatedly named a set of object pictures. During fMRI, participants viewed adaptation sequences composed of rapidly repeated objects (3-6 repetitions over several seconds) that were either named previously or that were new for the fMRI session, followed by single "deviant" object pictures used to measure recovery from adaptation and that shared a relationship to the adapted picture (a different exemplar of the same object, a conceptual associate, or an unrelated picture). Effects of adaptation and recovery were found throughout visually responsive brain regions. Occipitotemporal cortical regions displayed repetition suppression to previously named relative to new adapters but failed to exhibit pronounced changes in neural tuning. In contrast, changes in the slope of the recovery curves were found in the left lateral prefrontal cortex: Greater residual adaptation was observed to exemplar stimuli and conceptual associates following previously named adapting stimuli, consistent with greater rather than reduced neural overlap among representations of conceptually related objects. Furthermore, this change in neural tuning was directly related to the proportion of conceptual errors made by participants in the naming sessions pre- and post-fMRI, establishing that the experience-dependent conceptual broadening of object representations seen in fMRI is also manifest in behavior. In a follow-up behavioral experiment, we further show that recent naming experience leads to greater semantic priming when using the previously named pictures as briefly presented primes. Taken together, our results fail to support perceptual sharpening as the primary mediator between repetition suppression and behavioral priming at durations typically used to study priming and instead highlight an experience-dependent broadening of conceptual representations. We suggest that alternative mechanisms, such as increases in neural synchronization, are more promising in explaining priming in the face of repetition suppression.

Dataset Information

Unimodal statistical learning produces multimodal object-like representations.

Publications

Unimodal statistical learning produces multimodal object-like representations.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets