Unknown

Dataset Information

0

Generic decoding of seen and imagined objects using hierarchical visual features.


ABSTRACT: Object recognition is a key function in both human and machine vision. While brain decoding of seen and imagined objects has been achieved, the prediction is limited to training examples. We present a decoding approach for arbitrary objects using the machine vision principle that an object category is represented by a set of features rendered invariant through hierarchical processing. We show that visual features, including those derived from a deep convolutional neural network, can be predicted from fMRI patterns, and that greater accuracy is achieved for low-/high-level features with lower-/higher-level visual areas, respectively. Predicted features are used to identify seen/imagined object categories (extending beyond decoder training) from a set of computed features for numerous object images. Furthermore, decoding of imagined objects reveals progressive recruitment of higher-to-lower visual representations. Our results demonstrate a homology between human and machine vision and its utility for brain-based information retrieval.

SUBMITTER: Horikawa T 

PROVIDER: S-EPMC5458127 | biostudies-literature | 2017 May

REPOSITORIES: biostudies-literature

altmetric image

Publications

Generic decoding of seen and imagined objects using hierarchical visual features.

Horikawa Tomoyasu T   Kamitani Yukiyasu Y  

Nature communications 20170522


Object recognition is a key function in both human and machine vision. While brain decoding of seen and imagined objects has been achieved, the prediction is limited to training examples. We present a decoding approach for arbitrary objects using the machine vision principle that an object category is represented by a set of features rendered invariant through hierarchical processing. We show that visual features, including those derived from a deep convolutional neural network, can be predicted  ...[more]

Similar Datasets

| S-EPMC5322156 | biostudies-literature
| S-EPMC8375770 | biostudies-literature
| S-EPMC3772685 | biostudies-literature
| S-EPMC7027440 | biostudies-literature
| S-EPMC5725244 | biostudies-literature
| S-EPMC6245740 | biostudies-literature
| S-EPMC5664511 | biostudies-literature
| S-EPMC4141282 | biostudies-literature
| S-EPMC8618393 | biostudies-literature
| S-EPMC1885275 | biostudies-literature