Dataset Information

Visual dictionaries as intermediate features in the human brain.

ABSTRACT: The human visual system is assumed to transform low level visual features to object and scene representations via features of intermediate complexity. How the brain computationally represents intermediate features is still unclear. To further elucidate this, we compared the biologically plausible HMAX model and Bag of Words (BoW) model from computer vision. Both these computational models use visual dictionaries, candidate features of intermediate complexity, to represent visual scenes, and the models have been proven effective in automatic object and scene recognition. These models however differ in the computation of visual dictionaries and pooling techniques. We investigated where in the brain and to what extent human fMRI responses to short video can be accounted for by multiple hierarchical levels of the HMAX and BoW models. Brain activity of 20 subjects obtained while viewing a short video clip was analyzed voxel-wise using a distance-based variation partitioning method. Results revealed that both HMAX and BoW explain a significant amount of brain activity in early visual regions V1, V2, and V3. However, BoW exhibits more consistency across subjects in accounting for brain activity compared to HMAX. Furthermore, visual dictionary representations by HMAX and BoW explain significantly some brain activity in higher areas which are believed to process intermediate features. Overall our results indicate that, although both HMAX and BoW account for activity in the human visual system, the BoW seems to more faithfully represent neural responses in low and intermediate level visual areas of the brain.

SUBMITTER: Ramakrishnan K

PROVIDER: S-EPMC4295527 | biostudies-literature | 2014

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Visual dictionaries as intermediate features in the human brain.

Ramakrishnan Kandan K Scholte H Steven HS Groen Iris I A II Smeulders Arnold W M AW Ghebreab Sennay S

Frontiers in computational neuroscience 20150115

The human visual system is assumed to transform low level visual features to object and scene representations via features of intermediate complexity. How the brain computationally represents intermediate features is still unclear. To further elucidate this, we compared the biologically plausible HMAX model and Bag of Words (BoW) model from computer vision. Both these computational models use visual dictionaries, candidate features of intermediate complexity, to represent visual scenes, and the ...[more]

PMID: 25642183

Similar Datasets

Project description:Background and objectives: Many brain-computer interfaces (BCIs) for people with severe disabilities present stimuli in the visual modality with little consideration of the visual skills required for successful use. The primary objective of this tutorial is to present researchers and clinical professionals with basic information about the visual skills needed for functional use of visual BCIs, and to offer modifications that would render BCI technology more accessible for persons with vision impairments.Methods: First, we provide a background on BCIs that rely on a visual interface. We then describe the visual skills required for BCI technologies that are used for augmentative and alternative communication (AAC), as well as common eye conditions or impairments that can impact the user's performance. We summarize screening tools that can be administered by the non-eye care professional in a research or clinical setting, as well as the role of the eye care professional. Finally, we explore potential BCI design modifications to compensate for identified functional impairments. Information was generated from literature review and the clinical experience of vision experts.Results and conclusions: This in-depth description culminates in foundational information about visual skills and functional visual impairments that affect the design and use of visual interfaces for BCI technologies. The visual interface is a critical component of successful BCI systems. We can determine a BCI system for potential users with visual impairments and design BCI visual interfaces based on sound anatomical and physiological visual clinical science.Implications for RehabilitationAs brain-computer interfaces (BCIs) become possible access methods for people with severe motor impairments, it is critical that clinicians have a basic knowledge of the visual skills necessary for use of visual BCI interfaces.Rehabilitation providers must have a knowledge of objectively gathering information regarding a potential BCI user's functional visual skills.Rehabilitation providers must understand how to modify BCI visual interfaces for the potential user with visual impairments.Rehabilitation scientists should understand the visual demands of BCIs as they develop and evaluate these new access methods.

Dataset Information

Visual dictionaries as intermediate features in the human brain.

Publications

Visual dictionaries as intermediate features in the human brain.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets