Browse
Submit Data
Databases
API
Help

Dataset Information

19 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Computational discrimination between natural images based on gaze during mental imagery.

ABSTRACT: When retrieving image from memory, humans usually move their eyes spontaneously as if the image were in front of them. Such eye movements correlate strongly with the spatial layout of the recalled image content and function as memory cues facilitating the retrieval procedure. However, how close the correlation is between imagery eye movements and the eye movements while looking at the original image is unclear so far. In this work we first quantify the similarity of eye movements between recalling an image and encoding the same image, followed by the investigation on whether comparing such pairs of eye movements can be used for computational image retrieval. Our results show that computational image retrieval based on eye movements during spontaneous imagery is feasible. Furthermore, we show that such a retrieval approach can be generalized to unseen images.

SUBMITTER: Wang X

PROVIDER: S-EPMC7400610 | biostudies-literature | 2020 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Computational discrimination between natural images based on gaze during mental imagery.

Wang Xi X Ley Andreas A Koch Sebastian S Hays James J Holmqvist Kenneth K Alexa Marc M

Scientific reports 20200803 1

When retrieving image from memory, humans usually move their eyes spontaneously as if the image were in front of them. Such eye movements correlate strongly with the spatial layout of the recalled image content and function as memory cues facilitating the retrieval procedure. However, how close the correlation is between imagery eye movements and the eye movements while looking at the original image is unclear so far. In this work we first quantify the similarity of eye movements between recalli ...[more]

PMID: 32747683

Similar Datasets

Defocus blur discrimination in natural images with natural optics.

Project description:The lens system in the human eye is able to best focus light from only one distance at a time.Therefore, many objects in the natural environment are not imaged sharply on the retina. Furthermore, light from objects in the environment is subject to the particular aberrations of the observer's lens system (e.g., astigmatism and chromatic aberration). We refer to blur created by the observer's optics as "natural" or "defocus" blur as opposed to "on-screen" blur created by software on a display screen. Although blur discrimination has been studied extensively, human ability to discriminate defocus blur in images of natural scenes has not been systematically investigated. Here, we measured discrimination of defocus blur for a collection of natural image patches, sampled from well-focused photographs. We constructed a rig capable of presenting stimuli at three physical distances simultaneously. In Experiment 1, subjects viewed monocularly two simultaneously presented natural image patches through a 4-mm artificial pupil at ±1° eccentricity. The task was to identify the sharper patch. Discrimination thresholds varied substantially between stimuli but were correlated between subjects. The lowest thresholds were at or below the lowest thresholds ever reported. In a second experiment, we paralyzed accommodation and retested a subset of conditions from Experiment 1. A third experiment showed that removing contrast as a cue to defocus blur had only a modest effect on thresholds. Finally, we describe a simple masking model and evaluate how well it can explain our experimental results and the results from previous blur discrimination experiments.

| S-EPMC4419382 | biostudies-other

Discrimination between metastasis and glioblastoma multiforme based on morphometric analysis of MR images.

Project description:Background and purposeSolitary MET and GBM are difficult to distinguish by using MR imaging. Differentiation is useful before any metastatic work-up or biopsy. Our hypothesis was that MET and GBM tumors differ in morphology. Shape analysis was proposed as an indicator for discriminating these 2 types of brain pathologies. The purpose of this study was to evaluate the accuracy of this approach in the discrimination of GBMs and brain METs.Materials and methodsThe dataset consisted of 33 brain MR imaging sets of untreated patients, of which 18 patients were diagnosed as having a GBM and 15 patients, as having solitary metastatic brain tumor. The MR imaging was segmented by using the K-means algorithm. The resulting set of classes (also called "clusters") represented the variety of tissues observed. A morphology-based approach allowed discrimination of the 2 types of tumors. This approach was validated by a leave-1-patient-out procedure.ResultsA method was developed for the discrimination of GBMs and solitary METs. Two masses out of 33 were wrongly classified; the overall results were accurate in 93.9% of the observed cases.ConclusionsA semiautomated method based on a morphologic analysis was developed. Its application was found to be useful in the discrimination of GBM from solitary MET.

| S-EPMC7964969 | biostudies-literature

Decoding individual natural scene representations during perception and imagery.

Project description:We used a multi-voxel classification analysis of functional magnetic resonance imaging (fMRI) data to determine to what extent item-specific information about complex natural scenes is represented in several category-selective areas of human extrastriate visual cortex during visual perception and visual mental imagery. Participants in the scanner either viewed or were instructed to visualize previously memorized natural scene exemplars, and the neuroimaging data were subsequently subjected to a multi-voxel pattern analysis (MVPA) using a support vector machine (SVM) classifier. We found that item-specific information was represented in multiple scene-selective areas: the occipital place area (OPA), parahippocampal place area (PPA), retrosplenial cortex (RSC), and a scene-selective portion of the precuneus/intraparietal sulcus region (PCu/IPS). Furthermore, item-specific information from perceived scenes was re-instantiated during mental imagery of the same scenes. These results support findings from previous decoding analyses for other types of visual information and/or brain areas during imagery or working memory, and extend them to the case of visual scenes (and scene-selective cortex). Taken together, such findings support models suggesting that reflective mental processes are subserved by the re-instantiation of perceptual information in high-level visual cortex. We also examined activity in the fusiform face area (FFA) and found that it, too, contained significant item-specific scene information during perception, but not during mental imagery. This suggests that although decodable scene-relevant activity occurs in FFA during perception, FFA activity may not be a necessary (or even relevant) component of one's mental representation of visual scenes.

| S-EPMC3921604 | biostudies-other

Reading the mind's eye: decoding category information during mental imagery.

Project description:Category information for visually presented objects can be read out from multi-voxel patterns of fMRI activity in ventral-temporal cortex. What is the nature and reliability of these patterns in the absence of any bottom-up visual input, for example, during visual imagery? Here, we first ask how well category information can be decoded for imagined objects and then compare the representations evoked during imagery and actual viewing. In an fMRI study, four object categories (food, tools, faces, buildings) were either visually presented to subjects, or imagined by them. Using pattern classification techniques, we could reliably decode category information (including for non-special categories, i.e., food and tools) from ventral-temporal cortex in both conditions, but only during actual viewing from retinotopic areas. Interestingly, in temporal cortex when the classifier was trained on the viewed condition and tested on the imagery condition, or vice versa, classification performance was comparable to within the imagery condition. The above results held even when we did not use information in the specialized category-selective areas. Thus, the patterns of representation during imagery and actual viewing are in fact surprisingly similar to each other. Consistent with this observation, the maps of "diagnostic voxels" (i.e., the classifier weights) for the perception and imagery classifiers were more similar in ventral-temporal cortex than in retinotopic cortex. These results suggest that in the absence of any bottom-up input, cortical back projections can selectively re-activate specific patterns of neural activity.

| S-EPMC2823980 | biostudies-literature

Neural tracking of speech mental imagery during rhythmic inner counting.

Project description:The subjective inner experience of mental imagery is among the most ubiquitous human experiences in daily life. Elucidating the neural implementation underpinning the dynamic construction of mental imagery is critical to understanding high-order cognitive function in the human brain. Here, we applied a frequency-tagging method to isolate the top-down process of speech mental imagery from bottom-up sensory-driven activities and concurrently tracked the neural processing time scales corresponding to the two processes in human subjects. Notably, by estimating the source of the magnetoencephalography (MEG) signals, we identified isolated brain networks activated at the imagery-rate frequency. In contrast, more extensive brain regions in the auditory temporal cortex were activated at the stimulus-rate frequency. Furthermore, intracranial stereotactic electroencephalogram (sEEG) evidence confirmed the participation of the inferior frontal gyrus in generating speech mental imagery. Our results indicate that a disassociated neural network underlies the dynamic construction of speech mental imagery independent of auditory perception.

| S-EPMC6805153 | biostudies-literature

Effects of Gaze Fixation on the Performance of a Motor Imagery-Based Brain-Computer Interface.

Project description:Motor imagery-based brain-computer interfaces (BCIs) have been studied without controlling subjects' gaze fixation position previously. The effect of gaze fixation and covert attention on the behavioral performance of BCI is still unknown. This study designed a gaze fixation controlled experiment. Subjects were required to conduct a secondary task of gaze fixation when performing the primary task of motor imagination. Subjects' performance was analyzed according to the relationship between motor imagery target and the gaze fixation position, resulting in three BCI control conditions, i.e., congruent, incongruent, and center cross trials. A group of fourteen subjects was recruited. The average group performances of three different conditions did not show statistically significant differences in terms of BCI control accuracy, feedback duration, and trajectory length. Further analysis of gaze shift response time revealed a significantly shorter response time for congruent trials compared to incongruent trials. Meanwhile, the parietal occipital cortex also showed active neural activities for congruent and incongruent trials, and this was revealed by a contrast analysis of R-square values and lateralization index. However, the lateralization index computed from the parietal and occipital areas was not correlated with the BCI behavioral performance. Subjects' BCI behavioral performance was not affected by the position of gaze fixation and covert attention. This indicated that motor imagery-based BCI could be used freely in robotic arm control without sacrificing performance.

| S-EPMC8818858 | biostudies-literature

Aberrant activation of the mentalizing brain system during eye gaze discrimination in bipolar disorder.

Project description:Bipolar disorder (BD) is associated with a range of social cognitive deficits. This study investigated the functioning of the mentalizing brain system in BD probed by an eye gaze perception task during fMRI. Compared with healthy controls (n = 21), BD participants (n = 14) showed reduced preferential activation for self-directed gaze discrimination in the medial prefrontal cortex (mPFC) and temporo-parietal junction (TPJ), which was associated with poorer cognition/social cognition. Aberrant functions of the mentalizing system should be further investigated as marker of social dysfunction and treatment targets.

| S-EPMC8387449 | biostudies-literature

Exploring the relationship between grapheme colour-picking consistency and mental imagery.

Project description:Previous research has indicated a potential link between mental imagery and synaesthesia. However, these findings are mainly based on imagery self-report measures and recruitment of self-selected synaesthetes. To avoid issues of self-selection and demand effects, we recruited participants from the general population, rather than synaesthetes specifically, and used colour-picking consistency tests for letters and numbers to assess a 'synaesthete-like' experience. Mental imagery ability and mental rotation ability were assessed using both self-report measures and behavioural assessments. Consistency in colour-picking for letters (but not numbers) was predicted by performance on the visual mental imagery task but not by a mental rotation task or self-report measures. Using the consistency score as a proxy measure of grapheme-colour synaesthesia, we provide more evidence for the suggestion that synaesthetic experience is associated with enhanced mental imagery, even when participants are naive to the research topic. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

| S-EPMC6834015 | biostudies-literature

The creative interplay between hand gestures, convergent thinking, and mental imagery.

Project description:Using hand gestures benefits children's divergent thinking and enhances verbal improvisation in adults. In the present study, we asked whether gestures were also associated with convergent thinking by activating individuals' verbal lexicon and maintaining their visuospatial imagery. We tested young adults on verbal and visual convergent thinking, controlling for their mental imagery skills. Results showed that gestures and mental imagery skills play a role in verbal but not visual convergent thinking. Regardless of whether gestures were spontaneous or encouraged, we found a negative association between overall gesture frequency and verbal convergent thinking or individuals with low mental imagery, and a positive association for individuals with high mental imagery. Representational gestures benefited verbal convergent thinking for everyone except those who had low mental imagery and no experience with the task. Performing beat gestures hampered verbal convergent thinking in people with lower mental imagery capacity and helped those who had high mental imagery and previous experience with the task. We also found that gesturing can benefit people with lower verbal abilities on verbal convergent thinking, however, high spatial imagery abilities were required for gestures to boost verbal convergent thinking. The current study adds a new dimension to both the embodied creativity literature and the kaleidoscope of individual differences in gesture research.

| S-EPMC10079032 | biostudies-literature

Learning Process of Gaze Following: Computational Modeling Based on Reinforcement Learning.

Project description:Many studies have explored factors which influence gaze-following behavior of young infants. However, the results of empirical studies were inconsistent, and the mechanism underlying the contextual modulation of gaze following remains unclear. In order to provide valuable insight into the mechanisms underlying gaze following, we conducted computational modeling using Q-learning algorithm and simulated the learning process of infant gaze following to suggest a feasible model. In Experiment 1, we simulated how communicative cues and infant internal states affect the learning process of gaze following. The simulation indicated that the model in which communicative cues enhance infant internal states is the most feasible to explain the infant learning process. In Experiment 2, we simulated how individual differences in motivation for communication affect the learning process. The results showed that low motivation for communication can delay the learning process and decrease the frequency of gaze following. These simulations suggest that communicative cues may enhance infants' internal states and promote the development of gaze following. Also, initial social motivation may affect the learning process of social behaviors in the long term.

| S-EPMC7063100 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data