View-tuned and view-invariant face encoding in IT cortex is explained by selected natural image fragments.
Ontology highlight
ABSTRACT:
SUBMITTER: Nam Y
PROVIDER: S-EPMC8035202 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Orientation selectivity is a fundamental property of primary visual encoding. High-level processing stages also show some form of orientation dependence, with face identification preferentially relying on horizontally-oriented information. How high-level orientation tuning emerges from primary orientation biases is unclear. In the same group of participants, we derived the orientation selectivity profile at primary and high-level visual processing stages using a contrast detection and an identity matching task. To capture the orientation selectivity profile, we calculated the difference in performance between all tested orientations (0, 45, 90, and 135°) for each task and for upright and inverted faces, separately. Primary orientation selectivity was characterized by higher sensitivity to oblique as compared to cardinal orientations. The orientation profile of face identification showed superior horizontal sensitivity to face identity. In each task, performance with upright and inverted faces projected onto qualitatively similar a priori models of orientation selectivity. Yet the fact that the orientation selectivity profiles of contrast detection in upright and inverted faces correlated significantly while such correlation was absent for identification indicates a progressive dissociation of orientation selectivity profiles from primary to high-level stages of orientation encoding. Bayesian analyses further indicate a lack of correlation between the orientation selectivity profiles in the contrast detection and face identification tasks, for upright and inverted faces. From these findings, we conclude that orientation selectivity shows distinct profiles at primary and high-level stages of face processing and that a transformation must occur from general cardinal attenuation when processing basic properties of the face image to horizontal tuning when encoding more complex properties such as identity.
| S-EPMC7080280 | biostudies-literature
Project description:Anxiety involves the anticipation of aversive outcomes and can impair neurocognitive processes, such as the ability to recall faces encoded during the anxious state. It is important to precisely delineate and determine the replicability of these effects using causal state anxiety inductions in the general population. This study therefore aimed to replicate prior research on the distinct impacts of threat-of-shock-induced anxiety on the encoding and recognition stage of emotional face processing, in a large asymptomatic sample (n = 92). We successfully replicated previous results demonstrating impaired recognition of faces encoded under threat-of-shock. This was supported by a mega-analysis across three independent studies using the same paradigm (n = 211). Underlying this, a whole-brain fMRI analysis revealed enhanced activation in the posterior cingulate cortex (PCC), alongside previously seen activity in the anterior cingulate cortex (ACC) when combined in a mega-analysis with the fMRI findings we aimed to replicate. We further found replications of hippocampus activation when the retrieval and encoding states were congruent. Our results support the notion that state anxiety disrupts face recognition, potentially due to attentional demands of anxious arousal competing with affective stimuli processing during encoding and suggest that regions of the cingulate cortex play pivotal roles in this.
| S-EPMC11343718 | biostudies-literature
Project description:Principles of a dynamic, dyadic systems view of mother-infant face-to-face communication, which considers self- and interactive processes in relation to one another, were tested. The process of interaction across time in a large low-risk community sample at infant age 4 months was examined. Split-screen videotape was coded on a 1-s time base for communication modalities of attention, affect, orientation, touch, and composite facial-visual engagement. Time-series approaches generated self- and interactive contingency estimates in each modality. Evidence supporting the following principles was obtained: (a) Significant moment-to-moment predictability within each partner (self-contingency) and between the partners (interactive contingency) characterizes mother-infant communication. (b) Interactive contingency is organized by a bidirectional, but asymmetrical, process: Maternal contingent coordination with infant is higher than infant contingent coordination with mother. (c) Self-contingency organizes communication to a far greater extent than interactive contingency. (d) Self- and interactive contingency processes are not separate; each affects the other in communication modalities of facial affect, facial-visual engagement, and orientation. Each person's self-organization exists in a dynamic, homoeostatic (negative feedback) balance with the degree to which the person coordinates with the partner. For example, those individuals who are less facially stable are likely to coordinate more strongly with the partner's facial affect and vice versa. Our findings support the concept that the dyad is a fundamental unit of analysis in the investigation of early interaction. Moreover, an individual's self-contingency is influenced by the way the individual coordinates with the partner. Our results imply that it is not appropriate to conceptualize interactive processes without simultaneously accounting for dynamically interrelated self-organizing processes.
| S-EPMC4808406 | biostudies-literature
Project description:One of the key challenges in facial recognition is multi-view face synthesis from a single face image. The existing generative adversarial network (GAN) deep learning methods have been proven to be effective in performing facial recognition with a set of pre-processing, post-processing and feature representation techniques to bring a frontal view into the same position in-order to achieve high accuracy face identification. However, these methods still perform relatively weak in generating high quality frontal-face image samples under extreme face pose scenarios. The novel framework architecture of the two-pathway generative adversarial network (TP-GAN), has made commendable progress in the face synthesis model, making it possible to perceive global structure and local details in an unsupervised manner. More importantly, the TP-GAN solves the problems of photorealistic frontal view synthesis by relying on texture details of the landmark detection and synthesis functions, which limits its ability to achieve the desired performance in generating high-quality frontal face image samples under extreme pose. We propose, in this paper, a landmark feature-based method (LFM) for robust pose-invariant facial recognition, which aims to improve image resolution quality of the generated frontal faces under a variety of facial poses. We therefore augment the existing TP-GAN generative global pathway with a well-constructed 2D face landmark localization to cooperate with the local pathway structure in a landmark sharing manner to incorporate empirical face pose into the learning process, and improve the encoder-decoder global pathway structure for better representation of facial image features by establishing robust feature extractors that select meaningful features that ease the operational workflow toward achieving a balanced learning strategy, thus significantly improving the photorealistic face image resolution. We verify the effectiveness of our proposed method on both Multi-PIE and FEI datasets. The quantitative and qualitative experimental results show that our proposed method not only generates high quality perceptual images under extreme poses but also significantly improves upon the TP-GAN results.
| S-EPMC9044338 | biostudies-literature
Project description:The Face Mask Wearing Image Dataset is a comprehensive collection of images aimed at facilitating research in the domain of face mask detection and classification. This dataset consists of 24,916 images, carefully categorized into two main folders: "Correct" and "Incorrect" representing instances of face masks being worn properly and improperly, respectively. Each folder is further divided into four subfolders, each denoting a specific type of face mask - Bandana, Cotton, N95, and Surgical. In the "Correct" folder, images depict individuals correctly wearing their respective face masks, while the "Incorrect" folder contains images of improper face mask usage. To capture variations in face mask application across different demographics, such as age and gender, each subfolder also includes three additional subfolders - Child, Male, and Female. The dataset's diverse content encompasses different face mask types, covering bandana-style, cloth, N95 respirators, and surgical masks, across various age groups and genders. This design ensures a comprehensive representation of real-world scenarios, enabling the evaluation of machine learning algorithms for face mask detection and classification. Researchers can leverage this dataset to develop and assess models that can accurately identify and distinguish between correct and incorrect face mask usage. By contributing to the advancement of face mask detection technologies, this dataset further supports public health initiatives and encourages proper mask-wearing behavior to mitigate the spread of infectious diseases, particularly during times of heightened health concerns such as the COVID-19 pandemic.
| S-EPMC10700517 | biostudies-literature
Project description:Women typically remember more female than male faces, whereas men do not show a reliable own-gender bias. However, little is known about the neural correlates of this own-gender bias in face recognition memory. Using functional magnetic resonance imaging (fMRI), we investigated whether face gender modulated brain activity in fusiform and inferior occipital gyri during incidental encoding of faces. Fifteen women and 14 men underwent fMRI while passively viewing female and male faces, followed by a surprise face recognition task. Women recognized more female than male faces and showed higher activity to female than male faces in individually defined regions of fusiform and inferior occipital gyri. In contrast, men's recognition memory and blood-oxygen-level-dependent response were not modulated by face gender. Importantly, higher activity in the left fusiform gyrus (FFG) to one gender was related to better memory performance for that gender. These findings suggest that the FFG is involved in the gender bias in memory for faces, which may be linked to differential experience with female and male faces.
| S-EPMC4090962 | biostudies-literature
Project description:We used source imaging of visual evoked potentials to measure neural population responses over a wide range of horizontal disparities (0.5-64 arcmin). The stimulus was a central disk that moved back and forth across the fixation plane at 2 Hz, surrounded either by binocularly uncorrelated dots (disparity noise) or by correlated dots presented in the fixation plane. Both disk and surround were composed of dynamic random dots to remove coherent monocular information. Disparity tuning was measured in five visual regions of interest (ROIs) [V1, human middle temporal area (hMT+), V4, lateral occipital complex (LOC), and V3A], defined in separate functional magnetic resonance imaging scans. The disparity tuning functions peaked between 2 and 16 arcmin for both types of surround in each ROI. Disparity tuning in the V1 ROI was unaffected by the type of surround, but surround correlation altered both the amplitude and phase of the disparity responses in the other ROIs. Response amplitude increased when the disk was in front of the surround in the V3A and LOC ROIs, indicating that these areas encode figure-ground relationships and object convexity. The correlated surround produced a consistent phase lag at the second harmonic in the hMT+ and V4 ROIs without a change in amplitude, while in the V3A ROI, both phase and amplitude effects were observed. Sensitivity to disparity context is thus widespread in visual cortex, but the dynamics of these contextual interactions differ across regions.
| S-EPMC3298090 | biostudies-literature
Project description:Multispectral palmprint recognition has shown broad prospects for personal identification due to its high accuracy and great stability. In this paper, we develop a novel illumination-invariant multispectral palmprint recognition method. To combine the information from multiple spectral bands, an image-level fusion framework is completed based on a fast and adaptive bidimensional empirical mode decomposition (FABEMD) and a weighted Fisher criterion. The FABEMD technique decomposes the multispectral images into their bidimensional intrinsic mode functions (BIMFs), on which an illumination compensation operation is performed. The weighted Fisher criterion is to construct the fusion coefficients at the decomposition level, making the images be separated correctly in the fusion space. The image fusion framework has shown strong robustness against illumination variation. In addition, a tensor-based extreme learning machine (TELM) mechanism is presented for feature extraction and classification of two-dimensional (2D) images. In general, this method has fast learning speed and satisfying recognition accuracy. Comprehensive experiments conducted on the PolyU multispectral palmprint database illustrate that the proposed method can achieve favorable results. For the testing under ideal illumination, the recognition accuracy is as high as 99.93%, and the result is 99.50% when the lighting condition is unsatisfied.
| S-EPMC5448787 | biostudies-literature
Project description:The classification performance of all-optical Convolutional Neural Networks (CNNs) is greatly influenced by components' misalignment and translation of input images in the practical applications. In this paper, we propose a free-space all-optical CNN (named Trans-ONN) which accurately classifies translated images in the horizontal, vertical, or diagonal directions. Trans-ONN takes advantages of an optical motion pooling layer which provides the translation invariance property by implementing different optical masks in the Fourier plane for classifying translated test images. Moreover, to enhance the translation invariance property, global average pooling (GAP) is utilized in the Trans-ONN structure, rather than fully connected layers. The comparative studies confirm that taking advantage of vertical and horizontal masks along GAP operation provide the best translation invariance property, compared to the alternative network models, for classifying horizontally and vertically shifted test images up to 50 pixel shifts of Kaggle Cats and Dogs, CIFAR-10, and MNIST datasets, respectively. Also, adopting the diagonal mask along GAP operation achieves the best classification accuracy for classifying translated test images in the diagonal direction for large number of pixel shifts (i.e. more than 30 pixel shifts). It is worth mentioning that the proposed translation invariant networks are capable of classifying the translated test images not included in the training procedure.
| S-EPMC9568607 | biostudies-literature
Project description:The utilization of scale invariant feature transform algorithm in synthetic-aperture radar images (SAR-SIFT) to match image features may lead to principal orientation assignments of descriptors being affected by speckle noise, thereby diminishing accuracy. In this study, we propose using the Fourier histogram of oriented ratio gradient (Fourier HORG) descriptor for robust matching of SAR images. This method is based on the SAR-SIFT algorithm framework. During feature description, the rotation-invariant Fourier HORG descriptor is established by performing Fourier analysis on the ratio gradient in the polar coordinate system, whereby the principal orientation assignment process is avoided and the robustness of SAR image registration improved. A matching experiment was conducted involving four sets of SAR image pairs, and the results demonstrated that our method exhibited higher accuracy and robustness compared to image matching based on the Fourier histogram of oriented gradient (Fourier HOG) descriptor and the SAR-SIFT algorithm, thus confirming the effectiveness of our proposed method.
| S-EPMC10477315 | biostudies-literature