Does my face FIT?: a face image task reveals structure and distortions of facial feature representation.
Ontology highlight
ABSTRACT:
SUBMITTER: Fuentes CT
PROVIDER: S-EPMC3793930 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:An image target recognition approach based on mixed features and adaptive weighted joint sparse representation is proposed in this paper. This method is robust to the illumination variation, deformation, and rotation of the target image. It is a data-lightweight classification framework, which can recognize targets well with few training samples. First, Gabor wavelet transform and convolutional neural network (CNN) are used to extract the Gabor wavelet features and deep features of training samples and test samples, respectively. Then, the contribution weights of the Gabor wavelet feature vector and the deep feature vector are calculated. After adaptive weighted reconstruction, we can form the mixed features and obtain the training sample feature set and test sample feature set. Aiming at the high-dimensional problem of mixed features, we use principal component analysis (PCA) to reduce the dimensions. Lastly, the public features and private features of images are extracted from the training sample feature set so as to construct the joint feature dictionary. Based on joint feature dictionary, the sparse representation based classifier (SRC) is used to recognize the targets. The experiments on different datasets show that this approach is superior to some other advanced methods.
| S-EPMC7436358 | biostudies-literature
Project description:Facial expressions provide insight into a person's emotional experience. To automatically decode these expressions has been made possible by tremendous progress in the field of computer vision. Researchers are now able to decode emotional facial expressions with impressive accuracy in standardized images of prototypical basic emotions. We tested the sensitivity of a well-established automatic facial coding software program to detect spontaneous emotional reactions in individuals responding to emotional pictures. We compared automatically generated scores for valence and arousal of the Facereader (FR; Noldus Information Technology) with the current psychophysiological gold standard of measuring emotional valence (Facial Electromyography, EMG) and arousal (Skin Conductance, SC). We recorded physiological and behavioral measurements of 43 healthy participants while they looked at pleasant, unpleasant, or neutral scenes. When viewing pleasant pictures, FR Valence and EMG were both comparably sensitive. However, for unpleasant pictures, FR Valence showed an expected negative shift, but the signal differentiated not well between responses to neutral and unpleasant stimuli, that were distinguishable with EMG. Furthermore, FR Arousal values had a stronger correlation with self-reported valence than with arousal while SC was sensitive and specifically associated with self-reported arousal. This is the first study to systematically compare FR measurement of spontaneous emotional reactions to standardized emotional images with established psychophysiological measurement tools. This novel technology has yet to make strides to surpass the sensitivity of established psychophysiological measures. However, it provides a promising new measurement technique for non-contact assessment of emotional responses.
| S-EPMC7316962 | biostudies-literature
Project description:Image data collection and labelling is costly or difficult in many real applications. Generating diverse and controllable images using conditional generative adversarial networks (GANs) for data augmentation from a small dataset is promising but challenging as deep convolutional neural networks need a large training dataset to achieve reasonable performance in general. However, unlabeled and incomplete features (e.g., unintegral edges, simplified lines, hand-drawn sketches, discontinuous geometry shapes, etc.) can be conveniently obtained through pre-processing the training images and can be used for image data augmentation. This paper proposes a conditional GAN framework for facial image augmentation using a very small training dataset and incomplete or modified edge features as conditional input for diversity. The proposed method defines a new domain or space for refining interim images to prevent overfitting caused by using a very small training dataset and enhance the tolerance of distortions caused by incomplete edge features, which effectively improves the quality of facial image augmentation with diversity. Experimental results have shown that the proposed method can generate high-quality images of good diversity when the GANs are trained using very sparse edges and a small number of training samples. Compared to the state-of-the-art edge-to-image translation methods that directly convert sparse edges to images, when using a small training dataset, the proposed conditional GAN framework can generate facial images with desirable diversity and acceptable distortions for dataset augmentation and significantly outperform the existing methods in terms of the quality of synthesised images, evaluated by Fréchet Inception Distance (FID) and Kernel Inception Distance (KID) scores.
| S-EPMC8627232 | biostudies-literature
Project description:The neural mechanisms underlying visual perceptual learning (VPL) have typically been studied by examining changes in task-related brain activation after training. However, the relationship between post-task "offline" processes and VPL remains unclear. The present study examined this question by obtaining resting-state functional magnetic resonance imaging (fMRI) scans of human brains before and after a task-fMRI session involving visual perceptual training. During the task-fMRI session, participants performed a motion coherence discrimination task in which they judged the direction of moving dots with a coherence level that varied between trials (20, 40, and 80%). We found that stimulus-induced activation increased with motion coherence in the middle temporal cortex (MT+), a feature-specific region representing visual motion. On the other hand, stimulus-induced activation decreased with motion coherence in the dorsal anterior cingulate cortex (dACC) and bilateral insula, regions involved in decision making under perceptual ambiguity. Moreover, by comparing pre-task and post-task rest periods, we revealed that resting-state functional connectivity (rs-FC) with the MT+ was significantly increased after training in widespread cortical regions including the bilateral sensorimotor and temporal cortices. In contrast, rs-FC with the MT+ was significantly decreased in subcortical regions including the thalamus and putamen. Importantly, the training-induced change in rs-FC was observed only with the MT+, but not with the dACC or insula. Thus, our findings suggest that perceptual training induces plastic changes in offline functional connectivity specifically in brain regions representing the trained visual feature, emphasising the distinct roles of feature-representation regions and decision-related regions in VPL.
| S-EPMC5942817 | biostudies-literature
Project description:The traditional scale invariant feature transform (SIFT) method can extract distinctive features for image matching. However, it is extremely time-consuming in SIFT matching because of the use of the Euclidean distance measure. Recently, many binary SIFT (BSIFT) methods have been developed to improve matching efficiency; however, none of them is invariant to mirror reflection. To address these problems, in this paper, we present a horizontal or vertical mirror reflection invariant binary descriptor named MBR-SIFT, in addition to a novel image matching approach. First, 16 cells in the local region around the SIFT keypoint are reorganized, and then the 128-dimensional vector of the SIFT descriptor is transformed into a reconstructed vector according to eight directions. Finally, the MBR-SIFT descriptor is obtained after binarization and reverse coding. To improve the matching speed and accuracy, a fast matching algorithm that includes a coarse-to-fine two-step matching strategy in addition to two similarity measures for the MBR-SIFT descriptor are proposed. Experimental results on the UKBench dataset show that the proposed method not only solves the problem of mirror reflection, but also ensures desirable matching accuracy and speed.
| S-EPMC5436860 | biostudies-literature
Project description:To assess the ability to make emotional facial expressions, we newly developed the Yamaguchi facial expression-making task (Y-FEMT).We recruited 20 normal controls and 61 outpatients: 10 with amnestic mild cognitive impairment (aMCI), 34 with mild Alzheimer's disease (AD), and 17 with moderate AD. In the Y-FEMT, smile and anger expressions were made by arranging face parts. We examined the relationship between each Y-FEMT score and the Mini-Mental State Examination (MMSE) score or overlapping figure identification test (Fig-test).The Total score (0-20) was nearly achieved in controls (18.9 ± 1.4) and declined with AD progression (aMCI 17.2 ± 2.4, mild AD 15.7 ± 2.6, moderate AD 12.3 ± 2.7). The Anger score (0-10) was significantly lower than the Smile score (0-10) in mild and moderate AD (p = 0.007 and p = 0.006, respectively). The Structure score (0-6 each) correlated well with both the MMSE score (r = 0.44, p < 0.001) and Fig-test (r = 0.45, p < 0.001), whereas the Expression score (0-4 each) correlated only with the MMSE score (r = 0.33, p = 0.01). The Subjective scores (0-4), evaluated by 10 therapists, highly correlated with the Total score. Additionally, the Y-FEMT promoted laughter and a convivial atmosphere.The Y-FEMT pleasantly assessed the ability to make emotional facial expressions without special equipment. Furthermore, the Y-FEMT may provide helpful clues for caregivers to achieve good communication with AD patients for better care.
| S-EPMC3398831 | biostudies-other
Project description:BackgroundThe variety of ways in which faces are categorized makes face recognition challenging for both synthetic and biological vision systems. Here we focus on two face processing tasks, detection and individuation, and explore whether differences in task demands lead to differences both in the features most effective for automatic recognition and in the featural codes recruited by neural processing.Methodology/principal findingsOur study appeals to a computational framework characterizing the features representing object categories as sets of overlapping image fragments. Within this framework, we assess the extent to which task-relevant information differs across image fragments. Based on objective differences we find among task-specific representations, we test the sensitivity of the human visual system to these different face descriptions independently of one another. Both behavior and functional magnetic resonance imaging reveal effects elicited by objective task-specific levels of information. Behaviorally, recognition performance with image fragments improves with increasing task-specific information carried by different face fragments. Neurally, this sensitivity to the two tasks manifests as differential localization of neural responses across the ventral visual pathway. Fragments diagnostic for detection evoke larger neural responses than non-diagnostic ones in the right posterior fusiform gyrus and bilaterally in the inferior occipital gyrus. In contrast, fragments diagnostic for individuation evoke larger responses than non-diagnostic ones in the anterior inferior temporal gyrus. Finally, for individuation only, pattern analysis reveals sensitivity to task-specific information within the right "fusiform face area".Conclusions/significanceOUR RESULTS DEMONSTRATE: 1) information diagnostic for face detection and individuation is roughly separable; 2) the human visual system is independently sensitive to both types of information; 3) neural responses differ according to the type of task-relevant information considered. More generally, these findings provide evidence for the computational utility and the neural validity of fragment-based visual representation and recognition.
| S-EPMC2607027 | biostudies-literature
Project description:We live in an age of 'selfies.' Yet, how we look at our own faces has seldom been systematically investigated. In this study we test if the visual processing of the highly familiar self-face is different from other faces, using psychophysics and eye-tracking. This paradigm also enabled us to test the association between the psychophysical properties of self-face representation and visual processing strategies involved in self-face recognition. Thirty-three adults performed a self-face recognition task from a series of self-other face morphs with simultaneous eye-tracking. Participants were found to look longer at the lower part of the face for self-face compared to other-face. Participants with a more distinct self-face representation, as indexed by a steeper slope of the psychometric response curve for self-face recognition, were found to look longer at upper part of the faces identified as 'self' vs. those identified as 'other'. This result indicates that self-face representation can influence where we look when we process our own vs. others' faces. We also investigated the association of autism-related traits with self-face processing metrics since autism has previously been associated with atypical self-processing. The study did not find any self-face specific association with autistic traits, suggesting that autism-related features may be related to self-processing in a domain specific manner.
| S-EPMC5816906 | biostudies-literature
Project description:BackgroundAccurate identification of pelvic lymph node metastasis (PLNM) in patients with prostate cancer (PCa) is crucial for determining appropriate treatment options. Here, we built a PLNM-Risk calculator to obtain a precisely informed decision about whether to perform extended pelvic lymph node dissection (ePLND).MethodsThe PLNM-Risk calculator was developed in 280 patients and verified internally in 71 patients and externally in 50 patients by integrating a set of radiologists' interpretations, clinicopathological factors and newly refined imaging indicators from MR images with radiomics machine learning and deep transfer learning algorithms. Its clinical applicability was compared with Briganti and Memorial Sloan Kettering Cancer Center (MSKCC) nomograms.FindingsThe PLNM-Risk achieved good diagnostic discrimination with areas under the receiver operating characteristic curve (AUCs) of 0.93 (95% CI, 0.90-0.96), 0.92 (95% CI, 0.84-0.97) and 0.76 (95% CI, 0.62-0.87) in the training/validation, internal test and external test cohorts, respectively. If the number of ePLNDs missed was controlled at < 2%, PLNM-Risk provided both a higher number of ePLNDs spared (PLNM-Risk 59.6% vs MSKCC 44.9% vs Briganti 38.9%) and a lower number of false positives (PLNM-Risk 59.3% vs MSKCC 70.1% and Briganti 72.7%). In follow-up, patients stratified by the PLNM-Risk calculator showed significantly different biochemical recurrence rates after surgery.InterpretationThe PLNM-Risk calculator offers a noninvasive clinical biomarker to predict PLNM for patients with PCa. It shows improved accuracy of diagnosis support and reduced overtreatment burdens for patients with findings suggestive of PCa.FundingThis work was supported by the Key Research and Development Program of Jiangsu Province (BE2017756) and the Suzhou Science and Technology Bureau-Science and Technology Demonstration Project (SS201808).
| S-EPMC8167242 | biostudies-literature
Project description:For decades researchers have used mirrors to study self-recognition. However, attempts to identify neural processes underlying this ability have used photographs instead. Here we used event related potentials (ERPs) to compare self-face recognition in photographs versus mirrors and found distinct neural signatures. Measures of visual self-recognition are therefore not independent of the medium employed.
| S-EPMC3281068 | biostudies-literature