Real masks and spoof faces: On the masked face presentation attack detection.
Ontology highlight
ABSTRACT:
SUBMITTER: Fang M
PROVIDER: S-EPMC8547786 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:In response to the COVID-19 pandemic, many governments around the world now recommend, or require, that their citizens cover the lower half of their face in public. Consequently, many people now wear surgical face masks in public. We investigated whether surgical face masks affected the performance of human observers, and a state-of-the-art face recognition system, on tasks of perceptual face matching. Participants judged whether two simultaneously presented face photographs showed the same person or two different people. We superimposed images of surgical masks over the faces, creating three different mask conditions: control (no masks), mixed (one face wearing a mask), and masked (both faces wearing masks). We found that surgical face masks have a large detrimental effect on human face matching performance, and that the degree of impairment is the same regardless of whether one or both faces in each pair are masked. Surprisingly, this impairment is similar in size for both familiar and unfamiliar faces. When matching masked faces, human observers are biased to reject unfamiliar faces as "mismatches" and to accept familiar faces as "matches". Finally, the face recognition system showed very high classification accuracy for control and masked stimuli, even though it had not been trained to recognise masked faces. However, accuracy fell markedly when one face was masked and the other was not. Our findings demonstrate that surgical face masks impair the ability of humans, and naïve face recognition systems, to perform perceptual face matching tasks. Identification decisions for masked faces should be treated with caution.
| S-EPMC7673975 | biostudies-literature
Project description:The SARS-CoV-2 pandemic has led significant social repercussions and forced people to wear face masks. Recent research has demonstrated that the human ability to infer emotions from facial configurations is significantly reduced when face masks are worn. Since the mouth region is specifically crucial for deaf people who speak sign language, the current study assessed the impact of face masks on inferring emotional facial expressions in a population of adult deaf signers. A group of 34 congenitally deaf individuals and 34 normal-hearing individuals were asked to identify happiness, sadness, fear, anger, and neutral expression on static human pictures with and without facial masks presented through smartphones. For each emotion, the percentage of correct responses with and without face masks was calculated and compared between groups. Results indicated that face masks, such as those worn due to the SARS-CoV-2 pandemic, limit the ability of people to infer emotions from facial expressions. The negative impact of face masks is significantly pronounced when deaf people have to recognize low-intensity expressions of happiness. These findings are of essential importance because difficulties in recognizing emotions from facial expressions due to mask wearing may contribute to the communication challenges experienced by the deaf community during the SARS-CoV-2 pandemic, generating feelings of frustration and exclusion.
| S-EPMC9298172 | biostudies-literature
Project description:Previous studies in the context of the COVID-19 pandemic indicated that wearing a medical-style mask affects whether a stranger's face is judged as more trustworthy, socially desirable, or likely to be ill. However, given political controversies around mask use, these effects might vary by political orientation. In a pre-registered online experiment, we measured evaluations of trustworthiness, social desirability and perceived illness in masked and unmasked faces by 1241 British and US participants. We included questions on political orientation, along with the implicit online-VAAST approach/avoid task to test reaction times to masked/unmasked faces. There was a medium-sized effect of masks on trustworthiness and a significant interaction with political orientation, in that conservatives found masked faces less trustworthy than did liberals. Participants were quicker to approach masked than unmasked faces, but conservatives were relatively slower than liberals. The effects on trustworthiness suggest that differential moralization of novel social norms can affect how their adherents are evaluated in terms of their suitability for social interactions. Furthermore, the congruence between implicit and explicit methods implies that such differences can have deep-seated effects on reactions.
| S-EPMC10863087 | biostudies-literature
Project description:Mask wearing has been required in various settings since the outbreak of COVID-19, and research has shown that identity judgements are difficult for faces wearing masks. To date, however, the majority of experiments on face identification with masked faces tested humans and computer algorithms using images with superimposed masks rather than images of people wearing real face coverings. In three experiments we test humans (control participants and super-recognisers) and algorithms with images showing different types of face coverings. In all experiments we tested matching concealed or unconcealed faces to an unconcealed reference image, and we found a consistent decrease in face matching accuracy with masked compared to unconcealed faces. In Experiment 1, typical human observers were most accurate at face matching with unconcealed images, and poorer for three different types of superimposed mask conditions. In Experiment 2, we tested both typical observers and super-recognisers with superimposed and real face masks, and found that performance was poorer for real compared to superimposed masks. The same pattern was observed in Experiment 3 with algorithms. Our results highlight the importance of testing both humans and algorithms with real face masks, as using only superimposed masks may underestimate their detrimental effect on face identification.
| S-EPMC10834892 | biostudies-literature
Project description:Face mask is now a common feature in our social environment. Although face covering reduces our ability to recognize other's face identity and facial expressions, little is known about its impact on the formation of first impressions from faces. In two online experiments, we presented unfamiliar faces displaying neutral expressions with and without face masks, and participants rated the perceived approachableness, trustworthiness, attractiveness, and dominance from each face on a 9-point scale. Their anxiety levels were measured by the State-Trait Anxiety Inventory and Social Interaction Anxiety Scale. In comparison with mask-off condition, wearing face masks (mask-on) significantly increased the perceived approachableness and trustworthiness ratings, but showed little impact on increasing attractiveness or decreasing dominance ratings. Furthermore, both trait and state anxiety scores were negatively correlated with approachableness and trustworthiness ratings in both mask-off and mask-on conditions. Social anxiety scores, on the other hand, were negatively correlated with approachableness but not with trustworthiness ratings. It seems that the presence of a face mask can alter our first impressions of strangers. Although the ratings for approachableness, trustworthiness, attractiveness, and dominance were positively correlated, they appeared to be distinct constructs that were differentially influenced by face coverings and participants' anxiety types and levels.
| S-EPMC8772253 | biostudies-literature
Project description:Cotton and surgical face masks in community settings: bacterial contamination and face mask hygiene
| PRJEB45406 | ENA
Project description:The human visual system seems to be particularly efficient at detecting faces. This efficiency sometimes comes at the cost of wrongfully seeing faces in arbitrary patterns, including famous examples such as a rock configuration on Mars or a toast's roast patterns. In machine vision, face detection has made considerable progress and has become a standard feature of many digital cameras. The arguably most wide-spread algorithm for such applications ("Viola-Jones" algorithm) achieves high detection rates at high computational efficiency. To what extent do the patterns that the algorithm mistakenly classifies as faces also fool humans? We selected three kinds of stimuli from real-life, first-person perspective movies based on the algorithm's output: correct detections ("real faces"), false positives ("illusory faces") and correctly rejected locations ("non faces"). Observers were shown pairs of these for 20 ms and had to direct their gaze to the location of the face. We found that illusory faces were mistaken for faces more frequently than non faces. In addition, rotation of the real face yielded more errors, while rotation of the illusory face yielded fewer errors. Using colored stimuli increases overall performance, but does not change the pattern of results. When replacing the eye movement by a manual response, however, the preference for illusory faces over non faces disappeared. Taken together, our data show that humans make similar face-detection errors as the Viola-Jones algorithm, when directing their gaze to briefly presented stimuli. In particular, the relative spatial arrangement of oriented filters seems of relevance. This suggests that efficient face detection in humans is likely to be pre-attentive and based on rather simple features as those encoded in the early visual system.
| S-EPMC3187842 | biostudies-literature
Project description:Iconic representations are ubiquitous; they fill children's cartoons, add humor to newspapers, and bring emotional tone to online communication. Yet, the communicative function they serve remains unaddressed by cognitive psychology. Here, we examined the hypothesis that iconic representations communicate emotional information more efficiently than their realistic counterparts. In Experiment 1, we manipulated low-level features of emotional faces to create five sets of stimuli that ranged from photorealistic to fully iconic. Participants identified emotions on briefly presented faces. Results showed that, at short presentation times, accuracy for identifying emotion on more "cartoonized" images was enhanced. In addition, increasing contrast and decreasing featural complexity benefited accuracy. In Experiment 2, we examined an event-related potential component, the P1, which is sensitive to low-level visual stimulus features. Lower levels of contrast and complexity within schematic stimuli were also associated with lower P1 amplitudes. These findings support the hypothesis that iconic representations differ from realistic images in their ability to communicate specific information, including emotion, quickly and efficiently, and that this effect is driven by changes in low-level visual features in the stimuli.
| S-EPMC5256461 | biostudies-literature
Project description:IntroductionSince the onset of the coronavirus disease 2019 (COVID-19) pandemic, wearing surgical face masks has become mandatory for healthcare staff in many countries when interacting with patients. Recently, it has been shown that wearing face masks impairs social interaction by diminishing a person's ability to read the emotion of their counterparts, an essential prerequisite to respond adequately in social situations. It is easily conceivable that this may have a tangible negative influence on the communication and relationship between patients and healthcare personnel. We therefore investigated whether it has an effect on how patients perceive healthcare professionals when physicians and nursing staff wear portrait photos with their smiling faces in addition to face masks.MethodsDuring the study period of 16 days, the medical staff of our Department wore surgical face masks at all times during any kind of interaction with patients. In a pseudorandomized order, all members of our staff additionally affixed their portrait photos to their work clothes on 8 of the 16 days. After completion of their visit, 226 patients were interviewed anonymously in a cross-sectional study design using a questionnaire in which they rated the following three items: friendliness of staff, medical quality of treatment, and how well they felt taken care of during treatment in our Department.ResultsOn days, on which staff wore photos, mean scores of the questionnaires were significantly higher than on non-photo days (p = 0.013; mean ± standard deviation = 92.8 ± 11.3 vs. 91.0 ± 12.6; median (range) = 97 (98) vs. 96 (76)). When analyzed separately, the increased scores were only significant for the item friendliness of staff (p = 0.009; mean ± standard deviation = 95.8 ± 6.3 vs. 92.2 ± 11.5; median (range) = 98 (39) vs. 97 (54)).ConclusionOur study suggests that the use of portrait photos with smiling faces has a positive effect on how patients perceive healthcare staff.
| S-EPMC8133480 | biostudies-literature
Project description:With the COVID-19 pandemic, the wearing of face masks covering mouth and nose has become ubiquitous all around the world. This study investigates the impact of typical face masks on voice radiation. To analyze the transmission loss caused by masks and the influence of masks on directivity, this study measured the full-spherical voice directivity of a dummy head with a mouth simulator covered with six masks of different types, i.e., medical masks, filtering facepiece respirator masks, and cloth face coverings. The results show a significant frequency-dependent transmission loss, which varies depending on the mask, especially above 2 kHz. Furthermore, the two facepiece respirator masks also significantly affect speech directivity, as determined by the directivity index (DI). Compared to the measurements without a mask, the DI deviates by up to 7 dB at frequencies above 3 kHz. For all other masks, the deviations are below 2 dB in all third-octave frequency bands.
| S-EPMC7857507 | biostudies-literature