Facial recognition technology can expose political orientation from naturalistic facial images.
Ontology highlight
ABSTRACT:
SUBMITTER: Kosinski M
PROVIDER: S-EPMC7801376 | biostudies-literature | 2021 Jan
REPOSITORIES: biostudies-literature
Publications
Facial recognition technology can expose political orientation from naturalistic facial images.
Scientific reports 20210111 1
Ubiquitous facial recognition technology can expose individuals' political orientation, as faces of liberals and conservatives consistently differ. A facial recognition algorithm was applied to naturalistic images of 1,085,795 individuals to predict their political orientation by comparing their similarity to faces of liberal and conservative others. Political orientation was correctly classified in 72% of liberal-conservative face pairs, remarkably better than chance (50%), human accuracy (55%) ...[more]
Similar Datasets
Project description:A lack of methods to identify individual animals can be a barrier to zoonoses control. We developed and field-tested facial recognition technology for a mobile phone application to identify dogs, which we used to assess vaccination coverage against rabies in rural Tanzania. Dogs were vaccinated, registered using the application, and microchipped. During subsequent household visits to validate vaccination, dogs were registered using the application and their vaccination status determined by operators using the application to classify dogs as vaccinated (matched) or unvaccinated (unmatched), with microchips validating classifications. From 534 classified dogs (251 vaccinated, 283 unvaccinated), the application specificity was 98.9% and sensitivity 76.2%, with positive and negative predictive values of 98.4% and 82.8% respectively. The facial recognition algorithm correctly matched 249 (99.2%) vaccinated and microchipped dogs (true positives) and failed to match two (0.8%) vaccinated dogs (false negatives). Operators correctly identified 186 (74.1%) vaccinated dogs (true positives), and 280 (98.9%) unvaccinated dogs (true negatives), but incorrectly classified 58 (23.1%) vaccinated dogs as unmatched (false negatives). Reduced application sensitivity resulted from poor quality photos and light-associated color distortion. With development and operator training, this technology has potential to be a useful tool to identify dogs and support research and intervention programs.
| S-EPMC10716125 | biostudies-literature
Project description:Stroke is a major threat to life and health in modern society, especially in the aging population. Stroke may cause sudden death or severe sequela-like hemiplegia. Although computed tomography (CT) and magnetic resonance imaging (MRI) are standard diagnosis methods, and artificial intelligence models have been built based on these images, shortage in medical resources and the time and cost of CT/MRI imaging hamper fast detection, thus increasing the severity of stroke. Here, we developed a convolutional neural network model by integrating four networks, Xception, ResNet50, VGG19, and EfficientNetb1, to recognize stroke based on 2D facial images with a cross-validation area under curve (AUC) of 0.91 within the training set of 185 acute ischemic stroke patients and 551 age- and sex-matched controls, and AUC of 0.82 in an independent data set regardless of age and sex. The model computed stroke probability was quantitatively associated with facial features, various clinical parameters of blood clotting indicators and leukocyte counts, and, more importantly, stroke incidence in the near future. Our real-time facial image artificial intelligence model can be used to rapidly screen and prediagnose stroke before CT scanning, thus meeting the urgent need in emergency clinics, potentially translatable to routine monitoring.
| S-EPMC11320352 | biostudies-literature
Project description:Background There is limited literature on security and access for social care settings despite policy highlighting importance, and no published research exploring facial recognition lock technology (FRLT) for potential improvements. This study explored FRLT device implementation, use, barriers and benefits. Methods One residential care home with 43 older adults and 68 staff members (Site A), and one supported living facility caring for six individuals with mental health issues with 18 staff members (Site B) were provided with FRLT for six months. Nine pre-implementation staff interviews explored existing access and security perceptions. Ten post-implementation staff interviews and one staff focus group were conducted; all were analysed using content analysis to understand, alongside process mapping, the use and impact of the FRLT. Interview participants included site care staff and other visiting healthcare professionals. We additionally report feedback from the technology developers to demonstrate impact of industry-academia collaboration. Results Pre-implementation interviews highlighted issues with current pin-pad or lock-box systems, including; code sharing; code visibility, ineffective code changes, security issues following high staff turnover, lack of efficiency for visitors including NHS staff and lack of infection control suggesting requirement for innovation and improvement. Pre-implementation interviews showed openness and interest in FRLT, although initial queries were raised around cost effectiveness and staff skills. Following implementation, good levels of adoption were achieved with 72% and 100% (49/68 and 18/18) of staff members uploading their face at the two sites, and 100% of residents at Site B using the system (6/6). Additionally, Site B made a positive procurement decision and continues to discuss wider rollout. Post implementation interviews suggested FRLT was useful and acceptable for improving security and access. Benefits identified included staff/visitor time saving, enhanced security, team ease of access, resident autonomy and fewer shared touch points. Integration was suggested including with fire alarm systems, staff clocking in/out, and Covid monitoring to improve usefulness. The developers have since responded to feedback with design iterations. Conclusion We identified concerns on security and access in social care settings, which warrant further exploration and research. FRLT could increase resident autonomy and reduce staff burden, particularly considering frequent multi-agency health and care visits.
| S-EPMC10020502 | biostudies-literature
Project description:The COVID-19 pandemic has altered the way we interact with each other: mandatory mask-wearing obscures facial information that is crucial for emotion recognition. Whereas the influence of wearing a mask on emotion recognition has been repeatedly investigated, little is known about the impact on interaction effects among emotional signals and other social signals. Therefore, the current study sought to explore how gaze direction, head orientation, and emotional expression interact with respect to emotion perception, and how these interactions are altered by wearing a face mask. In two online experiments, we presented face stimuli from the Radboud Faces Database displaying different facial expressions (anger, fear, happiness, neutral, and sadness), gaze directions (−13°, 0°, and 13°), and head orientations (−45°, 0°, and 45°) – either without (Experiment 1) or with mask (Experiment 2). Participants categorized the displayed emotional expressions. Not surprisingly, masks impaired emotion recognition. Surprisingly, without the mask, emotion recognition was unaffected by averted head orientations and only slightly affected by gaze direction. The mask strongly interfered with this ability. The mask increased the influence of head orientation and gaze direction, in particular for the emotions that were poorly recognized with mask. The results suggest that in case of uncertainty due to ambiguity or absence of signals, we seem to unconsciously factor in extraneous information.
| S-EPMC9533556 | biostudies-literature
Project description:Researchers have theoretically proposed that humans decode other individuals' emotions or elementary cognitive appraisals from particular sets of facial action units (AUs). However, only a few empirical studies have systematically tested the relationships between the decoding of emotions/appraisals and sets of AUs, and the results are mixed. Furthermore, the previous studies relied on facial expressions of actors and no study used spontaneous and dynamic facial expressions in naturalistic settings. We investigated this issue using video recordings of facial expressions filmed unobtrusively in a real-life emotional situation, specifically loss of luggage at an airport. The AUs observed in the videos were annotated using the Facial Action Coding System. Male participants (n = 98) were asked to decode emotions (e.g., anger) and appraisals (e.g., suddenness) from facial expressions. We explored the relationships between the emotion/appraisal decoding and AUs using stepwise multiple regression analyses. The results revealed that all the rated emotions and appraisals were associated with sets of AUs. The profiles of regression equations showed AUs both consistent and inconsistent with those in theoretical proposals. The results suggest that (1) the decoding of emotions and appraisals in facial expressions is implemented by the perception of set of AUs, and (2) the profiles of such AU sets could be different from previous theories.
| S-EPMC6345715 | biostudies-literature
Project description:Facial affect is expressed dynamically - a giggle, grimace, or an agitated frown. However, the characterisation of human affect has relied almost exclusively on static images. This approach cannot capture the nuances of human communication or support the naturalistic assessment of affective disorders. Using the latest in machine vision and systems modelling, we studied dynamic facial expressions of people viewing emotionally salient film clips. We found that the apparent complexity of dynamic facial expressions can be captured by a small number of simple spatiotemporal states - composites of distinct facial actions, each expressed with a unique spectral fingerprint. Sequential expression of these states is common across individuals viewing the same film stimuli but varies in those with the melancholic subtype of major depressive disorder. This approach provides a platform for translational research, capturing dynamic facial expressions under naturalistic conditions and enabling new quantitative tools for the study of affective disorders and related mental illnesses.
| S-EPMC9439684 | biostudies-literature
Project description:The human visual system supports stable percepts of object color even though the light that reflects from object surfaces varies significantly with the scene illumination. To understand the computations that support stable color perception, we study how estimating a target object's luminous reflectance factor (LRF; a measure of the light reflected from the object under a standard illuminant) depends on variation in key properties of naturalistic scenes. Specifically, we study how variation in target object reflectance, illumination spectra, and the reflectance of background objects in a scene impact estimation of a target object's LRF. To do this, we applied supervised statistical learning methods to the simulated excitations of human cone photoreceptors, obtained from labeled naturalistic images. The naturalistic images were rendered with computer graphics. The illumination spectra of the light sources and the reflectance spectra of the surfaces in the scene were generated using statistical models of natural spectral variation. Optimally decoding target object LRF from the responses of a small learned set of task-specific linear receptive fields that operate on a contrast representation of the cone excitations yields estimates that are within 13% of the correct LRF. Our work provides a framework for evaluating how different sources of scene variability limit performance on luminance constancy.
| S-EPMC6314111 | biostudies-literature
Project description:BackgroundHigh-resolution medical images that include facial regions can be used to recognize the subject's face when reconstructing 3-dimensional (3D)-rendered images from 2-dimensional (2D) sequential images, which might constitute a risk of infringement of personal information when sharing data. According to the Health Insurance Portability and Accountability Act (HIPAA) privacy rules, full-face photographic images and any comparable image are direct identifiers and considered as protected health information. Moreover, the General Data Protection Regulation (GDPR) categorizes facial images as biometric data and stipulates that special restrictions should be placed on the processing of biometric data.ObjectiveThis study aimed to develop software that can remove the header information from Digital Imaging and Communications in Medicine (DICOM) format files and facial features (eyes, nose, and ears) at the 2D sliced-image level to anonymize personal information in medical images.MethodsA total of 240 cranial magnetic resonance (MR) images were used to train the deep learning model (144, 48, and 48 for the training, validation, and test sets, respectively, from the Alzheimer's Disease Neuroimaging Initiative [ADNI] database). To overcome the small sample size problem, we used a data augmentation technique to create 576 images per epoch. We used attention-gated U-net for the basic structure of our deep learning model. To validate the performance of the software, we adapted an external test set comprising 100 cranial MR images from the Open Access Series of Imaging Studies (OASIS) database.ResultsThe facial features (eyes, nose, and ears) were successfully detected and anonymized in both test sets (48 from ADNI and 100 from OASIS). Each result was manually validated in both the 2D image plane and the 3D-rendered images. Furthermore, the ADNI test set was verified using Microsoft Azure's face recognition artificial intelligence service. By adding a user interface, we developed and distributed (via GitHub) software named "Deface program" for medical images as an open-source project.ConclusionsWe developed deep learning-based software for the anonymization of MR images that distorts the eyes, nose, and ears to prevent facial identification of the subject in reconstructed 3D images. It could be used to share medical big data for secondary research while making both data providers and recipients compliant with the relevant privacy regulations.
| S-EPMC7759440 | biostudies-literature
Project description:Facial imaging and facial recognition technologies, now common in our daily lives, also are increasingly incorporated into health care processes, enabling touch-free appointment check-in, matching patients accurately, and assisting with the diagnosis of certain medical conditions. The use, sharing, and storage of facial data is expected to expand in coming years, yet little is documented about the perspectives of patients and participants regarding these uses. We developed a pair of surveys to gather public perspectives on uses of facial images and facial recognition technologies in healthcare and in health-related research in the United States. We used Qualtrics Panels to collect responses from general public respondents using two complementary and overlapping survey instruments; one focused on six types of biometrics (including facial images and DNA) and their uses in a wide range of societal contexts (including healthcare and research) and the other focused on facial imaging, facial recognition technology, and related data practices in health and research contexts specifically. We collected responses from a diverse group of 4,048 adults in the United States (2,038 and 2,010, from each survey respectively). A majority of respondents (55.5%) indicated they were equally worried about the privacy of medical records, DNA, and facial images collected for precision health research. A vignette was used to gauge willingness to participate in a hypothetical precision health study, with respondents split as willing to (39.6%), unwilling to (30.1%), and unsure about (30.3%) participating. Nearly one-quarter of respondents (24.8%) reported they would prefer to opt out of the DNA component of a study, and 22.0% reported they would prefer to opt out of both the DNA and facial imaging component of the study. Few indicated willingness to pay a fee to opt-out of the collection of their research data. Finally, respondents were offered options for ideal governance design of their data, as "open science"; "gated science"; and "closed science." No option elicited a majority response. Our findings indicate that while a majority of research participants might be comfortable with facial images and facial recognition technologies in healthcare and health-related research, a significant fraction expressed concern for the privacy of their own face-based data, similar to the privacy concerns of DNA data and medical records. A nuanced approach to uses of face-based data in healthcare and health-related research is needed, taking into consideration storage protection plans and the contexts of use.
| S-EPMC8516205 | biostudies-literature
Project description:Artificial intelligence (AI) technology is widely applied in different medical fields, including the diagnosis of various diseases on the basis of facial phenotypes, but there is no evaluation or quantitative synthesis regarding the performance of artificial intelligence. Here, for the first time, we summarized and quantitatively analyzed studies on the diagnosis of heterogeneous diseases on the basis on facial features. In pooled data from 20 systematically identified studies involving 7 single diseases and 12,557 subjects, quantitative random-effects models revealed a pooled sensitivity of 89% (95% CI 82% to 93%) and a pooled specificity of 92% (95% CI 87% to 95%). A new index, the facial recognition intensity (FRI), was established to describe the complexity of the association of diseases with facial phenotypes. Meta-regression revealed the important contribution of FRI to heterogeneous diagnostic accuracy (p = 0.021), and a similar result was found in subgroup analyses (p = 0.003). An appropriate increase in the training size and the use of deep learning models helped to improve the diagnostic accuracy for diseases with low FRI, although no statistically significant association was found between accuracy and photographic resolution, training size, AI architecture, and number of diseases. In addition, a novel hypothesis is proposed for universal rules in AI performance, providing a new idea that could be explored in other AI applications.
| S-EPMC8621146 | biostudies-literature