Dataset Information

Spontaneous facial expression in unscripted social interactions can be measured automatically.

ABSTRACT: Methods to assess individual facial actions have potential to shed light on important behavioral phenomena ranging from emotion and social interaction to psychological disorders and health. However, manual coding of such actions is labor intensive and requires extensive training. To date, establishing reliable automated coding of unscripted facial actions has been a daunting challenge impeding development of psychological theories and applications requiring facial expression assessment. It is therefore essential that automated coding systems be developed with enough precision and robustness to ease the burden of manual coding in challenging data involving variation in participant gender, ethnicity, head pose, speech, and occlusion. We report a major advance in automated coding of spontaneous facial actions during an unscripted social interaction involving three strangers. For each participant (n = 80, 47 % women, 15 % Nonwhite), 25 facial action units (AUs) were manually coded from video using the Facial Action Coding System. Twelve AUs occurred more than 3 % of the time and were processed using automated FACS coding. Automated coding showed very strong reliability for the proportion of time that each AU occurred (mean intraclass correlation = 0.89), and the more stringent criterion of frame-by-frame reliability was moderate to strong (mean Matthew's correlation = 0.61). With few exceptions, differences in AU detection related to gender, ethnicity, pose, and average pixel intensity were small. Fewer than 6 % of frames could be coded manually but not automatically. These findings suggest automated FACS coding has progressed sufficiently to be applied to observational research in emotion and related areas of study.

SUBMITTER: Girard JM

PROVIDER: S-EPMC4461567 | biostudies-literature | 2015 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Spontaneous facial expression in unscripted social interactions can be measured automatically.

Girard Jeffrey M JM Cohn Jeffrey F JF Jeni Laszlo A LA Sayette Michael A MA De la Torre Fernando F

Behavior research methods 20151201 4

Methods to assess individual facial actions have potential to shed light on important behavioral phenomena ranging from emotion and social interaction to psychological disorders and health. However, manual coding of such actions is labor intensive and requires extensive training. To date, establishing reliable automated coding of unscripted facial actions has been a daunting challenge impeding development of psychological theories and applications requiring facial expression assessment. It is th ...[more]

PMID: 25488104

Similar Datasets

Project description:BACKGROUND:Reduction or differences in facial expression are a core diagnostic feature of autism spectrum disorder (ASD), yet evidence regarding the extent of this discrepancy is limited and inconsistent. Use of automated facial expression detection technology enables accurate and efficient tracking of facial expressions that has potential to identify individual response differences. METHODS:Children and adults with ASD (N = 124) and typically developing (TD, N = 41) were shown short clips of "funny videos." Using automated facial analysis software, we investigated differences between ASD and TD groups and within the ASD group in evidence of facial action unit (AU) activation related to the expression of positive facial expression, in particular, a smile. RESULTS:Individuals with ASD on average showed less evidence of facial AUs (AU12, AU6) relating to positive facial expression, compared to the TD group (p < .05, r = -?0.17). Using Gaussian mixture model for clustering, we identified two distinct distributions within the ASD group, which were then compared to the TD group. One subgroup (n = 35), termed "over-responsive," expressed more intense positive facial expressions in response to the videos than the TD group (p < .001, r = 0.31). The second subgroup (n = 89), ("under-responsive"), displayed fewer, less intense positive facial expressions in response to videos than the TD group (p < .001; r = -?0.36). The over-responsive subgroup differed from the under-responsive subgroup in age and caregiver-reported impulsivity (p < .05, r = 0.21). Reduced expression in the under-responsive, but not the over-responsive group, was related to caregiver-reported social withdrawal (p < .01, r = -?0.3). LIMITATIONS:This exploratory study does not account for multiple comparisons, and future work will have to ascertain the strength and reproducibility of all results. Reduced displays of positive facial expressions do not mean individuals with ASD do not experience positive emotions. CONCLUSIONS:Individuals with ASD differed from the TD group in their facial expressions of positive emotion in response to "funny videos." Identification of subgroups based on response may help in parsing heterogeneity in ASD and enable targeting of treatment based on subtypes. TRIAL REGISTRATION:ClinicalTrials.gov, NCT02299700. Registration date: November 24, 2014.

Project description:BackgroundGenetic selection based on direct indicators of heat stress could capture additional mechanisms that are involved in heat stress response and enable more accurate selection for more heat-tolerant individuals. Therefore, the main objectives of this study were to estimate genetic parameters for various heat stress indicators in a commercial population of Landrace × Large White lactating sows measured under heat stress conditions. The main indicators evaluated were: skin surface temperatures (SST), automatically-recorded vaginal temperature (TV), respiration rate (RR), panting score (PS), body condition score (BCS), hair density (HD), body size (BS), ear size, and respiration efficiency (Reff).ResultsTraits based on TV presented moderate heritability estimates, ranging from 0.15 ± 0.02 to 0.29 ± 0.05. Low heritability estimates were found for SST traits (from 0.04 ± 0.01 to 0.06 ± 0.01), RR (0.06 ± 0.01), PS (0.05 0.01), and Reff (0.03 ± 0.01). Moderate to high heritability values were estimated for BCS (0.29 ± 0.04 for caliper measurements and 0.25 ± 0.04 for visual assessments), HD (0.25 ± 0.05), BS (0.33 ± 0.05), ear area (EA; 0.40 ± 0.09), and ear length (EL; 0.32 ± 0.07). High genetic correlations were estimated among SST traits (> 0.78) and among TV traits (> 0.75). Similarly, high genetic correlations were also estimated for RR with PS (0.87 ± 0.02), with BCS measures (0.92 ± 0.04), and with ear measures (0.95 ± 0.03). Low to moderate positive genetic correlations were estimated between SST and TV (from 0.25 ± 0.04 to 0.76 ± 0.07). Low genetic correlations were estimated between TV and BCS (from - 0.01 ± 0.08 to 0.06 ± 0.07). Respiration efficiency was estimated to be positively and moderately correlated with RR (0.36 ± 0.04), PS (0.56 ± 0.03), and BCS (0.56 ± 0.05 for caliper measurements and 0.50 ± 0.05 for the visual assessments). All other trait combinations were lowly genetically correlated.ConclusionsA comprehensive landscape of heritabilities and genetic correlations for various thermotolerance indicators in lactating sows were estimated. All traits evaluated are under genetic control and heritable, with different magnitudes, indicating that genetic progress is possible for all of them. The genetic correlation estimates provide evidence for the complex relationships between these traits and confirm the importance of a sub-index of thermotolerance traits to improve heat tolerance in pigs.

Dataset Information

Spontaneous facial expression in unscripted social interactions can be measured automatically.

Publications

Spontaneous facial expression in unscripted social interactions can be measured automatically.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets