Categorization of Vocal Emotion Cues Depends on Distributions of Input.
Ontology highlight
ABSTRACT: Supplementary information
The online version contains supplementary material available at 10.1007/s42761-021-00038-w.
SUBMITTER: Woodard K
PROVIDER: S-EPMC8035059 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Work on facial expressions of emotions (Calder, Burton, Miller, Young, & Akamatsu, [2001]) and emotionally inflected speech (Banse & Scherer, [1996]) has successfully delineated some of the physical properties that underlie emotion recognition. To identify the acoustic cues used in the perception of nonverbal emotional expressions like laugher and screams, an investigation was conducted into vocal expressions of emotion, using nonverbal vocal analogues of the "basic" emotions (anger, fear, disgust, sadness, and surprise; Ekman & Friesen, [1971]; Scott et al., [1997]), and of positive affective states (Ekman, [1992], [2003]; Sauter & Scott, [2007]). First, the emotional stimuli were categorized and rated to establish that listeners could identify and rate the sounds reliably and to provide confusion matrices. A principal components analysis of the rating data yielded two underlying dimensions, correlating with the perceived valence and arousal of the sounds. Second, acoustic properties of the amplitude, pitch, and spectral profile of the stimuli were measured. A discriminant analysis procedure established that these acoustic measures provided sufficient discrimination between expressions of emotional categories to permit accurate statistical classification. Multiple linear regressions with participants' subjective ratings of the acoustic stimuli showed that all classes of emotional ratings could be predicted by some combination of acoustic measures and that most emotion ratings were predicted by different constellations of acoustic features. The results demonstrate that, similarly to affective signals in facial expressions and emotionally inflected speech, the perceived emotional character of affective vocalizations can be predicted on the basis of their physical features.
| S-EPMC4178283 | biostudies-literature
Project description:Basal ganglia-thalamocortical circuits are critical for motor control and motor learning. Classically, basal ganglia nuclei are thought to regulate motor behavior by increasing or decreasing cortical firing rates, and basal ganglia diseases are assumed to reflect abnormal overall activity levels. More recent studies suggest instead that motor disorders derive from abnormal firing patterns, and have led to the hypothesis that surgical treatments, such as pallidotomy, act primarily by eliminating pathological firing patterns. Surprisingly little is known, however, about how the basal ganglia normally influence task-related cortical activity to regulate motor behavior, and how lesions of the basal ganglia influence cortical firing properties. Here, we investigated these questions in a songbird circuit that has striking homologies to mammalian basal ganglia-thalamocortical circuits but is specialized for singing. The "cortical" outflow nucleus of this circuit is required for song plasticity and normally exhibits increased firing during singing and song-locked burst firing. We found that lesions of the striato-pallidal nucleus in this circuit prevented hearing-dependent song changes. These basal ganglia lesions also stripped the cortical outflow neurons of their patterned burst firing during singing, without changing their spontaneous or singing-related firing rates. Taken together, these results suggest that the basal ganglia are essential not for normal cortical firing rates but for driving task-specific cortical firing patterns, including bursts. Moreover, such patterned bursting appears critical for motor plasticity. Our findings thus provide support for therapies that aim to treat basal ganglia movement disorders by normalizing firing patterns.
| S-EPMC3607039 | biostudies-literature
Project description:Animal vocalizations convey important information about the emitter, including sex, age, biological quality, and emotional state. Early on, Darwin proposed that sex differences in auditory signals and vocalizations were driven by sexual selection mechanisms. In humans, studies on the association between male voice attributes and physical formidability have thus far reported mixed results. Hence, with a view to furthering our understanding of the role of human voice in advertising physical formidability, we sought to identify acoustic attributes of male voices associated with physical formidability proxies. Mean fundamental frequency (F 0), formant dispersion (D f ), formant position (P f ), and vocal tract length (VTL) data from a sample of 101 male voices was analyzed for potential associations with height, weight, and maximal handgrip strength (HGS). F 0 correlated negatively with HGS; P f showed negative correlations with HGS, height and weight, whereas VTL positively correlated with HGS, height and weight. All zero-order correlations remained significant after controlling for false discovery rate (FDR) with the Benjamini-Hochberg method. After controlling for height and weight-and controlling for FDR-the correlation between F 0 and HGS remained significant. In addition, to evaluate the ability of human male voices to advertise physical formidability to potential mates, 151 heterosexual female participants rated the voices of the 10 strongest and the 10 weakest males from the original sample for perceived physical strength, and given that physical strength is a desirable attribute in male partners, perceived attractiveness. Generalized linear mixed model analyses-which allow for generalization of inferences to other samples of both raters and targets-failed to support a significant association of perceived strength or attractiveness from voices alone and actual physical strength. These results add to the growing body of work on the role of human voices in conveying relevant biological information.
| S-EPMC9294471 | biostudies-literature
Project description:We propose to use a comprehensive path model of vocal emotion communication, encompassing encoding, transmission, and decoding processes, to empirically model data sets on emotion expression and recognition. The utility of the approach is demonstrated for two data sets from two different cultures and languages, based on corpora of vocal emotion enactment by professional actors and emotion inference by naïve listeners. Lens model equations, hierarchical regression, and multivariate path analysis are used to compare the relative contributions of objectively measured acoustic cues in the enacted expressions and subjective voice cues as perceived by listeners to the variance in emotion inference from vocal expressions for four emotion families (fear, anger, happiness, and sadness). While the results confirm the central role of arousal in vocal emotion communication, the utility of applying an extended path modeling framework is demonstrated by the identification of unique combinations of distal cues and proximal percepts carrying information about specific emotion families, independent of arousal. The statistical models generated show that more sophisticated acoustic parameters need to be developed to explain the distal underpinnings of subjective voice quality percepts that account for much of the variance in emotion inference, in particular voice instability and roughness. The general approach advocated here, as well as the specific results, open up new research strategies for work in psychology (specifically emotion and social perception research) and engineering and computer science (specifically research and development in the domain of affective computing, particularly on automatic emotion detection and synthetic emotion expression in avatars).
| S-EPMC4556609 | biostudies-literature
Project description:Humans can recognize emotions expressed through body motion with high accuracy even when the stimuli are impoverished. However, most of the research on body motion has relied on exaggerated displays of emotions. In this paper we present two experiments where we investigated whether emotional body expressions could be recognized when they were recorded during natural narration. Our actors were free to use their entire body, face, and voice to express emotions, but our resulting visual stimuli used only the upper body motion trajectories in the form of animated stick figures. Observers were asked to perform an emotion recognition task on short motion sequences using a large and balanced set of emotions (amusement, joy, pride, relief, surprise, anger, disgust, fear, sadness, shame, and neutral). Even with only upper body motion available, our results show recognition accuracy significantly above chance level and high consistency rates among observers. In our first experiment, that used more classic emotion induction setup, all emotions were well recognized. In the second study that employed narrations, four basic emotion categories (joy, anger, fear, and sadness), three non-basic emotion categories (amusement, pride, and shame) and the "neutral" category were recognized above chance. Interestingly, especially in the second experiment, observers showed a bias toward anger when recognizing the motion sequences for emotions. We discovered that similarities between motion sequences across the emotions along such properties as mean motion speed, number of peaks in the motion trajectory and mean motion span can explain a large percent of the variation in observers' responses. Overall, our results show that upper body motion is informative for emotion recognition in narrative scenarios.
| S-EPMC4075474 | biostudies-literature
Project description:Doing two things at once (vs. one in isolation) usually yields performance costs. Such decrements are often distributed asymmetrically between the two actions involved, reflecting different processing priorities. A previous study (Huestegge & Koch, 2013) demonstrated that the particular effector systems associated with the two actions can determine the pattern of processing priorities: Vocal responses were prioritized over manual responses, as indicated by smaller performance costs (associated with dual-action demands) for the former. However, this previous study only involved auditory stimulation (for both actions). Given that previous research on input-output modality compatibility in dual tasks suggested that pairing auditory input with vocal output represents a particularly advantageous mapping, the question arises whether the observed vocal-over-manual prioritization was merely a consequence of auditory stimulation. To resolve this issue, we conducted a manual-vocal dual task study using either only auditory or only visual stimuli for both responses. We observed vocal-over-manual prioritization in both stimulus modality conditions. This suggests that input-output modality mappings can (to some extent) attenuate, but not abolish/reverse effector-based prioritization. Taken together, effector system pairings appear to have a more substantial impact on capacity allocation policies in dual-task control than input-output modality combinations.
| S-EPMC8878545 | biostudies-literature
Project description:The voice is a marker of a person's identity which allows individual recognition even if the person is not in sight. Listening to a voice also affords inferences about the speaker's emotional state. Both these types of personal information are encoded in characteristic acoustic feature patterns analyzed within the auditory cortex. In the present study 16 volunteers listened to pairs of non-verbal voice stimuli with happy or sad valence in two different task conditions while event-related brain potentials (ERPs) were recorded. In an emotion matching task, participants indicated whether the expressed emotion of a target voice was congruent or incongruent with that of a (preceding) prime voice. In an identity matching task, participants indicated whether or not the prime and target voice belonged to the same person. Effects based on emotion expressed occurred earlier than those based on voice identity. Specifically, P2 (approximately 200 ms)-amplitudes were reduced for happy voices when primed by happy voices. Identity match effects, by contrast, did not start until around 300 ms. These results show an early task-specific emotion-based influence on the early stages of auditory sensory processing.
| S-EPMC2642974 | biostudies-literature
Project description:Previous functional magnetic resonance imaging and event-related brain potential studies revealed that performing a cognitive task may suppress the preferential processing of emotional stimuli. However, these studies utilized simple and artificial tasks (i.e. letter, shape or orientation discrimination tasks), unfamiliar to the participants. The present event-related potential study examined the emotion-attention interaction in the context of a comparably more natural scene categorization task. Deciding whether a natural scene contains an animal or not is a familiar and meaningful task to the participants and presumed to require little attentional resources. The task images were presented centrally and were overlaid upon emotional or neutral background pictures. Thus, implicit emotion and explicit semantic categorization may compete for processing resources in neural regions implicated in object recognition. Additionally, participants passively viewed the same stimulus materials without the demand to categorize task images. Significant interactions between task condition and emotional picture valence were observed for the occipital negativity and late positive potential. In the passive viewing condition, emotional background images elicited an increased occipital negativity followed by an increased late positive potential. In contrast, during the animal-/non-animal-categorization task, emotional modulation effects were replaced by strong target categorization effects. These results suggest that explicit semantic categorization interferes with implicit emotion processing when both processes compete for shared resources.
| S-EPMC4221216 | biostudies-literature
Project description:Warning signals displayed by defended prey are mimicked by both mutualistic (Müllerian) and parasitic (Batesian) species. Yet mimicry is often imperfect: why does selection not improve mimicry? Predators create selection on warning signals, so predator psychology is crucial to understanding mimicry. We conducted experiments where humans acted as predators in a virtual ecosystem to ask how prey diversity affects the way that predators categorize prey phenotypes as profitable or unprofitable. The phenotypic diversity of prey communities strongly affected predator categorization. Higher diversity increased the likelihood that predators would use a 'key' trait to form broad categories, even if it meant committing errors. Broad categorization favors the evolution of mimicry. Both species richness and evenness contributed significantly to this effect. This lets us view the behavioral and evolutionary processes leading to mimicry in light of classical community ecology. Broad categorization by receivers is also likely to affect other forms of signaling.
| S-EPMC6510532 | biostudies-literature
Project description:BackgroundCognitive and emotional impairment are among the core features of schizophrenia; assessment of vocal emotion recognition may facilitate the detection of schizophrenia. We explored the differences between cognitive and social aspects of emotion using vocal emotion recognition and detailed clinical characterization.MethodsClinical symptoms and social and cognitive functioning were assessed by trained clinical psychiatrists. A vocal emotion perception test, including an assessment of emotion recognition and emotional intensity, was conducted. One-hundred-six patients with schizophrenia (SCZ) and 230 healthy controls (HCs) were recruited.ResultsConsidering emotion recognition, scores for all emotion categories were significantly lower in SCZ compared to HC. Considering emotional intensity, scores for anger, calmness, sadness, and surprise were significantly lower in the SCZs. Vocal recognition patterns showed a trend of unification and simplification in SCZs. A direct correlation was confirmed between vocal recognition impairment and cognition. In diagnostic tests, only the total score of vocal emotion recognition was a reliable index for the presence of schizophrenia.ConclusionsThis study shows that patients with schizophrenia are characterized by impaired vocal emotion perception. Furthermore, explicit and implicit vocal emotion perception processing in individuals with schizophrenia are viewed as distinct entities. This study provides a voice recognition tool to facilitate and improve the diagnosis of schizophrenia.
| S-EPMC10580536 | biostudies-literature