Audiovisual emotion perception develops differently from audiovisual phoneme perception during childhood.
Ontology highlight
ABSTRACT:
SUBMITTER: Yamamoto HW
PROVIDER: S-EPMC7302908 | biostudies-literature | 2020
REPOSITORIES: biostudies-literature
Publications
Audiovisual emotion perception develops differently from audiovisual phoneme perception during childhood.
Yamamoto Hisako W HW Kawahara Misako M Tanaka Akihiro A
PloS one 20200618 6
This study investigated the developmental paths in the use of audiovisual information for the perception of emotions and phonemes by Japanese speakers. Children aged 5 to 12 years and adults aged 30 to 39 years engaged in an emotion perception task in which speakers expressed their emotions through their faces and voices, and a phoneme perception task using phonemic information in speakers' lip movements and speech sounds. Results indicated that Japanese children's judgement of emotions by using ...[more]
Similar Datasets
Project description:PurposeHuman vision has a puzzling stereoscopic anisotropy: horizontal depth corrugations are easier to detect than vertical depth corrugations. To date, little is known about the function or the underlying mechanism responsible for this anisotropy. Here, we aim to find out whether this anisotropy is independent of age. To answer this, we compare detection thresholds for horizontal and vertical depth corrugations as a function of age.MethodsThe depth corrugations were defined solely by the horizontal disparity of random dot patterns. The disparities depicted a horizontal or vertical sinusoidal depth corrugation of spatial frequency 0.1 cyc/deg. Detection thresholds were obtained using Bayesian adaptive staircases from a total of 159 subjects aged from 3 to 73 years. For each participant we computed the anisotropy index, defined as the log10-ratio of the detection threshold for vertical corrugations divided by that for horizontal.ResultsAnisotropy index was highly variable between individuals but was positive in 87% of the participants. There was a significant correlation between anisotropy index and log-age (r = 0.21, P = 0.008) mainly driven by a significant difference between children and adults. In 67 children aged 3 to 13 years, the mean anisotropy index was 0.34 ± 0.38 (mean ± SD, meaning that vertical thresholds were on average 2.2 times the horizontal ones), compared with 0.59 ± 0.55 in 84 adults aged 18 to 73 years (vertical 3.9 times horizontal). This was mainly driven by a decline in the sensitivity to vertical corrugations. Children had poorer stereoacuity than adults, but had similar sensitivity to adults for horizontal corrugations and were actually more sensitive than adults to vertical corrugations.ConclusionsThe fact that adults show stronger stereo anisotropy than children raises the possibility that visual experience plays a critical role in developing and strengthening the stereo anisotropy.
| S-EPMC4788095 | biostudies-literature
Project description:Seventy-nine 3-year olds and their mothers participated in a laboratory-based task to assess maternal hostility. Mothers also reported their behavioral regulation of their child. Seven years later, functional magnetic resonance imaging data were acquired while viewing emotional faces and completing a reward processing task. Maternal hostility predicted more negative amygdala connectivity during exposure to sad relative to neutral faces with frontal and parietal regions as well as more negative left ventral striatal connectivity during monetary gain relative to loss feedback with the right posterior orbital frontal cortex and right inferior frontal gyrus. In contrast, maternal regulation predicted enhanced cingulo-frontal connectivity during monetary gain relative to loss feedback. Results suggest parenting is associated with alterations in emotion and reward processing circuitry 7-8 years later.
| S-EPMC6374219 | biostudies-literature
Project description:Emotion in daily life is often expressed in a multimodal fashion. Consequently emotional information from one modality can influence processing in another. In a previous fMRI study we assessed the neural correlates of audio-visual integration and found that activity in the left amygdala is significantly attenuated when a neutral stimulus is paired with an emotional one compared to conditions where emotional stimuli were present in both channels. Here we used dynamic causal modelling to investigate the effective connectivity in the neuronal network underlying this emotion presence congruence effect. Our results provided strong evidence in favor of a model family, differing only in the interhemispheric interactions. All winning models share a connection from the bilateral fusiform gyrus (FFG) into the left amygdala and a non-linear modulatory influence of bilateral posterior superior temporal sulcus (pSTS) on these connections. This result indicates that the pSTS not only integrates multi-modal information from visual and auditory regions (as reflected in our model by significant feed-forward connections) but also gates the influence of the sensory information on the left amygdala, leading to attenuation of amygdala activity when a neutral stimulus is integrated. Moreover, we found a significant lateralization of the FFG due to stronger driving input by the stimuli (faces) into the right hemisphere, whereas such lateralization was not present for sound-driven input into the superior temporal gyrus. In summary, our data provides further evidence for a rightward lateralization of the FFG and in particular for a key role of the pSTS in the integration and gating of audio-visual emotional information.
| S-EPMC8022349 | biostudies-literature
Project description:Developmental dyslexia is a learning disorder characterized by difficulties reading words accurately and/or fluently. Several behavioral studies have suggested the presence of anomalies at an early stage of phoneme processing, when the complex spectrotemporal patterns in the speech signal are analyzed and assigned to phonemic categories. In this study, fMRI was used to compare brain responses associated with categorical discrimination of speech syllables (P) and acoustically matched nonphonemic stimuli (N) in children and adolescents with dyslexia and in typically developing (TD) controls, aged 8-17 years. The TD group showed significantly greater activation during the P condition relative to N in an area of the left ventral occipitotemporal cortex that corresponds well with the region referred to as the "visual word form area" (VWFA). Regression analyses using reading performance as a continuous variable across the full group of participants yielded similar results. Overall, the findings are consistent with those of previous neuroimaging studies using print stimuli in individuals with dyslexia that found reduced activation in left occipitotemporal regions; however, the current study shows that these activation differences seen during reading are apparent during auditory phoneme discrimination in youth with dyslexia, suggesting that the primary deficit in at least a subset of children may lie early in the speech processing stream and that categorical perception may be an important target of early intervention in children at risk for dyslexia.
| S-EPMC7535924 | biostudies-literature
Project description:Causal inference-the process of deciding whether two incoming signals come from the same source-is an important step in audiovisual (AV) speech perception. This research explored causal inference and perception of incongruent AV English consonants. Nine adults were presented auditory, visual, congruent AV, and incongruent AV consonant-vowel syllables. Incongruent AV stimuli included auditory and visual syllables with matched vowels, but mismatched consonants. Open-set responses were collected. For most incongruent syllables, participants were aware of the mismatch between auditory and visual signals (59.04%) or reported the auditory syllable (33.73%). Otherwise, participants reported the visual syllable (1.13%) or some other syllable (6.11%). Statistical analyses were used to assess whether visual distinctiveness and place, voice, and manner features predicted responses. Mismatch responses occurred more when the auditory and visual consonants were visually distinct, when place and manner differed across auditory and visual consonants, and for consonants with high visual accuracy. Auditory responses occurred more when the auditory and visual consonants were visually similar, when place and manner were the same across auditory and visual stimuli, and with consonants produced further back in the mouth. Visual responses occurred more when voicing and manner were the same across auditory and visual stimuli, and for front and middle consonants. Other responses were variable, but typically matched the visual place, auditory voice, and auditory manner of the input. Overall, results indicate that causal inference and incongruent AV consonant perception depend on salience and reliability of auditory and visual inputs and degree of redundancy between auditory and visual inputs. A parameter-free computational model of incongruent AV speech perception based on unimodal confusions, with a causal inference rule, was applied. Data from the current study present an opportunity to test and improve the generalizability of current AV speech integration models.
| S-EPMC6428273 | biostudies-literature
Project description:To obtain a coherent perception of the world, our senses need to be in alignment. When we encounter misaligned cues from two sensory modalities, the brain must infer which cue is faulty and recalibrate the corresponding sense. We examined whether and how the brain uses cue reliability to identify the miscalibrated sense by measuring the audiovisual ventriloquism aftereffect for stimuli of varying visual reliability. To adjust for modality-specific biases, visual stimulus locations were chosen based on perceived alignment with auditory stimulus locations for each participant. During an audiovisual recalibration phase, participants were presented with bimodal stimuli with a fixed perceptual spatial discrepancy; they localized one modality, cued after stimulus presentation. Unimodal auditory and visual localization was measured before and after the audiovisual recalibration phase. We compared participants' behavior to the predictions of three models of recalibration: (a) Reliability-based: each modality is recalibrated based on its relative reliability-less reliable cues are recalibrated more; (b) Fixed-ratio: the degree of recalibration for each modality is fixed; (c) Causal-inference: recalibration is directly determined by the discrepancy between a cue and its estimate, which in turn depends on the reliability of both cues, and inference about how likely the two cues derive from a common source. Vision was hardly recalibrated by audition. Auditory recalibration by vision changed idiosyncratically as visual reliability decreased: the extent of auditory recalibration either decreased monotonically, peaked at medium visual reliability, or increased monotonically. The latter two patterns cannot be explained by either the reliability-based or fixed-ratio models. Only the causal-inference model of recalibration captures the idiosyncratic influences of cue reliability on recalibration. We conclude that cue reliability, causal inference, and modality-specific biases guide cross-modal recalibration indirectly by determining the perception of audiovisual stimuli.
| S-EPMC8629398 | biostudies-literature
Project description:In everyday conversation, we usually process the talker's face as well as the sound of the talker's voice. Access to visual speech information is particularly useful when the auditory signal is degraded. Here, we used fMRI to monitor brain activity while adult humans (n = 60) were presented with visual-only, auditory-only, and audiovisual words. The audiovisual words were presented in quiet and in several signal-to-noise ratios. As expected, audiovisual speech perception recruited both auditory and visual cortex, with some evidence for increased recruitment of premotor cortex in some conditions (including in substantial background noise). We then investigated neural connectivity using psychophysiological interaction analysis with seed regions in both primary auditory cortex and primary visual cortex. Connectivity between auditory and visual cortices was stronger in audiovisual conditions than in unimodal conditions, including a wide network of regions in posterior temporal cortex and prefrontal cortex. In addition to whole-brain analyses, we also conducted a region-of-interest analysis on the left posterior superior temporal sulcus (pSTS), implicated in many previous studies of audiovisual speech perception. We found evidence for both activity and effective connectivity in pSTS for visual-only and audiovisual speech, although these were not significant in whole-brain analyses. Together, our results suggest a prominent role for cross-region synchronization in understanding both visual-only and audiovisual speech that complements activity in integrative brain regions like pSTS.SIGNIFICANCE STATEMENT In everyday conversation, we usually process the talker's face as well as the sound of the talker's voice. Access to visual speech information is particularly useful when the auditory signal is hard to understand (e.g., background noise). Prior work has suggested that specialized regions of the brain may play a critical role in integrating information from visual and auditory speech. Here, we show a complementary mechanism relying on synchronized brain activity among sensory and motor regions may also play a critical role. These findings encourage reconceptualizing audiovisual integration in the context of coordinated network activity.
| S-EPMC8802926 | biostudies-literature
Project description:Amblyopia is a developmental visual impairment that is increasingly recognized to affect higher-level perceptual and multisensory processes. To further investigate the audiovisual (AV) perceptual impairments associated with this condition, we characterized the temporal interval in which asynchronous auditory and visual stimuli are perceived as simultaneous 50% of the time (i.e., the AV simultaneity window). Adults with unilateral amblyopia (n = 17) and visually normal controls (n = 17) judged the simultaneity of a flash and a click presented with both eyes viewing. The signal onset asynchrony (SOA) varied from 0 ms to 450 ms for auditory-lead and visual-lead conditions. A subset of participants with amblyopia (n = 6) was tested monocularly. Compared to the control group, the auditory-lead side of the AV simultaneity window was widened by 48 ms (36%; p = 0.002), whereas that of the visual-lead side was widened by 86 ms (37%; p = 0.02). The overall mean window width was 500 ms, compared to 366 ms among controls (37% wider; p = 0.002). Among participants with amblyopia, the simultaneity window parameters were unchanged by viewing condition, but subgroup analysis revealed differential effects on the parameters by amblyopia severity, etiology, and foveal suppression status. Possible mechanisms to explain these findings include visual temporal uncertainty, interocular perceptual latency asymmetry, and disruption of normal developmental tuning of sensitivity to audiovisual asynchrony.
| S-EPMC5466335 | biostudies-literature
Project description:Previous research suggests declines in emotion perception in older as compared to younger adults, but the underlying neural mechanisms remain unclear. Here, we address this by investigating how "face-age" and "face emotion intensity" affect both younger and older participants' behavioural and neural responses using event-related potentials (ERPs). Sixteen young and fifteen older adults viewed and judged the emotion type of facial images with old or young face-age and with high- or low- emotion intensities while EEG was recorded. The ERP results revealed that young and older participants exhibited significant ERP differences in two neural clusters: the left frontal and centromedial regions (100-200 ms stimulus onset) and frontal region (250-900 ms) when perceiving neutral faces. Older participants also exhibited significantly higher ERPs within these two neural clusters during anger and happiness emotion perceptual tasks. However, while this pattern of activity supported neutral emotion processing, it was not sufficient to support the effective processing of facial expressions of anger and happiness as older adults showed reductions in performance when perceiving these emotions. These age-related changes are consistent with theoretical models of age-related changes in neurocognitive abilities and may reflect a general age-related cognitive neural compensation in older adults, rather than a specific emotion-processing neural compensation.
| S-EPMC7071462 | biostudies-literature
Project description:Alexithymia is a psychological construct that can be divided into a cognitive and affective dimension. The cognitive dimension is characterized by difficulties in identifying, verbalizing and analysing feelings. The affective dimension comprises reduced levels of emotional experience and imagination. Alexithymia is widely regarded to arise from an impairment of emotion regulation. This is the first functional magnetic resonance imaging (fMRI) study to critically evaluate this by investigating the neural correlates of emotion regulation as a function of alexithymia levels. The aim of the current study was to investigate the neural correlates underlying the two alexithymia dimensions during emotion perception and emotion regulation. Using fMRI, we scanned 51 healthy subjects while viewing, reappraising or suppressing negative emotional pictures. The results support the idea that cognitive alexithymia, but not affective alexithymia, is associated with lower activation in emotional attention and recognition networks during emotion perception. However, in contrast with several theories, no alexithymia-related differences were found during emotion regulation (neither reappraisal nor suppression). These findings suggest that alexithymia may result from an early emotion processing deficit rather than compromised frontal circuits subserving higher-order emotion regulation processes.
| S-EPMC4321628 | biostudies-literature