Functional Connectivity of Attention, Visual, and Language Networks During Audio, Illustrated, and Animated Stories in Preschool-Age Children.
Ontology highlight
ABSTRACT:
SUBMITTER: Hutton JS
PROVIDER: S-EPMC6775495 | biostudies-literature | 2019 Sep
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Natural speech is processed in the brain as a mixture of auditory and visual features. An example of the importance of visual speech is the McGurk effect and related perceptual illusions that result from mismatching auditory and visual syllables. Although the McGurk effect has widely been applied to the exploration of audio-visual speech processing, it relies on isolated syllables, which severely limits the conclusions that can be drawn from the paradigm. In addition, the extreme variability and the quality of the stimuli usually employed prevents comparability across studies. To overcome these limitations, we present an innovative methodology using 3D virtual characters with realistic lip movements synchronized on computer-synthesized speech. We used commercially accessible and affordable tools to facilitate reproducibility and comparability, and the set-up was validated on 24 participants performing a perception task. Within complete and meaningful French sentences, we paired a labiodental fricative viseme (i.e. /v/) with a bilabial occlusive phoneme (i.e. /b/). This audiovisual mismatch is known to induce the illusion of hearing /v/ in a proportion of trials. We tested the rate of the illusion while varying the magnitude of background noise and audiovisual lag. Overall, the effect was observed in 40% of trials. The proportion rose to about 50% with added background noise and up to 66% when controlling for phonetic features. Our results conclusively demonstrate that computer-generated speech stimuli are judicious, and that they can supplement natural speech with higher control over stimulus timing and content.
| S-EPMC7511320 | biostudies-literature
Project description:Temporal recalibration of cross-modal synchrony has been proposed as a mechanism to compensate for timing differences between sensory modalities. However, far from the rich complexity of everyday life sensory environments, most studies to date have examined recalibration on isolated cross-modal pairings. Here, we hypothesize that selective attention might provide an effective filter to help resolve which stimuli are selected when multiple events compete for recalibration. We addressed this question by testing audio-visual recalibration following an adaptation phase where two opposing audio-visual asynchronies were present. The direction of voluntary visual attention, and therefore to one of the two possible asynchronies (flash leading or flash lagging), was manipulated using colour as a selection criterion. We found a shift in the point of subjective audio-visual simultaneity as a function of whether the observer had focused attention to audio-then-flash or to flash-then-audio groupings during the adaptation phase. A baseline adaptation condition revealed that this effect of endogenous attention was only effective toward the lagging flash. This hints at the role of exogenous capture and/or additional endogenous effects producing an asymmetry toward the leading flash. We conclude that selective attention helps promote selected audio-visual pairings to be combined and subsequently adjusted in time but, stimulus organization exerts a strong impact on recalibration. We tentatively hypothesize that the resolution of recalibration in complex scenarios involves the orchestration of top-down selection mechanisms and stimulus-driven processes.
| S-EPMC4086723 | biostudies-literature
Project description:Spatial terms such as "above", "in front of", and "on the left of" are all essential for describing the location of one object relative to another object in everyday communication. Apprehending such spatial relations involves relating linguistic to object representations by means of attention. This requires at least one attentional shift, and models such as the Attentional Vector Sum (AVS) predict the direction of that attention shift, from the sausage to the box for spatial utterances such as "The box is above the sausage". To the extent that this prediction generalizes to overt gaze shifts, a listener's visual attention should shift from the sausage to the box. However, listeners tend to rapidly look at referents in their order of mention and even anticipate them based on linguistic cues, a behavior that predicts a converse attentional shift from the box to the sausage. Four eye-tracking experiments assessed the role of overt attention in spatial language comprehension by examining to which extent visual attention is guided by words in the utterance and to which extent it also shifts "against the grain" of the unfolding sentence. The outcome suggests that comprehenders' visual attention is predominantly guided by their interpretation of the spatial description. Visual shifts against the grain occurred only when comprehenders had some extra time, and their absence did not affect comprehension accuracy. However, the timing of this reverse gaze shift on a trial correlated with that trial's verification time. Thus, while the timing of these gaze shifts is subtly related to the verification time, their presence is not necessary for successful verification of spatial relations.
| S-EPMC4301815 | biostudies-literature
Project description:The ability to volitionally regulate emotions is critical to health and well-being. While patterns of neural activation during emotion regulation have been well characterized, patterns of connectivity between regions remain less explored. It is increasingly recognized that the human brain is organized into large-scale intrinsic connectivity networks (ICNs) whose interrelationships are altered in characteristic ways during psychological tasks. In this fMRI study of 54 healthy individuals, we investigated alterations in connectivity within and between ICNs produced by the emotion regulation strategy of reappraisal. In order to gain a comprehensive picture of connectivity changes, we utilized connectomic psychophysiological interactions (PPI), a whole-brain generalization of standard single-seed PPI methods. In particular, we quantified PPI connectivity pair-wise across 837 ROIs placed throughout the cortex. We found that compared to maintaining one's emotional responses, engaging in reappraisal produced robust and distributed alterations in functional connections involving visual, dorsal attention, frontoparietal, and default networks. Visual network in particular increased connectivity with multiple ICNs including dorsal attention and default networks. We interpret these findings in terms of the role of these networks in mediating critical constituent processes in emotion regulation, including visual processing, stimulus salience, attention control, and interpretation and contextualization of stimuli. Our results add a new network perspective to our understanding of the neural underpinnings of emotion regulation, and highlight that connectomic methods can play a valuable role in comprehensively investigating modulation of connectivity across task conditions.
| S-EPMC3955705 | biostudies-literature
Project description:Healthy aging is accompanied by structural and functional changes in the brain, among which a loss of neural specificity (i.e., dedifferentiation) is one of the most consistent findings. Little is known, however, about changes in interregional integration underlying a dedifferentiation across different functional systems. In a large sample (n = 399) of healthy adults aged from 18 to 85 years, we analyzed age-dependent differences in resting-state (RS) (task-independent) functional connectivity (FC) of a set of brain regions derived from a previous fMRI study. In that study, these regions had shown an age-related loss of activation specificity in visual-attention (superior parietal area 7A and dorsal premotor cortex) or sensorimotor (area OP4 of the parietal operculum) tasks. In addition to these dedifferentiated regions, the FC analysis of the present study included "task-general" regions associated with both attention and sensorimotor systems (rostral supplementary motor area and bilateral anterior insula) as defined via meta-analytical co-activation mapping. Within this network, we observed both selective increases and decreases in RS-FC with age. In line with regional activation changes reported previously, we found diminished anti-correlated FC for inter-system connections (i.e., between sensorimotor-related and visual attention-related regions). Our analysis also revealed reduced FC between system-specific and task-general regions, which might reflect age-related deficits in top-down control possibly leading to dedifferentiation of task-specific brain activity. Together, our results underpin the notion that RS-FC changes concur with regional activity changes in the healthy aging brain, presumably contributing jointly to age-related behavioral changes.
| S-EPMC3810651 | biostudies-literature
Project description:IntroductionPrevious studies have confirmed increased functional connectivity in elderly adults during processing of simple audio-visual stimuli; however, it is unclear whether elderly adults maximize their performance by strengthening their functional brain connectivity when processing dynamic audio-visual hand-held tool stimuli. The present study aimed to explore this question using global functional connectivity.MethodsTwenty-one healthy elderly adults and 21 healthy younger adults were recruited to conduct a dynamic hand-held tool recognition task with high/low-intensity stimuli.ResultsElderly adults exhibited higher areas under the curve for both the high-intensity (3.5 versus. 2.7) and low-intensity (3.0 versus. 1.2) stimuli, indicating a higher audio-visual integration ability, but a delayed and widened audio-visual integration window for elderly adults for both the high-intensity (390 - 690 ms versus. 360 - 560 ms) and low-intensity (460 - 690 ms versus. 430 - 500 ms) stimuli. Additionally, elderly adults exhibited higher theta-band (all p < .01) but lower alpha-, beta-, and gamma-band functional connectivity (all p < .05) than younger adults under both the high- and low-intensity-stimulus conditions when processing audio-visual stimuli, except for gamma-band functional connectivity under the high-intensity-stimulus condition. Furthermore, higher theta- and alpha-band functional connectivity were observed for the audio-visual stimuli than for the auditory and visual stimuli and under the high-intensity-stimulus condition than under the low-intensity-stimulus condition.ConclusionThe higher theta-band functional connectivity in elderly adults was mainly due to higher attention allocation. The results further suggested that in the case of sensory processing, theta, alpha, beta, and gamma activity might participate in different stages of perception.
| S-EPMC7507049 | biostudies-literature
Project description:Seeing a speaker's face enhances speech intelligibility in adverse environments. We investigated the underlying network mechanisms by quantifying local speech representations and directed connectivity in MEG data obtained while human participants listened to speech of varying acoustic SNR and visual context. During high acoustic SNR speech encoding by temporally entrained brain activity was strong in temporal and inferior frontal cortex, while during low SNR strong entrainment emerged in premotor and superior frontal cortex. These changes in local encoding were accompanied by changes in directed connectivity along the ventral stream and the auditory-premotor axis. Importantly, the behavioral benefit arising from seeing the speaker's face was not predicted by changes in local encoding but rather by enhanced functional connectivity between temporal and inferior frontal cortex. Our results demonstrate a role of auditory-frontal interactions in visual speech representations and suggest that functional connectivity along the ventral pathway facilitates speech comprehension in multisensory environments.
| S-EPMC5462535 | biostudies-literature
Project description:People can discriminate the synchrony between audio-visual scenes. However, the sensitivity of audio-visual synchrony perception can be affected by many factors. Using a simultaneity judgment task, the present study investigated whether the synchrony perception of complex audio-visual stimuli was affected by audio-visual causality and stimulus reliability. In Experiment 1, the results showed that audio-visual causality could increase one's sensitivity to audio-visual onset asynchrony (AVOA) of both action stimuli and speech stimuli. Moreover, participants were more tolerant of AVOA of speech stimuli than that of action stimuli in the high causality condition, whereas no significant difference between these two kinds of stimuli was found in the low causality condition. In Experiment 2, the speech stimuli were manipulated with either high or low stimulus reliability. The results revealed a significant interaction between audio-visual causality and stimulus reliability. Under the low causality condition, the percentage of "synchronous" responses of audio-visual intact stimuli was significantly higher than that of visual_intact/auditory_blurred stimuli and audio-visual blurred stimuli. In contrast, no significant difference among all levels of stimulus reliability was observed under the high causality condition. Our study supported the synergistic effect of top-down processing and bottom-up processing in audio-visual synchrony perception.
| S-EPMC7930005 | biostudies-literature
Project description:An open challenge on the road to unraveling the brain's multilevel organization is establishing techniques to research connectivity and dynamics at different scales in time and space, as well as the links between them. This work focuses on the design of a framework that facilitates the generation of multiscale connectivity in large neural networks using a symbolic visual language capable of representing the model at different structural levels-ConGen. This symbolic language allows researchers to create and visually analyze the generated networks independently of the simulator to be used, since the visual model is translated into a simulator-independent language. The simplicity of the front end visual representation, together with the simulator independence provided by the back end translation, combine into a framework to enhance collaboration among scientists with expertise at different scales of abstraction and from different fields. On the basis of two use cases, we introduce the features and possibilities of our proposed visual language and associated workflow. We demonstrate that ConGen enables the creation, editing, and visualization of multiscale biological neural networks and provides a whole workflow to produce simulation scripts from the visual representation of the model.
| S-EPMC8777257 | biostudies-literature
Project description:The present study provides experimental evidence regarding 4-6-year-old children's visual processing of animated versus static illustrations in storybooks. Thirty nine participants listened to an animated and a static book, both three times, while eye movements were registered with an eye-tracker. Outcomes corroborate the hypothesis that specifically motion is what attracts children's attention while looking at illustrations. It is proposed that animated illustrations that are well matched to the text of the story guide children to those parts of the illustration that are important for understanding the story. This may explain why animated books resulted in better comprehension than static books.
| S-EPMC5062825 | biostudies-literature