Infants exploit vowels to label objects and actions from continuous audiovisual stimuli.
Ontology highlight
ABSTRACT:
SUBMITTER: Jara C
PROVIDER: S-EPMC8154951 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:In the current study, we examined the role of active experience on sensitivity to multisensory synchrony in six-month-old infants in a musical context. In the first of two experiments, we trained infants to produce a novel multimodal effect (i.e., a drum beat) and assessed the effects of this training, relative to no training, on their later perception of the synchrony between audio and visual presentation of the drumming action. In a second experiment, we then contrasted this active experience with the observation of drumming in order to test whether observation of the audiovisual effect was as effective for sensitivity to multimodal synchrony as active experience. Our results indicated that active experience provided a unique benefit above and beyond observational experience, providing insights on the embodied roots of (early) music perception and cognition.
| S-EPMC4482535 | biostudies-literature
Project description:For many animals, navigating their environment requires an ability to organize continuous streams of sensory input into discrete 'perceptual objects' that correspond to physical entities in visual and auditory scenes. The human visual and auditory systems follow several Gestalt laws of perceptual organization to bind constituent features into coherent perceptual objects. A largely unexplored question is whether nonhuman animals follow similar Gestalt laws in perceiving behaviourally relevant stimuli, such as communication signals. We used females of Cope's grey treefrog (Hyla chrysoscelis) to test the hypothesis that temporal coherence-a powerful Gestalt principle in human auditory scene analysis-promotes perceptual binding in forming auditory objects of species-typical vocalizations. According to the principle of temporal coherence, sound elements that start and stop at the same time or that modulate coherently over time are likely to become bound together into the same auditory object. We found that the natural temporal coherence between two spectral components of advertisement calls promotes their perceptual binding into auditory objects of advertisement calls. Our findings confirm the broad ecological validity of temporal coherence as a Gestalt law of auditory perceptual organization guiding the formation of biologically relevant perceptual objects in animal behaviour.
| S-EPMC7532704 | biostudies-literature
Project description:The aim of this study was to investigate neural dynamics of audiovisual temporal fusion processes in 6-month-old infants using event-related brain potentials (ERPs). In a habituation-test paradigm, infants did not show any behavioral signs of discrimination of an audiovisual asynchrony of 200 ms, indicating perceptual fusion. In a subsequent EEG experiment, audiovisual synchronous stimuli and stimuli with a visual delay of 200 ms were presented in random order. In contrast to the behavioral data, brain activity differed significantly between the two conditions. Critically, N1 and P2 latency delays were not observed between synchronous and fused items, contrary to previously observed N1 and P2 latency delays between synchrony and perceived asynchrony. Hence, temporal interaction processes in the infant brain between the two sensory modalities varied as a function of perceptual fusion versus asynchrony perception. The visual recognition components Pb and Nc were modulated prior to sound onset, emphasizing the importance of anticipatory visual events for the prediction of auditory signals. Results suggest mechanisms by which young infants predictively adjust their ongoing neural activity to the temporal synchrony relations to be expected between vision and audition.
| S-EPMC6989763 | biostudies-literature
Project description:To estimate an environmental property such as object location from multiple sensory signals, the brain must infer their causal relationship. Only information originating from the same source should be integrated. This inference relies on the characteristics of the measurements, the information the sensory modalities provide on a given trial, as well as on a cross-modal common-cause prior: accumulated knowledge about the probability that cross-modal measurements originate from the same source. We examined the plasticity of this cross-modal common-cause prior. In a learning phase, participants were exposed to a series of audiovisual stimuli that were either consistently spatiotemporally congruent or consistently incongruent; participants' audiovisual spatial integration was measured before and after this exposure. We fitted several Bayesian causal-inference models to the data; the models differed in the plasticity of the common-source prior. Model comparison revealed that, for the majority of the participants, the common-cause prior changed during the learning phase. Our findings reveal that short periods of exposure to audiovisual stimuli with a consistent causal relationship can modify the common-cause prior. In accordance with previous studies, both exposure conditions could either strengthen or weaken the common-cause prior at the participant level. Simulations imply that the direction of the prior-update might be mediated by the degree of sensory noise, the variability of the measurements of the same signal across trials, during the learning phase.
| S-EPMC9478143 | biostudies-literature
Project description:Most neuroimaging studies are performed using one imaging method only, either functional magnetic resonance imaging (fMRI), electroencephalography (EEG), or magnetoencephalography (MEG). Information on both location and timing has been sought by recording fMRI and EEG, simultaneously, or MEG and fMRI in separate sessions. Such approaches assume similar active areas whether detected via hemodynamic or electrophysiological signatures. Direct comparisons, after independent analysis of data from each imaging modality, have been conducted primarily on low-level sensory processing. Here, we report MEG (timing and location) and fMRI (location) results in 11 subjects when they named pictures that depicted an action or an object. The experimental design was exactly the same for the two imaging modalities. The MEG data were analyzed with two standard approaches: a set of equivalent current dipoles and a distributed minimum norm estimate. The fMRI blood-oxygen-level dependent (BOLD) data were subjected to the usual random-effect contrast analysis. At the group level, MEG and fMRI data showed fairly good convergence, with both overall activation patterns and task effects localizing to comparable cortical regions. There were some systematic discrepancies, however, and the correspondence was less compelling in the individual subjects. The present analysis should be helpful in reconciling results of fMRI and MEG studies on high-level cognitive functions.
| S-EPMC6870641 | biostudies-literature
Project description:Background:Individuals with Autism Spectrum Disorders (ASD) have been shown to have multisensory integration deficits, which may lead to problems perceiving complex, multisensory environments. For example, understanding audiovisual speech requires integration of visual information from the lips and face with auditory information from the voice, and audiovisual speech integration deficits can lead to impaired understanding and comprehension. While there is strong evidence for an audiovisual speech integration impairment in ASD, it is unclear whether this impairment is due to low level perceptual processes that affect all types of audiovisual integration or if it is specific to speech processing. Method:Here, we measure audiovisual integration of basic speech (i.e., consonant-vowel utterances) and object stimuli (i.e., a bouncing ball) in adolescents with ASD and well-matched controls. We calculate a temporal window of integration (TWI) using each individual's ability to identify which of two videos (one temporally aligned and one misaligned) matches auditory stimuli. The TWI measures tolerance for temporal asynchrony between the auditory and visual streams, and is an important feature of audiovisual perception. Results:While controls showed similar tolerance of asynchrony for the simple speech and object stimuli, individuals with ASD did not. Specifically, individuals with ASD showed less tolerance of asynchrony for speech stimuli compared to object stimuli. In individuals with ASD, decreased tolerance for asynchrony in speech stimuli was associated with higher ratings of autism symptom severity. Conclusions:These results suggest that audiovisual perception in ASD may vary for speech and object stimuli beyond what can be accounted for by stimulus complexity.
| S-EPMC6135104 | biostudies-literature
Project description:Initiating an eye movement towards a suddenly appearing visual target is faster when an accessory auditory stimulus occurs in close spatiotemporal vicinity. Such facilitation of saccadic reaction time (SRT) is well-documented, but the exact neural mechanisms underlying the crossmodal effect remain to be elucidated. From EEG/MEG studies it has been hypothesized that coupled oscillatory activity in primary sensory cortices regulates multisensory processing. Specifically, it is assumed that the phase of an ongoing neural oscillation is shifted due to the occurrence of a sensory stimulus so that, across trials, phase values become highly consistent (phase reset). If one can identify the phase an oscillation is reset to, it is possible to predict when temporal windows of high and low excitability will occur. However, in behavioral experiments the pre-stimulus phase will be different on successive repetitions of the experimental trial, and average performance over many trials will show no signs of the modulation. Here we circumvent this problem by repeatedly presenting an auditory accessory stimulus followed by a visual target stimulus with a temporal delay varied in steps of 2 ms. Performing a discrete time series analysis on SRT as a function of the delay, we provide statistical evidence for the existence of distinct peak spectral components in the power spectrum. These frequencies, although varying across participants, fall within the beta and gamma range (20 to 40 Hz) of neural oscillatory activity observed in neurophysiological studies of multisensory integration. Some evidence for high-theta/alpha activity was found as well. Our results are consistent with the phase reset hypothesis and demonstrate that it is amenable to testing by purely psychophysical methods. Thus, any theory of multisensory processes that connects specific brain states with patterns of saccadic responses should be able to account for traces of oscillatory activity in observable behavior.
| S-EPMC3463580 | biostudies-literature
Project description:Face-to-face communication relies on the integration of acoustic speech signals with the corresponding facial articulations. In the McGurk illusion, an auditory /ba/ phoneme presented simultaneously with a facial articulation of a /ga/ (i.e., viseme), is typically fused into an illusory 'da' percept. Despite its widespread use as an index of audiovisual speech integration, critics argue that it arises from perceptual processes that differ categorically from natural speech recognition. Conversely, Bayesian theoretical frameworks suggest that both the illusory McGurk and the veridical audiovisual congruent speech percepts result from probabilistic inference based on noisy sensory signals. According to these models, the inter-sensory conflict in McGurk stimuli may only increase observers' perceptual uncertainty. This functional magnetic resonance imaging (fMRI) study presented participants (20 male and 24 female) with audiovisual congruent, McGurk (i.e., auditory /ba/ + visual /ga/), and incongruent (i.e., auditory /ga/ + visual /ba/) stimuli along with their unisensory counterparts in a syllable categorization task. Behaviorally, observers' response entropy was greater for McGurk compared to congruent audiovisual stimuli. At the neural level, McGurk stimuli increased activations in a widespread neural system, extending from the inferior frontal sulci (IFS) to the pre-supplementary motor area (pre-SMA) and insulae, typically involved in cognitive control processes. Crucially, in line with Bayesian theories these activation increases were fully accounted for by observers' perceptual uncertainty as measured by their response entropy. Our findings suggest that McGurk and congruent speech processing rely on shared neural mechanisms, thereby supporting the McGurk illusion as a valid measure of natural audiovisual speech perception.
| S-EPMC10964917 | biostudies-literature
Project description:In additive manufacturing, it is imperative to increase print speeds, use higher-viscosity resins, and print with multiple different resins simultaneously. To this end, we introduce a previously unexplored ultraviolet-based photopolymerization three-dimensional printing process. The method exploits a continuous liquid interface-the dead zone-mechanically fed with resin at elevated pressures through microfluidic channels dynamically created and integral to the growing part. Through this mass transport control, injection continuous liquid interface production, or iCLIP, can accelerate printing speeds to 5- to 10-fold over current methods such as CLIP, can use resins an order of magnitude more viscous than CLIP, and can readily pattern a single heterogeneous object with different resins in all Cartesian coordinates. We characterize the process parameters governing iCLIP and demonstrate use cases for rapidly printing carbon nanotube-filled composites, multimaterial features with length scales spanning several orders of magnitude, and lattices with tunable moduli and energy absorption.
| S-EPMC9519045 | biostudies-literature
Project description:BackgroundHyperglycaemia and hypoglycaemia are common in preterm infants and have been associated with increased risk of mortality and morbidity. Interventions to reduce risk associated with these exposures are particularly challenging due to the infrequent measurement of blood glucose concentrations, with the potential of causing more harm instead of improving outcomes for these infants. Continuous glucose monitoring (CGM) is widely used in adults and children with diabetes to improve glucose control, but has not been approved for use in neonates. The REACT trial aimed to evaluate the efficacy and safety of CGM in preterm infants requiring intensive care.MethodsThis international, open-label, randomised controlled trial was done in 13 neonatal intensive care units in the UK, Spain, and the Netherlands. Infants were included if they were within 24 h of birth, had a birthweight of 1200 g or less, had a gestational age up to 33 weeks plus 6 days, and had parental written informed consent. Infants were randomly assigned (1:1) to real-time CGM or standard care (with masked CGM for comparison) using a central web randomisation system, stratified by recruiting centre and gestational age (<26 or ≥26 weeks). The primary efficacy outcome was the proportion of time sensor glucose concentration was 2·6-10 mmol/L for the first week of life. Safety outcomes related to hypoglycaemia (glucose concentrations <2·6 mmol/L) in the first 7 days of life. All outcomes were assessed on the basis of intention to treat in the full analysis set with available data. The study is registered with the International Standard Randomised Control Trials Registry, ISRCTN12793535.FindingsBetween July 4, 2016, and Jan 27, 2019, 182 infants were enrolled, 180 of whom were randomly assigned (85 to real-time CGM, 95 to standard care). 70 infants in the real-time CGM intervention group and 85 in the standard care group had CGM data and were included in the primary analysis. Compared with infants in the standard care group, infants managed using CGM had more time in the 2·6-10 mmol/L glucose concentration target range (mean proportion of time 84% [SD 22] vs 94% [11]; adjusted mean difference 8·9% [95% CI 3·4-14·4]), equivalent to 13 h (95% CI 5-21). More infants in the standard care group were exposed to at least one episode of sensor glucose concentration of less than 2·6 mmol/L for more than 1 h than those in the intervention group (13 [15%] of 85 vs four [6%] of 70). There were no serious adverse events related to the use of the device or episodes of infection.InterpretationReal-time CGM can reduce exposure to prolonged or severe hyperglycaemia and hypoglycaemia. Further studies using CGM are required to determine optimal glucose targets, strategies to obtain them, and the potential effect on long-term health outcomes.FundingNational Institute for Health Research Efficacy and Mechanisms Evaluation Programme.
| S-EPMC7970623 | biostudies-literature