Hearing tongue loops: perceptual sensitivity to acoustic signatures of articulatory dynamics.
Ontology highlight
ABSTRACT:
SUBMITTER: Nam H
PROVIDER: S-EPMC3829900 | biostudies-other | 2013 Nov
REPOSITORIES: biostudies-other
Similar Datasets
Project description:Recent research on body and head positions has shown that postural changes may induce varying degrees of changes on acoustic speech signals and articulatory gestures. While the preservation of formant profiles across different postures is suitably accounted for by the two-tube model and perturbation theory, it remains unclear whether it is resulted from the accommodation of tongue postures. Specifically, whether the tongue accommodates the changes in head angle to maintain the target acoustics is yet to be determined. The present study examines vowel acoustics and their correspondence with the articulatory maneuvers of the tongue, including both tongue postures and movements of the tongue center, across different head angles. The results show that vowel acoustics, including pitch and formants, are largely unaffected by upward or downward tilting of the head. These preserved acoustics may be attributed to the lingual gestures that compensate for the effects of gravity. Our results also reveal that the tongue postures in response to head movements appear to be vowel-dependent, and the tongue center may serve as an underlying drive that covariates with the head angle changes. These results imply a close relationship between vowel acoustics and tongue postures as well as a target-oriented strategy for different head angles.
| S-EPMC8801537 | biostudies-literature
Project description:Summary Vocalization, such as speaking, inevitably generates sensory feedback that can cause self-generated masking. However, perceptual hearing sensitivity during vocal production is poorly understood. Using an adaptive psychophysical method, we measured the perceptual hearing sensitivity of an echolocating bat, Hipposideros pratti, in a passive listening (PL) task to detect pure tones, an active listening (AL) task to detect pure tones triggered by its vocalization, and a phantom echo task. We found that hanging H. pratti had the best hearing sensitivity of approximately 0 dB sound pressure level (SPL) in the PL task but much lower hearing sensitivity (nearly 40 dB worse) in the echo task. In the AL task, all bats gradually increased call frequency by 0.8–1.1 kHz, which improved their hearing sensitivity by 25–29 dB. This study underscores the need for studying the sensory capability of subjects engaged in active behaviors. Graphical abstract Highlights • Vocal production strongly affects the perceptual hearing sensitivity of bats• Forward masking explains the reduced hearing sensitivity during vocalization• Long-term vocal plasticity enables bats to overcome self-generated auditory masking Biological sciences; Neuroscience; Sensory neuroscience
| S-EPMC9650033 | biostudies-literature
Project description:An automatic speech recognition approach is presented which uses articulatory features estimated by a subject-independent acoustic-to-articulatory inversion. The inversion allows estimation of articulatory features from any talker's speech acoustics using only an exemplary subject's articulatory-to-acoustic map. Results are reported on a broad class phonetic classification experiment on speech from English talkers using data from three distinct English talkers as exemplars for inversion. Results indicate that the inclusion of the articulatory information improves classification accuracy but the improvement is more significant when the speaking style of the exemplar and the talker are matched compared to when they are mismatched.
| S-EPMC3189967 | biostudies-other
Project description:The articulatory loop is a fundamental component of language function, involved in the short-term buffer of auditory information followed by its vocal reproduction. We characterized the network dynamics of the human articulatory loop, using invasive recording and stimulation.We measured high-gamma activity70-110 Hz recorded intracranially when patients with epilepsy either only listened to, or listened to and then reproduced two successive tones by humming. We also conducted network analyses, and analyzed behavioral responses to cortical stimulation.Presentation of the initial tone elicited high-gamma augmentation bilaterally in the superior-temporal gyrus (STG) within 40ms, and in the precentral and inferior-frontal gyri (PCG and IFG) within 160ms after sound onset. During presentation of the second tone, high-gamma augmentation was reduced in STG but enhanced in IFG. The task requiring tone reproduction further enhanced high-gamma augmentation in PCG during and after sound presentation. Event-related causality (ERC) analysis revealed dominant flows within STG immediately after sound onset, followed by reciprocal interactions involving PCG and IFG. Measurement of cortico-cortical evoked-potentials (CCEPs) confirmed connectivity between distant high-gamma sites in the articulatory loop. High-frequency stimulation of precentral high-gamma sites in either hemisphere induced speech arrest, inability to control vocalization, or forced vocalization. Vocalization of tones was accompanied by high-gamma augmentation over larger extents of PCG.Bilateral PCG rapidly and directly receives feed-forward signals from STG, and may promptly initiate motor planning including sub-vocal rehearsal for short-term buffering of auditory stimuli. Enhanced high-gamma augmentation in IFG during presentation of the second tone may reflect high-order processing of the tone sequence.The articulatory loop employs sustained reciprocal propagation of neural activity across a network of cortical sites with strong neurophysiological connectivity.
| S-EPMC5512585 | biostudies-literature
Project description:Phrase-final lengthening affects the segments preceding a prosodic boundary. This prosodic variation is generally assumed to be independent of the phonemic identity. We refer to this as the 'uniform lengthening hypothesis' (ULH). However, in German, lax vowels do not undergo lengthening for word stress or shortening for increased speech rate, indicating that temporal properties might interact with phonemic identity. We test the ULH by comparing the effect of the boundary on acoustic and kinematic measures for tense and lax vowels and several coda consonants. We further examine if the boundary effect decreases with distance from the boundary. Ten native speakers of German were recorded by means of electromagnetic articulography (EMA) while reading sentences that contained six minimal pairs varying in vowel tenseness and boundary type. In line with the ULH, the results show that the acoustic durations of lax vowels are lengthened phrase-finally, similarly to tense vowels. We find that acoustic lengthening is stronger the closer the segments are to the boundary. Articulatory parameters of the closing movements toward the post-vocalic consonants are affected by both phrasal position and identity of the preceding vowel. The results are discussed with regard to the interaction between prosodic structure and vowel tenseness.
| S-EPMC9975821 | biostudies-literature
Project description:Due to its aerodynamic, articulatory, and acoustic complexities, the fricative /s/ is known to require high precision in its control, and to be highly resistant to coarticulation. This study documents in detail how jaw, tongue front, tongue back, lips, and the first spectral moment covary during the production of /s/, to establish how coarticulation affects this segment. Data were obtained from 24 speakers in the Wisconsin x-ray microbeam database producing /s/ in prevocalic and pre-obstruent sequences. Analysis of the data showed that certain aspects of jaw and tongue motion had specific kinematic trajectories, regardless of context, and the first spectral moment trajectory corresponded to these in some aspects. In particular contexts, variability due to jaw motion is compensated for by tongue-tip motion and bracing against the palate, to maintain an invariant articulatory-aerodynamic goal, constriction degree. The change in the first spectral moment, which rises to a peak at the midpoint of the fricative, primarily reflects the motion of the jaw. Implications of the results for theories of speech motor control and acoustic-articulatory relations are discussed.
| S-EPMC3070998 | biostudies-other
Project description:A method for mapping between simultaneously measured articulatory and acoustic data is proposed. The method uses principal components analysis on the articulatory and acoustic variables, and mapping between the domains by locally weighted linear regression, or loess [Cleveland, W. S. (1979). J. Am. Stat. Assoc. 74, 829-836]. The latter method permits local variation in the slopes of the linear regression, assuming that the function being approximated is smooth. The methodology is applied to vowels of four speakers in the Wisconsin X-ray Microbeam Speech Production Database, with formant analysis. Results are examined in terms of (1) examples of forward (articulation-to-acoustics) mappings and inverse mappings, (2) distributions of local slopes and constants, (3) examples of correlations among slopes and constants, (4) root-mean-square error, and (5) sensitivity of formant frequencies to articulatory change. It is shown that the results are qualitatively correct and that loess performs better than global regression. The forward mappings show different root-mean-square error properties than the inverse mappings indicating that this method is better suited for the forward mappings than the inverse mappings, at least for the data chosen for the current study. Some preliminary results on sensitivity of the first two formant frequencies to the two most important articulatory principal components are presented.
| S-EPMC2771059 | biostudies-other
Project description:The many-to-one mapping from representations in the speech articulatory space to acoustic space renders the associated acoustic-to-articulatory inverse mapping non-unique. Among various techniques, imposing smoothness constraints on the articulator trajectories is one of the common approaches to handle the non-uniqueness in the acoustic-to-articulatory inversion problem. This is because, articulators typically move smoothly during speech production. A standard smoothness constraint is to minimize the energy of the difference of the articulatory position sequence so that the articulator trajectory is smooth and low-pass in nature. Such a fixed definition of smoothness is not always realistic or adequate for all articulators because different articulators have different degrees of smoothness. In this paper, an optimization formulation is proposed for the inversion problem, which includes a generalized smoothness criterion. Under such generalized smoothness settings, the smoothness parameter can be chosen depending on the specific articulator in a data-driven fashion. In addition, this formulation allows estimation of articulatory positions recursively over time without any loss in performance. Experiments with the MOCHA TIMIT database show that the estimated articulator trajectories obtained using such a generalized smoothness criterion have lower RMS error and higher correlation with the actual measured trajectories compared to those obtained using a fixed smoothness constraint.
| S-EPMC2981125 | biostudies-other
Project description:In the natural environment, we often form stable perceptual experiences from ambiguous and fleeting sensory inputs. Which neural activity underlies the content of perception and which neural activity supports perceptual stability remains an open question. We used a bistable perception paradigm involving ambiguous images to behaviorally dissociate perceptual content from perceptual stability, and magnetoencephalography to measure whole-brain neural dynamics in humans. Combining multivariate decoding and neural state-space analyses, we found frequency-band-specific neural signatures that underlie the content of perception and promote perceptual stability, respectively. Across different types of images, non-oscillatory neural activity in the slow cortical potential (<5 Hz) range supported the content of perception. Perceptual stability was additionally influenced by the amplitude of alpha and beta oscillations. In addition, neural activity underlying perceptual memory, which supports perceptual stability when sensory input is temporally removed from view, also encodes elapsed time. Together, these results reveal distinct neural mechanisms that support the content versus stability of visual perception.
| S-EPMC9550226 | biostudies-literature
Project description:BackgroundThe association between brain regions involved in speech production and those that play a role in speech perception is not yet fully understood. We compared speech production related brain activity with activations resulting from perceptual categorization of syllables using high field 7 Tesla functional magnetic resonance imaging (fMRI) at 1-mm isotropic voxel resolution, enabling high localization accuracy compared to previous studies.MethodsBlood oxygenation level dependent (BOLD) signals were obtained in 20 normal hearing subjects using a simultaneous multi-slice (SMS) 7T echo-planar imaging (EPI) acquisition with whole-head coverage and 1 mm isotropic resolution. In a speech production localizer task, subjects were asked to produce a silent lip-round vowel /u/ in response to the visual cue "U" or purse their lips when they saw the cue "P". In a phoneme discrimination task, subjects were presented with pairs of syllables, which were equiprobably identical or different along an 8-step continuum between the prototypic /ba/ and /da/ sounds. After the presentation of each stimulus pair, the subjects were asked to indicate whether the two syllables they heard were identical or different by pressing one of two buttons. In a phoneme classification task, the subjects heard only one syllable and asked to indicate whether it was /ba/ or /da/.ResultsUnivariate fMRI analyses using a parametric modulation approach suggested that left motor, premotor, and frontal cortex BOLD activations correlate with phoneme category variability in the /ba/-/da/ discrimination task. In contrast, the variability related to acoustic features of the phonemes were the highest in the right primary auditory cortex. Our multivariate pattern analysis (MVPA) suggested that left precentral/inferior frontal cortex areas, which were associated with speech production according to the localizer task, play a role also in perceptual categorization of the syllables.ConclusionsThe results support the hypothesis that articulatory motor networks in the left hemisphere that are activated during speech production could also have a role in perceptual categorization of syllables. Importantly, high voxel-resolution combined with advanced coil technology allowed us to pinpoint the exact brain regions involved in both perception and production tasks.
| S-EPMC10349975 | biostudies-literature