Phrase-level speech simulation with an airway modulation model of speech production.
Ontology highlight
ABSTRACT:
SUBMITTER: Story BH
PROVIDER: S-EPMC3596841 | biostudies-literature | 2013 Jun
REPOSITORIES: biostudies-literature
Publications
Phrase-level speech simulation with an airway modulation model of speech production.
Computer speech & language 20130601 4
Artificial talkers and speech synthesis systems have long been used as a means of understanding both speech production and speech perception. The development of an airway modulation model is described that simulates the time-varying changes of the glottis and vocal tract, as well as acoustic wave propagation, during speech production. The result is a type of artificial talker that can be used to study various aspects of how sound is generated by humans and how that sound is perceived by a listen ...[more]
Similar Datasets
Project description:A classic debate in the psychology of language concerns the question of the grain-size of the linguistic information that is stored in memory. One view is that only morphologically simple forms are stored (e.g., 'car', 'red'), and that more complex forms of language such as multi-word phrases (e.g., 'red car') are generated on-line from the simple forms. In two experiments we tested this view. In Experiment 1, participants produced noun+adjective and noun+noun phrases that were elicited by experimental displays consisting of colored line drawings and two superimposed line drawings. In Experiment 2, participants produced noun+adjective and determiner+noun+adjective utterances elicited by colored line drawings. In both experiments, naming latencies decreased with increasing frequency of the multi-word phrase, and were unaffected by the frequency of the object name in the utterance. These results suggest that the language system is sensitive to the distribution of linguistic information at grain-sizes beyond individual words.
| S-EPMC3314013 | biostudies-literature
Project description:BACKGROUND:In the context of the current refugee crisis, emergency services often have to deal with patients who have no language in common with the staff. As interpreters are not always available, especially in emergency settings, medical personnel rely on alternative solutions such as machine translation, which raises reliability and data confidentiality issues, or medical fixed-phrase translators, which sometimes lack usability. A collaboration between Geneva University Hospitals and Geneva University led to the development of BabelDr, a new type of speech-enabled fixed-phrase translator. Similar to other fixed-phrase translators (such as Medibabble or UniversalDoctor), it relies on a predefined list of pretranslated sentences, but instead of searching for sentences in this list, doctors can freely ask questions. OBJECTIVE:This study aimed to assess if a translation tool, such as BabelDr, can be used by doctors to perform diagnostic interviews under emergency conditions and to reach a correct diagnosis. In addition, we aimed to observe how doctors interact with the system using text and speech and to investigate if speech is a useful modality in this context. METHODS:We conducted a crossover study in December 2017 at Geneva University Hospitals with 12 French-speaking doctors (6 doctors working at the outpatient emergency service and 6 general practitioners who also regularly work in this service). They were asked to use the BabelDr tool to diagnose two standardized Arabic-speaking patients (one male and one female). The patients received a priori list of symptoms for the condition they presented with and were instructed to provide a negative or noncommittal answer for all other symptoms during the diagnostic interview. The male patient was standardized for nephritic colic and the female, for cystitis. Doctors used BabelDr as the only means of communication with the patient and were asked to make their diagnosis at the end of the dialogue. The doctors also completed a satisfaction questionnaire. RESULTS:All doctors were able to reach the correct diagnosis based on the information collected using BabelDr. They all agreed that the system helped them reach a conclusion, even if one-half felt constrained by the tool and some considered that they could not ask enough questions to reach a diagnosis. Overall, participants used more speech than text, thus confirming that speech is an important functionality in this type of tool. There was a negative association (P=.02) between the percentage of successful speech interactions (spoken sentences sent for translation) and the number of translated text items, showing that the doctors used more text when they had no success with speech. CONCLUSIONS:In emergency settings, when no interpreter is available, speech-enabled fixed-phrase translators can be a good alternative to reliably collect information from the patient.
| S-EPMC6528434 | biostudies-literature
Project description:In recent years, data-driven methods and artificial intelligence have been widely used in chemoinformatic and material informatics domains, for which the success is critically determined by the availability of training data with good quality and large quantity. A potential approach to break this bottleneck is by leveraging the chemical literature such as papers and patents as alternative data resources to high throughput experiments and simulation. Compared to other domains where natural language processing techniques have established successes, the chemical literature contains a large portion of phrases of multiple words that create additional challenges for accurate identification and representation. Here, we introduce a chemistry domain suitable approach to identify multiword chemical terms and train word representations at the phrase level. Through a series of special-designed experiments, we demonstrate that our multiword identifying and representing method effectively and accurately identifies multiword chemical terms from 119, 166 chemical patents and is more robust and precise to preserve the semantic meaning of chemical phrases compared to the conventional approach, which represents constituent single words first and combine them afterward. Because the accurate representation of chemical terms is the first and essential step to provide learning features for downstream natural language processing tasks, our results pave the road to utilize the large volume of chemical literature in future data-driven studies.
| S-EPMC6854573 | biostudies-literature
Project description:To examine children's comprehension of verb phrase (VP) ellipsis constructions in light of their automatic, online structural processing abilities and conscious, metalinguistic reflective skill.Forty-two children ages 5 through 12 years listened to VP ellipsis constructions involving the strict/sloppy ambiguity (e.g., "The janitor untangled himself from the rope and the fireman in the elementary school did too after the accident.") in which the ellipsis phrase ("did too") had 2 interpretations: (a) strict ("untangled the janitor") and (b) sloppy ("untangled the fireman"). We examined these sentences at a normal speech rate with an online cross-modal picture priming task (n = 14) and an offline sentence-picture matching task (n = 11). Both tasks were also given with slowed speech input (n = 17).Children showed priming for both the strict and sloppy interpretations at a normal speech rate but only for the strict interpretation with slowed input. Offline, children displayed an adultlike preference for the sloppy interpretation with normal-rate input but a divergent pattern with slowed speech.Our results suggest that children and adults rely on a hybrid syntax-discourse model for the online comprehension and offline interpretation of VP ellipsis constructions. This model incorporates a temporally sensitive syntactic process of VP reconstruction (disrupted with slow input) and a temporally protracted discourse effect attributed to parallelism (preserved with slow input).
| S-EPMC3703828 | biostudies-literature
Project description:Fragile X syndrome is the most common inherited intellectual disability and monogenic cause of autism spectrum disorder. Expressive language deficits, especially in speech production, are nearly ubiquitous among individuals with fragile X, but understanding of the neurological bases for these deficits remains limited. Speech production depends on feedforward control and the synchronization of neural oscillations between speech-related areas of frontal cortex and auditory areas of temporal cortex. Interaction in this circuitry allows the corollary discharge of intended speech generated from an efference copy of speech commands to be compared against actual speech sounds, which is critical for making adaptive adjustments to optimize future speech. We aimed to determine whether alterations in coherence between frontal and temporal cortices prior to speech production are present in individuals with fragile X and whether they relate to expressive language dysfunction. Twenty-one participants with full-mutation fragile X syndrome (aged 7-55 years, eight females) and 20 healthy controls (matched on age and sex) completed a talk/listen paradigm during high-density EEG recordings. During the talk task, participants repeated pronounced short vocalizations of 'Ah' every 1-2 s for a total of 180 s. During the listen task, participants passively listened to their recordings from the talk task. We compared pre-speech event-related potential activity, N1 suppression to speech sounds, single trial gamma power and fronto-temporal coherence between groups during these tasks and examined their relation to performance during a naturalistic language task. Prior to speech production, fragile X participants showed reduced pre-speech negativity, reduced fronto-temporal connectivity and greater frontal gamma power compared to controls. N1 suppression during self-generated speech did not differ between groups. Reduced pre-speech activity and increased frontal gamma power prior to speech production were related to less intelligible speech as well as broader social communication deficits in fragile X syndrome. Our findings indicate that coordinated pre-speech activity between frontal and temporal cortices is disrupted in individuals with fragile X in a clinically relevant way and represents a mechanism contributing to prominent speech production problems in the disorder.
| S-EPMC7425415 | biostudies-literature
Project description:Background. By defining what is "normal," appropriate, expected, and unacceptable, social norms shape human behavior. However, the individual-level mechanisms through which social norms impact population-level trends in health-relevant behaviors are not well understood. Aims. To test the ability of social norms mechanisms to predict changes in population-level drinking patterns. Method. An individual-level model was developed to simulate dynamic normative mechanisms and behavioral rules underlying drinking behavior over time. The model encompassed descriptive and injunctive drinking norms and their impact on frequency and quantity of alcohol use. A microsynthesis initialized in 1979 was used as a demographically representative synthetic U.S. population. Three experiments were performed in order to test the modelled normative mechanisms. Results. Overall, the experiments showed limited influence of normative interventions on population-level alcohol use. An increase in the desire to drink led to the most meaningful changes in the population's drinking behavior. The findings of the experiments underline the importance of autonomy, that is, the degree to which an individual is susceptible to normative influence. Conclusion. The model was able to predict theoretically plausible changes in drinking patterns at the population level through the impact of social mechanisms. Future applications of the model could be used to plan norms interventions pertaining to alcohol use as well as other health behaviors.
| S-EPMC7069782 | biostudies-literature
Project description:Warburg and coworkers (Warburg O, Posener K, Negelein E. Z Biochem 152: 319, 1924) first reported that cancerous cells switch glucose metabolism from oxidative phosphorylation to aerobic glycolysis, and that this switch is important for their proliferation. Nothing is known about aerobic glycolysis in T cells from asthma. The objective was to study aerobic glycolysis in human asthma and the role of this metabolic pathway in airway hyperreactivity and inflammation in a mouse model of asthma. Human peripheral blood and mouse spleen CD4 T cells were isolated by negative selection. T cell proliferation was measured by thymidine incorporation. Cytokines and serum lactate were measured by ELISA. Mouse airway hyperreactivity to inhaled methacholine was measured by a FlexiVent apparatus. The serum lactate concentration was significantly elevated in clinically stable asthmatic subjects compared with healthy and chronic obstructive pulmonary disease controls, and negatively correlated with forced expiratory volume in 1 s. Proliferating CD4 T cells from human asthma and a mouse model of asthma produced higher amounts of lactate upon stimulation, suggesting a heightened glycolytic activity. Lactate stimulated and inhibited T cell proliferation at low and high concentrations, respectively. Dichloroacetate (DCA), an inhibitor of aerobic glycolysis, inhibited lactate production, proliferation of T cells, and production of IL-5, IL-17, and IFN-γ, but it stimulated production of IL-10 and induction of Foxp3. DCA also inhibited airway inflammation and hyperreactivity in a mouse model of asthma. We conclude that aerobic glycolysis is increased in asthma, which promotes T cell activation. Inhibition of aerobic glycolysis blocks T cell activation and development of asthma.
| S-EPMC3289274 | biostudies-literature
Project description:Speech production is studied from both psycholinguistic and motor-control perspectives, with little interaction between the approaches. We assessed the explanatory value of integrating psycholinguistic and motor-control concepts for theories of speech production. By augmenting a popular psycholinguistic model of lexical retrieval with a motor-control-inspired architecture, we created a new computational model to explain speech errors in the context of aphasia. Comparing the model fits to picture-naming data from 255 aphasic patients, we found that our new model improves fits for a theoretically predictable subtype of aphasia: conduction. We discovered that the improved fits for this group were a result of strong auditory-lexical feedback activation, combined with weaker auditory-motor feedforward activation, leading to increased competition from phonologically related neighbors during lexical selection. We discuss the implications of our findings with respect to other extant models of lexical retrieval.
| S-EPMC5363858 | biostudies-literature
Project description:Sensorimotor adaptation experiments are commonly used to examine motor learning behavior and to uncover information about the underlying control mechanisms of many motor behaviors, including speech production. In the speech and voice domains, aspects of the acoustic signal are shifted/perturbed over time via auditory feedback manipulations. In response, speakers alter their production in the opposite direction of the shift so that their perceived production is closer to what they intended. This process relies on a combination of feedback and feedforward control mechanisms that are difficult to disentangle. The current study describes and tests a simple 3-parameter mathematical model that quantifies the relative contribution of feedback and feedforward control mechanisms to sensorimotor adaptation. The model is a simplified version of the DIVA model, an adaptive neural network model of speech motor control. The three fitting parameters of SimpleDIVA are associated with the three key subsystems involved in speech motor control, namely auditory feedback control, somatosensory feedback control, and feedforward control. The model is tested through computer simulations that identify optimal model fits to six existing sensorimotor adaptation datasets. We show its utility in (1) interpreting the results of adaptation experiments involving the first and second formant frequencies as well as fundamental frequency; (2) assessing the effects of masking noise in adaptation paradigms; (3) fitting more than one perturbation dimension simultaneously; (4) examining sensorimotor adaptation at different timepoints in the production signal; and (5) quantitatively predicting responses in one experiment using parameters derived from another experiment. The model simulations produce excellent fits to real data across different types of perturbations and experimental paradigms (mean correlation between data and model fits across all six studies = 0.95 ± 0.02). The model parameters provide a mechanistic explanation for the behavioral responses to the adaptation paradigm that are not readily available from the behavioral responses alone. Overall, SimpleDIVA offers new insights into speech and voice motor control and has the potential to inform future directions of speech rehabilitation research in disordered populations. Simulation software, including an easy-to-use graphical user interface, is publicly available to facilitate the use of the model in future studies.
| S-EPMC6985569 | biostudies-literature
Project description:Many voice disorders are the result of intricate neural and/or biomechanical impairments that are poorly understood. The limited knowledge of their etiological and pathophysiological mechanisms hampers effective clinical management. Behavioral studies have been used concurrently with computational models to better understand typical and pathological laryngeal motor control. Thus far, however, a unified computational framework that quantitatively integrates physiologically relevant models of phonation with the neural control of speech has not been developed. Here, we introduce LaDIVA, a novel neurocomputational model with physiologically based laryngeal motor control. We combined the DIVA model (an established neural network model of speech motor control) with the extended body-cover model (a physics-based vocal fold model). The resulting integrated model, LaDIVA, was validated by comparing its model simulations with behavioral responses to perturbations of auditory vocal fundamental frequency (fo) feedback in adults with typical speech. LaDIVA demonstrated capability to simulate different modes of laryngeal motor control, ranging from short-term (i.e., reflexive) and long-term (i.e., adaptive) auditory feedback paradigms, to generating prosodic contours in speech. Simulations showed that LaDIVA's laryngeal motor control displays properties of motor equivalence, i.e., LaDIVA could robustly generate compensatory responses to reflexive vocal fo perturbations with varying initial laryngeal muscle activation levels leading to the same output. The model can also generate prosodic contours for studying laryngeal motor control in running speech. LaDIVA can expand the understanding of the physiology of human phonation to enable, for the first time, the investigation of causal effects of neural motor control in the fine structure of the vocal signal.
| S-EPMC9258861 | biostudies-literature