Phrase-level speech simulation with an airway modulation model of speech production.
Ontology highlight
ABSTRACT:
SUBMITTER: Story BH
PROVIDER: S-EPMC3596841 | biostudies-literature | 2013 Jun
REPOSITORIES: biostudies-literature
Publications
Phrase-level speech simulation with an airway modulation model of speech production.
Computer speech & language 20130601 4
Artificial talkers and speech synthesis systems have long been used as a means of understanding both speech production and speech perception. The development of an airway modulation model is described that simulates the time-varying changes of the glottis and vocal tract, as well as acoustic wave propagation, during speech production. The result is a type of artificial talker that can be used to study various aspects of how sound is generated by humans and how that sound is perceived by a listen ...[more]
Similar Datasets
Project description:A classic debate in the psychology of language concerns the question of the grain-size of the linguistic information that is stored in memory. One view is that only morphologically simple forms are stored (e.g., 'car', 'red'), and that more complex forms of language such as multi-word phrases (e.g., 'red car') are generated on-line from the simple forms. In two experiments we tested this view. In Experiment 1, participants produced noun+adjective and noun+noun phrases that were elicited by experimental displays consisting of colored line drawings and two superimposed line drawings. In Experiment 2, participants produced noun+adjective and determiner+noun+adjective utterances elicited by colored line drawings. In both experiments, naming latencies decreased with increasing frequency of the multi-word phrase, and were unaffected by the frequency of the object name in the utterance. These results suggest that the language system is sensitive to the distribution of linguistic information at grain-sizes beyond individual words.
| S-EPMC3314013 | biostudies-literature
Project description:BACKGROUND:In the context of the current refugee crisis, emergency services often have to deal with patients who have no language in common with the staff. As interpreters are not always available, especially in emergency settings, medical personnel rely on alternative solutions such as machine translation, which raises reliability and data confidentiality issues, or medical fixed-phrase translators, which sometimes lack usability. A collaboration between Geneva University Hospitals and Geneva University led to the development of BabelDr, a new type of speech-enabled fixed-phrase translator. Similar to other fixed-phrase translators (such as Medibabble or UniversalDoctor), it relies on a predefined list of pretranslated sentences, but instead of searching for sentences in this list, doctors can freely ask questions. OBJECTIVE:This study aimed to assess if a translation tool, such as BabelDr, can be used by doctors to perform diagnostic interviews under emergency conditions and to reach a correct diagnosis. In addition, we aimed to observe how doctors interact with the system using text and speech and to investigate if speech is a useful modality in this context. METHODS:We conducted a crossover study in December 2017 at Geneva University Hospitals with 12 French-speaking doctors (6 doctors working at the outpatient emergency service and 6 general practitioners who also regularly work in this service). They were asked to use the BabelDr tool to diagnose two standardized Arabic-speaking patients (one male and one female). The patients received a priori list of symptoms for the condition they presented with and were instructed to provide a negative or noncommittal answer for all other symptoms during the diagnostic interview. The male patient was standardized for nephritic colic and the female, for cystitis. Doctors used BabelDr as the only means of communication with the patient and were asked to make their diagnosis at the end of the dialogue. The doctors also completed a satisfaction questionnaire. RESULTS:All doctors were able to reach the correct diagnosis based on the information collected using BabelDr. They all agreed that the system helped them reach a conclusion, even if one-half felt constrained by the tool and some considered that they could not ask enough questions to reach a diagnosis. Overall, participants used more speech than text, thus confirming that speech is an important functionality in this type of tool. There was a negative association (P=.02) between the percentage of successful speech interactions (spoken sentences sent for translation) and the number of translated text items, showing that the doctors used more text when they had no success with speech. CONCLUSIONS:In emergency settings, when no interpreter is available, speech-enabled fixed-phrase translators can be a good alternative to reliably collect information from the patient.
| S-EPMC6528434 | biostudies-literature
Project description:In recent years, data-driven methods and artificial intelligence have been widely used in chemoinformatic and material informatics domains, for which the success is critically determined by the availability of training data with good quality and large quantity. A potential approach to break this bottleneck is by leveraging the chemical literature such as papers and patents as alternative data resources to high throughput experiments and simulation. Compared to other domains where natural language processing techniques have established successes, the chemical literature contains a large portion of phrases of multiple words that create additional challenges for accurate identification and representation. Here, we introduce a chemistry domain suitable approach to identify multiword chemical terms and train word representations at the phrase level. Through a series of special-designed experiments, we demonstrate that our multiword identifying and representing method effectively and accurately identifies multiword chemical terms from 119, 166 chemical patents and is more robust and precise to preserve the semantic meaning of chemical phrases compared to the conventional approach, which represents constituent single words first and combine them afterward. Because the accurate representation of chemical terms is the first and essential step to provide learning features for downstream natural language processing tasks, our results pave the road to utilize the large volume of chemical literature in future data-driven studies.
| S-EPMC6854573 | biostudies-literature
Project description:Warburg and coworkers (Warburg O, Posener K, Negelein E. Z Biochem 152: 319, 1924) first reported that cancerous cells switch glucose metabolism from oxidative phosphorylation to aerobic glycolysis, and that this switch is important for their proliferation. Nothing is known about aerobic glycolysis in T cells from asthma. The objective was to study aerobic glycolysis in human asthma and the role of this metabolic pathway in airway hyperreactivity and inflammation in a mouse model of asthma. Human peripheral blood and mouse spleen CD4 T cells were isolated by negative selection. T cell proliferation was measured by thymidine incorporation. Cytokines and serum lactate were measured by ELISA. Mouse airway hyperreactivity to inhaled methacholine was measured by a FlexiVent apparatus. The serum lactate concentration was significantly elevated in clinically stable asthmatic subjects compared with healthy and chronic obstructive pulmonary disease controls, and negatively correlated with forced expiratory volume in 1 s. Proliferating CD4 T cells from human asthma and a mouse model of asthma produced higher amounts of lactate upon stimulation, suggesting a heightened glycolytic activity. Lactate stimulated and inhibited T cell proliferation at low and high concentrations, respectively. Dichloroacetate (DCA), an inhibitor of aerobic glycolysis, inhibited lactate production, proliferation of T cells, and production of IL-5, IL-17, and IFN-γ, but it stimulated production of IL-10 and induction of Foxp3. DCA also inhibited airway inflammation and hyperreactivity in a mouse model of asthma. We conclude that aerobic glycolysis is increased in asthma, which promotes T cell activation. Inhibition of aerobic glycolysis blocks T cell activation and development of asthma.
| S-EPMC3289274 | biostudies-literature
Project description:To examine children's comprehension of verb phrase (VP) ellipsis constructions in light of their automatic, online structural processing abilities and conscious, metalinguistic reflective skill.Forty-two children ages 5 through 12 years listened to VP ellipsis constructions involving the strict/sloppy ambiguity (e.g., "The janitor untangled himself from the rope and the fireman in the elementary school did too after the accident.") in which the ellipsis phrase ("did too") had 2 interpretations: (a) strict ("untangled the janitor") and (b) sloppy ("untangled the fireman"). We examined these sentences at a normal speech rate with an online cross-modal picture priming task (n = 14) and an offline sentence-picture matching task (n = 11). Both tasks were also given with slowed speech input (n = 17).Children showed priming for both the strict and sloppy interpretations at a normal speech rate but only for the strict interpretation with slowed input. Offline, children displayed an adultlike preference for the sloppy interpretation with normal-rate input but a divergent pattern with slowed speech.Our results suggest that children and adults rely on a hybrid syntax-discourse model for the online comprehension and offline interpretation of VP ellipsis constructions. This model incorporates a temporally sensitive syntactic process of VP reconstruction (disrupted with slow input) and a temporally protracted discourse effect attributed to parallelism (preserved with slow input).
| S-EPMC3703828 | biostudies-literature
Project description:ObjectivesEvaluating effectiveness of speech/phrase recognition software in critically ill patients with speech impairments.DesignProspective study.SettingTertiary hospital critical care unit in the northwest of England.Participants14 patients with tracheostomies, 3 female and 11 male.Main outcome measuresEvaluation of dynamic time warping (DTW) and deep neural networks (DNN) methods in a speech/phrase recognition application. Using speech/phrase recognition app for voice impaired (SRAVI), patients attempted mouthing various supported phrases with recordings evaluated by both DNN and DTW processing methods. Then, a trio of potential recognition phrases was displayed on the screen, ranked from first to third in order of likelihood.ResultsA total of 616 patient recordings were taken with 516 phrase identifiable recordings. The overall results revealed a total recognition accuracy across all three ranks of 86% using the DNN method. The rank 1 recognition accuracy of the DNN method was 75%. The DTW method had a total recognition accuracy of 74%, with a rank 1 accuracy of 48%.ConclusionThis feasibility evaluation of a novel speech/phrase recognition app using SRAVI demonstrated a good correlation between spoken phrases and app recognition. This suggests that speech/phrase recognition technology could be a therapeutic option to bridge the gap in communication in critically ill patients.What is already known about this topicCommunication can be attempted using visual charts, eye gaze boards, alphabet boards, speech/phrase reading, gestures and speaking valves in critically ill patients with speech impairments.What this study addsDeep neural networks and dynamic time warping methods can be used to analyse lip movements and identify intended phrases.How this study might affect research, practice and policyOur study shows that speech/phrase recognition software has a role to play in bridging the communication gap in speech impairment.
| S-EPMC10332046 | biostudies-literature
Project description:Fragile X syndrome is the most common inherited intellectual disability and monogenic cause of autism spectrum disorder. Expressive language deficits, especially in speech production, are nearly ubiquitous among individuals with fragile X, but understanding of the neurological bases for these deficits remains limited. Speech production depends on feedforward control and the synchronization of neural oscillations between speech-related areas of frontal cortex and auditory areas of temporal cortex. Interaction in this circuitry allows the corollary discharge of intended speech generated from an efference copy of speech commands to be compared against actual speech sounds, which is critical for making adaptive adjustments to optimize future speech. We aimed to determine whether alterations in coherence between frontal and temporal cortices prior to speech production are present in individuals with fragile X and whether they relate to expressive language dysfunction. Twenty-one participants with full-mutation fragile X syndrome (aged 7-55 years, eight females) and 20 healthy controls (matched on age and sex) completed a talk/listen paradigm during high-density EEG recordings. During the talk task, participants repeated pronounced short vocalizations of 'Ah' every 1-2 s for a total of 180 s. During the listen task, participants passively listened to their recordings from the talk task. We compared pre-speech event-related potential activity, N1 suppression to speech sounds, single trial gamma power and fronto-temporal coherence between groups during these tasks and examined their relation to performance during a naturalistic language task. Prior to speech production, fragile X participants showed reduced pre-speech negativity, reduced fronto-temporal connectivity and greater frontal gamma power compared to controls. N1 suppression during self-generated speech did not differ between groups. Reduced pre-speech activity and increased frontal gamma power prior to speech production were related to less intelligible speech as well as broader social communication deficits in fragile X syndrome. Our findings indicate that coordinated pre-speech activity between frontal and temporal cortices is disrupted in individuals with fragile X in a clinically relevant way and represents a mechanism contributing to prominent speech production problems in the disorder.
| S-EPMC7425415 | biostudies-literature
Project description:Background. By defining what is "normal," appropriate, expected, and unacceptable, social norms shape human behavior. However, the individual-level mechanisms through which social norms impact population-level trends in health-relevant behaviors are not well understood. Aims. To test the ability of social norms mechanisms to predict changes in population-level drinking patterns. Method. An individual-level model was developed to simulate dynamic normative mechanisms and behavioral rules underlying drinking behavior over time. The model encompassed descriptive and injunctive drinking norms and their impact on frequency and quantity of alcohol use. A microsynthesis initialized in 1979 was used as a demographically representative synthetic U.S. population. Three experiments were performed in order to test the modelled normative mechanisms. Results. Overall, the experiments showed limited influence of normative interventions on population-level alcohol use. An increase in the desire to drink led to the most meaningful changes in the population's drinking behavior. The findings of the experiments underline the importance of autonomy, that is, the degree to which an individual is susceptible to normative influence. Conclusion. The model was able to predict theoretically plausible changes in drinking patterns at the population level through the impact of social mechanisms. Future applications of the model could be used to plan norms interventions pertaining to alcohol use as well as other health behaviors.
| S-EPMC7069782 | biostudies-literature
Project description:Temporal synchrony between facial motion and acoustic modulations is a hallmark feature of audiovisual speech. The moving face and mouth during natural speech is known to be correlated with low-frequency acoustic envelope fluctuations (below 10 Hz), but the precise rates at which envelope information is synchronized with motion in different parts of the face are less clear. Here, we used regularized canonical correlation analysis (rCCA) to learn speech envelope filters whose outputs correlate with motion in different parts of the speakers face. We leveraged recent advances in video-based 3D facial landmark estimation allowing us to examine statistical envelope-face correlations across a large number of speakers (∼4000). Specifically, rCCA was used to learn modulation transfer functions (MTFs) for the speech envelope that significantly predict correlation with facial motion across different speakers. The AV analysis revealed bandpass speech envelope filters at distinct temporal scales. A first set of MTFs showed peaks around 3-4 Hz and were correlated with mouth movements. A second set of MTFs captured envelope fluctuations in the 1-2 Hz range correlated with more global face and head motion. These two distinctive timescales emerged only as a property of natural AV speech statistics across many speakers. A similar analysis of fewer speakers performing a controlled speech task highlighted only the well-known temporal modulations around 4 Hz correlated with orofacial motion. The different bandpass ranges of AV correlation align notably with the average rates at which syllables (3-4 Hz) and phrases (1-2 Hz) are produced in natural speech. Whereas periodicities at the syllable rate are evident in the envelope spectrum of the speech signal itself, slower 1-2 Hz regularities thus only become prominent when considering crossmodal signal statistics. This may indicate a motor origin of temporal regularities at the timescales of syllables and phrases in natural speech.
| S-EPMC9295967 | biostudies-literature
Project description:Speech production is studied from both psycholinguistic and motor-control perspectives, with little interaction between the approaches. We assessed the explanatory value of integrating psycholinguistic and motor-control concepts for theories of speech production. By augmenting a popular psycholinguistic model of lexical retrieval with a motor-control-inspired architecture, we created a new computational model to explain speech errors in the context of aphasia. Comparing the model fits to picture-naming data from 255 aphasic patients, we found that our new model improves fits for a theoretically predictable subtype of aphasia: conduction. We discovered that the improved fits for this group were a result of strong auditory-lexical feedback activation, combined with weaker auditory-motor feedforward activation, leading to increased competition from phonologically related neighbors during lexical selection. We discuss the implications of our findings with respect to other extant models of lexical retrieval.
| S-EPMC5363858 | biostudies-literature