CMU-MOSEAS: A Multimodal Language Dataset for Spanish, Portuguese, German and French.
Ontology highlight
ABSTRACT:
SUBMITTER: Zadeh A
PROVIDER: S-EPMC8106386 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:American English (AE) speakers' perceptual assimilation of 14 North German (NG) and 9 Parisian French (PF) vowels was examined in two studies using citation-form disyllables (study 1) and sentences with vowels surrounded by labial and alveolar consonants in multisyllabic nonsense words (study 2). Listeners categorized multiple tokens of each NG and PF vowel as most similar to selected AE vowels and rated their category "goodness" on a nine-point Likert scale. Front, rounded vowels were assimilated primarily to back AE vowels, despite their acoustic similarity to front AE vowels. In study 1, they were considered poorer exemplars of AE vowels than were NG and PF back, rounded vowels; in study 2, front and back, rounded vowels were perceived as similar to each other. Assimilation of some front, unrounded and back, rounded NG and PF vowels varied with language, speaking style, and consonantal context. Differences in perceived similarity often could not be predicted from context-specific cross-language spectral similarities. Results suggest that listeners can access context-specific, phonetic details when listening to citation-form materials, but assimilate non-native vowels on the basis of context-independent phonological equivalence categories when processing continuous speech. Results are interpreted within the Automatic Selective Perception model of speech perception.
| S-EPMC2757423 | biostudies-other
Project description:This dataset, colloquially known as the Mother Of Unification Studies (MOUS) dataset, contains multimodal neuroimaging data that has been acquired from 204 healthy human subjects. The neuroimaging protocol consisted of magnetic resonance imaging (MRI) to derive information at high spatial resolution about brain anatomy and structural connections, and functional data during task, and at rest. In addition, magnetoencephalography (MEG) was used to obtain high temporal resolution electrophysiological measurements during task, and at rest. All subjects performed a language task, during which they processed linguistic utterances that either consisted of normal or scrambled sentences. Half of the subjects were reading the stimuli, the other half listened to the stimuli. The resting state measurements consisted of 5?minutes eyes-open for the MEG and 7?minutes eyes-closed for fMRI. The neuroimaging data, as well as the information about the experimental events are shared according to the Brain Imaging Data Structure (BIDS) format. This unprecedented neuroimaging language data collection allows for the investigation of various aspects of the neurobiological correlates of language.
| S-EPMC6472396 | biostudies-literature
Project description:We present a synchronized multimodal neuroimaging dataset for studying brain language processing (SMN4Lang) that contains functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG) data on the same 12 healthy volunteers while the volunteers listened to 6 hours of naturalistic stories, as well as high-resolution structural (T1, T2), diffusion MRI and resting-state fMRI data for each participant. We also provide rich linguistic annotations for the stimuli, including word frequencies, syntactic tree structures, time-aligned characters and words, and various types of word and character embeddings. Quality assessment indicators verify that this is a high-quality neuroimaging dataset. Such synchronized data is separately collected by the same group of participants first listening to story materials in fMRI and then in MEG which are well suited to studying the dynamic processing of language comprehension, such as the time and location of different linguistic features encoded in the brain. In addition, this dataset, comprising a large vocabulary from stories with various topics, can serve as a brain benchmark to evaluate and improve computational language models.
| S-EPMC9525723 | biostudies-literature
Project description:Benford's Law states that, in many real-world data sets, the frequency of numbers' first digits is predicted by the formula log(1 + (1/d)). Numbers beginning with a 1 occur roughly 30% of the time, and are six times more common than numbers beginning with a 9. We show that Benford's Law applies to the the frequency rank of words in English, German, French, Spanish, and Italian. We calculated the frequency rank of words in the Google Ngram Viewer corpora. Then, using the first significant digit of the frequency rank, we found the FSD distribution adhered to the expected Benford's Law distribution. Over a series of additional corpora from sources ranging from news to books to social media and across the languages studied, we consistently found adherence to Benford's Law. Furthermore, at the user-level on social media, we found Benford's Law holds for the vast majority of users' collected posts and significant deviations from Benford's Law tends to be a mark of spam bots.
| S-EPMC10501622 | biostudies-literature
Project description:The study of articulatory gestures has a wide spectrum of applications, notably in speech production and recognition. Sets of phonemes, as well as their articulation, are language-specific; however, existing MRI databases mostly include English speakers. In our present work, we introduce a dataset acquired with MRI from 10 healthy native French speakers. A corpus consisting of synthetic sentences was used to ensure a good coverage of the French phonetic context. A real-time MRI technology with temporal resolution of 20 ms was used to acquire vocal tract images of the participants speaking. The sound was recorded simultaneously with MRI, denoised and temporally aligned with the images. The speech was transcribed to obtain phoneme-wise segmentation of sound. We also acquired static 3D MR images for a wide list of French phonemes. In addition, we include annotations of spontaneous swallowing.
| S-EPMC8486854 | biostudies-literature
Project description:In delineating the amount of orthographic information that can be processed in parallel during a single fixation, the visual attention (VA) span acts as a key component of the reading system. Previous studies focused on the contribution of VA span to normal and pathological reading in monolingual and bilingual children from different European languages, without direct cross-language comparison. In the current paper, we explored modulations of VA span abilities in three languages -French, Spanish, and Arabic- that differ in transparency, reading direction and writing systems. The participants were skilled adult readers who were native speakers of French, Spanish or Arabic. They were administered tasks of global and partial letter report, single letter identification and text reading. Their VA span abilities were assessed using tasks that require the processing of briefly presented five consonant strings (e.g., R S H F T). All five consonants had to be reported in global report but a single cued letter in partial report. Results showed that VA span was reduced in Arabic readers as compared to French or Spanish readers who otherwise show a similar high performance in the two report tasks. The analysis of VA span response patterns in global report showed a left-right asymmetry in all three languages. A leftward letter advantage was found in French and Spanish but a rightward advantage in Arabic. The response patterns were symmetric in partial report, regardless of the language. Last, a significant relationship was found between VA span abilities and reading speed but only for French. The overall findings suggest that the size of VA span, the shape of VA span response patterns and the VA Span-reading relationship are modulated by language-specific features.
| S-EPMC4779959 | biostudies-literature
Project description:Even in highly-developed countries, as many as 15-30% of the population can only understand texts written using a basic vocabulary. Their understanding of everyday texts is limited, which prevents them from taking an active role in society and making informed decisions regarding healthcare, legal representation, or democratic choice. Lexical simplification is a natural language processing task that aims to make text understandable to everyone by replacing complex vocabulary and expressions with simpler ones, while preserving the original meaning. It has attracted considerable attention in the last 20 years, and fully automatic lexical simplification systems have been proposed for various languages. The main obstacle for the progress of the field is the absence of high-quality datasets for building and evaluating lexical simplification systems. In this study, we present a new benchmark dataset for lexical simplification in English, Spanish, and (Brazilian) Portuguese, and provide details about data selection and annotation procedures, to enable compilation of comparable datasets in other languages and domains. As the first multilingual lexical simplification dataset, where instances in all three languages were selected and annotated using comparable procedures, this is the first dataset that offers a direct comparison of lexical simplification systems for three languages. To showcase the usability of the dataset, we adapt two state-of-the-art lexical simplification systems with differing architectures (neural vs. non-neural) to all three languages (English, Spanish, and Brazilian Portuguese) and evaluate their performances on our new dataset. For a fairer comparison, we use several evaluation measures which capture varied aspects of the systems' efficacy, and discuss their strengths and weaknesses. We find that a state-of-the-art neural lexical simplification system outperforms a state-of-the-art non-neural lexical simplification system in all three languages, according to all evaluation measures. More importantly, we find that the state-of-the-art neural lexical simplification systems perform significantly better for English than for Spanish and Portuguese, thus posing a question if such an architecture can be used for successful lexical simplification in other languages, especially the low-resourced ones.
| S-EPMC9536312 | biostudies-literature
Project description:Human language is often multimodal, which comprehends a mixture of natural language, facial gestures, and acoustic behaviors. However, two major challenges in modeling such multimodal human language time-series data exist: 1) inherent data non-alignment due to variable sampling rates for the sequences from each modality; and 2) long-range dependencies between elements across modalities. In this paper, we introduce the Multimodal Transformer (MulT) to generically address the above issues in an end-to-end manner without explicitly aligning the data. At the heart of our model is the directional pairwise cross-modal attention, which attends to interactions between multimodal sequences across distinct time steps and latently adapt streams from one modality to another. Comprehensive experiments on both aligned and non-aligned multimodal time-series show that our model outperforms state-of-the-art methods by a large margin. In addition, empirical analysis suggests that correlated crossmodal signals are able to be captured by the proposed crossmodal attention mechanism in MulT.
| S-EPMC7195022 | biostudies-literature
Project description:Epidemiology and public health are usually context-specific. Journals published in different languages and countries play a role both as sources of data and as channels through which evidence is incorporated into local public health practice. Databases in these languages facilitate access to relevant journals, and professional education in these languages facilitates the growth of native expertise in epidemiology and public health. However, as English has become the lingua franca of scientific communication in the era of globalisation, many journals published in non-English languages face the difficult dilemma of either switching to English and competing internationally, or sticking to the native tongue and having a restricted circulation among a local readership. This paper discusses the historical development of epidemiology and the current scene of epidemiological and public health journals, databases and professional education in three Western European languages: French, German and Italian, and examines the dynamics and struggles they have today.
| S-EPMC2570667 | biostudies-literature
Project description:The research works linked to the thinking of the teaching staff influence the relevant influence that implicit theories exert on decision-making about classroom practise and on the academic performance of students. In this sense, the present study focuses on the teaching belief system about the development of argumentation in the commentary of multimodal texts. For this, a quantitative methodology based on non-experimental or ex post facto design with semi-structured and closed survey-questionnaire-type instruments has been selected. From a target population made up of Spanish teachers, 502 respondents selected using the non-probabilistic sampling technique applied the accessibility criterion. An ad hoc questionnaire has been drawn up consisting of 28 items digitised electronically using the survey platform of the University of Murcia. It has been structured in two blocks: the first aimed at establishing the sociodemographic and professional profile of the participants and the second at collecting data related to the teachers' beliefs regarding the work of the text commentary in class. The results show five professional profiles defined based on the implicit theories and the pedagogical model to which they are associated. It is also found that the majority declare that they align themselves with non-conservative didactic trends or approaches, centred on the student body and oriented toward the construction of critical knowledge. In this regard, manifest contradictions are detected between his implicit and explicit epistemological convictions. The findings of this study offer guidelines for the design of an effective and efficient argumentative text commentary formative proposal.
| S-EPMC8579127 | biostudies-literature