SpeakingFaces: A Large-Scale Multimodal Dataset of Voice Commands with Visual and Thermal Video Streams.
Ontology highlight
ABSTRACT:
SUBMITTER: Abdrakhmanova M
PROVIDER: S-EPMC8156799 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:ObjectivesAlthough patient-reported outcome measures (PROMs) can be useful for assessing quality of life, they can be complex and cognitively burdensome. In this study, we prospectively evaluated a simple patient-reported voice assessment measure on a visual analog scale (VAS voice) and compared it with the Voice Handicap Index (VHI-10).Study designProspective survey.MethodsAn abbreviated voice measure was designed by a team of otolaryngologists, speech pathologists, and patients that consisted of four VAS questions related to (a) a global question of voice disturbance, (b) physical function of voice, (c) functional issues, and (d) emotional handicap. All English-speaking patients presenting to an academic laryngology clinic for a voice complaint were included. Internal consistency and validity were assessed with comparison to the VHI-10.ResultsA total of 209 patients were enrolled. Ninety-two percent of patients reported understanding the survey. The four-item VAS survey was highly correlated with VHI-10 score (Pearson correlation .81, P < .0001), and the Cronbach's alpha between all four VAS questions was .94. Age, gender, and diagnosis were not associated with either the global VAS or VHI-10 tool.ConclusionReducing the complexity of instruments assessing voice-related quality of life is feasible, and the VAS voice correlated with existing measures. Simplified assessments may offer advantages compared to more cumbersome PROMs.Level of evidence2c.
| S-EPMC7042645 | biostudies-literature
Project description:Our ability to return to the start of a route recently performed in darkness is thought to reflect path integration of motion-related information. Here we provide evidence that motion-related interoceptive representations (proprioceptive, vestibular, and motor efference copy) combine with visual representations to form a single multimodal representation guiding navigation. We used immersive virtual reality to decouple visual input from motion-related interoception by manipulating the rotation or translation gain of the visual projection. First, participants walked an outbound path with both visual and interoceptive input, and returned to the start in darkness, demonstrating the influences of both visual and interoceptive information in a virtual reality environment. Next, participants adapted to visual rotation gains in the virtual environment, and then performed the path integration task entirely in darkness. Our findings were accurately predicted by a quantitative model in which visual and interoceptive inputs combine into a single multimodal representation guiding navigation, and are incompatible with a model of separate visual and interoceptive influences on action (in which path integration in darkness must rely solely on interoceptive representations). Overall, our findings suggest that a combined multimodal representation guides large-scale navigation, consistent with a role for visual imagery or a cognitive map.
| S-EPMC3024704 | biostudies-other
Project description:Large high-quality datasets of human body shape and kinematics lay the foundation for modelling and simulation approaches in computer vision, computer graphics, and biomechanics. Creating datasets that combine naturalistic recordings with high-accuracy data about ground truth body shape and pose is challenging because different motion recording systems are either optimized for one or the other. We address this issue in our dataset by using different hardware systems to record partially overlapping information and synchronized data that lend themselves to transfer learning. This multimodal dataset contains 9 hours of optical motion capture data, 17 hours of video data from 4 different points of view recorded by stationary and hand-held cameras, and 6.6 hours of inertial measurement units data recorded from 60 female and 30 male actors performing a collection of 21 everyday actions and sports movements. The processed motion capture data is also available as realistic 3D human meshes. We anticipate use of this dataset for research on human pose estimation, action recognition, motion modelling, gait analysis, and body shape reconstruction.
| S-EPMC8211257 | biostudies-literature
Project description:Advances in Artificial Intelligence in Education (AIEd) and the ever-growing scale of Interactive Educational Systems (IESs) have led to the rise of data-driven approaches for knowledge tracing and learning path recommendation. Unfortunately, collecting student interaction data is challenging and costly. As a result, there is no public large-scale benchmark dataset reflecting the wide variety of student behaviors observed in modern IESs. Although several datasets, such as ASSISTments, Junyi Academy, Synthetic and STATICS are publicly available and widely used, they are not large enough to leverage the full potential of state-of-the-art data-driven models. Furthermore, the recorded behavior is limited to question-solving activities. To this end, we introduce EdNet, a large-scale hierarchical dataset of diverse student activities collected by Santa, a multi-platform self-study solution equipped with an artificial intelligence tutoring system. EdNet contains 131,417,236 interactions from 784,309 students collected over more than 2 years, making it the largest public IES dataset released to date. Unlike existing datasets, EdNet records a wide variety of student actions ranging from question-solving to lecture consumption to item purchasing. Also, EdNet has a hierarchical structure which divides the student actions into 4 different levels of abstractions. The features of EdNet are domain-agnostic, allowing EdNet to be easily extended to different domains. The dataset is publicly released for research purposes. We plan to host challenges in multiple AIEd tasks with EdNet to provide a common ground for the fair comparison between different state-of-the-art models and to encourage the development of practical and effective methods.
| S-EPMC7334672 | biostudies-literature
Project description:High-throughput gene expression profiling has become an important tool for investigating transcriptional activity in a variety of biological samples. To date, the vast majority of these experiments have focused on specific biological processes and perturbations. Here, we have generated and analyzed gene expression from a set of samples spanning a broad range of biological conditions. Specifically, we profiled gene expression from 91 human and mouse samples across a diverse array of tissues, organs, and cell lines. Because these samples predominantly come from the normal physiological state in the human and mouse, this dataset represents a preliminary, but substantial, description of the normal mammalian transcriptome. We have used this dataset to illustrate methods of mining these data, and to reveal insights into molecular and physiological gene function, mechanisms of transcriptional regulation, disease etiology, and comparative genomics. Finally, to allow the scientific community to use this resource, we have built a free and publicly accessible website (http://expression.gnf.org) that integrates data visualization and curation of current gene annotations. Keywords: other. This dataset is part of the TransQST collection.
2002-12-06 | E-GEOD-96 | biostudies-arrayexpress
Project description:The fundamental mechanisms governing macroscopic freckle defect formation during directional solidification are studied experimentally in a Hele-Shaw cell for a low-melting point Ga-25?wt.% In alloy and modelled numerically in three dimensions using a microscopic parallelized Cellular Automata Lattice Boltzmann Method. The size and distribution of freckles (long solute channels, or chimneys) are shown to be strongly dependent on the thermal profile of the casting, with flat, concave and convex isotherms being considered. For the flat isotherm case, no large-scale freckles form, while for concave or convex isotherms, large freckles appear but in different locations. The freckle formation mechanism is as expected buoyancy-driven, but the chimney stability, its long-term endurance and its location are shown to depend critically on the detailed convective transport through the inter-dendritic region. Flow is generated by curved isopleths of solute concentration. As solute density is different from that of the bulk fluid, gravity causes 'uphill' or 'downhill' lateral flow from the sample centre to the edges through the mush, feeding the freckle. An excellent agreement is obtained between the numerical model and real-time X-ray observations of a solidifying sample under strictly controlled temperature conditions. This article is part of the theme issue 'Heterogeneous materials: metastable and non-ergodic internal structures'.
| S-EPMC6460059 | biostudies-literature
Project description:People spend a substantial portion of their lives engaged in conversation, and yet, our scientific understanding of conversation is still in its infancy. Here, we introduce a large, novel, and multimodal corpus of 1656 conversations recorded in spoken English. This 7+ million word, 850-hour corpus totals more than 1 terabyte of audio, video, and transcripts, with moment-to-moment measures of vocal, facial, and semantic expression, together with an extensive survey of speakers' postconversation reflections. By taking advantage of the considerable scope of the corpus, we explore many examples of how this large-scale public dataset may catalyze future research, particularly across disciplinary boundaries, as scholars from a variety of fields appear increasingly interested in the study of conversation.
| S-EPMC10065445 | biostudies-literature
Project description:The optic tectum (called superior colliculus in mammals) is critical for eye-head gaze shifts as we navigate in the terrain and need to adapt our movements to the visual scene. The neuronal mechanisms underlying the tectal contribution to stimulus selection and gaze reorientation remains, however, unclear at the microcircuit level. To analyze this complex--yet phylogenetically conserved--sensorimotor system, we developed a novel in vitro preparation in the lamprey that maintains the eye and midbrain intact and allows for whole-cell recordings from prelabeled tectal gaze-controlling cells in the deep layer, while visual stimuli are delivered. We found that receptive field activation of these cells provide monosynaptic retinal excitation followed by local GABAergic inhibition (feedforward). The entire remaining retina, on the other hand, elicits only inhibition (surround inhibition). If two stimuli are delivered simultaneously, one inside and one outside the receptive field, the former excitatory response is suppressed. When local inhibition is pharmacologically blocked, the suppression induced by competing stimuli is canceled. We suggest that this rivalry between visual areas across the tectal map is triggered through long-range inhibitory tectal connections. Selection commands conveyed via gaze-controlling neurons in the optic tectum are, thus, formed through synaptic integration of local retinotopic excitation and global tectal inhibition. We anticipate that this mechanism not only exists in lamprey but is also conserved throughout vertebrate evolution.
| S-EPMC4403191 | biostudies-literature
Project description:Fast, volumetric imaging over large scales has been a long-standing challenge in biological microscopy. To address this challenge, we report an augmented variant of confocal microscopy that uses a series of reflecting pinholes axially distributed in the detection space, such that each pinhole probes a different depth within the sample. We thus obtain simultaneous multiplane imaging without the need for axial scanning. Our microscope technique is versatile and configured here to provide two-color fluorescence imaging with a field of view larger than a millimeter at video rate. Its general applicability is demonstrated with neuronal imaging of both Caenorhabditis elegans and mouse brains in vivo.
| S-EPMC8425499 | biostudies-literature
Project description:In this paper, we propose a new dataset for outdoor depth estimation from single and stereo RGB images. The dataset was acquired from the point of view of a pedestrian. Currently, the most novel approaches take advantage of deep learning-based techniques, which have proven to outperform traditional state-of-the-art computer vision methods. Nonetheless, these methods require large amounts of reliable ground-truth data. Despite there already existing several datasets that could be used for depth estimation, almost none of them are outdoor-oriented from an egocentric point of view. Our dataset introduces a large number of high-definition pairs of color frames and corresponding depth maps from a human perspective. In addition, the proposed dataset also features human interaction and great variability of data, as shown in this work.
| S-EPMC6715739 | biostudies-literature