DenseMatch: a dataset for real-time 3D reconstruction
Ontology highlight
ABSTRACT:
SUBMITTER: Lombardi M
PROVIDER: S-EPMC8529091 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:In this paper, a real-time, dynamic three-dimensional (3D) shape reconstruction scheme based on the Fourier-transform profilometry (FTP) method is achieved with a short-wave infrared (SWIR) indium gallium arsenide (InGaAs) camera for monitoring applications in low illumination environments. A SWIR 3D shape reconstruction system is built for generating and acquiring the SWIR two-dimensional (2D) fringe pattern of the target. The depth information of the target is reconstructed by employing an improved FTP method, which has the advantages of high reconstruction accuracy and speed. The maximum error in depth for static 3D shape reconstruction is 1.15 mm for a plastic model with a maximum depth of 36 mm. Meanwhile, a real-time 3D shape reconstruction with a frame rate of 25 Hz can be realized by this system, which has great application prospects in real-time dynamic 3D shape reconstruction, such as low illumination monitoring. In addition, for real-time dynamic 3D shape reconstruction, without considering the edge areas, the maximum error in depth among all frames is 1.42 mm for a hemisphere with a depth of 35 mm, and the maximum error of the average of all frames in depth is 0.52 mm.
| S-EPMC7014486 | biostudies-literature
Project description:The study of articulatory gestures has a wide spectrum of applications, notably in speech production and recognition. Sets of phonemes, as well as their articulation, are language-specific; however, existing MRI databases mostly include English speakers. In our present work, we introduce a dataset acquired with MRI from 10 healthy native French speakers. A corpus consisting of synthetic sentences was used to ensure a good coverage of the French phonetic context. A real-time MRI technology with temporal resolution of 20 ms was used to acquire vocal tract images of the participants speaking. The sound was recorded simultaneously with MRI, denoised and temporally aligned with the images. The speech was transcribed to obtain phoneme-wise segmentation of sound. We also acquired static 3D MR images for a wide list of French phonemes. In addition, we include annotations of spontaneous swallowing.
| S-EPMC8486854 | biostudies-literature
Project description:Unmanned aerial vehicles (UAVs) have become popular platforms for collecting various types of geospatial data for various mapping, monitoring and modelling applications. With the advancement of imaging and computing technologies, a vast variety of photogrammetric, computer-vision and, nowadays, end-to-end learning workflows are introduced to produce three-dimensional (3D) information in form of digital surface and terrain models, textured meshes, rectified mosaics, CAD models, etc. These 3D products might be used in applications where accuracy and precision play a vital role, e.g. structural health monitoring. Therefore, extensive tests against data with relevant characteristics and reliable ground-truth are required to assess and ensure the performance of 3D modelling workflows. This article describes the images collected by a customized unmanned aerial vehicle (UAV) system from an open-pit gravel mine accompanied with additional data that will allow implementing and evaluating any structure-from-motion or photogrammetric approach for sparse or dense 3D reconstruction. This dataset includes total of 158 high-quality images captured with more than 80% endlap and spatial resolution higher than 1.5 cm, the 3D coordinates of 109 ground control points and checkpoints, 2D coordinates of more than 40K corresponding points among the images, a subset of 25 multi-view stereo images selected from an area of approximately 30 m × 40 m within the scene accompanied with a dense point cloud measured by a terrestrial laser scanner.
| S-EPMC6554229 | biostudies-literature
Project description:Single-photon lidar has emerged as a prime candidate technology for depth imaging through challenging environments. Until now, a major limitation has been the significant amount of time required for the analysis of the recorded data. Here we show a new computational framework for real-time three-dimensional (3D) scene reconstruction from single-photon data. By combining statistical models with highly scalable computational tools from the computer graphics community, we demonstrate 3D reconstruction of complex outdoor scenes with processing times of the order of 20?ms, where the lidar data was acquired in broad daylight from distances up to 320?metres. The proposed method can handle an unknown number of surfaces in each pixel, allowing for target detection and imaging through cluttered scenes. This enables robust, real-time target reconstruction of complex moving scenes, paving the way for single-photon lidar at video rates for practical 3D imaging applications.
| S-EPMC6825222 | biostudies-literature
Project description:Real-time magnetic resonance imaging (RT-MRI) of human speech production is enabling significant advances in speech science, linguistics, bio-inspired speech technology development, and clinical applications. Easy access to RT-MRI is however limited, and comprehensive datasets with broad access are needed to catalyze research across numerous domains. The imaging of the rapidly moving articulators and dynamic airway shaping during speech demands high spatio-temporal resolution and robust reconstruction methods. Further, while reconstructed images have been published, to-date there is no open dataset providing raw multi-coil RT-MRI data from an optimized speech production experimental setup. Such datasets could enable new and improved methods for dynamic image reconstruction, artifact correction, feature extraction, and direct extraction of linguistically-relevant biomarkers. The present dataset offers a unique corpus of 2D sagittal-view RT-MRI videos along with synchronized audio for 75 participants performing linguistically motivated speech tasks, alongside the corresponding public domain raw RT-MRI data. The dataset also includes 3D volumetric vocal tract MRI during sustained speech sounds and high-resolution static anatomical T2-weighted upper airway MRI for each participant.
| S-EPMC8292336 | biostudies-literature
Project description:Gel'fand and Graev performed classical work on the inversion of integral transforms in different spaces [Gel'fand and Graev, Funct. Anal. Appl. 25(1) 1-5 (1991)]. This paper discusses their key results for further research and development.The Gel'fand-Graev inversion formula reveals a fundamental relationship between projection data and the Hilbert transform of an image to be reconstructed. This differential backprojection (DBP)∕backprojection filtration (BPF) approach was rediscovered in the CT field, and applied in important applications such as reconstruction from truncated projections, interior tomography, and limited-angle tomography. Here the authors present the Gel'fand-Graev inversion formula in a 3D setting assuming the 1D x-ray transform.The pseudodifferential operator is a powerful theoretical tool. There is a fundamental mathematical link between the Gel'fand-Graev formula and the DBP (or BPF) approach in the case of the 1D x-ray transform in a 3D real space.This paper shows the power of mathematics for tomographic imaging and the value of a pure theoretical finding, which may appear quite irrelevant to daily healthcare at the first glance.
| S-EPMC3172127 | biostudies-other
Project description:Complex dynamic tomographic experiments at brilliant X-ray light sources require real-time feedback on the sample changes with respect to environmental conditions, selecting representative regions of interest for high-resolution scanning, and on-demand data saving mechanisms for storing only relevant projections acquired by fast area detectors and reducing data volumes. Here the implementation details of a 3D real-time imaging monitoring instrument, with zooming to a volume of interest with easy-to-use visualization via ImageJ, a tool familiar to most beamline users, is presented. The instrument relies on optimized data flow between the detector and processing machines and is implemented on commodity computers. The instrument has been developed at beamline 2-BM of the Advanced Photon Source, where the automatic lens changing mechanism for zooming is implemented with an Optique Peter microscope. Performance tests demonstrate the ability to process more than 3 GB of projection data per second and generate real-time 3D zooming with different magnification. These new capabilities are essential for new APS Upgrade instruments such as the projection microscope under development at beamline 32-ID. The efficacy of the proposed instrument was demonstrated during an in situ tomographic experiment on ice and gas hydrate formation in porous samples.
| S-EPMC9070713 | biostudies-literature
Project description:Insect wings are highly evolved structures with aerodynamic and structural properties that are not fully understood or systematically modeled. Most species in the insect order Odonata have permanently deployed high aspect ratio wings. Odonata have been documented to exhibit extraordinary flight performance and a wide range of interesting flight behaviors that rely on agility and efficiency. The characteristic three-dimensional corrugated structures of these wings have been observed and modeled for a small number of species, with studies showing that corrugations can provide significant aerodynamic and structural advantages. Comprehensive museum collections are the most practical source of Odonata wing, despite the risk of adverse effects caused by dehydration and preservation of specimens. Museum specimens are not to be handled or damaged and are best left undisturbed in their display enclosures. We have undertaken a systematic process of scanning, modeling, and post-processing the wings of over 80 Odonata species using a novel and accurate method and apparatus we developed for this purpose. The method allows the samples to stay inside their glass cases if necessary and is non-destructive. The measurements taken have been validated against micro-computed tomography scanning and against similar-sized objects with measured dimensions. The resulting publicly available dataset will allow aeronautical analysis of Odonata aerodynamics and structures, the study of the evolution of functional structures, and research into insect ecology. The technique is useable for other orders of insects and other fragile samples.
| S-EPMC7190169 | biostudies-literature
Project description:The present dataset provides experimental measurements of the 3D liquid/gas interface shape during lateral water sloshing in a partially filled cylindrical container. The measurement technique used to acquire the data is the Reference Image Topography [1] based on a Synthetic Schlieren Free-Surface Reconstruction method [2]. A modified version of the processing algorithm has been used. This one transforms the coordinate system from Cartesian to polar so that the computational domain only includes the area where the fluid is present. Moreover, it uses the conservation of the fluid volume into the investigated area that permits to obtain the absolute height. This allows overcoming the strong limitation of the RIT method regarding the inability to detect changes of the mean surface height, at the condition that the complete and only liquid domain recorded in the images is used in the inversion algorithm. The complete details of the post-processing of the images is reported in the paper associated to this DIB [3]. The dataset includes the external excitation history and maps of the liquid/gas interface acquired during the experiment. These data are considered fundamental for the validation of CFD simulations of sloshing and of simplified theoretical models. A set of 12 test cases are reported in this DIB. A part of these test cases refers to steady state sloshing and a part to sloshing damping. In the last cases, also the 3D map of damping coefficients, calculated using the logarithmic decrement method, is provided.
| S-EPMC7725740 | biostudies-literature
Project description:Automated capture of animal pose is transforming how we study neuroscience and social behavior. Movements carry important social cues, but current methods are not able to robustly estimate pose and shape of animals, particularly for social animals such as birds, which are often occluded by each other and objects in the environment. To address this problem, we first introduce a model and multi-view optimization approach, which we use to capture the unique shape and pose space displayed by live birds. We then introduce a pipeline and experiments for keypoint, mask, pose, and shape regression that recovers accurate avian postures from single views. Finally, we provide extensive multi-view keypoint and mask annotations collected from a group of 15 social birds housed together in an outdoor aviary. The project website with videos, results, code, mesh model, and the Penn Aviary Dataset can be found at https://marcbadger.github.io/avian-mesh.
| S-EPMC9273110 | biostudies-literature