3D Bird Reconstruction: a Dataset, Model, and Shape Recovery from a Single View
Ontology highlight
ABSTRACT:
SUBMITTER: Badger M
PROVIDER: S-EPMC9273110 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Single-shot 3D imaging and shape reconstruction has seen a surge of interest due to the ever-increasing evolution in sensing technologies. In this paper, a robust single-shot 3D shape reconstruction technique integrating the structured light technique with the deep convolutional neural networks (CNNs) is proposed. The input of the technique is a single fringe-pattern image, and the output is the corresponding depth map for 3D shape reconstruction. The essential training and validation datasets with high-quality 3D ground-truth labels are prepared by using a multi-frequency fringe projection profilometry technique. Unlike the conventional 3D shape reconstruction methods which involve complex algorithms and intensive computation to determine phase distributions or pixel disparities as well as depth map, the proposed approach uses an end-to-end network architecture to directly carry out the transformation of a 2D image to its corresponding 3D depth map without extra processing. In the approach, three CNN-based models are adopted for comparison. Furthermore, an accurate structured-light-based 3D imaging dataset used in this paper is made publicly available. Experiments have been conducted to demonstrate the validity and robustness of the proposed technique. It is capable of satisfying various 3D shape reconstruction demands in scientific research and engineering applications.
| S-EPMC7374384 | biostudies-literature
Project description:Unmanned aerial vehicles (UAVs) have become popular platforms for collecting various types of geospatial data for various mapping, monitoring and modelling applications. With the advancement of imaging and computing technologies, a vast variety of photogrammetric, computer-vision and, nowadays, end-to-end learning workflows are introduced to produce three-dimensional (3D) information in form of digital surface and terrain models, textured meshes, rectified mosaics, CAD models, etc. These 3D products might be used in applications where accuracy and precision play a vital role, e.g. structural health monitoring. Therefore, extensive tests against data with relevant characteristics and reliable ground-truth are required to assess and ensure the performance of 3D modelling workflows. This article describes the images collected by a customized unmanned aerial vehicle (UAV) system from an open-pit gravel mine accompanied with additional data that will allow implementing and evaluating any structure-from-motion or photogrammetric approach for sparse or dense 3D reconstruction. This dataset includes total of 158 high-quality images captured with more than 80% endlap and spatial resolution higher than 1.5 cm, the 3D coordinates of 109 ground control points and checkpoints, 2D coordinates of more than 40K corresponding points among the images, a subset of 25 multi-view stereo images selected from an area of approximately 30 m × 40 m within the scene accompanied with a dense point cloud measured by a terrestrial laser scanner.
| S-EPMC6554229 | biostudies-literature
Project description:We provide a database aimed at real-time quantitative analysis of 3D reconstruction and alignment methods, containing 3140 point clouds from 10 subjects/objects. These scenes are acquired with a high-resolution 3D scanner. It contains depth maps that produce point clouds with more than 500k points on average. This dataset is useful to develop new models and alignment strategies to automatically reconstruct 3D scenes from data acquired with optical scanners or benchmarking purposes.
| S-EPMC8529091 | biostudies-literature
Project description:In natural conditions the human visual system can estimate the 3D shape of specular objects even from a single image. Although previous studies suggested that the orientation field plays a key role for 3D shape perception from specular reflections, its computational plausibility, and possible mechanisms have not been investigated. In this study, to complement the orientation field information, we first add prior knowledge that objects are illuminated from above and utilize the vertical polarity of the intensity gradient. Then we construct an algorithm that incorporates these two image cues to estimate 3D shapes from a single specular image. We evaluated the algorithm with glossy and mirrored surfaces and found that 3D shapes can be recovered with a high correlation coefficient of around 0.8 with true surface shapes. Moreover, under a specific condition, the algorithm's errors resembled those made by human observers. These findings show that the combination of the orientation field and the vertical polarity of the intensity gradient is computationally sufficient and probably reproduces essential representations used in human shape perception from specular reflections.
| S-EPMC6407488 | biostudies-literature
Project description:In this paper, a real-time, dynamic three-dimensional (3D) shape reconstruction scheme based on the Fourier-transform profilometry (FTP) method is achieved with a short-wave infrared (SWIR) indium gallium arsenide (InGaAs) camera for monitoring applications in low illumination environments. A SWIR 3D shape reconstruction system is built for generating and acquiring the SWIR two-dimensional (2D) fringe pattern of the target. The depth information of the target is reconstructed by employing an improved FTP method, which has the advantages of high reconstruction accuracy and speed. The maximum error in depth for static 3D shape reconstruction is 1.15 mm for a plastic model with a maximum depth of 36 mm. Meanwhile, a real-time 3D shape reconstruction with a frame rate of 25 Hz can be realized by this system, which has great application prospects in real-time dynamic 3D shape reconstruction, such as low illumination monitoring. In addition, for real-time dynamic 3D shape reconstruction, without considering the edge areas, the maximum error in depth among all frames is 1.42 mm for a hemisphere with a depth of 35 mm, and the maximum error of the average of all frames in depth is 0.52 mm.
| S-EPMC7014486 | biostudies-literature
Project description:Phenotypic analysis of cassava root crowns (CRCs) so far has been limited to visual inspection and very few measurements due to its laborious process in the field. Here, we developed a platform for acquiring 3D CRC models using close-range photogrammetry for phenotypic analysis. The state of the art is a low cost and easy to set up 3D acquisition requiring only a background sheet, a reference object and a camera, compatible with field experiments in remote areas. We tested different software with CRC samples, and Agisoft and Blender were the most suitable software for generating high-quality 3D models and data analysis, respectively. We optimized the workflow by testing different numbers of images for 3D reconstruction and found that a minimum of 25 images per CRC can provide high quality 3D models. Up to ten traits, including 3D crown volumes, 3D crown surface, root density, surface-to-volume ratio, root numbers, root angle, crown diameter, cylinder soil volume, CRC compactness and root length can be extracted providing novel parameters for studying cassava storage roots. We applied this platform to partial-inbred cassava populations and demonstrated that our platform provides reliable 3D CRC modelling for phenotypic analysis, analysis of genetic variances and supporting breeding selection.
| S-EPMC9200979 | biostudies-literature
Project description:Insect wings are highly evolved structures with aerodynamic and structural properties that are not fully understood or systematically modeled. Most species in the insect order Odonata have permanently deployed high aspect ratio wings. Odonata have been documented to exhibit extraordinary flight performance and a wide range of interesting flight behaviors that rely on agility and efficiency. The characteristic three-dimensional corrugated structures of these wings have been observed and modeled for a small number of species, with studies showing that corrugations can provide significant aerodynamic and structural advantages. Comprehensive museum collections are the most practical source of Odonata wing, despite the risk of adverse effects caused by dehydration and preservation of specimens. Museum specimens are not to be handled or damaged and are best left undisturbed in their display enclosures. We have undertaken a systematic process of scanning, modeling, and post-processing the wings of over 80 Odonata species using a novel and accurate method and apparatus we developed for this purpose. The method allows the samples to stay inside their glass cases if necessary and is non-destructive. The measurements taken have been validated against micro-computed tomography scanning and against similar-sized objects with measured dimensions. The resulting publicly available dataset will allow aeronautical analysis of Odonata aerodynamics and structures, the study of the evolution of functional structures, and research into insect ecology. The technique is useable for other orders of insects and other fragile samples.
| S-EPMC7190169 | biostudies-literature
Project description:Hand shape and pose recovery is essential for many computer vision applications such as animation of a personalized hand mesh in a virtual environment. Although there are many hand pose estimation methods, only a few deep learning based algorithms target 3D hand shape and pose from a single RGB or depth image. Jointly estimating hand shape and pose is very challenging because none of the existing real benchmarks provides ground truth hand shape. For this reason, we propose a novel weakly-supervised approach for 3D hand shape and pose recovery (named WHSP-Net) from a single depth image by learning shapes from unlabeled real data and labeled synthetic data. To this end, we propose a novel framework which consists of three novel components. The first is the Convolutional Neural Network (CNN) based deep network which produces 3D joints positions from learned 3D bone vectors using a new layer. The second is a novel shape decoder that recovers dense 3D hand mesh from sparse joints. The third is a novel depth synthesizer which reconstructs 2D depth image from 3D hand mesh. The whole pipeline is fine-tuned in an end-to-end manner. We demonstrate that our approach recovers reasonable hand shapes from real world datasets as well as from live stream of depth camera in real-time. Our algorithm outperforms state-of-the-art methods that output more than the joint positions and shows competitive performance on 3D pose estimation task.
| S-EPMC6749339 | biostudies-literature
Project description:Analysis of microscopy images can provide insight into many biological processes. One particularly challenging problem is cellular nuclear segmentation in highly anisotropic and noisy 3D image data. Manually localizing and segmenting each and every cellular nucleus is very time-consuming, which remains a bottleneck in large-scale biological experiments. In this work, we present a tool for automated segmentation of cellular nuclei from 3D fluorescent microscopic data. Our tool is based on state-of-the-art image processing and machine learning techniques and provides a user-friendly graphical user interface. We show that our tool is as accurate as manual annotation and greatly reduces the time for the registration.
| S-EPMC4389647 | biostudies-literature
Project description:Plant phenotyping is essential in plant breeding and management. High-throughput data acquisition and automatic phenotypes extraction are common concerns in plant phenotyping. Despite the development of phenotyping platforms and the realization of high-throughput three-dimensional (3D) data acquisition in tall plants, such as maize, handling small-size plants with complex structural features remains a challenge. This study developed a miniaturized shoot phenotyping platform MVS-Pheno V2 focusing on low plant shoots. The platform is an improvement of MVS-Pheno V1 and was developed based on multi-view stereo 3D reconstruction. It has the following four components: Hardware, wireless communication and control, data acquisition system, and data processing system. The hardware sets the rotation on top of the platform, separating plants to be static while rotating. A novel local network was established to realize wireless communication and control; thus, preventing cable twining. The data processing system was developed to calibrate point clouds and extract phenotypes, including plant height, leaf area, projected area, shoot volume, and compactness. This study used three cultivars of wheat shoots at four growth stages to test the performance of the platform. The mean absolute percentage error of point cloud calibration was 0.585%. The squared correlation coefficient R 2 was 0.9991, 0.9949, and 0.9693 for plant height, leaf length, and leaf width, respectively. The root mean squared error (RMSE) was 0.6996, 0.4531, and 0.1174 cm for plant height, leaf length, and leaf width. The MVS-Pheno V2 platform provides an alternative solution for high-throughput phenotyping of low individual plants and is especially suitable for shoot architecture-related plant breeding and management studies.
| S-EPMC9393617 | biostudies-literature