Stereo3D: using stereo images to enrich 3D visualization.
Ontology highlight
ABSTRACT: Summary
Visualization in 3D space is a standard but critical process for examining the complex structure of high-dimensional data. Stereoscopic imaging technology can be adopted to enhance 3D representation of many complex data, especially those consisting of points and lines. We illustrate the simple steps that are involved and strongly recommend others to implement it in designing visualization software. To facilitate its application, we created a new software that can convert a regular 3D scatterplot or network figure to a pair of stereo images.Availability and implementation
Stereo3D is freely available as an open source R package released under an MIT license at https://github.com/bioinfoDZ/Stereo3D. Others can integrate the codes and implement the method in academic software.Contact
deyou.zheng@einsteinmed.org.Supplementary information
Supplementary data are available at Bioinformatics online.
SUBMITTER: Liu Y
PROVIDER: S-EPMC7390991 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description: Not available
| S-EPMC8257206 | biostudies-literature
Project description:Accurate and timely detection of plant diseases can help mitigate the worldwide losses experienced by the horticulture and agriculture industries each year. Thermal imaging provides a fast and non-destructive way of scanning plants for diseased regions and has been used by various researchers to study the effect of disease on the thermal profile of a plant. However, thermal image of a plant affected by disease has been known to be affected by environmental conditions which include leaf angles and depth of the canopy areas accessible to the thermal imaging camera. In this paper, we combine thermal and visible light image data with depth information and develop a machine learning system to remotely detect plants infected with the tomato powdery mildew fungus Oidium neolycopersici. We extract a novel feature set from the image data using local and global statistics and show that by combining these with the depth information, we can considerably improve the accuracy of detection of the diseased plants. In addition, we show that our novel feature set is capable of identifying plants which were not originally inoculated with the fungus at the start of the experiment but which subsequently developed disease through natural transmission.
| S-EPMC4393321 | biostudies-literature
Project description:The paper presents a novel depth-estimation method for light-field (LF) images based on innovative multi-stereo matching and machine-learning techniques. In the first stage, a novel block-based stereo matching algorithm is employed to compute the initial estimation. The proposed algorithm is specifically designed to operate on any pair of sub-aperture images (SAIs) in the LF image and to compute the pair's corresponding disparity map. For the central SAI, a disparity fusion technique is proposed to compute the initial disparity map based on all available pairwise disparities. In the second stage, a novel pixel-wise deep-learning (DL)-based method for residual error prediction is employed to further refine the disparity estimation. A novel neural network architecture is proposed based on a new structure of layers. The proposed DL-based method is employed to predict the residual error of the initial estimation and to refine the final disparity map. The experimental results demonstrate the superiority of the proposed framework and reveal that the proposed method achieves an average improvement of 15.65% in root mean squared error (RMSE), 43.62% in mean absolute error (MAE), and 5.03% in structural similarity index (SSIM) over machine-learning-based state-of-the-art methods.
| S-EPMC7663356 | biostudies-literature
Project description:PurposeThis study aimed to develop a fully automated deep learning ciliary body segmentation and assessment approach in three-dimensional ultrasound biomicroscopy (3D-UBM) images.MethodsEach 3D-UBM eye volume was aligned to the optic axis via multiplanar reformatting. Ciliary muscle and processes were manually annotated, and Deeplab-v3+ models with different loss functions were trained to segment the ciliary body (ciliary muscle and processes) in both en face and radial images.ResultsWe trained and tested the models on 4320 radial and 3864 en face images from 12 cadaver eye volumes. Deep learning models trained on radial images with Dice loss achieved the highest mean F1-score (0.89) for ciliary body segmentation. For three-class segmentation (ciliary muscle, processes, and background), radial images with Dice loss achieved the highest mean F1-score (0.75 for the ciliary process and 0.82 for the ciliary muscle). Part of the ciliary muscle (10.9%) was misclassified as the ciliary process and vice versa, which occurred owing to the difficulty in differentiating the ciliary muscle-processes border, even by experts. Deep learning segmentation made further editing by experts at least seven times faster than a fully manual approach. In eight cadaver eyes, the average ciliary muscle, process, and body volumes were 56 ± 9, 43 ± 13, and 99 ± 18 mm3, respectively. The average surface area of the ciliary muscle, process, and body were 346 ± 45, 363 ± 83, and 709 ± 80 mm2, respectively. We performed transscleral cyclophotocoagulation in cadaver eyes to shrink the ciliary processes. Both manual and automated measurements from deep learning segmentation show a decrease in volume, surface area, and 360° cross-sectional area measurements.ConclusionsThe proposed deep learning segmentation of the ciliary body and 3D measurements showed transscleral cyclophotocoagulation-related changes in the ciliary body.Translational relevanceAutomated ciliary body assessment using 3D-UBM has the translational potential for ophthalmic treatment planning and monitoring.
| S-EPMC9547360 | biostudies-literature
Project description:Three-dimensional (3D) reconstruction of capsule endoscopic images has been attempted for a long time to obtain more information on small bowel structures. Due to the limited hardware resources of capsule size and battery capacity, software approaches have been studied but have mainly exhibited inherent limitations. Recently, stereo camera-based capsule endoscopy, which can perform hardware-enabled 3D reconstruction, has been developed. We aimed to evaluate the feasibility of newly developed 3D capsule endoscopy in clinical practice. This study was a prospective, single-arm, feasibility study conducted at two university-affiliated hospitals in South Korea. Small bowel evaluation was performed using a newly developed 3D capsule endoscope for patients with obscure gastrointestinal bleeding, suspected or established Crohn's disease, small bowel tumors, and abdominal pain of unknown origin. We assessed the technical limitations, performance, and safety of the new capsule endoscope. Thirty-one patients (20 men and 11 women; mean age: 44.5 years) were enrolled. There was no technical defect preventing adequate visualization of the small bowel. The overall completion rate was 77.4%, the detection rate was 64.5%, and there was no capsule retention. All capsule endoscopic procedures were completed uneventfully. In conclusion, newly developed 3D capsule endoscopy was safe and feasible, showing similar performance as conventional capsule endoscopy. Newly added features of 3D reconstruction and size measurement are expected to be useful in the characterization of subepithelial tumours.
| S-EPMC7138835 | biostudies-literature
Project description:Phenotypic analysis of cassava root crowns (CRCs) so far has been limited to visual inspection and very few measurements due to its laborious process in the field. Here, we developed a platform for acquiring 3D CRC models using close-range photogrammetry for phenotypic analysis. The state of the art is a low cost and easy to set up 3D acquisition requiring only a background sheet, a reference object and a camera, compatible with field experiments in remote areas. We tested different software with CRC samples, and Agisoft and Blender were the most suitable software for generating high-quality 3D models and data analysis, respectively. We optimized the workflow by testing different numbers of images for 3D reconstruction and found that a minimum of 25 images per CRC can provide high quality 3D models. Up to ten traits, including 3D crown volumes, 3D crown surface, root density, surface-to-volume ratio, root numbers, root angle, crown diameter, cylinder soil volume, CRC compactness and root length can be extracted providing novel parameters for studying cassava storage roots. We applied this platform to partial-inbred cassava populations and demonstrated that our platform provides reliable 3D CRC modelling for phenotypic analysis, analysis of genetic variances and supporting breeding selection.
| S-EPMC9200979 | biostudies-literature
Project description:Plant phenotyping is essential in plant breeding and management. High-throughput data acquisition and automatic phenotypes extraction are common concerns in plant phenotyping. Despite the development of phenotyping platforms and the realization of high-throughput three-dimensional (3D) data acquisition in tall plants, such as maize, handling small-size plants with complex structural features remains a challenge. This study developed a miniaturized shoot phenotyping platform MVS-Pheno V2 focusing on low plant shoots. The platform is an improvement of MVS-Pheno V1 and was developed based on multi-view stereo 3D reconstruction. It has the following four components: Hardware, wireless communication and control, data acquisition system, and data processing system. The hardware sets the rotation on top of the platform, separating plants to be static while rotating. A novel local network was established to realize wireless communication and control; thus, preventing cable twining. The data processing system was developed to calibrate point clouds and extract phenotypes, including plant height, leaf area, projected area, shoot volume, and compactness. This study used three cultivars of wheat shoots at four growth stages to test the performance of the platform. The mean absolute percentage error of point cloud calibration was 0.585%. The squared correlation coefficient R 2 was 0.9991, 0.9949, and 0.9693 for plant height, leaf length, and leaf width, respectively. The root mean squared error (RMSE) was 0.6996, 0.4531, and 0.1174 cm for plant height, leaf length, and leaf width. The MVS-Pheno V2 platform provides an alternative solution for high-throughput phenotyping of low individual plants and is especially suitable for shoot architecture-related plant breeding and management studies.
| S-EPMC9393617 | biostudies-literature
Project description:The popularity of mesoscopic whole-brain imaging techniques has increased dramatically, but these techniques generate teravoxel-sized volumetric image data. Visualizing or interacting with these massive data is both necessary and essential in the bioimage analysis pipeline; however, due to their size, researchers have difficulty using typical computers to process them. The existing solutions do not consider applying web visualization and three-dimensional (3D) volume rendering methods simultaneously to reduce the number of data copy operations and provide a better way to visualize 3D structures in bioimage data. Here, we propose webTDat, an open-source, web-based, real-time 3D visualization framework for mesoscopic-scale whole-brain imaging datasets. webTDat uses an advanced rendering visualization method designed with an innovative data storage format and parallel rendering algorithms. webTDat loads the primary information in the image first and then decides whether it needs to load the secondary information in the image. By performing validation on TB-scale whole-brain datasets, webTDat achieves real-time performance during web visualization. The webTDat framework also provides a rich interface for annotation, making it a useful tool for visualizing mesoscopic whole-brain imaging data.
| S-EPMC7838507 | biostudies-literature
Project description:PurposeTo assess the suitability of digital stereo images for optic disc evaluations in glaucoma.MethodsStereo color optic disc images in both digital and 35-mm slide film formats were acquired contemporaneously from 29 subjects with various cup-to-disc ratios (range, 0.26-0.76; median, 0.475). Using a grading scale designed to assess image quality, the ease of visualizing optic disc features important for glaucoma diagnosis, and the comparative diameters of the optic disc cup, experienced observers separately compared the primary digital stereo images to each subject's 35-mm slides, to scanned images of the same 35-mm slides, and to grayscale conversions of the digital images. Statistical analysis accounted for multiple gradings and comparisons and also assessed image formats under monoscopic viewing.ResultsOverall, the quality of primary digital color images was judged superior to that of 35-mm slides (P < 0.001), including improved stereo (P < 0.001), but the primary digital color images were mostly equivalent to the scanned digitized images of the same slides. Color seemingly added little to grayscale optic disc images, except that peripapillary atrophy was best seen in color (P < 0.0001); both the nerve fiber layer (P < 0.0001) and the paths of blood vessels on the optic disc (P < 0.0001) were best seen in grayscale. The preference for digital over film images was maintained under monoscopic viewing conditions.ConclusionsDigital stereo optic disc images are useful for evaluating the optic disc in glaucoma and allow the application of advanced image processing applications. Grayscale images, by providing luminance distinct from color, may be informative for assessing certain features.
| S-EPMC3061503 | biostudies-literature
Project description:In this paper we report on an automated procedure to capture and characterize the detailed structure of a crop canopy by means of stereo imaging. We focus attention specifically on the detailed characteristic of canopy height distribution-canopy shoot area as a function of height-which can provide an elaborate picture of canopy growth and health under a given set of conditions. We apply the method to a wheat field trial involving ten Australian wheat varieties that were subjected to two different fertilizer treatments. A novel camera self-calibration approach is proposed which allows the determination of quantitative plant canopy height data (as well as other valuable phenotypic information) by stereo matching. Utilizing the canopy height distribution to provide a measure of canopy height, the results compare favourably with manual measurements of canopy height (resulting in an R2 value of 0.92), and are indeed shown to be more consistent. By comparing canopy height distributions of different varieties and different treatments, the methodology shows that different varieties subjected to the same treatment, and the same variety subjected to different treatments can respond in much more distinctive and quantifiable ways within their respective canopies than can be captured by a simple trait measure such as overall canopy height.
| S-EPMC5967702 | biostudies-literature