Stereo3D: using stereo images to enrich 3D visualization.
Ontology highlight
ABSTRACT: Summary
Visualization in 3D space is a standard but critical process for examining the complex structure of high-dimensional data. Stereoscopic imaging technology can be adopted to enhance 3D representation of many complex data, especially those consisting of points and lines. We illustrate the simple steps that are involved and strongly recommend others to implement it in designing visualization software. To facilitate its application, we created a new software that can convert a regular 3D scatterplot or network figure to a pair of stereo images.Availability and implementation
Stereo3D is freely available as an open source R package released under an MIT license at https://github.com/bioinfoDZ/Stereo3D. Others can integrate the codes and implement the method in academic software.Contact
deyou.zheng@einsteinmed.org.Supplementary information
Supplementary data are available at Bioinformatics online.
SUBMITTER: Liu Y
PROVIDER: S-EPMC7390991 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description: Not available
| S-EPMC8257206 | biostudies-literature
Project description:The paper presents a novel depth-estimation method for light-field (LF) images based on innovative multi-stereo matching and machine-learning techniques. In the first stage, a novel block-based stereo matching algorithm is employed to compute the initial estimation. The proposed algorithm is specifically designed to operate on any pair of sub-aperture images (SAIs) in the LF image and to compute the pair's corresponding disparity map. For the central SAI, a disparity fusion technique is proposed to compute the initial disparity map based on all available pairwise disparities. In the second stage, a novel pixel-wise deep-learning (DL)-based method for residual error prediction is employed to further refine the disparity estimation. A novel neural network architecture is proposed based on a new structure of layers. The proposed DL-based method is employed to predict the residual error of the initial estimation and to refine the final disparity map. The experimental results demonstrate the superiority of the proposed framework and reveal that the proposed method achieves an average improvement of 15.65% in root mean squared error (RMSE), 43.62% in mean absolute error (MAE), and 5.03% in structural similarity index (SSIM) over machine-learning-based state-of-the-art methods.
| S-EPMC7663356 | biostudies-literature
Project description:Accurate and timely detection of plant diseases can help mitigate the worldwide losses experienced by the horticulture and agriculture industries each year. Thermal imaging provides a fast and non-destructive way of scanning plants for diseased regions and has been used by various researchers to study the effect of disease on the thermal profile of a plant. However, thermal image of a plant affected by disease has been known to be affected by environmental conditions which include leaf angles and depth of the canopy areas accessible to the thermal imaging camera. In this paper, we combine thermal and visible light image data with depth information and develop a machine learning system to remotely detect plants infected with the tomato powdery mildew fungus Oidium neolycopersici. We extract a novel feature set from the image data using local and global statistics and show that by combining these with the depth information, we can considerably improve the accuracy of detection of the diseased plants. In addition, we show that our novel feature set is capable of identifying plants which were not originally inoculated with the fungus at the start of the experiment but which subsequently developed disease through natural transmission.
| S-EPMC4393321 | biostudies-literature
Project description:Three-dimensional (3D) reconstruction of capsule endoscopic images has been attempted for a long time to obtain more information on small bowel structures. Due to the limited hardware resources of capsule size and battery capacity, software approaches have been studied but have mainly exhibited inherent limitations. Recently, stereo camera-based capsule endoscopy, which can perform hardware-enabled 3D reconstruction, has been developed. We aimed to evaluate the feasibility of newly developed 3D capsule endoscopy in clinical practice. This study was a prospective, single-arm, feasibility study conducted at two university-affiliated hospitals in South Korea. Small bowel evaluation was performed using a newly developed 3D capsule endoscope for patients with obscure gastrointestinal bleeding, suspected or established Crohn's disease, small bowel tumors, and abdominal pain of unknown origin. We assessed the technical limitations, performance, and safety of the new capsule endoscope. Thirty-one patients (20 men and 11 women; mean age: 44.5 years) were enrolled. There was no technical defect preventing adequate visualization of the small bowel. The overall completion rate was 77.4%, the detection rate was 64.5%, and there was no capsule retention. All capsule endoscopic procedures were completed uneventfully. In conclusion, newly developed 3D capsule endoscopy was safe and feasible, showing similar performance as conventional capsule endoscopy. Newly added features of 3D reconstruction and size measurement are expected to be useful in the characterization of subepithelial tumours.
| S-EPMC7138835 | biostudies-literature
Project description:The popularity of mesoscopic whole-brain imaging techniques has increased dramatically, but these techniques generate teravoxel-sized volumetric image data. Visualizing or interacting with these massive data is both necessary and essential in the bioimage analysis pipeline; however, due to their size, researchers have difficulty using typical computers to process them. The existing solutions do not consider applying web visualization and three-dimensional (3D) volume rendering methods simultaneously to reduce the number of data copy operations and provide a better way to visualize 3D structures in bioimage data. Here, we propose webTDat, an open-source, web-based, real-time 3D visualization framework for mesoscopic-scale whole-brain imaging datasets. webTDat uses an advanced rendering visualization method designed with an innovative data storage format and parallel rendering algorithms. webTDat loads the primary information in the image first and then decides whether it needs to load the secondary information in the image. By performing validation on TB-scale whole-brain datasets, webTDat achieves real-time performance during web visualization. The webTDat framework also provides a rich interface for annotation, making it a useful tool for visualizing mesoscopic whole-brain imaging data.
| S-EPMC7838507 | biostudies-literature
Project description:To assess the suitability of digital stereo images for optic disc evaluations in glaucoma.Stereo color optic disc images in both digital and 35-mm slide film formats were acquired contemporaneously from 29 subjects with various cup-to-disc ratios (range, 0.26-0.76; median, 0.475). Using a grading scale designed to assess image quality, the ease of visualizing optic disc features important for glaucoma diagnosis, and the comparative diameters of the optic disc cup, experienced observers separately compared the primary digital stereo images to each subject's 35-mm slides, to scanned images of the same 35-mm slides, and to grayscale conversions of the digital images. Statistical analysis accounted for multiple gradings and comparisons and also assessed image formats under monoscopic viewing.Overall, the quality of primary digital color images was judged superior to that of 35-mm slides (P < 0.001), including improved stereo (P < 0.001), but the primary digital color images were mostly equivalent to the scanned digitized images of the same slides. Color seemingly added little to grayscale optic disc images, except that peripapillary atrophy was best seen in color (P < 0.0001); both the nerve fiber layer (P < 0.0001) and the paths of blood vessels on the optic disc (P < 0.0001) were best seen in grayscale. The preference for digital over film images was maintained under monoscopic viewing conditions.Digital stereo optic disc images are useful for evaluating the optic disc in glaucoma and allow the application of advanced image processing applications. Grayscale images, by providing luminance distinct from color, may be informative for assessing certain features.
| S-EPMC3061503 | biostudies-literature
Project description:In this paper we report on an automated procedure to capture and characterize the detailed structure of a crop canopy by means of stereo imaging. We focus attention specifically on the detailed characteristic of canopy height distribution-canopy shoot area as a function of height-which can provide an elaborate picture of canopy growth and health under a given set of conditions. We apply the method to a wheat field trial involving ten Australian wheat varieties that were subjected to two different fertilizer treatments. A novel camera self-calibration approach is proposed which allows the determination of quantitative plant canopy height data (as well as other valuable phenotypic information) by stereo matching. Utilizing the canopy height distribution to provide a measure of canopy height, the results compare favourably with manual measurements of canopy height (resulting in an R2 value of 0.92), and are indeed shown to be more consistent. By comparing canopy height distributions of different varieties and different treatments, the methodology shows that different varieties subjected to the same treatment, and the same variety subjected to different treatments can respond in much more distinctive and quantifiable ways within their respective canopies than can be captured by a simple trait measure such as overall canopy height.
| S-EPMC5967702 | biostudies-literature
Project description:To glean an appreciation of the holistic genetic activity in the gastrulating mouse embryo, we performed a genome-wide spatial transcriptome analysis (Stereo-seq), using a low-cell number sequencing protocol on laser microdissected samples of epiblast cells with retained positional address. The 3D transcriptome reveals that (i) the epiblast is partitioned into transcription domains corresponding to regions of epiblast where cells are endowed specifically with ectoderm and mesendoderm potency, (ii) novel lineage markers are identified as genes expressed in epiblast domains populated by cells displaying different lineage fates, (iii) functionally related gene regulatory circuitry and signaling pathways are acting in concert in the transcriptional domains, and (iv) the spatial information provides reference zipcodes for mapping the prospective address of cell samples from different embryos and stem cell lines. The quantified expression data can also be visualized as â3D digitized whole mount in situ hybridizationâ of all the expressed transcripts in the epiblast. (i) By using laser-microdissection, we carried out transcriptome profiling on embryo sections at a high resolution of ~20 cells per sample with the spatial information preserved. We then constructed a comprehensive spatial transcriptome map in the mid-gastrulation embryo that is visualized in a 3D embryonic model based on the sequencing data. Embryo position (A/L/P/R) and section (1-11) descriptors: A stands for laser capture microdissected samples from the anterior epiblast of the embryo; P for posterior; L for the left lateral epiblast of the embryo; R for the right lateral. The section is collected from distal to proximal, and the section 1 to 11 is the cryosection order, covering the whole embryonic part of a late mid-streak embryo. Section 1 is the most distal section and 11 is the most proximal section. (ii) Additional samples are RNA-seq data of 70 single cells from E7.0 mouse embryo. These 70 samples were randomly picked from the anterior or posterior embryonic half.
2016-03-24 | E-GEOD-65924 | biostudies-arrayexpress
Project description:Photoacoustic (PA) imaging (or optoacoustic imaging) is a novel biomedical imaging method in biological and medical research. This modality performs morphological, functional, and molecular imaging with and without labels in both microscopic and deep tissue imaging domains. A variety of innovations have enhanced 3D PA imaging performance and thus has opened new opportunities in preclinical and clinical imaging. However, the 3D visualization tools for PA images remains a challenge. There are several commercially available software packages to visualize the generated 3D PA images. They are generally expensive, and their features are not optimized for 3D visualization of PA images. Here, we demonstrate a specialized 3D visualization software package, namely 3D Photoacoustic Visualization Studio (3D PHOVIS), specifically targeting photoacoustic data, image, and visualization processes. To support the research environment for visualization and fast processing, we incorporated 3D PHOVIS onto the MATLAB with graphical user interface and developed multi-core graphics processing unit modules for fast processing. The 3D PHOVIS includes following modules: (1) a mosaic volume generator, (2) a scan converter for optical scanning photoacoustic microscopy, (3) a skin profile estimator and depth encoder, (4) a multiplanar viewer with a navigation map, and (5) a volume renderer with a movie maker. This paper discusses the algorithms present in the software package and demonstrates their functions. In addition, the applicability of this software to ultrasound imaging and optical coherence tomography is also investigated. User manuals and application files for 3D PHOVIS are available for free on the website (www.boa-lab.com). Core functions of 3D PHOVIS are developed as a result of a summer class at POSTECH, "High-Performance Algorithm in CPU/GPU/DSP, and Computer Architecture." We believe our 3D PHOVIS provides a unique tool to PA imaging researchers, expedites its growth, and attracts broad interests in a wide range of studies.
| S-EPMC7082691 | biostudies-literature
Project description:BACKGROUND:Tracking and predicting the growth performance of plants in different environments is critical for predicting the impact of global climate change. Automated approaches for image capture and analysis have allowed for substantial increases in the throughput of quantitative growth trait measurements compared with manual assessments. Recent work has focused on adopting computer vision and machine learning approaches to improve the accuracy of automated plant phenotyping. Here we present PS-Plant, a low-cost and portable 3D plant phenotyping platform based on an imaging technique novel to plant phenotyping called photometric stereo (PS). RESULTS:We calibrated PS-Plant to track the model plant Arabidopsis thaliana throughout the day-night (diel) cycle and investigated growth architecture under a variety of conditions to illustrate the dramatic effect of the environment on plant phenotype. We developed bespoke computer vision algorithms and assessed available deep neural network architectures to automate the segmentation of rosettes and individual leaves, and extract basic and more advanced traits from PS-derived data, including the tracking of 3D plant growth and diel leaf hyponastic movement. Furthermore, we have produced the first PS training data set, which includes 221 manually annotated Arabidopsis rosettes that were used for training and data analysis (1,768 images in total). A full protocol is provided, including all software components and an additional test data set. CONCLUSIONS:PS-Plant is a powerful new phenotyping tool for plant research that provides robust data at high temporal and spatial resolutions. The system is well-suited for small- and large-scale research and will help to accelerate bridging of the phenotype-to-genotype gap.
| S-EPMC6534809 | biostudies-literature