BigDataProcessor2: A free and open-source Fiji plugin for inspection and processing of TB sized image data.
Ontology highlight
ABSTRACT: Summary
Modern bioimaging and related areas such as sensor technology have undergone tremendous development over the last few years. As a result, contemporary imaging techniques, particularly electron microscopy (EM) and light sheet microscopy, can frequently generate datasets attaining sizes of several terabytes (TB). As a consequence, even seemingly simple data operations such as cropping, chromatic- and drift-corrections and even visualisation, poses challenges when applied to thousands of time points or tiles. To address this we developed BigDataProcessor2-a Fiji plugin facilitating processing workflows for TB sized image datasets.Availability and implementation
BigDataProcessor2 is available as a Fiji plugin via the BigDataProcessor update site. The application is implemented in Java and the code is publicly available on GitHub (https://github.com/bigdataprocessor/bigdataprocessor2).
SUBMITTER: Tischer C
PROVIDER: S-EPMC8479660 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Fiji is a distribution of the popular open-source software ImageJ focused on biological-image analysis. Fiji uses modern software engineering practices to combine powerful software libraries with a broad range of scripting languages to enable rapid prototyping of image-processing algorithms. Fiji facilitates the transformation of new algorithms into ImageJ plugins that can be shared with end users through an integrated update system. We propose Fiji as a platform for productive collaboration between computer science and biology research communities.
| S-EPMC3855844 | biostudies-literature
Project description:Coleoid cephalopods (squid, octopus, and sepia) are renowned for their elaborate body patterning capabilities, which are employed for camouflage or communication. The specific chromatic appearance of a cephalopod, at any given moment, is a direct result of the combined action of their intradermal pigmented chromatophore organs and reflecting cells. Therefore, a lot can be learned about the cephalopod coloration system by video recording and analyzing the activation of individual chromatophores in time. The fact that adult cephalopods have small chromatophores, up to several hundred thousand in number, makes measurement and analysis over several seconds a difficult task. However, current advancements in videography enable high-resolution and high framerate recording, which can be used to record chromatophore activity in more detail and accuracy in both space and time domains. In turn, the additional pixel information and extra frames per video from such recordings result in large video files of several gigabytes, even when the recording spans only few minutes. We created a software plugin, "SpotMetrics," that can automatically analyze high resolution, high framerate video of chromatophore organ activation in time. This image analysis software can track hundreds of individual chromatophores over several hundred frames to provide measurements of size and color. This software may also be used to measure differences in chromatophore activation during different behaviors which will contribute to our understanding of the cephalopod sensorimotor integration system. In addition, this software can potentially be utilized to detect numbers of round objects and size changes in time, such as eye pupil size or number of bacteria in a sample. Thus, we are making this software plugin freely available as open-source because we believe it will be of benefit to other colleagues both in the cephalopod biology field and also within other disciplines.
| S-EPMC5331055 | biostudies-literature
Project description:High-throughput plant phenotyping is an effective approach to bridge the genotype-to-phenotype gap in crops. Phenomics experiments typically result in large-scale image datasets, which are not amenable for processing on desktop computers, thus creating a bottleneck in the image-analysis pipeline. Here, we present an open-source, flexible image-analysis framework, called Image Harvest (IH), for processing images originating from high-throughput plant phenotyping platforms. Image Harvest is developed to perform parallel processing on computing grids and provides an integrated feature for metadata extraction from large-scale file organization. Moreover, the integration of IH with the Open Science Grid provides academic researchers with the computational resources required for processing large image datasets at no cost. Image Harvest also offers functionalities to extract digital traits from images to interpret plant architecture-related characteristics. To demonstrate the applications of these digital traits, a rice (Oryza sativa) diversity panel was phenotyped and genome-wide association mapping was performed using digital traits that are used to describe different plant ideotypes. Three major quantitative trait loci were identified on rice chromosomes 4 and 6, which co-localize with quantitative trait loci known to regulate agronomically important traits in rice. Image Harvest is an open-source software for high-throughput image processing that requires a minimal learning curve for plant biologists to analyzephenomics datasets.
| S-EPMC4892737 | biostudies-literature
Project description:To assess the adequacy of image agreement regarding uveitis based on color fundus and fluorescein angiography images alone, and to use free and open source applications to conduct an image agreement study.Cross-sectional agreement study.Baseline fundus and fluorescein images of patients with panuveitis, posterior, or intermediate uveitis enrolled in the Multi-center Uveitis Steroid Treatment (MUST) trial.Three fellowship-trained specialists in uveitis independently reviewed patient images using ClearCanvas™ and responded using Epi Info™. The diagnoses of the 3 reviewers were compared with the MUST clinician as a gold standard. A rank transformation adjusted for the possible variation in number of responses per patient. Chance-corrected interobserver agreement among the 3 reviewers was estimated with the ? coefficient. Confidence interval (CI) and SE were bootstrapped.Agreement between the diagnoses of the respondents and the baseline MUST clinician's diagnosis was poor across all diagnostic categories, ? = 0.09 (95% CI, 0.07-0.11). The agreement among respondents alone also was poor, ? = 0.11 ± 0.02 (95% CI, 0.08-0.13). The specialists requested more patient historical and clinical information to make a diagnosis on all patients.The role in distinguishing the multiple conditions in uveitis appears to be limited when based on fundus imaging alone. Future studies should investigate different categories of clinical data to supplement image data. Freely available applications have excellent utility in ophthalmic imaging agreement studies.
| S-EPMC3741676 | biostudies-literature
Project description:Annotation of time-lapse data provides an important tool to highlight dynamic processes. Particularly, arrows, circles and arrowheads are useful to pinpoint a specific process, stationary or evolving over time. Here, we describe a user-friendly Fiji plugin to facilitate annotation of movies with arrows, arrowheads and circles. The plugin also enables saving and loading of annotated tracks.This article has an associated First Person interview with the first author of the paper.
| S-EPMC7725597 | biostudies-literature
Project description:SignificanceOptical and acoustic imaging techniques enable noninvasive visualisation of structural and functional properties of tissue. The quantification of measurements, however, remains challenging due to the inverse problems that must be solved. Emerging data-driven approaches are promising, but they rely heavily on the presence of high-quality simulations across a range of wavelengths due to the lack of ground truth knowledge of tissue acoustical and optical properties in realistic settings.AimTo facilitate this process, we present the open-source simulation and image processing for photonics and acoustics (SIMPA) Python toolkit. SIMPA is being developed according to modern software design standards.ApproachSIMPA enables the use of computational forward models, data processing algorithms, and digital device twins to simulate realistic images within a single pipeline. SIMPA's module implementations can be seamlessly exchanged as SIMPA abstracts from the concrete implementation of each forward model and builds the simulation pipeline in a modular fashion. Furthermore, SIMPA provides comprehensive libraries of biological structures, such as vessels, as well as optical and acoustic properties and other functionalities for the generation of realistic tissue models.ResultsTo showcase the capabilities of SIMPA, we show examples in the context of photoacoustic imaging: the diversity of creatable tissue models, the customisability of a simulation pipeline, and the degree of realism of the simulations.ConclusionsSIMPA is an open-source toolkit that can be used to simulate optical and acoustic imaging modalities. The code is available at: https://github.com/IMSY-DKFZ/simpa, and all of the examples and experiments in this paper can be reproduced using the code available at: https://github.com/IMSY-DKFZ/simpa_paper_experiments.
| S-EPMC8978263 | biostudies-literature
Project description:We describe Orbit Image Analysis, an open-source whole slide image analysis tool. The tool consists of a generic tile-processing engine which allows the execution of various image analysis algorithms provided by either Orbit itself or from other open-source platforms using a tile-based map-reduce execution framework. Orbit Image Analysis is capable of sophisticated whole slide imaging analyses due to several key features. First, Orbit has machine-learning capabilities. This deep learning segmentation can be integrated with complex object detection for analysis of intricate tissues. In addition, Orbit can run locally as standalone or connect to the open-source image server OMERO. Another important characteristic is its scale-out functionality, using the Apache Spark framework for distributed computing. In this paper, we describe the use of Orbit in three different real-world applications: quantification of idiopathic lung fibrosis, nerve fibre density quantification, and glomeruli detection in the kidney.
| S-EPMC7028292 | biostudies-literature
Project description:High-throughput screening generates large volumes of heterogeneous data that require a diverse set of computational tools for management, processing, and analysis. Building integrated, scalable, and robust computational workflows for such applications is challenging but highly valuable. Scientific data integration and pipelining facilitate standardized data processing, collaboration, and reuse of best practices. We describe how Jenkins-CI, an "off-the-shelf," open-source, continuous integration system, is used to build pipelines for processing images and associated data from high-content screening (HCS). Jenkins-CI provides numerous plugins for standard compute tasks, and its design allows the quick integration of external scientific applications. Using Jenkins-CI, we integrated CellProfiler, an open-source image-processing platform, with various HCS utilities and a high-performance Linux cluster. The platform is web-accessible, facilitates access and sharing of high-performance compute resources, and automates previously cumbersome data and image-processing tasks. Imaging pipelines developed using the desktop CellProfiler client can be managed and shared through a centralized Jenkins-CI repository. Pipelines and managed data are annotated to facilitate collaboration and reuse. Limitations with Jenkins-CI (primarily around the user interface) were addressed through the selection of helper plugins from the Jenkins-CI community.
| S-EPMC5322829 | biostudies-other
Project description:Understanding the complex ecology of a tumor tissue and the spatiotemporal relationships between its cellular and microenvironment components is becoming a key component of translational research, especially in immuno-oncology. The generation and analysis of multiplexed images from patient samples is of paramount importance to facilitate this understanding. Here, we present Mistic, an open-source multiplexed image t-SNE viewer that enables the simultaneous viewing of multiple 2D images rendered using multiple layout options to provide an overall visual preview of the entire dataset. In particular, the positions of the images can be t-SNE or UMAP coordinates. This grouped view of all images allows an exploratory understanding of the specific expression pattern of a given biomarker or collection of biomarkers across all images, helps to identify images expressing a particular phenotype, and can help select images for subsequent downstream analysis. Currently, there is no freely available tool to generate such image t-SNEs.
| S-EPMC9278502 | biostudies-literature
Project description:Accurate determination of plant water status is mandatory to optimize irrigation scheduling and thus maximize yield. Infrared thermography (IRT) can be used as a proxy for detecting stomatal closure as a measure of plant water stress. In this study, an open-source software (Thermal Image Processor (TIPCIP)) that includes image processing techniques such as thermal-visible image segmentation and morphological operations was developed to estimate the crop water stress index (CWSI) in potato crops. Results were compared to the CWSI derived from thermocouples where a high correlation was found ( r P e a r s o n = 0.84). To evaluate the effectiveness of the software, two experiments were implemented. TIPCIP-based canopy temperature was used to estimate CWSI throughout the growing season, in a humid environment. Two treatments with different irrigation timings were established based on CWSI thresholds: 0.4 (T2) and 0.7 (T3), and compared against a control (T1, irrigated when soil moisture achieved 70% of field capacity). As a result, T2 showed no significant reduction in fresh tuber yield (34.5 ± 3.72 and 44.3 ± 2.66 t ha - 1 ), allowing a total water saving of 341.6 ± 63.65 and 515.7 ± 37.73 m 3 ha - 1 in the first and second experiment, respectively. The findings have encouraged the initiation of experiments to automate the use of the CWSI for precision irrigation using either UAVs in large settings or by adapting TIPCIP to process data from smartphone-based IRT sensors for applications in smallholder settings.
| S-EPMC7013904 | biostudies-literature