Browse
Submit Data
Databases
API
Help

Dataset Information

22 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Object detection networks and augmented reality for cellular detection in fluorescence microscopy.

ABSTRACT: Object detection networks are high-performance algorithms famously applied to the task of identifying and localizing objects in photography images. We demonstrate their application for the classification and localization of cells in fluorescence microscopy by benchmarking four leading object detection algorithms across multiple challenging 2D microscopy datasets. Furthermore we develop and demonstrate an algorithm that can localize and image cells in 3D, in close to real time, at the microscope using widely available and inexpensive hardware. Furthermore, we exploit the fast processing of these networks and develop a simple and effective augmented reality (AR) system for fluorescence microscopy systems using a display screen and back-projection onto the eyepiece. We show that it is possible to achieve very high classification accuracy using datasets with as few as 26 images present. Using our approach, it is possible for relatively nonskilled users to automate detection of cell classes with a variety of appearances and enable new avenues for automation of fluorescence microscopy acquisition pipelines.

SUBMITTER: Waithe D

PROVIDER: S-EPMC7659718 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Mapping molecular assemblies with fluorescence microscopy and object-based spatial statistics.

Project description:Elucidating protein functions and molecular organisation requires to localise precisely single or aggregated molecules and analyse their spatial distributions. We develop a statistical method SODA (Statistical Object Distance Analysis) that uses either micro- or nanoscopy to significantly improve on standard co-localisation techniques. Our method considers cellular geometry and densities of molecules to provide statistical maps of isolated and associated (coupled) molecules. We use SODA with three-colour structured-illumination microscopy (SIM) images of hippocampal neurons, and statistically characterise spatial organisation of thousands of synapses. We show that presynaptic synapsin is arranged in asymmetric triangle with the 2 postsynaptic markers homer and PSD95, indicating a deeper localisation of homer. We then determine stoichiometry and distance between localisations of two synaptic vesicle proteins with 3D-STORM. These findings give insights into the protein organisation at the synapse, and prove the efficiency of SODA to quantitatively assess the geometry of molecular assemblies.

| S-EPMC5814551 | biostudies-literature

Impact of Dehazing on Underwater Marker Detection for Augmented Reality.

Project description:Underwater augmented reality is a very challenging task and amongst several issues, one of the most crucial aspects involves real-time tracking. Particles present in water combined with the uneven absorption of light decrease the visibility in the underwater environment. Dehazing methods are used in many areas to improve the quality of digital image data that is degraded by the influence of the environment. This paper describes the visibility conditions affecting underwater scenes and shows existing dehazing techniques that successfully improve the quality of underwater images. Four underwater dehazing methods are selected for evaluation of their capability of improving the success of square marker detection in underwater videos. Two reviewed methods represent approaches of image restoration: Multi-Scale Fusion, and Bright Channel Prior. Another two methods evaluated, the Automatic Color Enhancement and the Screened Poisson Equation, are methods of image enhancement. The evaluation uses diverse test data set to evaluate different environmental conditions. Results of the evaluation show an increased number of successful marker detections in videos pre-processed by dehazing algorithms and evaluate the performance of each compared method. The Screened Poisson method performs slightly better to other methods across various tested environments, while Bright Channel Prior and Automatic Color Enhancement shows similarly positive results.

| S-EPMC7805651 | biostudies-literature

Augmented reality instructions for construction toys enabled by accurate model registration and realistic object/hand occlusions.

Project description:BRICKxAR is a novel augmented reality (AR) instruction method for construction toys such as LEGO®. With BRICKxAR, physical LEGO construction is guided by virtual bricks. Compared with the state of the art, accuracy of the virtual-physical model alignment is significantly improved through a new design of marker-based registration, which can achieve an average error less than 1 mm throughout the model. Realistic object occlusion is accomplished to reveal the true spatial relationship between physical and virtual bricks. LEGO players' hand detection and occlusion are realized to visualize the correct spatial relationship between real hands and virtual bricks, and allow virtual bricks to be "grasped" by real hands. The major finding of the research is that the integration of these features makes AR instructions possible for small parts assembly, validated through a working AR prototype for constructing LEGO Arc de Triomphe and quantitative measures of the accuracies of registration and occlusions. In addition, a heuristic evaluation of BRICKxAR's features has led to findings that the present method could advance AR instructions in terms of enhancing part visibility, match between mental models and visualization, alignment of physical and virtual parts in perspective views and spatial transformations, tangible user interface, consolidated structural diagrams, virtual cutaway views, among other benefits for guiding construction.Supplementary informationThe online version contains supplementary material available at 10.1007/s10055-021-00582-7.

| S-EPMC8500825 | biostudies-literature

OOPS: Object-Oriented Polarization Software for analysis of fluorescence polarization microscopy images.

Project description:Most essential cellular functions are performed by proteins assembled into larger complexes. Fluorescence Polarization Microscopy (FPM) is a powerful technique that goes beyond traditional imaging methods by allowing researchers to measure not only the localization of proteins within cells, but also their orientation or alignment within complexes or cellular structures. FPM can be easily integrated into standard widefield microscopes with the addition of a polarization modulator. However, the extensive image processing and analysis required to interpret the data have limited its widespread adoption. To overcome these challenges and enhance accessibility, we introduce OOPS (Object-Oriented Polarization Software), a MATLAB package for object-based analysis of FPM data. By combining flexible image segmentation and novel object-based analyses with a high-throughput FPM processing pipeline, OOPS empowers researchers to simultaneously study molecular order and orientation in individual biological structures; conduct population assessments based on morphological features, intensity statistics, and FPM measurements; and create publication-quality visualizations, all within a user-friendly graphical interface. Here, we demonstrate the power and versatility of our approach by applying OOPS to punctate and filamentous structures.

| S-EPMC11341096 | biostudies-literature

Fluorescence microscopy datasets for training deep neural networks.

Project description:Fluorescence microscopy is an important technique in many areas of biological research. Two factors that limit the usefulness and performance of fluorescence microscopy are photobleaching of fluorescent probes during imaging and, when imaging live cells, phototoxicity caused by light exposure. Recently developed methods in machine learning are able to greatly improve the signal-to-noise ratio of acquired images. This allows researchers to record images with much shorter exposure times, which in turn minimizes photobleaching and phototoxicity by reducing the dose of light reaching the sample. To use deep learning methods, a large amount of data is needed to train the underlying convolutional neural network. One way to do this involves use of pairs of fluorescence microscopy images acquired with long and short exposure times. We provide high-quality datasets that can be used to train and evaluate deep learning methods under development. The availability of high-quality data is vital for training convolutional neural networks that are used in current machine learning approaches.

| S-EPMC8099770 | biostudies-literature

Fluorescence lifetime image microscopy prediction with convolutional neural networks for cell detection and classification in tissues.

Project description:Convolutional neural networks (CNNs) and other deep-learning models have proven to be transformative tools for the automated analysis of microscopy images, particularly in the domain of cellular and tissue imaging. These computer-vision models have primarily been applied with traditional microscopy imaging modalities (e.g. brightfield and fluorescence), likely due to the availability of large datasets in these regimes. However, more advanced microscopy imaging techniques could, potentially, allow for improved model performance in various computational histopathology tasks. In this work, we demonstrate that CNNs can achieve high accuracy in cell detection and classification without large amounts of data when applied to histology images acquired by fluorescence lifetime imaging microscopy (FLIM). This accuracy is higher than what would be achieved with regular single or dual-channel fluorescence images under the same settings, particularly for CNNs pretrained on publicly available fluorescent cell or general image datasets. Additionally, generated FLIM images could be predicted from just the fluorescence image data by using a dense U-Net CNN model trained on a subset of ground-truth FLIM images. These U-Net CNN generated FLIM images demonstrated high similarity to ground truth and improved accuracy in cell detection and classification over fluorescence alone when used as input to a variety of commonly used CNNs. This improved accuracy was maintained even when the FLIM images were generated by a U-Net CNN trained on only a few example FLIM images.

| S-EPMC9802238 | biostudies-literature

Augmented microscopy: real-time overlay of bright-field and near-infrared fluorescence images.

Project description:Intraoperative applications of near-infrared (NIR) fluorescent contrast agents can be aided by instrumentation capable of merging the view of surgical field with that of NIR fluorescence. We demonstrate augmented microscopy, an intraoperative imaging technique in which bright-field (real) and electronically processed NIR fluorescence (synthetic) images are merged within the optical path of a stereomicroscope. Under luminance of 100,000 lx, representing typical illumination of the surgical field, the augmented microscope detects 189 nM concentration of indocyanine green and produces a composite of the real and synthetic images within the eyepiece of the microscope at 20 fps. Augmentation described here can be implemented as an add-on module to visualize NIR contrast agents, laser beams, or various types of electronic data within the surgical microscopes commonly used in neurosurgical, cerebrovascular, otolaryngological, and ophthalmic procedures.

| S-EPMC4881285 | biostudies-literature

Design and Testing of Augmented Reality-Based Fluorescence Imaging Goggle for Intraoperative Imaging-Guided Surgery.

Project description:The different pathways between the position of a near-infrared camera and the user's eye limit the use of existing near-infrared fluorescence imaging systems for tumor margin assessments. By utilizing an optical system that precisely matches the near-infrared fluorescence image and the optical path of visible light, we developed an augmented reality (AR)-based fluorescence imaging system that provides users with a fluorescence image that matches the real-field, without requiring any additional algorithms. Commercial smart glasses, dichroic beam splitters, mirrors, and custom near-infrared cameras were employed to develop the proposed system, and each mount was designed and utilized. After its performance was assessed in the laboratory, preclinical experiments involving tumor detection and lung lobectomy in mice and rabbits by using indocyanine green (ICG) were conducted. The results showed that the proposed system provided a stable image of fluorescence that matched the actual site. In addition, preclinical experiments confirmed that the proposed system could be used to detect tumors using ICG and evaluate lung lobectomies. The AR-based intraoperative smart goggle system could detect fluorescence images for tumor margin assessments in animal models, without disrupting the surgical workflow in an operating room. Additionally, it was confirmed that, even when the system itself was distorted when worn, the fluorescence image consistently matched the actual site.

| S-EPMC8224390 | biostudies-literature

Real-Time Detection of Strawberry Ripeness Using Augmented Reality and Deep Learning.

Project description:Currently, strawberry harvesting relies heavily on human labour and subjective assessments of ripeness, resulting in inconsistent post-harvest quality. Therefore, the aim of this work is to automate this process and provide a more accurate and efficient way of assessing ripeness. We explored a unique combination of YOLOv7 object detection and augmented reality technology to detect and visualise the ripeness of strawberries. Our results showed that the proposed YOLOv7 object detection model, which employed transfer learning, fine-tuning and multi-scale training, accurately identified the level of ripeness of each strawberry with an mAP of 0.89 and an F1 score of 0.92. The tiny models have an average detection time of 18 ms per frame at a resolution of 1280 × 720 using a high-performance computer, thereby enabling real-time detection in the field. Our findings distinctly establish the superior performance of YOLOv7 when compared to other cutting-edge methodologies. We also suggest using Microsoft HoloLens 2 to overlay predicted ripeness labels onto each strawberry in the real world, providing a visual representation of the ripeness level. Despite some challenges, this work highlights the potential of augmented reality to assist farmers in harvesting support, which could have significant implications for current agricultural practices.

| S-EPMC10490577 | biostudies-literature

Quantifying cellular interaction dynamics in 3D fluorescence microscopy data.

Project description:The wealth of information available from advanced fluorescence imaging techniques used to analyze biological processes with high spatial and temporal resolution calls for high-throughput image analysis methods. Here, we describe a fully automated approach to analyzing cellular interaction behavior in 3D fluorescence microscopy images. As example application, we present the analysis of drug-induced and S1P(1)-knockout-related changes in bone-osteoclast interactions. Moreover, we apply our approach to images showing the spatial association of dendritic cells with the fibroblastic reticular cell network within lymph nodes and to microscopy data regarding T-B lymphocyte synapse formation. Such analyses that yield important information about the molecular mechanisms determining cellular interaction behavior would be very difficult to perform with approaches that rely on manual/semi-automated analyses. This protocol integrates adaptive threshold segmentation, object detection, adaptive color channel merging, and neighborhood analysis and permits rapid, standardized, quantitative analysis and comparison of the relevant features in large data sets.

| S-EPMC3443679 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data