Stereo vision tracking of multiple objects in complex indoor environments.
Ontology highlight
ABSTRACT:
SUBMITTER: Marron-Romera M
PROVIDER: S-EPMC3230977 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Many processes in cell biology are connected to the movement of compact entities: intracellular vesicles and even single molecules. The tracking of individual objects is important for understanding cellular dynamics. Here we describe the tracking algorithms which have been developed in the non-biological fields and successfully applied to object detection and tracking in biological applications. The characteristics features of the different algorithms are compared.
| S-EPMC2798991 | biostudies-literature
Project description:Microscope-integrated intraoperative OCT (iOCT) enables imaging of tissue cross-sections concurrent with ophthalmic surgical maneuvers. However, limited acquisition rates and complex three-dimensional visualization methods preclude real-time surgical guidance using iOCT. We present an automated stereo vision surgical instrument tracking system integrated with a prototype iOCT system. We demonstrate, for the first time, automatically tracked video-rate cross-sectional iOCT imaging of instrument-tissue interactions during ophthalmic surgical maneuvers. The iOCT scan-field is automatically centered on the surgical instrument tip, ensuring continuous visualization of instrument positions relative to the underlying tissue over a 2500 mm(2) field with sub-millimeter positional resolution and <1° angular resolution. Automated instrument tracking has the added advantage of providing feedback on surgical dynamics during precision tissue manipulations because it makes it possible to use only two cross-sectional iOCT images, aligned parallel and perpendicular to the surgical instrument, which also reduces both system complexity and data throughput requirements. Our current implementation is suitable for anterior segment surgery. Further system modifications are proposed for applications in posterior segment surgery. Finally, the instrument tracking system described is modular and system agnostic, making it compatible with different commercial and research OCT and surgical microscopy systems and surgical instrumentations. These advances address critical barriers to the development of iOCT-guided surgical maneuvers and may also be translatable to applications in microsurgery outside of ophthalmology.
| S-EPMC4541528 | biostudies-other
Project description:Stereoscopic vision delivers a sense of depth based on binocular information but additionally acts as a mechanism for achieving correspondence between patterns arriving at the left and right eyes. We analyse quantitatively the cortical architecture for stereoscopic vision in two areas of macaque visual cortex. For primary visual cortex V1, the result is consistent with a module that is isotropic in cortical space with a diameter of at least 3 mm in surface extent. This implies that the module for stereo is larger than the repeat distance between ocular dominance columns in V1. By contrast, in the extrastriate cortical area V5/MT, which has a specialized architecture for stereo depth, the module for representation of stereo is about 1 mm in surface extent, so the representation of stereo in V5/MT is more compressed than V1 in terms of neural wiring of the neocortex. The surface extent estimated for stereo in V5/MT is consistent with measurements of its specialized domains for binocular disparity. Within V1, we suggest that long-range horizontal, anatomical connections form functional modules that serve both binocular and monocular pattern recognition: this common function may explain the distortion and disruption of monocular pattern vision observed in amblyopia.This article is part of the themed issue 'Vision in our three-dimensional world'.
| S-EPMC4901455 | biostudies-literature
Project description:BackgroundTracking and predicting the growth performance of plants in different environments is critical for predicting the impact of global climate change. Automated approaches for image capture and analysis have allowed for substantial increases in the throughput of quantitative growth trait measurements compared with manual assessments. Recent work has focused on adopting computer vision and machine learning approaches to improve the accuracy of automated plant phenotyping. Here we present PS-Plant, a low-cost and portable 3D plant phenotyping platform based on an imaging technique novel to plant phenotyping called photometric stereo (PS).ResultsWe calibrated PS-Plant to track the model plant Arabidopsis thaliana throughout the day-night (diel) cycle and investigated growth architecture under a variety of conditions to illustrate the dramatic effect of the environment on plant phenotype. We developed bespoke computer vision algorithms and assessed available deep neural network architectures to automate the segmentation of rosettes and individual leaves, and extract basic and more advanced traits from PS-derived data, including the tracking of 3D plant growth and diel leaf hyponastic movement. Furthermore, we have produced the first PS training data set, which includes 221 manually annotated Arabidopsis rosettes that were used for training and data analysis (1,768 images in total). A full protocol is provided, including all software components and an additional test data set.ConclusionsPS-Plant is a powerful new phenotyping tool for plant research that provides robust data at high temporal and spatial resolutions. The system is well-suited for small- and large-scale research and will help to accelerate bridging of the phenotype-to-genotype gap.
| S-EPMC6534809 | biostudies-literature
Project description:The ability to track animals accurately is critical for behavioral experiments. For video-based assays, this is often accomplished by manipulating environmental conditions to increase contrast between the animal and the background in order to achieve proper foreground/background detection (segmentation). Modifying environmental conditions for experimental scalability opposes ethological relevance. The biobehavioral research community needs methods to monitor behaviors over long periods of time, under dynamic environmental conditions, and in animals that are genetically and behaviorally heterogeneous. To address this need, we applied a state-of-the-art neural network-based tracker for single mice. We compare three different neural network architectures across visually diverse mice and different environmental conditions. We find that an encoder-decoder segmentation neural network achieves high accuracy and speed with minimal training data. Furthermore, we provide a labeling interface, labeled training data, tuned hyperparameters, and a pretrained network for the behavior and neuroscience communities.
| S-EPMC6440983 | biostudies-literature
Project description:The problem of finding stereo correspondences in binocular vision is solved effortlessly in nature and yet it is still a critical bottleneck for artificial machine vision systems. As temporal information is a crucial feature in this process, the advent of event-based vision sensors and dedicated event-based processors promises to offer an effective approach to solving the stereo matching problem. Indeed, event-based neuromorphic hardware provides an optimal substrate for fast, asynchronous computation, that can make explicit use of precise temporal coincidences. However, although several biologically-inspired solutions have already been proposed, the performance benefits of combining event-based sensing with asynchronous and parallel computation are yet to be explored. Here we present a hardware spike-based stereo-vision system that leverages the advantages of brain-inspired neuromorphic computing by interfacing two event-based vision sensors to an event-based mixed-signal analog/digital neuromorphic processor. We describe a prototype interface designed to enable the emulation of a stereo-vision system on neuromorphic hardware and we quantify the stereo matching performance with two datasets. Our results provide a path toward the realization of low-latency, end-to-end event-based, neuromorphic architectures for stereo vision.
| S-EPMC7693562 | biostudies-literature
Project description:As part of a worldwide survey of the indoor mycobiota about 520 new Cladosporium isolates from indoor environments mainly collected in China, Europe, New Zealand, North America and South Africa were investigated by using a polyphasic approach to determine their species identity. All Cladosporium species occurring in indoor environments are fully described and illustrated. Fourty-six Cladosporium species are treated of which 16 species are introduced as new. A key for the most common Cladosporium species isolated from indoor environments is provided. Cladosporium halotolerans proved to be the most frequently isolated Cladosporium species indoors.
| S-EPMC5909081 | biostudies-other
Project description:Motivated by recent findings of improved perceptual processing and perceptual-motor skill following stroboscopic vision training, the current study examined the performance and acquisition effects of stroboscopic vision methods that afford a different visual experience. In Experiment 1, we conducted a within-subject design study to examine performance of a multiple object tracking (MOT) task in different stroboscopic vision conditions (Nike Vapor Strobe®, PLATO visual occlusion, and intermittent display presentation) operating at 5.6, 3.2, or 1.8 Hz. We found that participants maintained MOT performance in the Vapor Strobe condition irrespective of strobe rate. However, MOT performance deteriorated as strobe rate was reduced in the other two stroboscopic vision conditions. Moreover, at the lowest strobe rate (1.8 Hz) there was an increase in probe reaction time, thus indicating an increased attentional demand due to the stroboscopic vision. In Experiment 2, we conducted a mixed design study to examine if practice in different stroboscopic vision conditions (Nike Vapor Strobe® and PLATO visual occlusion) influenced acquisition of a novel precision-aiming task [i.e., multiple object avoidance (MOA) task] compared to a normal vision group. Participants in the PLATO visual occlusion group exhibited worse performance during practice than the Vapor Strobe and normal vision groups. At post-test, the Vapor Strobe group demonstrated greater success and reduced end-point error than the normal vision and PLATO groups. We interpret these findings as showing that both an intermittent perturbation (Nike Vapor Strobe®) and elimination (PLATO visual occlusion and intermittent display presentation) of visual motion and form are more attention demanding (Experiment 1), however, the intermittent perturbation, but not elimination, of visual motion and form can facilitate acquisition of perceptual-motor skill (Experiment 2) in situations where it is necessary to maintain and update a spatio-temporal representation of multiple moving objects.
| S-EPMC6068388 | biostudies-literature
Project description:We introduce a hybrid algorithm for the self-semantic location and autonomous navigation of robots using entropy-based vision and visual topological maps. In visual topological maps the visual landmarks are considered as leave points for guiding the robot to reach a target point (robot homing) in indoor environments. These visual landmarks are defined from images of relevant objects or characteristic scenes in the environment. The entropy of an image is directly related to the presence of a unique object or the presence of several different objects inside it: the lower the entropy the higher the probability of containing a single object inside it and, conversely, the higher the entropy the higher the probability of containing several objects inside it. Consequently, we propose the use of the entropy of images captured by the robot not only for the landmark searching and detection but also for obstacle avoidance. If the detected object corresponds to a landmark, the robot uses the suggestions stored in the visual topological map to reach the next landmark or to finish the mission. Otherwise, the robot considers the object as an obstacle and starts a collision avoidance maneuver. In order to validate the proposal we have defined an experimental framework in which the visual bug algorithm is used by an Unmanned Aerial Vehicle (UAV) in typical indoor navigation tasks.
| S-EPMC5581837 | biostudies-literature
Project description:The performance of eight microbial source tracking (MST) markers was evaluated in a low-resource, tropical community located in Iquitos, Peru. Fecal samples from humans, dogs, cats, rats, goats, buffalos, guinea-pigs, chickens, ducks, pigeons, and parrots were collected (n = 117). All samples were tested with human (BacHum, HF183-Taqman), dog (BactCan), pig (Pig-2-Bac), and avian (LA35, Av4143, ND5, cytB) markers using quantitative PCR (qPCR). Internal validity metrics were calculated using all animal fecal samples, as well as animal fecal samples contextually relevant for the Peruvian Amazon. Overall, Pig-2-Bac performed best, with 100% sensitivity and 88.5% specificity to detect the correct fecal source. Human-associated markers showed a sensitivity of 80.0% and 76.7%, and specificity of 66.2% and 67.6%. When limiting the analysis to contextually relevant animal fecal samples for the Peruvian Amazon, Av143 surpassed cytB with 95.7% sensitivity and 81.8% specificity. BactCan demonstrated 100% sensitivity and 47.4% specificity. The gene copy number detected by BacHum and HF183-Taqman were positively correlated (Pearson's correlation coefficient: 0.785), as well as avian markers cytB with Av4143 (Pearson's correlation coefficient: 0.508) and nd5 (Pearson's correlation coefficient: 0.949). These findings suggest that markers such as Av4143, Pig2Bac, cytb and BacHum have acceptable performance to be impactful in source attribution studies for zoonotic enteric disease transmission in this and similar low-resource communities.
| S-EPMC7511695 | biostudies-literature