Stereo vision tracking of multiple objects in complex indoor environments.
Ontology highlight
ABSTRACT:
SUBMITTER: Marron-Romera M
PROVIDER: S-EPMC3230977 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Many processes in cell biology are connected to the movement of compact entities: intracellular vesicles and even single molecules. The tracking of individual objects is important for understanding cellular dynamics. Here we describe the tracking algorithms which have been developed in the non-biological fields and successfully applied to object detection and tracking in biological applications. The characteristics features of the different algorithms are compared.
| S-EPMC2798991 | biostudies-literature
Project description:Automatically tracking the positions of multiple animals is often necessary for studying behaviours. This task involves multiple object tracking, a challenging problem in computer vision. Recent advances in machine learning applied to video analysis have been helpful for animal tracking. However, existing tools work well only in homogeneous environments with uniform illumination, features rarely found in natural settings. Moreover, available algorithms cannot effectively process discontinuities in animal motion such as sudden jumps, thus requiring laborious manual review.Here we present Argos, a software toolkit for tracking multiple animals in inhomogeneous environments. Argos includes tools for compressing videos based on animal movement, for generating training sets for a convolutional neural network (CNN) to detect animals, for tracking multiple animals in a video and for facilitating review and correction of the tracks manually, with simple graphical user interfaces.We demonstrate that Argos can help reduce the amount of video data to be stored and analysed, speed up analysis and allow analysing difficult and ambiguous conditions in a scene.Thus, Argos supports multiple approaches to animal tracking suited for varying recording conditions and available computational resources. Together, these tools allow the recording and tracking of movements of multiple markerless animals in inhomogeneous environments over many hours.
| S-EPMC10621779 | biostudies-literature
Project description:Microscope-integrated intraoperative OCT (iOCT) enables imaging of tissue cross-sections concurrent with ophthalmic surgical maneuvers. However, limited acquisition rates and complex three-dimensional visualization methods preclude real-time surgical guidance using iOCT. We present an automated stereo vision surgical instrument tracking system integrated with a prototype iOCT system. We demonstrate, for the first time, automatically tracked video-rate cross-sectional iOCT imaging of instrument-tissue interactions during ophthalmic surgical maneuvers. The iOCT scan-field is automatically centered on the surgical instrument tip, ensuring continuous visualization of instrument positions relative to the underlying tissue over a 2500 mm(2) field with sub-millimeter positional resolution and <1° angular resolution. Automated instrument tracking has the added advantage of providing feedback on surgical dynamics during precision tissue manipulations because it makes it possible to use only two cross-sectional iOCT images, aligned parallel and perpendicular to the surgical instrument, which also reduces both system complexity and data throughput requirements. Our current implementation is suitable for anterior segment surgery. Further system modifications are proposed for applications in posterior segment surgery. Finally, the instrument tracking system described is modular and system agnostic, making it compatible with different commercial and research OCT and surgical microscopy systems and surgical instrumentations. These advances address critical barriers to the development of iOCT-guided surgical maneuvers and may also be translatable to applications in microsurgery outside of ophthalmology.
| S-EPMC4541528 | biostudies-other
Project description:Stereoscopic vision delivers a sense of depth based on binocular information but additionally acts as a mechanism for achieving correspondence between patterns arriving at the left and right eyes. We analyse quantitatively the cortical architecture for stereoscopic vision in two areas of macaque visual cortex. For primary visual cortex V1, the result is consistent with a module that is isotropic in cortical space with a diameter of at least 3 mm in surface extent. This implies that the module for stereo is larger than the repeat distance between ocular dominance columns in V1. By contrast, in the extrastriate cortical area V5/MT, which has a specialized architecture for stereo depth, the module for representation of stereo is about 1 mm in surface extent, so the representation of stereo in V5/MT is more compressed than V1 in terms of neural wiring of the neocortex. The surface extent estimated for stereo in V5/MT is consistent with measurements of its specialized domains for binocular disparity. Within V1, we suggest that long-range horizontal, anatomical connections form functional modules that serve both binocular and monocular pattern recognition: this common function may explain the distortion and disruption of monocular pattern vision observed in amblyopia.This article is part of the themed issue 'Vision in our three-dimensional world'.
| S-EPMC4901455 | biostudies-literature
Project description:BackgroundTracking and predicting the growth performance of plants in different environments is critical for predicting the impact of global climate change. Automated approaches for image capture and analysis have allowed for substantial increases in the throughput of quantitative growth trait measurements compared with manual assessments. Recent work has focused on adopting computer vision and machine learning approaches to improve the accuracy of automated plant phenotyping. Here we present PS-Plant, a low-cost and portable 3D plant phenotyping platform based on an imaging technique novel to plant phenotyping called photometric stereo (PS).ResultsWe calibrated PS-Plant to track the model plant Arabidopsis thaliana throughout the day-night (diel) cycle and investigated growth architecture under a variety of conditions to illustrate the dramatic effect of the environment on plant phenotype. We developed bespoke computer vision algorithms and assessed available deep neural network architectures to automate the segmentation of rosettes and individual leaves, and extract basic and more advanced traits from PS-derived data, including the tracking of 3D plant growth and diel leaf hyponastic movement. Furthermore, we have produced the first PS training data set, which includes 221 manually annotated Arabidopsis rosettes that were used for training and data analysis (1,768 images in total). A full protocol is provided, including all software components and an additional test data set.ConclusionsPS-Plant is a powerful new phenotyping tool for plant research that provides robust data at high temporal and spatial resolutions. The system is well-suited for small- and large-scale research and will help to accelerate bridging of the phenotype-to-genotype gap.
| S-EPMC6534809 | biostudies-literature
Project description:The ability to track animals accurately is critical for behavioral experiments. For video-based assays, this is often accomplished by manipulating environmental conditions to increase contrast between the animal and the background in order to achieve proper foreground/background detection (segmentation). Modifying environmental conditions for experimental scalability opposes ethological relevance. The biobehavioral research community needs methods to monitor behaviors over long periods of time, under dynamic environmental conditions, and in animals that are genetically and behaviorally heterogeneous. To address this need, we applied a state-of-the-art neural network-based tracker for single mice. We compare three different neural network architectures across visually diverse mice and different environmental conditions. We find that an encoder-decoder segmentation neural network achieves high accuracy and speed with minimal training data. Furthermore, we provide a labeling interface, labeled training data, tuned hyperparameters, and a pretrained network for the behavior and neuroscience communities.
| S-EPMC6440983 | biostudies-literature
Project description:The problem of finding stereo correspondences in binocular vision is solved effortlessly in nature and yet it is still a critical bottleneck for artificial machine vision systems. As temporal information is a crucial feature in this process, the advent of event-based vision sensors and dedicated event-based processors promises to offer an effective approach to solving the stereo matching problem. Indeed, event-based neuromorphic hardware provides an optimal substrate for fast, asynchronous computation, that can make explicit use of precise temporal coincidences. However, although several biologically-inspired solutions have already been proposed, the performance benefits of combining event-based sensing with asynchronous and parallel computation are yet to be explored. Here we present a hardware spike-based stereo-vision system that leverages the advantages of brain-inspired neuromorphic computing by interfacing two event-based vision sensors to an event-based mixed-signal analog/digital neuromorphic processor. We describe a prototype interface designed to enable the emulation of a stereo-vision system on neuromorphic hardware and we quantify the stereo matching performance with two datasets. Our results provide a path toward the realization of low-latency, end-to-end event-based, neuromorphic architectures for stereo vision.
| S-EPMC7693562 | biostudies-literature
Project description:As part of a worldwide survey of the indoor mycobiota about 520 new Cladosporium isolates from indoor environments mainly collected in China, Europe, New Zealand, North America and South Africa were investigated by using a polyphasic approach to determine their species identity. All Cladosporium species occurring in indoor environments are fully described and illustrated. Fourty-six Cladosporium species are treated of which 16 species are introduced as new. A key for the most common Cladosporium species isolated from indoor environments is provided. Cladosporium halotolerans proved to be the most frequently isolated Cladosporium species indoors.
| S-EPMC5909081 | biostudies-other
Project description:Motivated by recent findings of improved perceptual processing and perceptual-motor skill following stroboscopic vision training, the current study examined the performance and acquisition effects of stroboscopic vision methods that afford a different visual experience. In Experiment 1, we conducted a within-subject design study to examine performance of a multiple object tracking (MOT) task in different stroboscopic vision conditions (Nike Vapor Strobe®, PLATO visual occlusion, and intermittent display presentation) operating at 5.6, 3.2, or 1.8 Hz. We found that participants maintained MOT performance in the Vapor Strobe condition irrespective of strobe rate. However, MOT performance deteriorated as strobe rate was reduced in the other two stroboscopic vision conditions. Moreover, at the lowest strobe rate (1.8 Hz) there was an increase in probe reaction time, thus indicating an increased attentional demand due to the stroboscopic vision. In Experiment 2, we conducted a mixed design study to examine if practice in different stroboscopic vision conditions (Nike Vapor Strobe® and PLATO visual occlusion) influenced acquisition of a novel precision-aiming task [i.e., multiple object avoidance (MOA) task] compared to a normal vision group. Participants in the PLATO visual occlusion group exhibited worse performance during practice than the Vapor Strobe and normal vision groups. At post-test, the Vapor Strobe group demonstrated greater success and reduced end-point error than the normal vision and PLATO groups. We interpret these findings as showing that both an intermittent perturbation (Nike Vapor Strobe®) and elimination (PLATO visual occlusion and intermittent display presentation) of visual motion and form are more attention demanding (Experiment 1), however, the intermittent perturbation, but not elimination, of visual motion and form can facilitate acquisition of perceptual-motor skill (Experiment 2) in situations where it is necessary to maintain and update a spatio-temporal representation of multiple moving objects.
| S-EPMC6068388 | biostudies-literature
Project description:We introduce a hybrid algorithm for the self-semantic location and autonomous navigation of robots using entropy-based vision and visual topological maps. In visual topological maps the visual landmarks are considered as leave points for guiding the robot to reach a target point (robot homing) in indoor environments. These visual landmarks are defined from images of relevant objects or characteristic scenes in the environment. The entropy of an image is directly related to the presence of a unique object or the presence of several different objects inside it: the lower the entropy the higher the probability of containing a single object inside it and, conversely, the higher the entropy the higher the probability of containing several objects inside it. Consequently, we propose the use of the entropy of images captured by the robot not only for the landmark searching and detection but also for obstacle avoidance. If the detected object corresponds to a landmark, the robot uses the suggestions stored in the visual topological map to reach the next landmark or to finish the mission. Otherwise, the robot considers the object as an obstacle and starts a collision avoidance maneuver. In order to validate the proposal we have defined an experimental framework in which the visual bug algorithm is used by an Unmanned Aerial Vehicle (UAV) in typical indoor navigation tasks.
| S-EPMC5581837 | biostudies-literature