Stereo Vision-Based High Dynamic Range Imaging Using Differently-Exposed Image Pair.
Ontology highlight
ABSTRACT:
SUBMITTER: Park WJ
PROVIDER: S-EPMC5539793 | biostudies-other | 2017 Jun
REPOSITORIES: biostudies-other
Similar Datasets
Project description:PurposeTo minimize feature loss in T1- and T2-weighted MRI by merging multiple MR images acquired at different TR and TE to generate an image with increased dynamic range.Materials and methodsHigh Dynamic Range (HDR) processing techniques from the field of photography were applied to a series of acquired MR images. Specifically, a method to parameterize the algorithm for MRI data was developed and tested. T1- and T2-weighted images of a number of contrast agent phantoms and a live mouse were acquired with varying TR and TE parameters. The images were computationally merged to produce HDR-MR images. All acquisitions were performed on a 7.05 T Bruker PharmaScan with a multi-echo spin echo pulse sequence.ResultsHDR-MRI delineated bright and dark features that were either saturated or indistinguishable from background in standard T1- and T2-weighted MRI. The increased dynamic range preserved intensity gradation over a larger range of T1 and T2 in phantoms and revealed more anatomical features in vivo.ConclusionsWe have developed and tested a method to apply HDR processing to MR images. The increased dynamic range of HDR-MR images as compared to standard T1- and T2-weighted images minimizes feature loss caused by magnetization recovery or low SNR.
| S-EPMC3826760 | biostudies-literature
Project description:The past few years have seen the application of confocal and especially two-photon microscopy to the dynamic high-resolution imaging of lymphocytes and antigen presenting cells within organs such as lymph nodes and thymus. After summarizing some of the published results obtained to date using these methods, we describe our view of how this technology will develop and be applied in the near future. This includes its extension to a wide variety of non-lymphoid tissues, to the tracking of functional responses in addition to migratory behavior, to the analysis of molecular events previously studied only in vitro, to dissection of the interplay between hematopoietic and stromal elements, to visualization of a wider array of cell types including neutrophils, macrophages, NK cells, NKT cells and others, and to the interaction of the host with infectious agents. Reaching these goals will depend on a combination of new tools for genetic manipulations, novel fluorescent reporters, enhanced instrumentation, and better surgical techniques for the extended imaging of live animals. The end result will be a new level of understanding of how orchestrated cell movement and interaction contribute to the physiological and pathological activities of the immune system.
| S-EPMC1462950 | biostudies-literature
Project description:The photometric stereo method enables estimation of surface normals from images that have been captured using different but known lighting directions. The classical photometric stereo method requires at least three images to determine the normals in a given scene. However, this method cannot be applied to dynamic scenes because it is assumed that the scene remains static while the required images are captured. In this work, we present a dynamic photometric stereo method for estimation of the surface normals in a dynamic scene. We use a multi-tap complementary metal-oxide-semiconductor (CMOS) image sensor to capture the input images required for the proposed photometric stereo method. This image sensor can divide the electrons from the photodiode from a single pixel into the different taps of the exposures and can thus capture multiple images under different lighting conditions with almost identical timing. We implemented a camera lighting system and created a software application to enable estimation of the normal map in real time. We also evaluated the accuracy of the estimated surface normals and demonstrated that our proposed method can estimate the surface normals of dynamic scenes.
| S-EPMC5876938 | biostudies-literature
Project description:Stereoscopic vision delivers a sense of depth based on binocular information but additionally acts as a mechanism for achieving correspondence between patterns arriving at the left and right eyes. We analyse quantitatively the cortical architecture for stereoscopic vision in two areas of macaque visual cortex. For primary visual cortex V1, the result is consistent with a module that is isotropic in cortical space with a diameter of at least 3 mm in surface extent. This implies that the module for stereo is larger than the repeat distance between ocular dominance columns in V1. By contrast, in the extrastriate cortical area V5/MT, which has a specialized architecture for stereo depth, the module for representation of stereo is about 1 mm in surface extent, so the representation of stereo in V5/MT is more compressed than V1 in terms of neural wiring of the neocortex. The surface extent estimated for stereo in V5/MT is consistent with measurements of its specialized domains for binocular disparity. Within V1, we suggest that long-range horizontal, anatomical connections form functional modules that serve both binocular and monocular pattern recognition: this common function may explain the distortion and disruption of monocular pattern vision observed in amblyopia.This article is part of the themed issue 'Vision in our three-dimensional world'.
| S-EPMC4901455 | biostudies-literature
Project description:A mathematical model and a possible neural mechanism are proposed to account for how fixational drift motion in the retina confers a benefit for the discrimination of high-acuity targets. We show that by simultaneously estimating object shape and eye motion, neurons in visual cortex can compute a higher quality representation of an object by averaging out non-uniformities in the retinal sampling lattice. The model proposes that this is accomplished by two separate populations of cortical neurons - one providing a representation of object shape and another representing eye position or motion - which are coupled through specific multiplicative connections. Combined with recent experimental findings, our model suggests that the visual system may utilize principles not unlike those used in computational imaging for achieving "super-resolution" via camera motion.
| S-EPMC7424138 | biostudies-literature
Project description:The problem of finding stereo correspondences in binocular vision is solved effortlessly in nature and yet it is still a critical bottleneck for artificial machine vision systems. As temporal information is a crucial feature in this process, the advent of event-based vision sensors and dedicated event-based processors promises to offer an effective approach to solving the stereo matching problem. Indeed, event-based neuromorphic hardware provides an optimal substrate for fast, asynchronous computation, that can make explicit use of precise temporal coincidences. However, although several biologically-inspired solutions have already been proposed, the performance benefits of combining event-based sensing with asynchronous and parallel computation are yet to be explored. Here we present a hardware spike-based stereo-vision system that leverages the advantages of brain-inspired neuromorphic computing by interfacing two event-based vision sensors to an event-based mixed-signal analog/digital neuromorphic processor. We describe a prototype interface designed to enable the emulation of a stereo-vision system on neuromorphic hardware and we quantify the stereo matching performance with two datasets. Our results provide a path toward the realization of low-latency, end-to-end event-based, neuromorphic architectures for stereo vision.
| S-EPMC7693562 | biostudies-literature
Project description:Dynamic range quantifies the linear operation regime available in nanomechanical resonators. Nonlinearities dominate the response of flexural beams in the limit of very high aspect ratio and very small diameter, which leads to expectation of low dynamic range for nanowire resonators in general. However, the highest achievable dynamic range for nanowire resonators with practical dimensions remains to be determined. We report dynamic range measurements on singly clamped silicon nanowire resonators reaching remarkably high values of up to 90 dB obtained with a simple harmonic actuation scheme. We explain these measurements by a comprehensive theoretical examination of dynamic range in singly clamped flexural beams including the effect of tapering, a usual feature of semiconductor nanowires. Our analysis reveals the nanowire characteristics required for broad linear operation, and given the relationship between dynamic range and mass sensing performance, it also enables analytical determination of mass detection limits, reaching atomic-scale resolution for feasible nanowires.
| S-EPMC8361434 | biostudies-literature
Project description:BackgroundTracking and predicting the growth performance of plants in different environments is critical for predicting the impact of global climate change. Automated approaches for image capture and analysis have allowed for substantial increases in the throughput of quantitative growth trait measurements compared with manual assessments. Recent work has focused on adopting computer vision and machine learning approaches to improve the accuracy of automated plant phenotyping. Here we present PS-Plant, a low-cost and portable 3D plant phenotyping platform based on an imaging technique novel to plant phenotyping called photometric stereo (PS).ResultsWe calibrated PS-Plant to track the model plant Arabidopsis thaliana throughout the day-night (diel) cycle and investigated growth architecture under a variety of conditions to illustrate the dramatic effect of the environment on plant phenotype. We developed bespoke computer vision algorithms and assessed available deep neural network architectures to automate the segmentation of rosettes and individual leaves, and extract basic and more advanced traits from PS-derived data, including the tracking of 3D plant growth and diel leaf hyponastic movement. Furthermore, we have produced the first PS training data set, which includes 221 manually annotated Arabidopsis rosettes that were used for training and data analysis (1,768 images in total). A full protocol is provided, including all software components and an additional test data set.ConclusionsPS-Plant is a powerful new phenotyping tool for plant research that provides robust data at high temporal and spatial resolutions. The system is well-suited for small- and large-scale research and will help to accelerate bridging of the phenotype-to-genotype gap.
| S-EPMC6534809 | biostudies-literature
Project description:Super-resolution optical fluctuation imaging (SOFI) offers a simple and affordable alternative to other super-resolution (SR) imaging techniques. The theoretical resolution enhancement of SOFI scales linearly with the order of cumulants, while the imaging conditions exhibit less photo-toxicity to the living samples as compared to other SR methods. High order SOFI could, therefore, be a method of choice for dynamic live cell imaging. However, due to the cusp-artifacts and dynamic range expansion of pixel intensities, this promise has not been materialized as of yet. Here we investigated and compared high order moments vs. high order cumulant SOFI reconstructions. We demonstrate that even-order moments reconstructions are intrinsically free of cusp artifacts, allowing for a subsequent deconvolution operation to be performed, hence enhancing the resolution even further. High order moments reconstruction performance was examined for various (simulated) conditions and applied to (experimental) imaging of QD labeled microtubules in fixed cells, and actin stress fiber dynamics in live cells.
| S-EPMC6524576 | biostudies-literature
Project description:We propose a photographic method to show scalar values of high dynamic range (HDR) by color mapping for 2D visualization. We combine (1) tone-mapping operators that transform the data to the display range of the monitor while preserving perceptually important features, based on a systematic evaluation, and (2) simulated glares that highlight high-value regions. Simulated glares are effective for highlighting small areas (of a few pixels) that may not be visible with conventional visualizations; through a controlled perception study, we confirm that glare is preattentive. The usefulness of our overall photographic HDR visualization is validated through the feedback of expert users.
| S-EPMC8500312 | biostudies-literature