The Dynamic Photometric Stereo Method Using a Multi-Tap CMOS Image Sensor.
Ontology highlight
ABSTRACT:
SUBMITTER: Yoda T
PROVIDER: S-EPMC5876938 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:While color video endoscopy has enabled wide-field examination of the gastrointestinal tract, it often misses or incorrectly classifies lesions. Many of these missed lesions exhibit characteristic three-dimensional surface topographies. An endoscopic system that adds topographical measurements to conventional color imagery could therefore increase lesion detection and improve classification accuracy. We introduce photometric stereo endoscopy (PSE), a technique which allows high spatial frequency components of surface topography to be acquired simultaneously with conventional two-dimensional color imagery. We implement this technique in an endoscopic form factor and demonstrate that it can acquire the topography of small features with complex geometries and heterogeneous optical properties. PSE imaging of ex vivo human gastrointestinal tissue shows that surface topography measurements enable differentiation of abnormal shapes from surrounding normal tissue. Together, these results confirm that the topographical measurements can be obtained with relatively simple hardware in an endoscopic form factor, and suggest the potential of PSE to improve lesion detection and classification in gastrointestinal imaging.
| S-EPMC4407669 | biostudies-literature
Project description:We present photometric stereo algorithms robust to non-Lambertian reflection, which are based on a convolutional neural network in which surface normals of objects with complex geometry and surface reflectance are estimated from a given set of an arbitrary number of images. These images are taken from the same viewpoint under different directional illumination conditions. The proposed method focuses on surface normal estimation, where multi-scale feature aggregation is proposed to obtain a more accurate surface normal, and max pooling is adopted to obtain an intermediate order-agnostic representation in the photometric stereo scenario. The proposed multi-scale feature aggregation scheme using feature concatenation is easily incorporated into existing photometric stereo network architectures. Our experiments were performed with a DiLiGent photometric stereo benchmark dataset consisting of ten real objects, and they demonstrated that the accuracies of our calibrated and uncalibrated photometric stereo approaches were improved over those of baseline methods. In particular, our experiments also demonstrated that our uncalibrated photometric stereo outperformed the state-of-the-art method. Our work is the first to consider the multi-scale feature aggregation in photometric stereo, and we showed that our proposed multi-scale fusion scheme estimated the surface normal accurately and was beneficial to improving performance.
| S-EPMC7675179 | biostudies-literature
Project description:Light scattering is a fundamental property that can be exploited to create essential devices such as particle analysers. The most common particle size analyser relies on measuring the angle-dependent diffracted light from a sample illuminated by a laser beam. Compared to other non-light-based counterparts, such a laser diffraction scheme offers precision, but it does so at the expense of size, complexity and cost. In this paper, we introduce the concept of a new particle size analyser in a collimated beam configuration using a consumer electronic camera and machine learning. The key novelty is a small form factor angular spatial filter that allows for the collection of light scattered by the particles up to predefined discrete angles. The filter is combined with a light-emitting diode and a complementary metal-oxide-semiconductor image sensor array to acquire angularly resolved scattering images. From these images, a machine learning model predicts the volume median diameter of the particles. To validate the proposed device, glass beads with diameters ranging from 13 to 125 µm were measured in suspension at several concentrations. We were able to correct for multiple scattering effects and predict the particle size with mean absolute percentage errors of 5.09% and 2.5% for the cases without and with concentration as an input parameter, respectively. When only spherical particles were analysed, the former error was significantly reduced (0.72%). Given that it is compact (on the order of ten cm) and built with low-cost consumer electronics, the newly designed particle size analyser has significant potential for use outside a standard laboratory, for example, in online and in-line industrial process monitoring.
| S-EPMC7016131 | biostudies-literature
Project description:In this paper, a high dynamic range (HDR) imaging method based on the stereo vision system is presented. The proposed method uses differently exposed low dynamic range (LDR) images captured from a stereo camera. The stereo LDR images are first converted to initial stereo HDR images using the inverse camera response function estimated from the LDR images. However, due to the limited dynamic range of the stereo LDR camera, the radiance values in under/over-exposed regions of the initial main-view (MV) HDR image can be lost. To restore these radiance values, the proposed stereo matching and hole-filling algorithms are applied to the stereo HDR images. Specifically, the auxiliary-view (AV) HDR image is warped by using the estimated disparity between initial the stereo HDR images and then effective hole-filling is applied to the warped AV HDR image. To reconstruct the final MV HDR, the warped and hole-filled AV HDR image is fused with the initial MV HDR image using the weight map. The experimental results demonstrate objectively and subjectively that the proposed stereo HDR imaging method provides better performance compared to the conventional method.
| S-EPMC5539793 | biostudies-other
Project description:This paper presents a non-invasive, non-contact system for the measurement of the arterial dorsum manus vibration waveforms of Parkinson disease patients. The laser line method is applied to detect the dorsum manus vibration in rest and postural situations. The proposed measurement system mainly consists of a laser diode and a low cost complementary metal-oxide semiconductor (CMOS) image sensor. Laser line and centroid methods are combined with the Fast Fourier Transform (FFT) in this study. The shape and frequency and relative frequency of the dorsum manus vibration waveforms can be detected rapidly using our Parkinson's disease measurement system. A laser line near the wrist joint is used as the testing line. The experimental results show an obvious increase in the amplitude and frequency of dorsum manus variation in the measured region in patients suffering from Parkinson's disease, indicating the obvious effects of the disease. Both in postural and rest state measurements, as the patient disease age increases the vibration frequency increases. The measurement system is well suited for evaluating and pre-diagnosing early stage Parkinson's disease.
| S-EPMC3274029 | biostudies-other
Project description:Organic photodiodes (OPDs) for its interesting optoelectronic properties has the potential to be utilized with complementary metal-oxide-semiconductor (CMOS) circuit for imaging, automotive, and security based applications. To achieve such a hybrid device as an image sensor, it is imperative that the quality of the OPD remains high on the CMOS substrate and that it has a well-connected optoelectronic interface with the underneath readout integrated circuit (ROIC) for efficient photogeneration and signal readout. Here, we demonstrate seamless integration of a thermally deposited visible light sensitive small molecule OPD on a standard commercial CMOS substrate using optimized doped PCBM buffer layer. Under a standard power supply voltage of 3?V, this hybrid device shows an excellent photolinearity in the entire bias regime, a high pixel sensitivity of 2?V/Lux.sec, a dynamic range (DR) of 71?dB, and a low dark leakage current density of 1?nA/cm2. Moreover, the integrated OPD has a minimum bandwidth of 400?kHz. The photoresponse nonuniformity being only 1.7%, achieved under research lab conditions, strengthens the notion that this fully-CMOS compatible technology has the potential to be applied in high-performance large-scale imaging array.
| S-EPMC7200686 | biostudies-literature
Project description:BackgroundTracking and predicting the growth performance of plants in different environments is critical for predicting the impact of global climate change. Automated approaches for image capture and analysis have allowed for substantial increases in the throughput of quantitative growth trait measurements compared with manual assessments. Recent work has focused on adopting computer vision and machine learning approaches to improve the accuracy of automated plant phenotyping. Here we present PS-Plant, a low-cost and portable 3D plant phenotyping platform based on an imaging technique novel to plant phenotyping called photometric stereo (PS).ResultsWe calibrated PS-Plant to track the model plant Arabidopsis thaliana throughout the day-night (diel) cycle and investigated growth architecture under a variety of conditions to illustrate the dramatic effect of the environment on plant phenotype. We developed bespoke computer vision algorithms and assessed available deep neural network architectures to automate the segmentation of rosettes and individual leaves, and extract basic and more advanced traits from PS-derived data, including the tracking of 3D plant growth and diel leaf hyponastic movement. Furthermore, we have produced the first PS training data set, which includes 221 manually annotated Arabidopsis rosettes that were used for training and data analysis (1,768 images in total). A full protocol is provided, including all software components and an additional test data set.ConclusionsPS-Plant is a powerful new phenotyping tool for plant research that provides robust data at high temporal and spatial resolutions. The system is well-suited for small- and large-scale research and will help to accelerate bridging of the phenotype-to-genotype gap.
| S-EPMC6534809 | biostudies-literature
Project description:In this paper, we present a multi-resolution mode CMOS image sensor (CIS) for intelligent surveillance system (ISS) applications. A low column fixed-pattern noise (CFPN) comparator is proposed in 8-bit two-step single-slope analog-to-digital converter (TSSS ADC) for the CIS that supports normal, 1/2, 1/4, 1/8, 1/16, 1/32, and 1/64 mode of pixel resolution. We show that the scaled-resolution images enable CIS to reduce total power consumption while images hold steady without events. A prototype sensor of 176 × 144 pixels has been fabricated with a 0.18 μm 1-poly 4-metal CMOS process. The area of 4-shared 4T-active pixel sensor (APS) is 4.4 μm × 4.4 μm and the total chip size is 2.35 mm × 2.35 mm. The maximum power consumption is 10 mW (with full resolution) with supply voltages of 3.3 V (analog) and 1.8 V (digital) and 14 frame/s of frame rates.
| S-EPMC5539649 | biostudies-other
Project description:Accurate traceable measurement systems often use laser interferometers for position measurements in one or more dimensions. Since interferometers provide only incremental information, they are often combined with index sensors to provide a stable reference starting point. Straightness measurements are important for machine axis correction and for systems having several degrees of freedom. In this paper, we investigate the accuracy of an optical two-dimensional (2D) index sensor, which can also be used in a straightness measurement system, based on a fiber-coupled, collimated laser beam pointing onto an image sensor. Additionally, the sensor can directly determine a 2D position over a range of a few millimeters. The device is based on a simple and low-cost complementary metal-oxide-semiconductor (CMOS) image sensor chip and provides sub-micrometer accuracy. The system is an interesting alternative to standard techniques and can even be implemented on machines for real-time corrections. This paper presents the developed sensor properties for various applications and introduces a novel error separation method for straightness measurements.
| S-EPMC6960588 | biostudies-literature
Project description:Photometric stereo uses images of objects illuminated from various directions to calculate surface normals which can be used to generate 3D meshes of the object. Such meshes can be used by engineers to estimate damage of a concrete surface, or track damage progression over time to inform maintenance decisions. This dataset [1] was collected to quantify the uncertainty in a photometric stereo test rig through both the comparison with a well characterised method (coordinate measurement machine) and experiment virtualisation. Data was collected for 9 real objects using both the test rig and the coordinate measurement machine. These objects range from clay statues to damaged concrete slabs. Furthermore, synthetic data for 12 objects was created via virtual renders generated using Blender (3D software) [2]. The two methods of data generation allowed the decoupling of the physical rig (used to light and photograph objects) and the photometric stereo algorithm (used to convert images and lighting information into 3D meshes). This data can allow users to: test their own photometric stereo algorithms, with specialised data created for structural health monitoring applications; provide an industrially relevant case study to develop and test uncertainty quantification methods on test rigs for structural health monitoring of concrete; or develop data processing methodologies for the alignment of scaled, translated, and rotated data.
| S-EPMC10875225 | biostudies-literature