Dataset Information

Colour Helmholtz Stereopsis for Reconstruction of Dynamic Scenes with Arbitrary Unknown Reflectance.

ABSTRACT: Helmholtz Stereopsis is a powerful technique for reconstruction of scenes with arbitrary reflectance properties. However, previous formulations have been limited to static objects due to the requirement to sequentially capture reciprocal image pairs (i.e. two images with the camera and light source positions mutually interchanged). In this paper, we propose colour Helmholtz Stereopsis-a novel framework for Helmholtz Stereopsis based on wavelength multiplexing. To address the new set of challenges introduced by multispectral data acquisition, the proposed Colour Helmholtz Stereopsis pipeline uniquely combines a tailored photometric calibration for multiple camera/light source pairs, a novel procedure for spatio-temporal surface chromaticity calibration and a state-of-the-art Bayesian formulation necessary for accurate reconstruction from a minimal number of reciprocal pairs. In this framework, reflectance is spatially unconstrained both in terms of its chromaticity and the directional component dependent on the illumination incidence and viewing angles. The proposed approach for the first time enables modelling of dynamic scenes with arbitrary unknown and spatially varying reflectance using a practical acquisition set-up consisting of a small number of cameras and light sources. Experimental results demonstrate the accuracy and flexibility of the technique on a variety of static and dynamic scenes with arbitrary unknown BRDF and chromaticity ranging from uniform to arbitrary and spatially varying.

SUBMITTER: Roubtsova N

PROVIDER: S-EPMC6979544 | biostudies-literature | 2017

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Colour Helmholtz Stereopsis for Reconstruction of Dynamic Scenes with Arbitrary Unknown Reflectance.

Roubtsova Nadejda N Guillemaut Jean-Yves JY

International journal of computer vision 20160920 1

Helmholtz Stereopsis is a powerful technique for reconstruction of scenes with arbitrary reflectance properties. However, previous formulations have been limited to static objects due to the requirement to sequentially capture reciprocal image pairs (i.e. two images with the camera and light source positions mutually interchanged). In this paper, we propose colour Helmholtz Stereopsis-a novel framework for Helmholtz Stereopsis based on wavelength multiplexing. To address the new set of challenge ...[more]

PMID: 32025092

Similar Datasets

Project description:BackgroundAlthough it is recognized that dynamic stereopsis is vital in daily life, there is still room for improvement in assessment methods. A novel clinical dynamic stereopsis assessment method was created based on an autostereoscopic display system that did not require additional auxiliary glasses. This study evaluated the optical parameters and clinical performance of the autostereoscopic display system for clinical dynamic stereopsis assessment.MethodsThe autostereoscopic dynamic stereopsis assessment device was based on a directional backlight technology. Experiment 1 was performed under the same environmental conditions to compare luminance, crosstalk, and spectrum between the autostereoscopic dynamic stereopsis assessment device and the conventional dynamic random-dot stereopsis measuring instrument. Experiment 2 was an observational, analytic, cross-sectional study involving 135 healthy participants, each of whom was asked to complete measurements on both the autostereoscopic and conventional devices in random order. Stereo acuity, operating time, acceptance, and visual fatigue scores were recorded for clinical evaluation.ResultsThe autostereoscopic device had brighter luminance (139 and 140 cd/m2 for 2 eyes, respectively), lower crosstalk (4.50% for both eyes), and higher color restoration degree than those of the conventional instrument. Clinically, the novel dynamic stereopsis assessment was as accurate as the traditional method [170" (0.00") and 170" (0.00") respectively; P=0.317], and with more efficiency (166±58.9 and 298±116 s, respectively; P<0.001), higher acceptance (3.36±0.93 and 2.02±0.59 points, respectively; P<0.001), lesser fatigue (0.27±0.46 and 0.73±0.66 points, respectively; P<0.001). The autostereoscopic dynamic stereopsis assessment device with brighter luminance, lower crosstalk, and higher color restoration degree was more effective than the traditional instrument at displaying dynamic clues for clinical dynamic stereopsis assessment. Furthermore, its high-quality image and user-friendly interface provided accurate assessment results in all 3 dynamic stereopsis assessment task conditions, with a higher level of acceptance and lesser visual fatigue, than the traditional assessment method.ConclusionsThe autostereoscopic device has excellent functions in both optical parameters and clinical performance, and therefore has the potential to be applied and popularized in future assessments.

Project description:Quantitative measurements of colour, pattern and morphology are vital to a growing range of disciplines. Digital cameras are readily available and already widely used for making these measurements, having numerous advantages over other techniques, such as spectrometry. However, off-the-shelf consumer cameras are designed to produce images for human viewing, meaning that their uncalibrated photographs cannot be used for making reliable, quantitative measurements. Many studies still fail to appreciate this, and of those scientists who are aware of such issues, many are hindered by a lack of usable tools for making objective measurements from photographs.We have developed an image processing toolbox that generates images that are linear with respect to radiance from the RAW files of numerous camera brands and can combine image channels from multispectral cameras, including additional ultraviolet photographs. Images are then normalised using one or more grey standards to control for lighting conditions. This enables objective measures of reflectance and colour using a wide range of consumer cameras. Furthermore, if the camera's spectral sensitivities are known, the software can convert images to correspond to the visual system (cone-catch values) of a wide range of animals, enabling human and non-human visual systems to be modelled. The toolbox also provides image analysis tools that can extract luminance (lightness), colour and pattern information. Furthermore, all processing is performed on 32-bit floating point images rather than commonly used 8-bit images. This increases precision and reduces the likelihood of data loss through rounding error or saturation of pixels, while also facilitating the measurement of objects with shiny or fluorescent properties.All cameras tested using this software were found to demonstrate a linear response within each image and across a range of exposure times. Cone-catch mapping functions were highly robust, converting images to several animal visual systems and yielding data that agreed closely with spectrometer-based estimates.Our imaging toolbox is freely available as an addition to the open source ImageJ software. We believe that it will considerably enhance the appropriate use of digital cameras across multiple areas of biology, in particular researchers aiming to quantify animal and plant visual signals.

Dataset Information

Colour Helmholtz Stereopsis for Reconstruction of Dynamic Scenes with Arbitrary Unknown Reflectance.

Publications

Colour Helmholtz Stereopsis for Reconstruction of Dynamic Scenes with Arbitrary Unknown Reflectance.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets