Dataset Information

Geometrical Consistency Modeling on B-Spline Parameter Domain for 3D Face Reconstruction From Limited Number of Wild Images.

ABSTRACT: A number of methods have been proposed for face reconstruction from single/multiple image(s). However, it is still a challenge to do reconstruction for limited number of wild images, in which there exists complex different imaging conditions, various face appearance, and limited number of high-quality images. And most current mesh model based methods cannot generate high-quality face model because of the local mapping deviation in geometric optics and distortion error brought by discrete differential operation. In this paper, accurate geometrical consistency modeling on B-spline parameter domain is proposed to reconstruct high-quality face surface from the various images. The modeling is completely consistent with the law of geometric optics, and B-spline reduces the distortion during surface deformation. In our method, 0th- and 1st-order consistency of stereo are formulated based on low-rank texture structures and local normals, respectively, to approach the pinpoint geometric modeling for face reconstruction. A practical solution combining the two consistency as well as an iterative algorithm is proposed to optimize high-detailed B-spline face effectively. Extensive empirical evaluations on synthetic data and unconstrained data are conducted, and the experimental results demonstrate the effectiveness of our method on challenging scenario, e.g., limited number of images with different head poses, illuminations, and expressions.

SUBMITTER: Peng W

PROVIDER: S-EPMC8079323 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:We present the attenuated spline reconstruction technique (aSRT) which provides an innovative algorithm for single photon emission computed tomography (SPECT) image reconstruction. aSRT is based on an analytic formula of the inverse attenuated Radon transform. It involves the computation of the Hilbert transforms of the linear attenuation function and of two sinusoidal functions of the so-called attenuated sinogram These computations are achieved by employing the attenuation information provided by computed tomography (CT) scans and by utilizing custom-made cubic spline interpolation. The purpose of this work is: (i) to present the mathematics of aSRT, (ii) to reconstruct simulated and real SPECT/CT data using aSRT and (iii) to evaluate aSRT by comparing it to filtered backprojection (FBP) and to ordered subsets expectation minimization (OSEM) reconstruction algorithms. Simulation studies were performed by using an image quality phantom and an appropriate attenuation map. Reconstructed images were generated for 45, 90 and 180 views over 360 degrees with 20 realizations and involved Poisson noise of three different levels (NL), namely 100% (NL1), 50% (NL2) and 10% (NL3) of the total counts, respectively. Moreover, real attenuated SPECT sinograms were reconstructed from a real study of a Jaszczak phantom, as well as from a real clinical myocardial SPECT/CT study. Comparisons between aSRT, FBP and OSEM reconstructions were performed using contrast, bias and image roughness. The results suggest that aSRT can efficiently produce accurate attenuation-corrected reconstructions for simulated and real phantoms, as well as for clinical data. In particular, in the case of the clinical myocardial study, aSRT produced reconstructions with higher cold contrast than both FBP and OSEM. aSRT, by incorporating the attenuation correction within itself, may provide an improved alternative to FBP. This is particularly promising for 'cold' regions as those occurring in myocardial ischaemia.

Project description:4D reconstruction of dynamic positron emission tomography (dPET) data can improve the signal-to-noise ratio in reconstructed image sequences by fitting smooth temporal functions to the voxel time-activity-curves (TACs) during the reconstruction, though the optimal choice of function remains an open question. We propose a spline-residue model, which describes TACs as weighted sums of convolutions of the arterial input function with cubic B-spline basis functions. Convolution with the input function constrains the spline-residue model at early time-points, potentially enhancing noise suppression in early time-frames, while still allowing a wide range of TAC descriptions over the entire imaged time-course, thus limiting bias. Spline-residue based 4D-reconstruction is compared to that of a conventional (non-4D) maximum a posteriori (MAP) algorithm, and to 4D-reconstructions based on adaptive-knot cubic B-splines, the spectral model and an irreversible two-tissue compartment ('2C3K') model. 4D reconstructions were carried out using a nested-MAP algorithm including spatial and temporal roughness penalties. The algorithms were tested using Monte-Carlo simulated scanner data, generated for a digital thoracic phantom with uptake kinetics based on a dynamic [18F]-Fluromisonidazole scan of a non-small cell lung cancer patient. For every algorithm, parametric maps were calculated by fitting each voxel TAC within a sub-region of the reconstructed images with the 2C3K model. Compared to conventional MAP reconstruction, spline-residue-based 4D reconstruction achieved??>50% improvements for five of the eight combinations of the four kinetics parameters for which parametric maps were created with the bias and noise measures used to analyse them, and produced better results for 5/8 combinations than any of the other reconstruction algorithms studied, while spectral model-based 4D reconstruction produced the best results for 2/8. 2C3K model-based 4D reconstruction generated the most biased parametric maps. Inclusion of a temporal roughness penalty function improved the performance of 4D reconstruction based on the cubic B-spline, spectral and spline-residue models.

Dataset Information

Geometrical Consistency Modeling on B-Spline Parameter Domain for 3D Face Reconstruction From Limited Number of Wild Images.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets