Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

3D Reconstruction of Space Objects from Multi-Views by a Visible Sensor.

ABSTRACT: In this paper, a novel 3D reconstruction framework is proposed to recover the 3D structural model of a space object from its multi-view images captured by a visible sensor. Given an image sequence, this framework first estimates the relative camera poses and recovers the depths of the surface points by the structure from motion (SFM) method, then the patch-based multi-view stereo (PMVS) algorithm is utilized to generate a dense 3D point cloud. To resolve the wrong matches arising from the symmetric structure and repeated textures of space objects, a new strategy is introduced, in which images are added to SFM in imaging order. Meanwhile, a refining process exploiting the structural prior knowledge that most sub-components of artificial space objects are composed of basic geometric shapes is proposed and applied to the recovered point cloud. The proposed reconstruction framework is tested on both simulated image datasets and real image datasets. Experimental results illustrate that the recovered point cloud models of space objects are accurate and have a complete coverage of the surface. Moreover, outliers and points with severe noise are effectively filtered out by the refinement, resulting in an distinct improvement of the structure and visualization of the recovered points.

SUBMITTER: Zhang H

PROVIDER: S-EPMC5539474 | biostudies-other | 2017 Jul

REPOSITORIES: biostudies-other

ACCESS DATA

Json Xml

Similar Datasets

Dynamical machine learning volumetric reconstruction of objects' interiors from limited angular views.

Project description:Limited-angle tomography of an interior volume is a challenging, highly ill-posed problem with practical implications in medical and biological imaging, manufacturing, automation, and environmental and food security. Regularizing priors are necessary to reduce artifacts by improving the condition of such problems. Recently, it was shown that one effective way to learn the priors for strongly scattering yet highly structured 3D objects, e.g. layered and Manhattan, is by a static neural network [Goy et al. Proc. Natl. Acad. Sci. 116, 19848-19856 (2019)]. Here, we present a radically different approach where the collection of raw images from multiple angles is viewed analogously to a dynamical system driven by the object-dependent forward scattering operator. The sequence index in the angle of illumination plays the role of discrete time in the dynamical system analogy. Thus, the imaging problem turns into a problem of nonlinear system identification, which also suggests dynamical learning as a better fit to regularize the reconstructions. We devised a Recurrent Neural Network (RNN) architecture with a novel Separable-Convolution Gated Recurrent Unit (SC-GRU) as the fundamental building block. Through a comprehensive comparison of several quantitative metrics, we show that the dynamic method is suitable for a generic interior-volumetric reconstruction under a limited-angle scheme. We show that this approach accurately reconstructs volume interiors under two conditions: weak scattering, when the Radon transform approximation is applicable and the forward operator well defined; and strong scattering, which is nonlinear with respect to the 3D refractive index distribution and includes uncertainty in the forward operator.

| S-EPMC8027224 | biostudies-literature

A 3D k-space Fourier encoding and reconstruction framework for simultaneous multi-slab acquisition.

Project description:PURPOSE:To propose a novel 3D k-space Fourier encoding and reconstruction framework for simultaneous multi-slab (SMSlab) acquisition and demonstrate its efficacy in high-resolution imaging. METHODS:First, it is illustrated in theory how the inter-slab gap interferes with the formation of the SMSlab 3D k-space. Then, joint RF and gradient encoding are applied to remove the inter-slab gap interference and form a SMSlab 3D k-space. In vivo experiments are performed to validate the proposed theory. Acceleration in the proposed SMSlab 3D k-space is also evaluated. RESULTS:High-resolution (1.0 mm isotropic) images can be reconstructed using the proposed SMSlab 3D framework. Controlled aliasing in parallel imaging sampling and 2D GRAPPA reconstruction can also be applied in the SMSlab 3D k-space. Compared with conventional multi-slab acquisition, SMSlab exhibits better SNR maintainability (such as lower g-factors), especially at high acceleration factors. CONCLUSION:It is demonstrated that the joint application of RF and gradient encoding enables SMSlab within a 3D Fourier encoding framework. Images with high isotropic resolution can be reconstructed, and further acceleration is also applicable. The proposed SMSlab 3D k-space can be valuable for both high-resolution and high-efficiency diffusion and functional MRI.

| S-EPMC6831486 | biostudies-literature

Gel'fand-Graev's reconstruction formula in the 3D real space.

Project description:Gel'fand and Graev performed classical work on the inversion of integral transforms in different spaces [Gel'fand and Graev, Funct. Anal. Appl. 25(1) 1-5 (1991)]. This paper discusses their key results for further research and development.The Gel'fand-Graev inversion formula reveals a fundamental relationship between projection data and the Hilbert transform of an image to be reconstructed. This differential backprojection (DBP)∕backprojection filtration (BPF) approach was rediscovered in the CT field, and applied in important applications such as reconstruction from truncated projections, interior tomography, and limited-angle tomography. Here the authors present the Gel'fand-Graev inversion formula in a 3D setting assuming the 1D x-ray transform.The pseudodifferential operator is a powerful theoretical tool. There is a fundamental mathematical link between the Gel'fand-Graev formula and the DBP (or BPF) approach in the case of the 1D x-ray transform in a 3D real space.This paper shows the power of mathematics for tomographic imaging and the value of a pure theoretical finding, which may appear quite irrelevant to daily healthcare at the first glance.

| S-EPMC3172127 | biostudies-other

Virtual multi-alignment theory of parallel-beam CT image reconstruction for elastic objects.

Project description:In parallel-beam tomography, the virtual alignment method plays an important role in obtaining an ideally aligned reconstruction of a rigid specimen. Furthermore, the method has been developed for elastic specimens with specific motions such as periodic motion, regular expansion or contraction, and elliptical expansion or contraction to obtain a sinogram with an ideal sinogram pattern by transforming an elastic-type projection image set into a rigid-type projection image set satisfying the Helgason-Ludwig consistency condition. In this article, we present a method to convert a combined elastic specimen to a rigid specimen using the virtual multi-alignment method that allows us to obtain an ideally multi-aligned reconstruction of a combined elastic specimen.

| S-EPMC6497627 | biostudies-literature

Space-Time-Frequency Multi-Sensor Analysis for Motor Cortex Localization Using Magnetoencephalography.

Project description:Brain source imaging and time frequency mapping (TFM) are commonly used in magneto/electro encephalography (M/EEG) imaging. However, these methods suffer from important limitations. Source imaging is based on an ill-posed inverse problem leading to instability of source localization solutions, has a limited capacity to localize high frequency oscillations and loses its robustness for induced responses (ill-defined trigger). The drawback of TFM is that it involves independent analysis of signals from a number of frequency bands, and from co-localized sensors. In the present article, a regression-based multi-sensor space-time-frequency analysis (MSA) approach, which integrates co-localized sensors and/or multi-frequency information, is proposed. To estimate task-specific brain activations, MSA uses cross-validated, shifted, multiple Pearson correlation, calculated from the time-frequency transformed brain signal and the binary signal of stimuli. The results are projected from the sensor space onto the cortical surface. To assess MSA performance, the proposed method was compared to the weighted minimum norm estimate (wMNE) source imaging method, in terms of spatial selectivity and robustness against an ill-defined trigger. Magnetoencephalography (MEG) recordings were performed in fourteen subjects during two motor tasks: finger tapping and elbow flexion/extension. In particular, our results show that the MSA approach provides good localization performance when compared to wMNE and statistically significant improvement of robustness against ill-defined trigger.

| S-EPMC7248938 | biostudies-literature

Center point to pose: Multiple views 3D human pose estimation for multi-person.

Project description:3D human pose estimation has always been an important task in computer vision, especially in crowded scenes where multiple people interact with each other. There are many state-of-the-arts for object detection based on single view. However, recovering the location of people is complicated in crowded and occluded scenes due to the lack of depth information for single view, which is the lack of robustness. Multi-view Human Pose Estimation for Multi-Person became an effective approach. The previous multi-view 3D human pose estimation method can be attributed to a strategy to associate the joints of the same person from 2D pose estimation. However, the incompleteness and noise of the 2D pose are inevitable. In addition, how to associate the joints itself is challenging. To solve this issue, we propose a CTP (Center Point to Pose) network based on multi-view which directly operates in the 3D space. The 2D joint features in all cameras are projected into 3D voxel space. Our CTP network regresses the center of one person as the location, and the 3D bounding box as the activity area of one person. Then our CTP network estimates detailed 3D pose for each bounding box. Besides, our CTP network is Non-Maximum Suppression free at the stage of regressing the center of one person, which makes it more efficient and simpler. Our method outperforms competitively on several public datasets which shows the efficacy of our center point to pose network representation.

| S-EPMC9469997 | biostudies-literature

Multi-National Banknote Classification Based on Visible-light Line Sensor and Convolutional Neural Network.

Project description:Automatic recognition of banknotes is applied in payment facilities, such as automated teller machines (ATMs) and banknote counters. Besides the popular approaches that focus on studying the methods applied to various individual types of currencies, there have been studies conducted on simultaneous classification of banknotes from multiple countries. However, their methods were conducted with limited numbers of banknote images, national currencies, and denominations. To address this issue, we propose a multi-national banknote classification method based on visible-light banknote images captured by a one-dimensional line sensor and classified by a convolutional neural network (CNN) considering the size information of each denomination. Experiments conducted on the combined banknote image database of six countries with 62 denominations gave a classification accuracy of 100%, and results show that our proposed algorithm outperforms previous methods.

| S-EPMC5539635 | biostudies-other

MRI visible Fe3O4 polypropylene mesh: 3D reconstruction of spatial relation to bony pelvis and neurovascular structures.

Project description:To demonstrate mesh magnetic resonance imaging (MRI) visibility in living women, the feasibility of reconstructing the full mesh course in 3D, and to document its spatial relationship to pelvic anatomical structures.This is a proof of concept study of three patients from a prospective multi-center trial evaluating women with anterior vaginal mesh repair using a MRI-visible Fe3O4 polypropylene implant for pelvic floor reconstruction. High-resolution sagittal T2-weighted (T2w) sequences, transverse T1-weighted (T1w) FLASH 2D, and transverse T1w FLASH 3D sequences were performed to evaluate Fe3O4 polypropylene mesh MRI visibility and overall post-surgical pelvic anatomy 3 months after reconstructive surgery. Full mesh course in addition to important pelvic structures were reconstructed using the 3D Slicer® software program based on T1w and T2w MRI.Three women with POP-Q grade III cystoceles were successfully treated with a partially absorbable MRI-visible anterior vaginal mesh with six fixation arms and showed no recurrent cystocele at the 3-month follow-up examination. The course of mesh in the pelvis was visible on MRI in all three women. The mesh body and arms could be reconstructed allowing visualization of the full course of the mesh in relationship to important pelvic structures such as the obturator or pudendal vessel nerve bundles in 3D.The use of MRI-visible Fe3O4 polypropylene meshes in combination with post-surgical 3D reconstruction of the mesh and adjacent structures is feasible suggesting that it might be a useful tool for evaluating mesh complications more precisely and a valuable interactive feedback tool for surgeons and mesh design engineers.

| S-EPMC6085093 | biostudies-literature

All-Printed Finger-Inspired Tactile Sensor Array for Microscale Texture Detection and 3D Reconstruction.

Project description:Electronic skins are expected to replicate a human-like tactile sense, which significantly detects surface information, including geometry, material, and temperature. Although most texture features can be sensed in the horizontal direction, the lack of effective approaches for detecting vertical properties limits the development of artificial skin based on tactile sensors. In this study, an all-printed finger-inspired tactile sensor array is developed to realize the 3D detection and reconstruction of microscale structures. A beam structure with a suspended multilayer membrane is proposed, and a tactile sensor array of 12 units arranged in a dual-column layout is developed. This architecture enables the tactile sensor array to obtain comprehensive geometric information of micro-textures, including 3D morphology and clearance characteristics, and optimizes the 3D reconstruction patterns by self-calibration. Moreover, an innovative screen-printing technology incorporating multilayer printing and sacrificial-layer techniques is adopted to print the entire device. In additon, a Braille recognition system utilizing this tactile sensor array is developed to interpret Shakespeare's quotes printed in Grade 2 Braille. The abovementioned demonstrations reveal an attractive future vision for endowing bioinspired robots with the unique capability of touching and feeling the microscale real world and reconstructing it in the cyber world.

| S-EPMC11234443 | biostudies-literature

Comparing MEG and fMRI views to naming actions and objects.

Project description:Most neuroimaging studies are performed using one imaging method only, either functional magnetic resonance imaging (fMRI), electroencephalography (EEG), or magnetoencephalography (MEG). Information on both location and timing has been sought by recording fMRI and EEG, simultaneously, or MEG and fMRI in separate sessions. Such approaches assume similar active areas whether detected via hemodynamic or electrophysiological signatures. Direct comparisons, after independent analysis of data from each imaging modality, have been conducted primarily on low-level sensory processing. Here, we report MEG (timing and location) and fMRI (location) results in 11 subjects when they named pictures that depicted an action or an object. The experimental design was exactly the same for the two imaging modalities. The MEG data were analyzed with two standard approaches: a set of equivalent current dipoles and a distributed minimum norm estimate. The fMRI blood-oxygen-level dependent (BOLD) data were subjected to the usual random-effect contrast analysis. At the group level, MEG and fMRI data showed fairly good convergence, with both overall activation patterns and task effects localizing to comparable cortical regions. There were some systematic discrepancies, however, and the correspondence was less compelling in the individual subjects. The present analysis should be helpful in reconciling results of fMRI and MEG studies on high-level cognitive functions.

| S-EPMC6870641 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data