Single-pixel imaging of dynamic objects using multi-frame motion estimation.
Ontology highlight
ABSTRACT:
SUBMITTER: Monin S
PROVIDER: S-EPMC8032706 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:A novel technique for the simultaneous fusion, imaging and encryption of multiple objects using a single-pixel detector is proposed. Here, encoded multiplexing patterns are employed to illuminate multiple objects simultaneously. The mixed light reflected from the objects is detected by a single-pixel detector. An iterative reconstruction method is used to restore the fused image by summing the multiplexed patterns and detected intensities. Next, clear images of the objects are recovered by decoding the fused image. We experimentally obtain fused and multiple clear images by utilizing a single-pixel detector to collect the direct and indirect reflected light. Technically, by utilizing the patterns with per-pixel exposure control, multiple objects' information is multiplexed into the detected intensities and then demultiplexed computationally under the single-pixel imaging and compressed sensing schemes. An encryption experiment is performed by setting the multiplexed patterns' encoding as keys.
| S-EPMC5640669 | biostudies-literature
Project description:Terahertz (THz) imaging can see through otherwise opaque materials. However, because of the long wavelengths of THz radiation (λ = 400 μm at 0.75 THz), far-field THz imaging techniques suffer from low resolution compared to visible wavelengths. We demonstrate noninvasive, near-field THz imaging with subwavelength resolution. We project a time-varying, intense (>100 μJ/cm(2)) optical pattern onto a silicon wafer, which spatially modulates the transmission of synchronous pulse of THz radiation. An unknown object is placed on the hidden side of the silicon, and the far-field THz transmission corresponding to each mask is recorded by a single-element detector. Knowledge of the patterns and of the corresponding detector signal are combined to give an image of the object. Using this technique, we image a printed circuit board on the underside of a 115-μm-thick silicon wafer with ~100-μm (λ/4) resolution. With subwavelength resolution and the inherent sensitivity to local conductivity, it is possible to detect fissures in the circuitry wiring of a few micrometers in size. THz imaging systems of this type will have other uses too, where noninvasive measurement or imaging of concealed structures is necessary, such as in semiconductor manufacturing or in ex vivo bioimaging.
| S-EPMC4928995 | biostudies-literature
Project description:In contrast to conventional multipixel cameras, single-pixel cameras capture images using a single detector that measures the correlations between the scene and a set of patterns. However, these systems typically exhibit low frame rates, because to fully sample a scene in this way requires at least the same number of correlation measurements as the number of pixels in the reconstructed image. To mitigate this, a range of compressive sensing techniques have been developed which use a priori knowledge to reconstruct images from an undersampled measurement set. Here, we take a different approach and adopt a strategy inspired by the foveated vision found in the animal kingdom-a framework that exploits the spatiotemporal redundancy of many dynamic scenes. In our system, a high-resolution foveal region tracks motion within the scene, yet unlike a simple zoom, every frame delivers new spatial information from across the entire field of view. This strategy rapidly records the detail of quickly changing features in the scene while simultaneously accumulating detail of more slowly evolving regions over several consecutive frames. This architecture provides video streams in which both the resolution and exposure time spatially vary and adapt dynamically in response to the evolution of the scene. The degree of local frame rate enhancement is scene-dependent, but here, we demonstrate a factor of 4, thereby helping to mitigate one of the main drawbacks of single-pixel imaging techniques. The methods described here complement existing compressive sensing approaches and may be applied to enhance computational imagers that rely on sequential correlation measurements.
| S-EPMC5400451 | biostudies-literature
Project description:Hyperspectral imaging technology is playing an increasingly important role in the fields of food analysis, medicine and biotechnology. To improve the speed of operation and increase the light throughput in a compact equipment structure, a Fourier transform hyperspectral imaging system based on a single-pixel technique is proposed in this study. Compared with current imaging spectrometry approaches, the proposed system has a wider spectral range (400-1100 nm), a better spectral resolution (1 nm) and requires fewer measurement data (a sample rate of 6.25%). The performance of this system was verified by its application to the non-destructive testing of potatoes.
| S-EPMC5364546 | biostudies-literature
Project description:In this paper, an irregular displacement-based lensless wide-field microscopy imaging platform is presented by combining digital in-line holography and computational pixel super-resolution using multi-frame processing. The samples are illuminated by a nearly coherent illumination system, where the hologram shadows are projected into a complementary metal-oxide semiconductor-based imaging sensor. To increase the resolution, a multi-frame pixel resolution approach is employed to produce a single holographic image from multiple frame observations of the scene, with small planar displacements. Displacements are resolved by a hybrid approach: (i) alignment of the LR images by a fast feature-based registration method, and (ii) fine adjustment of the sub-pixel information using a continuous optimization approach designed to find the global optimum solution. Numerical method for phase-retrieval is applied to decode the signal and reconstruct the morphological details of the analyzed sample. The presented approach was evaluated with various biological samples including sperm and platelets, whose dimensions are in the order of a few microns. The obtained results demonstrate a spatial resolution of 1.55 µm on a field-of-view of ?30 mm2.
| S-EPMC5898403 | biostudies-literature
Project description:BACKGROUND:Subject motion is known to produce spurious covariance among time-series in functional connectivity that has been reported to induce distance-dependent spurious correlations. PURPOSE:To present a feasibility study for applying the extended Kalman filter (EKF) framework for high temporal resolution motion correction of resting state functional MRI (rs-fMRI) series using each simultaneous multi-slice (SMS) echo planar imaging (EPI) shot as its own navigator. STUDY TYPE:Prospective feasibility study. POPULATION/SUBJECTS:Three human volunteers. FIELD STRENGTH/SEQUENCE:3T GE DISCOVERY MR750 scanner using a 32-channel head coil. Simultaneous multi-slice rs-fMRI sequence with repetition time (TR)/echo time (TE) = 800/30 ms, and SMS factor 6. ASSESSMENT:Motion estimates were computed using two techniques: a conventional rigid-body volume-wise registration; and a high-temporal resolution motion estimation rigid-body approach. The reference image was resampled using the estimates obtained from both approaches and the difference between these predicted volumes and the original moving series was summarized using the normalized mean squared error (NMSE). STATISTICAL TESTS:Direct comparison of NMSE values. RESULTS:High-temporal motion estimation was always superior to volume-wise motion estimation for the sample presented. For staged continuous rotations, the NMSE using high-temporal resolution motion estimates ranged between [0.130, 0.150] for the first volunteer (in-plane rotations), between [0.060, 0.068] for the second volunteer (in-plane rotations), and between [0.063, 0.080] for the third volunteer (through-plane rotations). These values went up to [0.384, 0.464]; [0.136, 0.179]; and [0.080, 0.096], respectively, when using volume-wise motion estimates. DATA CONCLUSION:Accurate high-temporal rigid-body motion estimates can be obtained for rs-fMRI taking advantage of simultaneous multi-slice EPI sub-TR shots. LEVEL OF EVIDENCE:2 Technical Efficacy: Stage 1 J. Magn. Reson. Imaging 2018.
| S-EPMC6153080 | biostudies-literature
Project description:Patient motion during dynamic PET imaging can induce errors in myocardial blood flow (MBF) estimation. Motion correction for dynamic cardiac PET is challenging because the rapid tracer kinetics of 82Rb leads to substantial tracer distribution change across different dynamic frames over time, which can cause difficulties for image registration-based motion correction, particularly for early dynamic frames. In this paper, we developed an automatic deep learning-based motion correction (DeepMC) method for dynamic cardiac PET. In this study we focused on the detection and correction of inter-frame rigid translational motion caused by voluntary body movement and pattern change of respiratory motion. A bidirectional-3D LSTM network was developed to fully utilize both local and nonlocal temporal information in the 4D dynamic image data for motion detection. The network was trained and evaluated over motion-free patient scans with simulated motion so that the motion ground-truths are available, where one million samples based on 65 patient scans were used in training, and 600 samples based on 20 patient scans were used in evaluation. The proposed method was also evaluated using additional 10 patient datasets with real motion. We demonstrated that the proposed DeepMC obtained superior performance compared to conventional registration-based methods and other convolutional neural networks (CNN), in terms of motion estimation and MBF quantification accuracy. Once trained, DeepMC is much faster than the registration-based methods and can be easily integrated into the clinical workflow. In the future work, additional investigation is needed to evaluate this approach in a clinical context with realistic patient motion.
| S-EPMC8670362 | biostudies-literature
Project description:Single-shot ultrafast multi-frame imaging technology plays a crucial role in the observation of laser-induced plasma. However, there are many challenges in the application of laser processing, such as technology fusion and imaging stability. To provide a stable and reliable observation method, we propose an ultrafast single-shot multi-frame imaging technology based on wavelength polarization multiplexing. Through the frequency doubling and birefringence effects of the BBO and the quartz crystal, the 800 nm femtosecond laser pulse was frequency doubled to 400 nm, and a sequence of probe sub-pulses with dual-wavelength and different polarization was generated. The coaxial propagation and framing imaging of multi-frequency pulses provided stable imaging quality and clarity, as well as high temporal/spatial resolution (200 fs and 228 lp/mm). In the experiments involving femtosecond laser-induced plasma propagation, the probe sub-pulses measured their time intervals by capturing the same results. Specifically, the measured time intervals were 200 fs between the same color pulses and 1 ps between the adjacent different. Finally, based on the obtained system time resolution, we observed and revealed the evolution mechanism of femtosecond laser-induced air plasma filaments, the multifilament propagation of femtosecond laser in fused silica, and the influence mechanism of air ionization on laser-induced shock waves.
| S-EPMC10142422 | biostudies-literature
Project description:We demonstrate single-shot multi-frame imaging of quasi-2D cylindrically converging shock waves as they propagate through a multi-layer target sample assembly. We visualize the shock with sequences of up to 16 images, using a Fabry-Perot cavity to generate a pulse train that can be used in various imaging configurations. We employ multi-frame shadowgraph and dark-field imaging to measure the amplitude and phase of the light transmitted through the shocked target. Single-shot multi-frame imaging tracks geometric distortion and additional features in our images that were not previously resolvable in this experimental geometry. Analysis of our images, in combination with simulations, shows that the additional image features are formed by a coupled wave structure resulting from interface effects in our targets. This technique presents a new capability for tabletop imaging of shock waves that can be extended to experiments at large-scale facilities.
| S-EPMC6403302 | biostudies-literature
Project description:To improve the life quality of forearm amputees, prosthetic hands with high accuracy, and robustness are necessary. The application of surface electromyography (sEMG) signals to control a prosthetic hand is challenging. In this study, we proposed a time-domain CNN model for the regression prediction of joint angles in three degrees of freedom (3-DOFs, include two wrist joint motion and one finger joint motion), and five-fold cross validation was used to evaluate the correlation coefficient (CC). The CC value results of wrist flexion/extension motion obtained from 10 participants was 0.87-0.92, pronation/supination motion was 0.72-0.95, and hand grip/open motion was 0.75-0.94. We backtracked the fully connected layer weights to create a geometry plot for analyzing the motion pattern to investigate the learning of the proposed model. In order to discuss the daily updateability of the model by transfer learning, we performed a second experiment on five of the participants in another day and conducted transfer learning based on smaller amount of dataset. The CC results improved (wrist flexion/extension was 0.90-0.97, pronation/supination was 0.84-0.96, hand grip/open was 0.85-0.92), suggesting the effectiveness of the transfer learning by incorporating the small amounts of sEMG data acquired in different days. We compared our CNN-based model with four conventional regression models, the result illustrates that proposed model significantly outperforms the four conventional models with and without transfer learning. The offline result suggests the reliability of the proposed model in real-time control in different days, it can be applied for real-time prosthetic control in the future.
| S-EPMC8366416 | biostudies-literature