Continuously streaming compressed high-speed photography using time delay integration.
Ontology highlight
ABSTRACT:
SUBMITTER: Park J
PROVIDER: S-EPMC9202649 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Compressed ultrafast photography (CUP), a computational imaging technique, is synchronized with short-pulsed laser illumination to enable dynamic three-dimensional (3D) imaging. By leveraging the time-of-flight (ToF) information of pulsed light backscattered by the object, ToF-CUP can reconstruct a volumetric image from a single camera snapshot. In addition, the approach unites the encryption of depth data with the compressed acquisition of 3D data in a single snapshot measurement, thereby allowing efficient and secure data storage and transmission. We demonstrated high-speed 3D videography of moving objects at up to 75 volumes per second. The ToF-CUP camera was applied to track the 3D position of a live comet goldfish. We have also imaged a moving object obscured by a scattering medium.
| S-EPMC4621413 | biostudies-literature
Project description:Simultaneous and efficient ultrafast recording of multiple photon tags contributes to high-dimensional optical imaging and characterization in numerous fields. Existing high-dimensional optical imaging techniques that record space and polarization cannot detect the photon's time of arrival owing to the limited speeds of the state-of-the-art electronic sensors. Here, we overcome this long-standing limitation by implementing stereo-polarimetric compressed ultrafast photography (SP-CUP) to record light-speed high-dimensional events in a single exposure. Synergizing compressed sensing and streak imaging with stereoscopy and polarimetry, SP-CUP enables video-recording of five photon tags (x, y, z: space; t: time of arrival; and ψ: angle of linear polarization) at 100 billion frames per second with a picosecond temporal resolution. We applied SP-CUP to the spatiotemporal characterization of linear polarization dynamics in early-stage plasma emission from laser-induced breakdown. This system also allowed three-dimensional ultrafast imaging of the linear polarization properties of a single ultrashort laser pulse propagating in a scattering medium.
| S-EPMC7567836 | biostudies-literature
Project description:SignificanceCompressed ultrafast photography (CUP) is currently the world's fastest single-shot imaging technique. Through the integration of compressed sensing and streak imaging, CUP can capture a transient event in a single camera exposure with imaging speeds from thousands to trillions of frames per second, at micrometer-level spatial resolutions, and in broad sensing spectral ranges.AimThis tutorial aims to provide a comprehensive review of CUP in its fundamental methods, system implementations, biomedical applications, and prospect.ApproachA step-by-step guideline to CUP's forward model and representative image reconstruction algorithms is presented with sample codes and illustrations in Matlab and Python. Then, CUP's hardware implementation is described with a focus on the representative techniques, advantages, and limitations of the three key components-the spatial encoder, the temporal shearing unit, and the two-dimensional sensor. Furthermore, four representative biomedical applications enabled by CUP are discussed, followed by the prospect of CUP's technical advancement.ConclusionsCUP has emerged as a state-of-the-art ultrafast imaging technology. Its advanced imaging ability and versatility contribute to unprecedented observations and new applications in biomedicine. CUP holds great promise in improving technical specifications and facilitating the investigation of biomedical processes.
| S-EPMC10826888 | biostudies-literature
Project description:We report a method of high-speed phase contrast and bright field microscopy which permits large cell culture vessels to be scanned at much higher speed (up to 30 times faster) than when conventional methods are used without compromising image quality. The object under investigation moves continuously and is captured using a flash illumination which creates an exposure time short enough to prevent motion blur. During the scan the object always stays in focus due to a novel hardware-autofocus system.
| S-EPMC5036042 | biostudies-literature
Project description:Deep-tissue optical imaging suffers from the reduction of resolving power due to tissue-induced optical aberrations and multiple scattering noise. Reflection matrix approaches recording the maps of backscattered waves for all the possible orthogonal input channels have provided formidable solutions for removing severe aberrations and recovering the ideal diffraction-limited spatial resolution without relying on fluorescence labeling and guide stars. However, measuring the full input-output response of the tissue specimen is time-consuming, making the real-time image acquisition difficult. Here, we present the use of a time-reversal matrix, instead of the reflection matrix, for fast high-resolution volumetric imaging of a mouse brain. The time-reversal matrix reduces two-way problem to one-way problem, which effectively relieves the requirement for the coverage of input channels. Using a newly developed aberration correction algorithm designed for the time-reversal matrix, we demonstrated the correction of complex aberrations using as small as 2% of the complete basis while maintaining the image reconstruction fidelity comparable to the fully sampled reflection matrix. Due to nearly 100-fold reduction in the matrix recording time, we could achieve real-time aberration-correction imaging for a field of view of 40 × 40 µm2 (176 × 176 pixels) at a frame rate of 80 Hz. Furthermore, we demonstrated high-throughput volumetric adaptive optical imaging of a mouse brain by recording a volume of 128 × 128 × 125 µm3 (568 × 568 × 125 voxels) in 3.58 s, correcting tissue aberrations at each and every 1 µm depth section, and visualizing myelinated axons with a lateral resolution of 0.45 µm and an axial resolution of 2 µm.
| S-EPMC8758712 | biostudies-literature
Project description:We present high-resolution, high-speed fluorescence lifetime imaging microscopy (FLIM) of live cells based on a compressed sensing scheme. By leveraging the compressibility of biological scenes in a specific domain, we simultaneously record the time-lapse fluorescence decay upon pulsed laser excitation within a large field of view. The resultant system, referred to as compressed FLIM, can acquire a widefield fluorescence lifetime image within a single camera exposure, eliminating the motion artifact and minimizing the photobleaching and phototoxicity. The imaging speed, limited only by the readout speed of the camera, is up to 100 Hz. We demonstrated the utility of compressed FLIM in imaging various transient dynamics at the microscopic scale.
| S-EPMC7826382 | biostudies-literature
Project description:To coordinate movements with events in a dynamic environment the brain has to anticipate when those events occur. A classic example is the estimation of time to contact (TTC), that is, when an object reaches a target. It is thought that TTC is estimated from kinematic variables. For example, a tennis player might use an estimate of distance (d) and speed (v) to estimate TTC (TTC = d/v). However, the tennis player may instead estimate TTC as twice the time it takes for the ball to move from the serve line to the net line. This latter strategy does not rely on kinematics and instead computes TTC solely from temporal cues. Which of these two strategies do humans use to estimate TTC? Considering that both speed and time estimates are inherently uncertain and the ability of the human brain to combine different sources of information, we hypothesized that humans estimate TTC by integrating speed information with temporal cues. We evaluated this hypothesis systematically using psychophysics and Bayesian modeling. Results indicated that humans rely on both speed information and temporal cues and integrate them to optimize their TTC estimates when both cues are present. These findings suggest that the brain's timing mechanisms are actively engaged when interacting with dynamic stimuli.
| S-EPMC5866542 | biostudies-literature
Project description:Single-shot optical imaging based on ultrashort lasers has revealed nonrepetitive processes in subnanosecond timescales beyond the recording range of conventional high-speed cameras. However, nanosecond photography without sacrificing short exposure time and image quality is still missing because of the gap in recordable timescales between ultrafast optical imaging and high-speed electronic cameras. Here, we demonstrate nanosecond photography and ultrawide time-range high-speed photography using a spectrum circuit that produces interval-tunable pulse trains while keeping short pulse durations. We capture a shock wave propagating through a biological cell with a 1.5-ns frame interval and 44-ps exposure time while suppressing image blur. Furthermore, we observe femtosecond laser processing over multiple timescales (25-ps, 2.0-ns, and 1-ms frame intervals), showing that the plasma generated at the picosecond timescale affects subsequent shock wave formation at the nanosecond timescale. Our technique contributes to accumulating data of various fast processes for analysis and to analyzing multi-timescale phenomena as a series of physical processes.
| S-EPMC10732534 | biostudies-literature
Project description:The single-shot compressed ultrafast photography (CUP) camera is the fastest receive-only camera in the world. In this Letter, we introduce an external CCD camera and a space- and intensity-constrained (SIC) reconstruction algorithm to improve the image quality of CUP. The external CCD camera takes a time-unsheared image of the dynamic scene. Unlike the previously used unconstrained algorithm, the proposed algorithm incorporates both spatial and intensity constraints based on the additional prior information provided by the external CCD camera. First, a spatial mask is extracted from the time-unsheared image to define the zone of action. Next, an intensity threshold is determined based on the similarity between the temporally projected image of the reconstructed datacube and the time-unsheared image. Both simulation and experimental studies show that the SIC reconstruction improves the spatial resolution, contrast, and general quality of the reconstructed image.
| S-EPMC5538792 | biostudies-other
Project description:The morphological changes of leaves under the airflow have a significant effect on the deposition of pesticide droplets on the leaves, but the wind-induced vibration of the leaves is complicated to measure. In this study, an aerodynamic test of the pear leaf was conducted in the wind tunnel, and binocular high-speed photography was used to record the deformation and vibration of the leaves under various airflow velocities. Experiments showed that air velocity (v) had a significant effect on the morphological response of the leaf. As v increased, the leaf was in three states, including static deformation, low-frequency vibration, and reconfiguration of airfoil steady state. The mutation from one state to another occurred at the critical velocity of vcr1 and vcr2 . By tracking the leaf marker point, various morphological parameters were calculated, including the bending angle of the petiole, the wind deflection angle, and the twist angle of leaves under different air velocities. When vcr1 ≤v ≤vcr2 , the parameters changed periodically. When v< vcr1 , the petiole and the leaf bent statically, and the bending angle of the petiole and the wind deflection angle of the leaf gradually increased. When v >vcr2 , the morphology of the leaf and the petiole was stable. Besides, this study tracked and measured the wind deflection area of leaf, which was consistent with the theoretical calculation results. The measurement of the leaf morphological parameters can reflect the morphological changes of leaves under airflow, thus providing a basis for the decision-making of air-assisted spray airflow.
| S-EPMC9685665 | biostudies-literature