Low-latency time-of-flight non-line-of-sight imaging at 5 frames per second
Ontology highlight
ABSTRACT:
SUBMITTER: Nam J
PROVIDER: S-EPMC8586255 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Real-time imaging of countless femtosecond dynamics requires extreme speeds orders of magnitude beyond the limits of electronic sensors. Existing femtosecond imaging modalities either require event repetition or provide single-shot acquisition with no more than 1013 frames per second (fps) and 3 × 102 frames. Here, we report compressed ultrafast spectral photography (CUSP), which attains several new records in single-shot multi-dimensional imaging speeds. In active mode, CUSP achieves both 7 × 1013 fps and 103 frames simultaneously by synergizing spectral encoding, pulse splitting, temporal shearing, and compressed sensing-enabling unprecedented quantitative imaging of rapid nonlinear light-matter interaction. In passive mode, CUSP provides four-dimensional (4D) spectral imaging at 0.5 × 1012 fps, allowing the first single-shot spectrally resolved fluorescence lifetime imaging microscopy (SR-FLIM). As a real-time multi-dimensional imaging technology with the highest speeds and most frames, CUSP is envisioned to play instrumental roles in numerous pivotal scientific studies without the need for event repetition.
| S-EPMC7190645 | biostudies-literature
Project description:ObjectiveDysphagia or difficulty in swallowing is a potentially hazardous clinical problem that needs regular monitoring. Real-time 2D MRI of swallowing is a promising radiation-free alternative to the current clinical standard: videofluoroscopy. However, aspiration may be missed if it occurs outside this single imaged slice. We therefore aimed to image swallowing in 3D real time at 12 frames per second (fps).Materials and methodsAt 3 T, three 3D real-time MRI acquisition approaches were compared to the 2D acquisition: an aligned stack-of-stars (SOS), and a rotated SOS with a golden-angle increment and with a tiny golden-angle increment. The optimal 3D acquisition was determined by computer simulations and phantom scans. Subsequently, five healthy volunteers were scanned and swallowing parameters were measured.ResultsAlthough the rotated SOS approaches resulted in better image quality in simulations, in practice, the aligned SOS performed best due to the limited number of slices. The four swallowing phases could be distinguished in 3D real-time MRI, even though the spatial blurring was stronger than in 2D. The swallowing parameters were similar between 2 and 3D.ConclusionAt a spatial resolution of 2-by-2-by-6 mm with seven slices, swallowing can be imaged in 3D real time at a frame rate of 12 fps.
| S-EPMC9188511 | biostudies-literature
Project description:Three-dimensional, fluorescence imaging methods with ~1?MHz frame rates are needed for high-speed, blur-free flow cytometry and capturing volumetric neuronal activity. The frame rates of current imaging methods are limited to kHz by the photon budget, slow camera readout, and/or slow laser beam scanners. Here, we present line excitation array detection (LEAD) fluorescence microscopy, a high-speed imaging method capable of providing 0.8 million frames per second. The method performs 0.8?MHz line-scanning of an excitation laser beam using a chirped signal-driven longitudinal acousto-optic deflector to create a virtual light-sheet, and images the field-of-view with a linear photomultiplier tube array to generate a 66?×?14 pixel frame each scan cycle. We implement LEAD microscopy as a blur-free flow cytometer for Caenorhabditis elegans moving at 1?m?s-1 with 3.5-µm resolution and signal-to-background ratios >200. Signal-to-noise measurements indicate future LEAD fluorescence microscopes can reach higher resolutions and pixels per frame without compromising frame rates.
| S-EPMC6206139 | biostudies-literature
Project description:Optical imaging through diffusive, visually-opaque barriers and around corners is an important challenge in many fields, ranging from defense to medical applications. Recently, novel techniques that combine time-of-flight (TOF) measurements with computational reconstruction have allowed breakthrough imaging and tracking of objects hidden from view. These light detection and ranging (LiDAR)-based approaches require active short-pulsed illumination and ultrafast time-resolved detection. Here, bringing notions from passive radio detection and ranging (RADAR) and passive geophysical mapping approaches, we present an optical TOF technique that allows passive localization of light sources and reflective objects through diffusive barriers and around corners. Our approach retrieves TOF information from temporal cross-correlations of scattered light, via interferometry, providing temporal resolution that surpasses state-of-the-art ultrafast detectors by three orders of magnitude. While our passive approach is limited by signal-to-noise to relatively sparse scenes, we demonstrate passive localization of multiple white-light sources and reflective objects hidden from view using a simple setup.
| S-EPMC6659653 | biostudies-literature
Project description:Objective. Atherosclerosis is a leading cause of mortality and morbidity. Optical endoscopy, ultrasound, and X-ray offer minimally invasive imaging assessments but have limited sensitivity for characterizing disease and therapeutic response. Magnetic resonance imaging (MRI) endoscopy is a newer idea employing tiny catheter-mounted detectors connected to the MRI scanner. It can see through vessel walls and provide soft-tissue sensitivity, but its slow imaging speed limits practical applications. Our goal is high-resolution MRI endoscopy with real-time imaging speeds comparable to existing modalities. Methods. Intravascular (3 mm) transmit-receive MRI endoscopes were fabricated for highly undersampled radial-projection MRI in a clinical 3-tesla MRI scanner. Iterative nonlinear reconstruction was accelerated using graphics processor units connected via a single ethernet cable to achieve true real-time endoscopy visualization at the scanner. MRI endoscopy was performed at 6-10 frames/sec and 200-300 μm resolution in human arterial specimens and porcine vessels ex vivo and in vivo and compared with fully sampled 0.3 frames/sec and three-dimensional reference scans using mutual information (MI) and structural similarity (3-SSIM) indices. Results. High-speed MRI endoscopy at 6-10 frames/sec was consistent with fully sampled MRI endoscopy and histology, with feasibility demonstrated in vivo in a large animal model. A 20-30-fold speed-up vs. 0.3 frames/sec reference scans came at a cost of ~7% in MI and ~45% in 3-SSIM, with reduced motion sensitivity. Conclusion. High-resolution MRI endoscopy can now be performed at frame rates comparable to those of X-ray and optical endoscopy and could provide an alternative to existing modalities, with MRI's advantages of soft-tissue sensitivity and lack of ionizing radiation.
| S-EPMC10521714 | biostudies-literature
Project description:Intravascular photoacoustic-ultrasound (IVPA-US) imaging is an emerging hybrid modality for the detection of lipid-laden plaques, as it provides simultaneous morphological and lipid-specific chemical information of an artery wall. Real-time imaging and display at video-rate speed are critical for clinical utility of the IVPA-US imaging technology. Here, we demonstrate a portable IVPA-US system capable of imaging at up to 25 frames per second in real-time display mode. This unprecedented imaging speed was achieved by concurrent innovations in excitation laser source, rotary joint assembly, 1 mm IVPA-US catheter size, differentiated A-line strategy, and real-time image processing and display algorithms. Spatial resolution, chemical specificity, and capability for imaging highly dynamic objects were evaluated by phantoms to characterize system performance. An imaging speed of 16 frames per second was determined to be adequate to suppress motion artifacts from cardiac pulsation for in vivo applications. The translational capability of this system for the detection of lipid-laden plaques was validated by ex vivo imaging of an atherosclerotic human coronary artery at 16 frames per second, which showed strong correlation to gold-standard histopathology. Thus, this high-speed IVPA-US imaging system presents significant advances in the translational intravascular and other endoscopic applications.
| S-EPMC5431181 | biostudies-literature
Project description:Photoacoustic tomography, a hybrid imaging modality combining optical and ultrasound imaging, is gaining attention in the field of medical imaging. Typically, a Q-switched Nd:YAG laser is used to excite the tissue and generate photoacoustic signals. But, such photoacoustic imaging systems are difficult to translate into clinical applications owing to their high cost, bulky size often requiring an optical table to house such lasers. Moreover, the low pulse repetition rate of few tens of hertz prevents them from being used in high frame rate photoacoustic imaging. In this work, we have demonstrated up to 7000 Hz photoacoustic imaging (B-mode) and measured the flow rate of a fast moving object. We used a ~140 nanosecond pulsed laser diode as an excitation source and a clinical ultrasound imaging system to capture and display the photoacoustic images. The excitation laser is ~803 nm in wavelength with ~1.4 mJ energy per pulse. So far, the reported 2-dimensional photoacoustic B-scan imaging is only a few tens of frames per second using a clinical ultrasound system. Therefore, this is the first report on 2-dimensional photoacoustic B-scan imaging with 7000 frames per second. We have demonstrated phantom imaging to view and measure the flow rate of ink solution inside a tube. This fast photoacoustic imaging can be useful for various clinical applications including cardiac related problems, where the blood flow rate is quite high, or other dynamic studies.
| S-EPMC4771451 | biostudies-other
Project description:The capture of transient scenes at high imaging speed has been long sought by photographers, with early examples being the well known recording in 1878 of a horse in motion and the 1887 photograph of a supersonic bullet. However, not until the late twentieth century were breakthroughs achieved in demonstrating ultrahigh-speed imaging (more than 10(5) frames per second). In particular, the introduction of electronic imaging sensors based on the charge-coupled device (CCD) or complementary metal-oxide-semiconductor (CMOS) technology revolutionized high-speed photography, enabling acquisition rates of up to 10(7) frames per second. Despite these sensors' widespread impact, further increasing frame rates using CCD or CMOS technology is fundamentally limited by their on-chip storage and electronic readout speed. Here we demonstrate a two-dimensional dynamic imaging technique, compressed ultrafast photography (CUP), which can capture non-repetitive time-evolving events at up to 10(11) frames per second. Compared with existing ultrafast imaging techniques, CUP has the prominent advantage of measuring an x-y-t (x, y, spatial coordinates; t, time) scene with a single camera snapshot, thereby allowing observation of transient events with temporal resolution as tens of picoseconds. Furthermore, akin to traditional photography, CUP is receive-only, and so does not need the specialized active illumination required by other single-shot ultrafast imagers. As a result, CUP can image a variety of luminescent--such as fluorescent or bioluminescent--objects. Using CUP, we visualize four fundamental physical phenomena with single laser shots only: laser pulse reflection and refraction, photon racing in two media, and faster-than-light propagation of non-information (that is, motion that appears faster than the speed of light but cannot convey information). Given CUP's capability, we expect it to find widespread applications in both fundamental and applied sciences, including biomedical research.
| S-EPMC4270006 | biostudies-literature
Project description:The correlation properties of light provide an outstanding tool to overcome the limitations of traditional imaging techniques. A relevant case is represented by correlation plenoptic imaging (CPI), a quantum-inspired volumetric imaging protocol employing spatio-temporally correlated photons from either entangled or chaotic sources to address the main limitations of conventional light-field imaging, namely, the poor spatial resolution and the reduced change of perspective for 3D imaging. However, the application potential of high-resolution imaging modalities relying on photon correlations is limited, in practice, by the need to collect a large number of frames. This creates a gap, unacceptable for many relevant tasks, between the time performance of correlated-light imaging and that of traditional imaging methods. In this article, we address this issue by exploiting the photon number correlations intrinsic in chaotic light, combined with a cutting-edge ultrafast sensor made of a large array of single-photon avalanche diodes (SPADs). This combination of source and sensor is embedded within a novel single-lens CPI scheme enabling to acquire 10 volumetric images per second. Our results place correlated-photon imaging at a competitive edge and prove its potential in practical applications.
| S-EPMC10406932 | biostudies-literature
Project description:Non-line-of-sight (NLOS) imaging aims at reconstructing targets obscured from the direct line of sight. Existing NLOS imaging algorithms require dense measurements at regular grid points in a large area of the relay surface, which severely hinders their availability to variable relay scenarios in practical applications such as robotic vision, autonomous driving, rescue operations and remote sensing. In this work, we propose a Bayesian framework for NLOS imaging without specific requirements on the spatial pattern of illumination and detection points. By introducing virtual confocal signals, we design a confocal complemented signal-object collaborative regularization (CC-SOCR) algorithm for high-quality reconstructions. Our approach is capable of reconstructing both the albedo and surface normal of the hidden objects with fine details under general relay settings. Moreover, with a regular relay surface, coarse rather than dense measurements are enough for our approach such that the acquisition time can be reduced significantly. As demonstrated in multiple experiments, the proposed framework substantially extends the application range of NLOS imaging.
| S-EPMC10239523 | biostudies-literature