Net-FLICS: fast quantitative wide-field fluorescence lifetime imaging with compressed sensing - a deep learning approach.
Ontology highlight
ABSTRACT:
SUBMITTER: Yao R
PROVIDER: S-EPMC6400960 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Photoluminescence lifetime imaging of upconverting nanoparticles is increasingly featured in recent progress in optical thermometry. Despite remarkable advances in photoluminescent temperature indicators, existing optical instruments lack the ability of wide-field photoluminescence lifetime imaging in real time, thus falling short in dynamic temperature mapping. Here, we report video-rate upconversion temperature sensing in wide field using single-shot photoluminescence lifetime imaging thermometry (SPLIT). Developed from a compressed-sensing ultrahigh-speed imaging paradigm, SPLIT first records wide-field luminescence intensity decay compressively in two views in a single exposure. Then, an algorithm, built upon the plug-and-play alternating direction method of multipliers, is used to reconstruct the video, from which the extracted lifetime distribution is converted to a temperature map. Using the core/shell NaGdF4:Er3+,Yb3+/NaGdF4 upconverting nanoparticles as the lifetime-based temperature indicators, we apply SPLIT in longitudinal wide-field temperature monitoring beneath a thin scattering medium. SPLIT also enables video-rate temperature mapping of a moving biological sample at single-cell resolution.
| S-EPMC8568918 | biostudies-literature
Project description:We present high-resolution, high-speed fluorescence lifetime imaging microscopy (FLIM) of live cells based on a compressed sensing scheme. By leveraging the compressibility of biological scenes in a specific domain, we simultaneously record the time-lapse fluorescence decay upon pulsed laser excitation within a large field of view. The resultant system, referred to as compressed FLIM, can acquire a widefield fluorescence lifetime image within a single camera exposure, eliminating the motion artifact and minimizing the photobleaching and phototoxicity. The imaging speed, limited only by the readout speed of the camera, is up to 100 Hz. We demonstrated the utility of compressed FLIM in imaging various transient dynamics at the microscopic scale.
| S-EPMC7826382 | biostudies-literature
Project description:Compressed fluorescence lifetime imaging (Compressed-FLIM) is a novel Snapshot compressive imaging (SCI) method for single-shot widefield FLIM. This approach has the advantages of high temporal resolution and deep frame sequences, allowing for the analysis of FLIM signals that follow complex decay models. However, the precision of Compressed-FLIM is limited by reconstruction algorithms. To improve the reconstruction accuracy of Compressed-FLIM in dealing with large-scale FLIM problem, we developed a more effective combined prior model 3DTGp V_net, based on the Plug and Play (PnP) framework. Extensive numerical simulations indicate the proposed method eliminates reconstruction artifacts caused by the Deep denoiser networks. Moreover, it improves the reconstructed accuracy by around 4dB (peak signal-to-noise ratio; PSNR) over the state-of-the-art TV+FFDNet in test data sets. We conducted the single-shot FLIM experiment with different Rhodamine reagents and the results show that in practice, the proposed algorithm has promising reconstruction performance and more negligible lifetime bias.
| S-EPMC9374265 | biostudies-literature
Project description:Optical imaging of tissue autofluorescence has the potential to provide rapid label-free screening and detection of surface tumors for clinical applications, including when combined with endoscopy. Quantitative imaging of intensity-based contrast is notoriously difficult and spectrally resolved imaging does not always provide sufficient contrast. We demonstrate that fluorescence lifetime imaging (FLIM) applied to intrinsic tissue autofluorescence can directly contrast a range of surface tissue tumors, including in gastrointestinal tissues, using compact, clinically deployable instrumentation achieving wide-field fluorescence lifetime images of unprecedented clarity. Statistically significant contrast is observed between cancerous and healthy colon tissue for FLIM with excitation at 355 nm. To illustrate the clinical potential, wide-field fluorescence lifetime images of unstained ex vivo tissue have been acquired at near video rate, which is an important step towards real-time FLIM for diagnostic and interoperative imaging, including for screening and image-guided biopsy applications.
| S-EPMC3017991 | biostudies-other
Project description:Spectrally resolved fluorescence lifetime imaging1-3 and spatial multiplexing1,4,5 have offered information content and collection-efficiency boosts in microscopy, but efficient implementations for macroscopic applications are still lacking. An imaging platform based on time-resolved structured light and hyperspectral single-pixel detection has been developed to perform quantitative macroscopic fluorescence lifetime imaging (MFLI) over a large field of view (FOV) and multiple spectral bands simultaneously. The system makes use of three digital micromirror device (DMD)-based spatial light modulators (SLMs) to generate spatial optical bases and reconstruct N by N images over 16 spectral channels with a time-resolved capability (~40 ps temporal resolution) using fewer than N2 optical measurements. We demonstrate the potential of this new imaging platform by quantitatively imaging near-infrared (NIR) Förster resonance energy transfer (FRET) both in vitro and in vivo. The technique is well suited for quantitative hyperspectral lifetime imaging with a high sensitivity and paves the way for many important biomedical applications.
| S-EPMC5726531 | biostudies-literature
Project description:Nanosecond temporal resolution enables new methods for wide-field imaging like time-of-flight, gated detection, and fluorescence lifetime. The optical efficiency of existing approaches, however, presents challenges for low-light applications common to fluorescence microscopy and single-molecule imaging. We demonstrate the use of Pockels cells for wide-field image gating with nanosecond temporal resolution and high photon collection efficiency. Two temporal frames are obtained by combining a Pockels cell with a pair of polarizing beam-splitters. We show multi-label fluorescence lifetime imaging microscopy (FLIM), single-molecule lifetime spectroscopy, and fast single-frame FLIM at the camera frame rate with 103-105 times higher throughput than single photon counting. Finally, we demonstrate a space-to-time image multiplexer using a re-imaging optical cavity with a tilted mirror to extend the Pockels cell technique to multiple temporal frames. These methods enable nanosecond imaging with standard optical systems and sensors, opening a new temporal dimension for wide-field low-light microscopy.
| S-EPMC6783475 | biostudies-other
Project description:We apply wide-field fluorescence microscopy to measure real-time attachment of photosynthetic proteins to plasmonically active silver nanowires. The observation of this effect is enabled, on the one hand, by sensitive detection of fluorescence and, on the other hand, by plasmonic enhancement of protein fluorescence. We examined two sample configurations with substrates being a bare glass coverslip and a coverslip functionalized with a monolayer of streptavidin. The different preparation of the substrate changes the observed behavior as far as attachment of the protein is concerned as well as its subsequent photobleaching. For the latter substrate the conjugation process is measurably slower. The described method can be universally applied in studying protein-nanostructure interactions for real-time fluorescence-based sensing.
| S-EPMC5796375 | biostudies-literature
Project description:Wide-field optical tomography based on structured light illumination and detection strategies enables efficient tomographic imaging of large tissues at very fast acquisition speeds. However, the optical inverse problem based on such instrumental approach is still ill-conditioned. Herein, we investigate the benefit of employing compressive sensing-based preconditioning to wide-field structured illumination and detection approaches. We assess the performances of Fluorescence Molecular Tomography (FMT) when using such preconditioning methods both in silico and with experimental data. Additionally, we demonstrate that such methodology could be used to select the subset of patterns that provides optimal reconstruction performances. Lastly, we compare preconditioning data collected using a normal base that offers good experimental SNR against that directly acquired with optimal designed base. An experimental phantom study is provided to validate the proposed technique.
| S-EPMC4679262 | biostudies-literature
Project description:Fluorescence Lifetime Imaging Microscopy in the time domain is typically performed by recording the arrival time of photons either by using electronic time tagging or a gated detector. As such the temporal resolution is limited by the performance of the electronics to 100's of picoseconds. Here, we demonstrate a fluorescence lifetime measurement technique based on photon-bunching statistics with a resolution that is only dependent on the duration of the reference photon or laser pulse, which can readily reach the 1-0.1 picosecond timescale. A range of fluorescent dyes having lifetimes spanning from 1.6 to 7 picoseconds have been here measured with only ~1 s measurement duration. We corroborate the effectiveness of the technique by measuring the Newtonian viscosity of glycerol/water mixtures by means of a molecular rotor having over an order of magnitude variability in lifetime, thus introducing a new method for contact-free nanorheology. Accessing fluorescence lifetime information at such high temporal resolution opens a doorway for a wide range of fluorescent markers to be adopted for studying yet unexplored fast biological processes, as well as fundamental interactions such as lifetime shortening in resonant plasmonic devices.
| S-EPMC10696080 | biostudies-literature
Project description:The AI community has been paying attention to submodular functions due to their various applications (e.g., target search and 3D mapping). Learning submodular functions is a challenge since the number of a function's outcomes of N sets is 2 N . The state-of-the-art approach is based on compressed sensing techniques, which are to learn submodular functions in the Fourier domain and then recover the submodular functions in the spatial domain. However, the number of Fourier bases is relevant to the number of sets' sensing overlapping. To overcome this issue, this research proposed a submodular deep compressed sensing (SDCS) approach to learning submodular functions. The algorithm consists of learning autoencoder networks and Fourier coefficients. The learned networks can be applied to predict 2 N values of submodular functions. Experiments conducted with this approach demonstrate that the algorithm is more efficient than the benchmark approach.
| S-EPMC7249116 | biostudies-literature