Multiple illumination learned spectral decoloring for quantitative optoacoustic oximetry imaging.
Ontology highlight
ABSTRACT: Significance
Quantitative measurement of blood oxygen saturation (sO2) with optoacoustic (OA) imaging is one of the most sought after goals of quantitative OA imaging research due to its wide range of biomedical applications.Aim
A method for accurate and applicable real-time quantification of local sO2 with OA imaging.Approach
We combine multiple illumination (MI) sensing with learned spectral decoloring (LSD). We train LSD feedforward neural networks and random forests on Monte Carlo simulations of spectrally colored absorbed energy spectra, to apply the trained models to real OA measurements. We validate our combined MI-LSD method on a highly reliable, reproducible, and easily scalable phantom model, based on copper and nickel sulfate solutions.Results
With this sulfate model, we see a consistently high estimation accuracy using MI-LSD, with median absolute estimation errors of 2.5 to 4.5 percentage points. We further find fewer outliers in MI-LSD estimates compared with LSD. Random forest regressors outperform previously reported neural network approaches.Conclusions
Random forest-based MI-LSD is a promising method for accurate quantitative OA oximetry imaging.
SUBMITTER: Kirchner T
PROVIDER: S-EPMC8336722 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Optoacoustic (OA) imaging is a promising modality for quantifying blood oxygen saturation (sO2) in various biomedical applications - in diagnosis, monitoring of organ function, or even tumor treatment planning. We present an accurate and practically feasible real-time capable method for quantitative imaging of sO2 based on combining multispectral (MS) and multiple illumination (MI) OA imaging with learned spectral decoloring (LSD). For this purpose we developed a hybrid real-time MI MS OA imaging setup with ultrasound (US) imaging capability; we trained gradient boosting machines on MI spectrally colored absorbed energy spectra generated by generic Monte Carlo simulations and used the trained models to estimate sO2 on real OA measurements. We validated MI-LSD in silico and on in vivo image sequences of radial arteries and accompanying veins of five healthy human volunteers. We compared the performance of the method to prior LSD work and conventional linear unmixing. MI-LSD provided highly accurate results in silico and consistently plausible results in vivo. This preliminary study shows a potentially high applicability of quantitative OA oximetry imaging, using our method.
| S-EPMC9203099 | biostudies-literature
Project description:The ability of photoacoustic imaging to measure functional tissue properties, such as blood oxygenation sO[Formula: see text], enables a wide variety of possible applications. sO[Formula: see text] can be computed from the ratio of oxyhemoglobin HbO[Formula: see text] and deoxyhemoglobin Hb, which can be distuinguished by multispectral photoacoustic imaging due to their distinct wavelength-dependent absorption. However, current methods for estimating sO[Formula: see text] yield inaccurate results in realistic settings, due to the unknown and wavelength-dependent influence of the light fluence on the signal. In this work, we propose learned spectral decoloring to enable blood oxygenation measurements to be inferred from multispectral photoacoustic imaging. The method computes sO[Formula: see text] pixel-wise, directly from initial pressure spectra [Formula: see text], which represent initial pressure values at a fixed spatial location [Formula: see text] over all recorded wavelengths [Formula: see text]. The method is compared to linear unmixing approaches, as well as pO[Formula: see text] and blood gas analysis reference measurements. Experimental results suggest that the proposed method is able to obtain sO[Formula: see text] estimates from multispectral photoacoustic measurements in silico, in vitro, and in vivo.
| S-EPMC7985523 | biostudies-literature
Project description:Optoacoustic (OA) imaging has the capacity to effectively bridge the gap between macroscopic and microscopic realms in biological imaging. High-resolution OA microscopy has so far been performed via point-by-point scanning with a focused laser beam, thus greatly restricting the achievable imaging speed and/or field of view. Herein we introduce multifocal structured illumination OA microscopy (MSIOAM) that attains real-time 3D imaging speeds. For this purpose, the excitation laser beam is shaped to a grid of focused spots at the tissue surface by means of a beamsplitting diffraction grating and a condenser and is then scanned with an acousto-optic deflector operating at kHz rates. In both phantom and in vivo mouse experiments, a 10 mm wide volumetric field of view was imaged with 15 Hz frame rate at 28 μm spatial resolution. The proposed method is expected to greatly aid in biological investigations of dynamic functional, kinetic, and metabolic processes across multiple scales.
| S-EPMC7459102 | biostudies-literature
Project description:Label free imaging of oxygenation distribution in tissues is highly desired in numerous biomedical applications, but is still elusive, in particular in sub-epidermal measurements. Eigenspectra multispectral optoacoustic tomography (eMSOT) and its Bayesian-based implementation have been introduced to offer accurate label-free blood oxygen saturation (sO2) maps in tissues. The method uses the eigenspectra model of light fluence in tissue to account for the spectral changes due to the wavelength dependent attenuation of light with tissue depth. eMSOT relies on the solution of an inverse problem bounded by a number of ad hoc hand-engineered constraints. Despite the quantitative advantage offered by eMSOT, both the non-convex nature of the optimization problem and the possible sub-optimality of the constraints may lead to reduced accuracy. We present herein a neural network architecture that is able to learn how to solve the inverse problem of eMSOT by directly regressing from a set of input spectra to the desired fluence values. The architecture is composed of a combination of recurrent and convolutional layers and uses both spectral and spatial features for inference. We train an ensemble of such networks using solely simulated data and demonstrate how this approach can improve the accuracy of sO2 computation over the original eMSOT, not only in simulations but also in experimental datasets obtained from blood phantoms and small animals (mice) in vivo. The use of a deep-learning approach in optoacoustic sO2 imaging is confirmed herein for the first time on ground truth sO2 values experimentally obtained in vivo and ex vivo.
| S-EPMC7671861 | biostudies-literature
Project description:Measurement of blood oxygen saturation (sO2) by optical imaging oximetry provides invaluable insight into local tissue functions and metabolism. Despite different embodiments and modalities, all label-free optical-imaging oximetry techniques utilize the same principle of sO2-dependent spectral contrast from haemoglobin. Traditional approaches for quantifying sO2 often rely on analytical models that are fitted by the spectral measurements. These approaches in practice suffer from uncertainties due to biological variability, tissue geometry, light scattering, systemic spectral bias, and variations in the experimental conditions. Here, we propose a new data-driven approach, termed deep spectral learning (DSL), to achieve oximetry that is highly robust to experimental variations and, more importantly, able to provide uncertainty quantification for each sO2 prediction. To demonstrate the robustness and generalizability of DSL, we analyse data from two visible light optical coherence tomography (vis-OCT) setups across two separate in vivo experiments on rat retinas. Predictions made by DSL are highly adaptive to experimental variabilities as well as the depth-dependent backscattering spectra. Two neural-network-based models are tested and compared with the traditional least-squares fitting (LSF) method. The DSL-predicted sO2 shows significantly lower mean-square errors than those of the LSF. For the first time, we have demonstrated en face maps of retinal oximetry along with a pixel-wise confidence assessment. Our DSL overcomes several limitations of traditional approaches and provides a more flexible, robust, and reliable deep learning approach for in vivo non-invasive label-free optical oximetry.
| S-EPMC6864044 | biostudies-literature
Project description:Multiphoton microscopy is a powerful technique for deep in vivo imaging in scattering samples. However, it requires precise, sample-dependent increases in excitation power with depth in order to generate contrast in scattering tissue, while minimizing photobleaching and phototoxicity. We show here how adaptive imaging can optimize illumination power at each point in a 3D volume as a function of the sample's shape, without the need for specialized fluorescent labeling. Our method relies on training a physics-based machine learning model using cells with identical fluorescent labels imaged in situ. We use this technique for in vivo imaging of immune responses in mouse lymph nodes following vaccination. We achieve visualization of physiologically realistic numbers of antigen-specific T cells (~2 orders of magnitude lower than previous studies), and demonstrate changes in the global organization and motility of dendritic cell networks during the early stages of the immune response. We provide a step-by-step tutorial for implementing this technique using exclusively open-source hardware and software.
| S-EPMC7997974 | biostudies-literature
Project description:There has been an increasing push to derive quantitative measurements using optical microscopes. While several aspects of microscopy have been identified to enhance quantitative imaging, non-uniform angular illumination asymmetry (ANILAS) across the field-of-view is an important factor that has been largely overlooked. Non-uniform ANILAS results in loss of imaging precision and can lead to, for example, less reliability in medical diagnoses. We use ANILAS maps to demonstrate that objective lens design, illumination wavelength and location of the aperture diaphragm are significant factors that contribute to illumination aberrations. To extract the best performance from an optical microscope, the combination of all these factors must be optimized for each objective lens. This requires the capability to optimally align the aperture diaphragm in the axial direction. Such optimization enhances the quantitative imaging accuracy of optical microscopes and can benefit applications in important areas such as biotechnology, optical metrology, and nanotechnology.
| S-EPMC5859171 | biostudies-literature
Project description:Most imaging studies of immunotherapy have focused on tracking labeled T cell biodistribution in vivo for understanding trafficking and homing parameters and predicting therapeutic efficacy by the presence of transferred T cells at or in the tumour mass. Conversely, we investigate here a novel concept for longitudinally elucidating anatomical and pathophysiological changes of solid tumours after adoptive T cell transfer in a preclinical set up, using previously unexplored in-tandem macroscopic and mesoscopic optoacoustic (photoacoustic) imaging. We show non-invasive in vivo observations of vessel collapse during tumour rejection across entire tumours and observe for the first time longitudinal tumour rejection in a label-free manner based on optical absorption changes in the tumour mass due to cellular decline. We complement these observations with high resolution episcopic fluorescence imaging of T cell biodistribution using optimized T cell labeling based on two near-infrared dyes targeting the cell membrane and the cytoplasm. We discuss how optoacoustic macroscopy and mesoscopy offer unique contrast and immunotherapy insights, allowing label-free and longitudinal observations of tumour therapy. The results demonstrate optoacoustic imaging as an invaluable tool in understanding and optimizing T cell therapy.
| S-EPMC7078227 | biostudies-literature
Project description:SignificanceQuantitative oblique back-illumination microscopy (qOBM) is a recently developed label-free imaging technique that enables 3D quantitative phase imaging of thick scattering samples with epi-illumination. Here, we propose dynamic qOBM to achieve functional imaging based on subcellular dynamics, potentially indicative of metabolic activity. We show the potential utility of this novel technique by imaging adherent mesenchymal stromal cells (MSCs) grown in bioreactors, which can help address important unmet needs in cell manufacturing for therapeutics.AimWe aim to develop dynamic qOBM and demonstrate its potential for functional imaging based on cellular and subcellular dynamics.ApproachTo obtain functional images with dynamic qOBM, a sample is imaged over a period of time and its temporal signals are analyzed. The dynamic signals display an exponential frequency response that can be analyzed with phasor analysis. Functional images of the dynamic signatures are obtained by mapping the frequency dynamic response to phasor space and color-coding clustered signals.ResultsFunctional imaging with dynamic qOBM provides unique information related to subcellular activity. The functional qOBM images of MSCs not only improve conspicuity of cells in complex environments (e.g., porous micro-carriers) but also reveal two distinct cell populations with different dynamic behavior.ConclusionsIn this work we present a label-free, fast, and scalable functional imaging approach to study and intuitively display cellular and subcellular dynamics. We further show the potential utility of this novel technique to help monitor adherent MSCs grown in bioreactors, which can help achieve quality-by-design of cell products, a significant unmet need in the field of cell therapeutics. This approach also has great potential for dynamic studies of other thick samples, such as organoids.
| S-EPMC9243522 | biostudies-literature
Project description:Light propagating in tissue attains a spectrum that varies with location due to wavelength-dependent fluence attenuation, an effect that causes spectral corruption. Spectral corruption has limited the quantification accuracy of optical and optoacoustic spectroscopic methods, and impeded the goal of imaging blood oxygen saturation (sO2) deep in tissues; a critical goal for the assessment of oxygenation in physiological processes and disease. Here we describe light fluence in the spectral domain and introduce eigenspectra multispectral optoacoustic tomography (eMSOT) to account for wavelength-dependent light attenuation, and estimate blood sO2 within deep tissue. We validate eMSOT in simulations, phantoms and animal measurements and spatially resolve sO2 in muscle and tumours, validating our measurements with histology data. eMSOT shows substantial sO2 accuracy enhancement over previous optoacoustic methods, potentially serving as a valuable tool for imaging tissue pathophysiology.
| S-EPMC4931322 | biostudies-literature