Scalable 3D Spatial Queries for Analytical Pathology Imaging with MapReduce.
Ontology highlight
ABSTRACT:
SUBMITTER: Liang Y
PROVIDER: S-EPMC5535306 | biostudies-other | 2016 Oct-Nov
REPOSITORIES: biostudies-other
Similar Datasets
Project description:MotivationPost-sequencing DNA analysis typically consists of read mapping followed by variant calling. Especially for whole genome sequencing, this computational step is very time-consuming, even when using multithreading on a multi-core machine.ResultsWe present Halvade, a framework that enables sequencing pipelines to be executed in parallel on a multi-node and/or multi-core compute infrastructure in a highly efficient manner. As an example, a DNA sequencing analysis pipeline for variant calling has been implemented according to the GATK Best Practices recommendations, supporting both whole genome and whole exome sequencing. Using a 15-node computer cluster with 360 CPU cores in total, Halvade processes the NA12878 dataset (human, 100 bp paired-end reads, 50× coverage) in <3 h with very high parallel efficiency. Even on a single, multi-core machine, Halvade attains a significant speedup compared with running the individual tools with multithreading.
| S-EPMC4514927 | biostudies-literature
Project description:Tissue organization arises from the coordinated molecular programs of cells. Spatial genomics maps cells and their molecular programs within the spatial context of tissues. However, current methods measure spatial information through imaging or direct registration, which often require specialized equipment and are limited in scale. Here, we developed an imaging-free spatial transcriptomics method that uses molecular diffusion patterns to computationally reconstruct spatial data. To do so, we utilize a simple experimental protocol on two dimensional barcode arrays to establish an interaction network between barcodes via molecular diffusion. Sequencing these interactions generates a high dimensional matrix of interactions between different spatial barcodes. Then, we perform dimensionality reduction to regenerate a two-dimensional manifold, which represents the spatial locations of the barcode arrays. Surprisingly, we found that the UMAP algorithm, with minimal modifications can faithfully successfully reconstruct the arrays. We demonstrated that this method is compatible with capture array based spatial transcriptomics/genomics methods, Slide-seq and Slide-tags, with high fidelity. We systematically explore the fidelity of the reconstruction through comparisons with experimentally derived ground truth data, and demonstrate that reconstruction generates high quality spatial genomics data. We also scaled this technique to reconstruct high-resolution spatial information over areas up to 1.2 centimeters. This computational reconstruction method effectively converts spatial genomics measurements to molecular biology, enabling spatial transcriptomics with high accessibility, and scalability.
| S-EPMC11326198 | biostudies-literature
Project description:BackgroundStaying up to date and answering clinical questions with current best evidence from health research is challenging. Evidence-based clinical texts, databases, and tools can help, but clinicians first need to translate their clinical questions into searchable queries. MacPLUS FS (McMaster Premium LiteratUre Service Federated Search) is an online search engine that allows clinicians to explore multiple resources simultaneously and retrieves one single output that includes the following: (1) evidence from summaries (eg, UpToDate and DynaMed), (2) preappraised research (eg, EvidenceAlerts), and (3) non-preappraised research (eg, PubMed), with and without validated bibliographic search filters. MacPLUS FS can also be used as a laboratory to explore clinical questions and evidence retrieval.ObjectiveOur primary objective was to examine how clinicians formulate their queries on a federated search engine, according to the population, intervention, comparison, and outcome (PICO) framework. Our secondary objective was to assess which resources were accessed by clinicians to answer their questions.MethodsWe performed an analytical survey among 908 clinicians who used MacPLUS FS in the context of a randomized controlled trial on search retrieval. Recording account log-ins and usage, we extracted all 1085 queries performed during a 6-month period and classified each search term according to the PICO framework. We further categorized queries into background (eg, "What is porphyria?") and foreground questions (eg, "Does treatment A work better than B?"). We then analyzed the type of resources that clinicians accessed.ResultsThere were 695 structured queries, after exclusion of meaningless queries and iterations of similar searches. We classified 56.5% (393/695) of these queries as background questions and 43.5% (302/695) as foreground questions, the majority of which were related to questions about therapy (213/695, 30.6%), followed by diagnosis (48/695, 6.9%), etiology (24/695, 3.5%), and prognosis (17/695, 2.5%). This distribution did not significantly differ between postgraduate residents and medical faculty physicians (P=.51). Queries included a median of 3 search terms (IQR 2-4), most often related to the population and intervention or test, rarely related to the outcome, and never related to the comparator. About half of the resources accessed (314/610, 51.5%) were summaries, 24.4% (149/610) were preappraised research, and 24.1% were (147/610) non-preappraised research.ConclusionsOur results, from a large sample of real-life queries, could guide the development of educational interventions to improve clinicians' retrieval skills, as well as inform the design of more useful evidence-based resources for clinical practice.Trial registrationClinicalTrials.gov NCT02038439; https://www.clinicaltrials.gov/ct2/show/NCT02038439.
| S-EPMC7199131 | biostudies-literature
Project description:Three-dimensional (3D) fluorescence imaging is important to accurately capture and understand biological structures and phenomena. However, because of its slow acquisition speed, it was difficult to implement 3D fluorescence imaging for imaging flow cytometry. Especially, modern flow cytometers operate at a flow velocity of 1-10 m/s, and no 3D fluorescence imaging technique was able to capture cells at such high velocity. Here, we present a high-speed 3D fluorescence imaging technique in which a set of optical cross sections of a cell is captured within a single frame of a camera by combining strobe light-sheet excitation and optofluidic spatial transformation. Using this technique, we demonstrated 3D fluorescence imaging of cells flowing at a velocity of over 10 m/s, which is the fastest to our knowledge. Such technology can allow integration of 3D imaging with flow systems of common flow cytometers and cell sorters.
| S-EPMC9208600 | biostudies-literature
Project description:Four-dimensional CT (4DCT) and cone beam CT (CBCT) are widely used in radiation therapy for accurate tumor target definition and localization. However, high-resolution and dynamic image reconstruction is computationally demanding because of the large amount of data processed. Efficient use of these imaging techniques in the clinic requires high-performance computing. The purpose of this work is to develop a novel ultrafast, scalable and reliable image reconstruction technique for 4D CBCT∕CT using a parallel computing framework called MapReduce. We show the utility of MapReduce for solving large-scale medical physics problems in a cloud computing environment.In this work, we accelerated the Feldcamp-Davis-Kress (FDK) algorithm by porting it to Hadoop, an open-source MapReduce implementation. Gated phases from a 4DCT scans were reconstructed independently. Following the MapReduce formalism, Map functions were used to filter and backproject subsets of projections, and Reduce function to aggregate those partial backprojection into the whole volume. MapReduce automatically parallelized the reconstruction process on a large cluster of computer nodes. As a validation, reconstruction of a digital phantom and an acquired CatPhan 600 phantom was performed on a commercial cloud computing environment using the proposed 4D CBCT∕CT reconstruction algorithm.Speedup of reconstruction time is found to be roughly linear with the number of nodes employed. For instance, greater than 10 times speedup was achieved using 200 nodes for all cases, compared to the same code executed on a single machine. Without modifying the code, faster reconstruction is readily achievable by allocating more nodes in the cloud computing environment. Root mean square error between the images obtained using MapReduce and a single-threaded reference implementation was on the order of 10(-7). Our study also proved that cloud computing with MapReduce is fault tolerant: the reconstruction completed successfully with identical results even when half of the nodes were manually terminated in the middle of the process.An ultrafast, reliable and scalable 4D CBCT∕CT reconstruction method was developed using the MapReduce framework. Unlike other parallel computing approaches, the parallelization and speedup required little modification of the original reconstruction code. MapReduce provides an efficient and fault tolerant means of solving large-scale computing problems in a cloud computing environment.
| S-EPMC3247927 | biostudies-other
Project description:The aim of this study was to compare the anatomical registration of preoperative magnetic resonance imaging (MRI) and prostate whole-mount obtained with 3D-printed, patient-specific, MRI-derived molds (PSM) versus conventional whole-mount sectioning (WMS).Based on an a priori power analysis, this institutional review board-approved study prospectively included 50 consecutive men who underwent 3 T multiparametric prostate MRI followed by radical prostatectomy. Two blinded and independent readers (R1 and R2) outlined the contours of the prostate, tumor, peripheral, and transition zones in the MRI scans using regions of interest. These were compared with the corresponding regions of interest from the whole-mounted histopathology, the reference standard, using PSM whole-mount results obtained in the study group (n = 25) or conventional WMS in the control group (n = 25). The spatial overlap across the MRI and histology data sets was calculated using the Dice similarity coefficient (DSC) for the prostate overall (DSCprostate), tumor (DSCtumor), peripheral (DSCPZ), and transition (DSCTZ) zone. Results in the study and control groups were compared using Wilcoxon rank sum test.The MRI histopathology anatomical registration for the prostate gland overall, tumor, peripheral, and transition zones were significantly superior with the use of PSMs (DSCs for R1: 0.95, 0.86, 0.84, and 0.89; for R2: 0.93, 0.75, 0.78, and 0.85, respectively) than with the use of standard WMS (R1: 0.85, 0.46, 0.66, and 0.69; R2: 0.85, 0.46, 0.66, and 0.69) (P < 0.0001).The use of PSMs for prostate specimen whole-mount sectioning provides significantly superior anatomical registration of in vivo multiparametric MRI and ex vivo prostate whole-mounts than conventional WMS.
| S-EPMC5544596 | biostudies-literature
Project description:In high-throughput spatial transcriptomics (ST) studies, it is of great interest to identify the genes whose level of expression in a tissue covaries with the spatial location of cells/spots. Such genes, also known as spatially variable genes (SVGs), can be crucial to the biological understanding of both structural and functional characteristics of complex tissues. Existing methods for detecting SVGs either suffer from huge computational demand or significantly lack statistical power. We propose a non-parametric method termed SMASH that achieves a balance between the above two problems. We compare SMASH with other existing methods in varying simulation scenarios demonstrating its superior statistical power and robustness. We apply the method to four ST datasets from different platforms revealing interesting biological insights.
| S-EPMC10055313 | biostudies-literature
Project description:Growth in open-source hardware designs combined with the low-cost of high performance optoelectronic and robotics components has supported a resurgence of in-house custom lab equipment development. We describe a low cost (below $700), open-source, fully customizable high-throughput imaging system for analytical microbiology applications. The system comprises a Raspberry Pi camera mounted on an aluminium extrusion frame with 3D-printed joints controlled by an Arduino microcontroller running open-source Repetier Host Firmware. The camera position is controlled by simple G-code scripts supplied from a Raspberry Pi singleboard computer and allow customized time-lapse imaging of microdevices over a large imaging area. Open-source OctoPrint software allows remote access and control. This simple yet effective design allows high-throughput microbiology testing in multiple formats including formats for bacterial motility, colony growth, microtitre plates and microfluidic devices termed 'lab-on-a-comb' to screen the effects of different culture media components and antibiotics on bacterial growth. The open-source robot design allows customization of the size of the imaging area; the current design has an imaging area of ~420 × 300mm, which allows 29 'lab-on-a-comb' devices to be imaged which is equivalent 3480 individual 1?l samples. The system can also be modified for fluorescence detection using LED and emission filters embedded on the PiCam for more sensitive detection of bacterial growth using fluorescent dyes.
| S-EPMC6863568 | biostudies-literature
Project description:Purpose: Here, we describe a method, Array-seq, to repurpose classical oligonucleotide microarrays for spatial transcriptomics profiling. We demonstrate that Array-seq yields spatial transcriptomes with high detection sensitivity and localization specificity using histological sections from mouse tissues as test systems. Moreover, we show that the large surface area of Array-seq slides enables the generation of spatial transcriptomes at high throughput by profiling multi-organ sections, in three dimensions by processing serial sections from one sample, and across whole human organs using spleen sections. Experimental Methods: To generate Array-seq slides, we first obtain microarrays carrying custom-design probes that contain common sequences flanking unique barcodes at known coordinates. Second, we perform a simple, two-step reaction that produces mRNA capture probes across all spots on the microarray and thereby creates Array-seq slides set for spatial transcriptomics. Following in-situ mRNA capture, reverse transcription, libaray preparation, Array-seq libraries are sequenced using the Illumina sequencing-by-synthesis (SBS) platform.
2024-11-14 | GSE266244 | GEO
Project description:Objective3D cine-magnetic resonance imaging (cine-MRI) can capture images of the human body volume with high spatial and temporal resolutions to study the anatomical dynamics. However, the reconstruction of 3D cine-MRI is challenged by highly undersampled k-space data in each dynamic (cine) frame, due to the slow speed of MR signal acquisition. We proposed a machine learning-based framework, spatial and temporal implicit neural representation learning (STINR-MR), for accurate 3D cine-MRI reconstruction from highly undersampled data.ApproachSTINR-MR used a joint reconstruction and deformable registration approach to achieve a high acceleration factor for cine volumetric imaging. It addressed the ill-posed spatiotemporal reconstruction problem by solving a reference-frame 3D MR image and a corresponding motion model which deforms the reference frame to each cine frame. The reference-frame 3D MR image was reconstructed as a spatial implicit neural representation (INR) network, which learns the mapping from input 3D spatial coordinates to corresponding MR values. The dynamic motion model was constructed via a temporal INR, as well as basis deformation vector fields (DVFs) extracted from prior/onboard 4D-MRIs using principal component analysis (PCA). The learned temporal INR encodes input time points and outputs corresponding weighting factors to combine the basis DVFs into time-resolved motion fields that represent cine-frame-specific dynamics. STINR-MR was evaluated using MR data simulated from the 4D extended cardiac-torso (XCAT) digital phantom, as well as MR data acquired clinically from a healthy human subject. Its reconstruction accuracy was also compared with that of the model-based non-rigid motion estimation method (MR-MOTUS).Main resultsSTINR-MR can reconstruct 3D cine-MR images with high temporal (<100 ms) and spatial (3 mm) resolutions. Compared with MR-MOTUS, STINR-MR consistently reconstructed images with better image quality and fewer artifacts and achieved superior tumor localization accuracy via the solved dynamic DVFs. For the XCAT study, STINR reconstructed the tumors to a mean±S.D. center-of-mass error of 1.0±0.4 mm, compared to 3.4±1.0 mm of the MR-MOTUS method. The high-frame-rate reconstruction capability of STINR-MR allows different irregular motion patterns to be accurately captured.SignificanceSTINR-MR provides a lightweight and efficient framework for accurate 3D cine-MRI reconstruction. It is a 'one-shot' method that does not require external data for pre-training, allowing it to avoid generalizability issues typically encountered in deep learning-based methods.
| S-EPMC10462175 | biostudies-literature