Dataset Information

Anatomic and Molecular MR Image Synthesis Using Confidence Guided CNNs.

ABSTRACT: Data-driven automatic approaches have demonstrated their great potential in resolving various clinical diagnostic dilemmas in neuro-oncology, especially with the help of standard anatomic and advanced molecular MR images. However, data quantity and quality remain a key determinant, and a significant limit of the potential applications. In our previous work, we explored the synthesis of anatomic and molecular MR image networks (SAMR) in patients with post-treatment malignant gliomas. In this work, we extend this through a confidence-guided SAMR (CG-SAMR) that synthesizes data from lesion contour information to multi-modal MR images, including T1-weighted ( [Formula: see text]), gadolinium enhanced [Formula: see text] (Gd- [Formula: see text]), T2-weighted ( [Formula: see text]), and fluid-attenuated inversion recovery ( FLAIR ), as well as the molecular amide proton transfer-weighted ( [Formula: see text]) sequence. We introduce a module that guides the synthesis based on a confidence measure of the intermediate results. Furthermore, we extend the proposed architecture to allow training using unpaired data. Extensive experiments on real clinical data demonstrate that the proposed model can perform better than current the state-of-the-art synthesis methods. Our code is available at https://github.com/guopengf/CG-SAMR.

SUBMITTER: Guo P

PROVIDER: S-EPMC8543492 | biostudies-literature | 2021 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Anatomic and Molecular MR Image Synthesis Using Confidence Guided CNNs.

Guo Pengfei P Wang Puyang P Yasarla Rajeev R Zhou Jinyuan J Patel Vishal M VM Jiang Shanshan S

IEEE transactions on medical imaging 20210930 10

Data-driven automatic approaches have demonstrated their great potential in resolving various clinical diagnostic dilemmas in neuro-oncology, especially with the help of standard anatomic and advanced molecular MR images. However, data quantity and quality remain a key determinant, and a significant limit of the potential applications. In our previous work, we explored the synthesis of anatomic and molecular MR image networks (SAMR) in patients with post-treatment malignant gliomas. In this work ...[more]

PMID: 33351754

Similar Datasets

Project description:BackgroundMagnetic resonance imaging (MRI) is currently used for online target monitoring and plan adaptation in modern image-guided radiotherapy. However, storing a large amount of data accumulated during patient treatment becomes an issue. In this study, the feasibility to compress MRI images accumulated in MR-guided radiotherapy using video encoders was investigated.MethodsTwo sorting algorithms were employed to reorder the slices in multiple MRI sets for the input sequence of video encoder. Three cropping algorithms were used to auto-segment regions of interest for separate data storage. Four video encoders, motion-JPEG (M-JPEG), MPEG-4 (MP4), Advanced Video Coding (AVC or H.264) and High Efficiency Video Coding (HEVC or H.265) were investigated. The compression performance of video encoders was evaluated by compression ratio and time, while the restoration accuracy of video encoders was evaluated by mean square error (MSE), peak signal-to-noise ratio (PSNR), and video quality matrix (VQM). The performances of all combinations of video encoders, sorting methods, and cropping algorithms were investigated and their effects were statistically analyzed.ResultsThe compression ratios of MP4, H.264 and H.265 with both sorting methods were improved by 26% and 5%, 42% and 27%, 72% and 43%, respectively, comparing to those of M-JPEG. The slice-prioritized sorting method showed a higher compression ratio than that of the location-prioritized sorting method for MP4 (P=0.00000), H.264 (P=0.00012) and H.265 (P=0.00000), respectively. The compression ratios of H.265 were improved significantly with the applications of morphology algorithm (P=0.01890 and P=0.00530), flood-fill algorithm (P=0.00510 and P=0.00020) and level-set algorithm (P=0.02800 and P=0.00830) for both sorting methods. Among the four video encoders, H.265 showed the best compression ratio and restoration accuracy.ConclusionsThe compression ratio and restoration accuracy of video encoders using inter-frame coding (MP4, H.264 and H.265) were higher than that of video encoders using intra-frame coding (M-JPEG). It is feasible to implement video encoders using inter-frame coding for high-performance MRI data storage in MR-guided radiotherapy.

Project description:The purpose of this study was to propose and evaluate a method of creating a synthetic CT (S-CT) from MRI simulation for dose calculation and daily CBCT localization. A pair of MR and CT images was obtained in the same day from each of 10 prostate patients. The pair of MR and CT images was preregistered using the deformable image registration (DIR). Using the corresponding displacement vector field (atlas-DVF), the CT image was deformed to the MR image to create an atlas MR-CT pair. Regions of interest (ROI) on the atlas MR-CT pair were delineated and used to create atlas-ROI masks. 'Leave-one-out' test (one pair of MR and CT was used as subject-MR and subject-CT for evaluation, and the remaining 9 pairs were in the atlas library) was performed. For a subject-MR, autosegmentation and DVFs were generated using DIR between the subject-MR and the 9 atlas-MRs. An S-CT was then generated using the corresponding 9 paired atlas-CTs, the 9 atlas-DVFs and the corresponding atlas-ROI masks. The total 10 S-CTs were evaluated using the Hounsfield unit (HU), the calculated dose distribution, and the auto bony registration to daily CBCT images with respect to the 10 subject-CTs. HU differences (mean ± STD) were (2.4 ± 25.23), (1.18 ± 39.49), (32.46 ± 81.9), (0.23 ± 40.13), and (3.74 ± 144.76) for prostate, bladder, rectal wall, soft tissue outside all ROIs, and bone, respectively. The discrepancy of dose-volume param-eters calculated using the S-CT for treatment planning was small (≤ 0.22% with 95% confidence). Gamma pass rate (2% & 2 mm) was higher than 99.86% inside PTV and 98.45% inside normal structures. Using the 10 S-CTs as the reference CT for daily CBCT localization achieved the similar results compared to using the subject-CT. The translational vector differences were within 1.08 mm (0.37 ± 0.23 mm), and the rotational differences were within 1.1° in all three directions. S-CT created from a simulation MR image using the proposed approach with the preconstructed atlas library can replace the planning CT for dose calculation and daily CBCT image guidance.

Project description:Multi-modality image-guided radiotherapy is the standard of care in contemporary cancer management; however, it is not common in preclinical settings due to both hardware and software limitations. Soft tissue lesions, such as orthotopic prostate tumors, are difficult to identify using cone beam computed tomography (CBCT) imaging alone. In this study, we characterized a research magnetic resonance (MR) scanner for preclinical studies and created a protocol for combined MR-CBCT image-guided small animal radiotherapy. Two in-house dual-modality, MR and CBCT compatible, phantoms were designed and manufactured using 3D printing technology. The phantoms were used for quality assurance tests and to facilitate end-to-end testing for combined preclinical MR and CBCT based treatment planning. MR and CBCT images of the phantoms were acquired utilizing a Varian 4.7 T scanner and XRad-225Cx irradiator, respectively. The geometry distortion was assessed by comparing MR images to phantom blueprints and CBCT. The corrected MR scans were co-registered with CBCT and subsequently used for treatment planning. The fidelity of 3D printed phantoms compared to the blueprint design yielded favorable agreement as verified with the CBCT measurements. The geometric distortion, which varied between -5% and 11% throughout the scanning volume, was substantially reduced to within 0.4% after correction. The distortion free MR images were co-registered with the corresponding CBCT images and imported into a commercial treatment planning software SmART Plan. The planning target volume (PTV) was on average 19% smaller when contoured on the corrected MR-CBCT images relative to raw images without distortion correction. An MR-CBCT based preclinical workflow was successfully designed and implemented for small animal radiotherapy. Combined MR-CBCT image-guided radiotherapy for preclinical research potentially delivers enhanced relevance to human radiotherapy for various disease sites. This novel protocol is wide-ranging and not limited to the orthotopic prostate tumor study presented in the study.

Dataset Information

Anatomic and Molecular MR Image Synthesis Using Confidence Guided CNNs.

Publications

Anatomic and Molecular MR Image Synthesis Using Confidence Guided CNNs.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets