Dataset Information

The effect of multispectral image fusion enhancement on human efficiency.

ABSTRACT: The visual system can be highly influenced by changes to visual presentation. Thus, numerous techniques have been developed to augment imagery in an attempt to improve human perception. The current paper examines the potential impact of one such enhancement, multispectral image fusion, where imagery captured in varying spectral bands (e.g., visible, thermal, night vision) is algorithmically combined to produce an output to strengthen visual perception. We employ ideal observer analysis over a series of experimental conditions to (1) establish a framework for testing the impact of image fusion over the varying aspects surrounding its implementation (e.g., stimulus content, task) and (2) examine the effectiveness of fusion on human information processing efficiency in a basic application. We used a set of rotated Landolt C images captured with a number of individual sensor cameras and combined across seven traditional fusion algorithms (e.g., Laplacian pyramid, principal component analysis, averaging) in a 1-of-8 orientation task. We found that, contrary to the idea of fused imagery always producing a greater impact on perception, single-band imagery can be just as influential. Additionally, efficiency data were shown to fluctuate based on sensor combination instead of fusion algorithm, suggesting the need for examining multiple factors to determine the success of image fusion. Our use of ideal observer analysis, a popular technique from the vision sciences, provides not only a standard for testing fusion in direct relation to the visual system but also allows for comparable examination of fusion across its associated problem space of application.

SUBMITTER: Bittner JL

PROVIDER: S-EPMC5357665 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundQuantification of myocardium scarring in late gadolinium enhanced (LGE) cardiac magnetic resonance imaging can be challenging due to low scar-to-background contrast and low image quality. To resolve ambiguous LGE regions, experienced readers often use conventional cine sequences to accurately identify the myocardium borders.PurposeTo develop a deep learning model for combining LGE and cine images to improve the robustness and accuracy of LGE scar quantification.Study typeRetrospective.PopulationA total of 191 hypertrophic cardiomyopathy patients: 1) 162 patients from two sites randomly split into training (50%; 81 patients), validation (25%, 40 patients), and testing (25%; 41 patients); and 2) an external testing dataset (29 patients) from a third site.Field strength/sequence1.5T, inversion-recovery segmented gradient-echo LGE and balanced steady-state free-precession cine sequences ASSESSMENT: Two convolutional neural networks (CNN) were trained for myocardium and scar segmentation, one with and one without LGE-Cine fusion. For CNN with fusion, the input was two aligned LGE and cine images at matched cardiac phase and anatomical location. For CNN without fusion, only LGE images were used as input. Manual segmentation of the datasets was used as reference standard.Statistical testsManual and CNN-based quantifications of LGE scar burden and of myocardial volume were assessed using Pearson linear correlation coefficients (r) and Bland-Altman analysis.ResultsBoth CNN models showed strong agreement with manual quantification of LGE scar burden and myocardium volume. CNN with LGE-Cine fusion was more robust than CNN without LGE-Cine fusion, allowing for successful segmentation of significantly more slices (603 [95%] vs. 562 (89%) of 635 slices; P < 0.001). Also, CNN with LGE-Cine fusion showed better agreement with manual quantification of LGE scar burden than CNN without LGE-Cine fusion (%ScarLGE-cine = 0.82 × %Scarmanual , r = 0.84 vs. %ScarLGE = 0.47 × %Scarmanual , r = 0.81) and myocardium volume (VolumeLGE-cine = 1.03 × Volumemanual , r = 0.96 vs. VolumeLGE = 0.91 × Volumemanual , r = 0.91).Data conclusionCNN based LGE-Cine fusion can improve the robustness and accuracy of automated scar quantification.Level of evidence3 TECHNICAL EFFICACY: 1.

Dataset Information

The effect of multispectral image fusion enhancement on human efficiency.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets