Dataset Information

Roof Shape Classification from LiDAR and Satellite Image Data Fusion Using Supervised Learning.

ABSTRACT: Geographic information systems (GIS) provide accurate maps of terrain, roads, waterways, and building footprints and heights. Aircraft, particularly small unmanned aircraft systems (UAS), can exploit this and additional information such as building roof structure to improve navigation accuracy and safely perform contingency landings particularly in urban regions. However, building roof structure is not fully provided in maps. This paper proposes a method to automatically label building roof shape from publicly available GIS data. Satellite imagery and airborne LiDAR data are processed and manually labeled to create a diverse annotated roof image dataset for small to large urban cities. Multiple convolutional neural network (CNN) architectures are trained and tested, with the best performing networks providing a condensed feature set for support vector machine and decision tree classifiers. Satellite image and LiDAR data fusion is shown to provide greater classification accuracy than using either data type alone. Model confidence thresholds are adjusted leading to significant increases in models precision. Networks trained from roof data in Witten, Germany and Manhattan (New York City) are evaluated on independent data from these cities and Ann Arbor, Michigan.

SUBMITTER: Castagno J

PROVIDER: S-EPMC6264004 | biostudies-literature | 2018 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Roof Shape Classification from LiDAR and Satellite Image Data Fusion Using Supervised Learning.

Castagno Jeremy J Atkins Ella E

Sensors (Basel, Switzerland) 20181115 11

Geographic information systems (GIS) provide accurate maps of terrain, roads, waterways, and building footprints and heights. Aircraft, particularly small unmanned aircraft systems (UAS), can exploit this and additional information such as <i>building roof structure</i> to improve navigation accuracy and safely perform contingency landings particularly in urban regions. However, building roof structure is not fully provided in maps. This paper proposes a method to automatically label building ro ...[more]

PMID: 30445731

Similar Datasets

Project description:Airborne remote sensing offers unprecedented opportunities to efficiently monitor vegetation, but methods to delineate and classify individual plant species using the collected data are still actively being developed and improved. The Integrating Data science with Trees and Remote Sensing (IDTReeS) plant identification competition openly invited scientists to create and compare individual tree mapping methods. Participants were tasked with training taxon identification algorithms based on two sites, to then transfer their methods to a third unseen site, using field-based plant observations in combination with airborne remote sensing image data products from the National Ecological Observatory Network (NEON). These data were captured by a high resolution digital camera sensitive to red, green, blue (RGB) light, hyperspectral imaging spectrometer spanning the visible to shortwave infrared wavelengths, and lidar systems to capture the spectral and structural properties of vegetation. As participants in the IDTReeS competition, we developed a two-stage deep learning approach to integrate NEON remote sensing data from all three sensors and classify individual plant species and genera. The first stage was a convolutional neural network that generates taxon probabilities from RGB images, and the second stage was a fusion neural network that "learns" how to combine these probabilities with hyperspectral and lidar data. Our two-stage approach leverages the ability of neural networks to flexibly and automatically extract descriptive features from complex image data with high dimensionality. Our method achieved an overall classification accuracy of 0.51 based on the training set, and 0.32 based on the test set which contained data from an unseen site with unknown taxa classes. Although transferability of classification algorithms to unseen sites with unknown species and genus classes proved to be a challenging task, developing methods with openly available NEON data that will be collected in a standardized format for 30 years allows for continual improvements and major gains for members of the computational ecology community. We outline promising directions related to data preparation and processing techniques for further investigation, and provide our code to contribute to open reproducible science efforts.

Project description:Urban areas feature complex and heterogeneous land covers which create challenging issues for tree species classification. The increased availability of high spatial resolution multispectral satellite imagery and LiDAR datasets combined with the recent evolution of deep learning within remote sensing for object detection and scene classification, provide promising opportunities to map individual tree species with greater accuracy and resolution. However, there are knowledge gaps that are related to the contribution of Worldview-3 SWIR bands, very high resolution PAN band and LiDAR data in detailed tree species mapping. Additionally, contemporary deep learning methods are hampered by lack of training samples and difficulties of preparing training data. The objective of this study was to examine the potential of a novel deep learning method, Dense Convolutional Network (DenseNet), to identify dominant individual tree species in a complex urban environment within a fused image of WorldView-2 VNIR, Worldview-3 SWIR and LiDAR datasets. DenseNet results were compared against two popular machine classifiers in remote sensing image analysis, Random Forest (RF) and Support Vector Machine (SVM). Our results demonstrated that: (1) utilizing a data fusion approach beginning with VNIR and adding SWIR, LiDAR, and panchromatic (PAN) bands increased the overall accuracy of the DenseNet classifier from 75.9% to 76.8%, 81.1% and 82.6%, respectively. (2) DenseNet significantly outperformed RF and SVM for the classification of eight dominant tree species with an overall accuracy of 82.6%, compared to 51.8% and 52% for SVM and RF classifiers, respectively. (3) DenseNet maintained superior performance over RF and SVM classifiers under restricted training sample quantities which is a major limiting factor for deep learning techniques. Overall, the study reveals that DenseNet is more effective for urban tree species classification as it outperforms the popular RF and SVM techniques when working with highly complex image scenes regardless of training sample size.

Project description:BackgroundDuring atherosclerosis, the narrowing of the arterial lumen is observed through the accumulation of bio compounds and the formation of plaque within artery walls. A non-linear optical imaging modality (NLOM), coherent anti-stokes Raman scattering (CARS) microscopy, can be used to image lipid-rich structures commonly found in atherosclerotic plaques. By matching the lipid's molecular vibrational frequencies (CH bonds), it is possible to map the accumulation of lipid-rich structures without the need for exogenous labelling and/or processing of the samples. CARS allows for the visualization of the morphological features of plaque. In combination with supervised machine learning, CARS imaged morphological features can be used to characterize the progression of atherosclerotic plaques. RESULTS: Based on a set of label-free CARS images of atherosclerotic plaques (i.e. foam cell clusters) from a Watanabe heritable hyperlipidemic rabbit model, we developed an automated pipeline to classify atherosclerotic lesions based on their major morphological features. Our method uses image preprocessing to first improve the quality of the CARS-imaged plaque, followed by the segmentation of the plaque using Otsu thresholding, marker-controlled watershed, K-means segmentation and a novel independent foam cell thresholding segmentation. To define relevant morphological features, 27 quantitative features were extracted and further refined by a novel coefficient of variation feature refinement method in accordance with filter-type feature selection. Refined morphological features were supplied into three supervised machine learning algorithms; K-nearest neighbour, support vector machine and decision tree classifier. The classification pipeline showcased the ability to exploit relevant plaque morphological features to accurately classify 3 pre-defined stages of atherosclerosis: early fatty streak development (EFS) and advancing atheroma (AA) with a greater than 85% class accuracy CONCLUSIONS: Through the combination of CARS microscopy and computational methods, a powerful classification tool was developed to identify the progression of atherosclerotic plaque in an automated manner. Using a curated dataset, the classification pipeline demonstrated the ability to differentiate between EFS, EF and AA. Thus, presenting the opportunity to classify the onset of atherosclerosis at an earlier stage of development.

Dataset Information

Roof Shape Classification from LiDAR and Satellite Image Data Fusion Using Supervised Learning.

Publications

Roof Shape Classification from LiDAR and Satellite Image Data Fusion Using Supervised Learning.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets