Dataset Information

A Machine Learning Method for Vision-Based Unmanned Aerial Vehicle Systems to Understand Unknown Environments.

ABSTRACT: What makes unmanned aerial vehicles (UAVs) intelligent is their capability of sensing and understanding new unknown environments. Some studies utilize computer vision algorithms like Visual Simultaneous Localization and Mapping (VSLAM) and Visual Odometry (VO) to sense the environment for pose estimation, obstacles avoidance and visual servoing. However, understanding the new environment (i.e., make the UAV recognize generic objects) is still an essential scientific problem that lacks a solution. Therefore, this paper takes a step to understand the items in an unknown environment. The aim of this research is to enable the UAV with basic understanding capability for a high-level UAV flock application in the future. Specially, firstly, the proposed understanding method combines machine learning and traditional algorithm to understand the unknown environment through RGB images; secondly, the You Only Look Once (YOLO) object detection system is integrated (based on TensorFlow) in a smartphone to perceive the position and category of 80 classes of objects in the images; thirdly, the method makes the UAV more intelligent and liberates the operator from labor; fourthly, detection accuracy and latency in working condition are quantitatively evaluated, and properties of generality (can be used in various platforms), transportability (easily deployed from one platform to another) and scalability (easily updated and maintained) for UAV flocks are qualitatively discussed. The experiments suggest that the method has enough accuracy to recognize various objects with high computational speed, and excellent properties of generality, transportability and scalability.

SUBMITTER: Zhang T

PROVIDER: S-EPMC7308845 | biostudies-literature | 2020 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Machine Learning Method for Vision-Based Unmanned Aerial Vehicle Systems to Understand Unknown Environments.

Zhang Tianyao T Hu Xiaoguang X Xiao Jin J Zhang Guofeng G

Sensors (Basel, Switzerland) 20200607 11

What makes unmanned aerial vehicles (UAVs) intelligent is their capability of sensing and understanding new unknown environments. Some studies utilize computer vision algorithms like Visual Simultaneous Localization and Mapping (VSLAM) and Visual Odometry (VO) to sense the environment for pose estimation, obstacles avoidance and visual servoing. However, understanding the new environment (i.e., make the UAV recognize generic objects) is still an essential scientific problem that lacks a solution ...[more]

PMID: 32517309

Similar Datasets

Project description:Agricultural subsurface drainage systems are commonly installed on farmland to remove the excess water from poorly drained soils. Conventional methods for drainage mapping such as tile probes and trenching equipment are laborious, cause pipe damage, and are often inefficient to apply at large spatial scales. Knowledge of locations of an existing drainage network is crucial to understand the increased leaching and offsite release of drainage discharge and to retrofit the new drain lines within the existing drainage system. Recent technological developments in non-destructive techniques might provide a potential alternative solution. The objective of this study was to determine the suitability of unmanned aerial vehicle (UAV) imagery collected using three different cameras (visible-color, multispectral, and thermal infrared) and ground penetrating radar (GPR) for subsurface drainage mapping. Both the techniques are complementary in terms of their usage, applicability, and the properties they measure and were applied at four different sites in the Midwest USA. At Site-1, both the UAV imagery and GPR were equally successful across the entire field, while at Site-2, the UAV imagery was successful in one section of the field, and GPR proved to be useful in the other section where the UAV imagery failed to capture the drainage pipes' location. At Site-3, less to no success was observed in finding the drain lines using UAV imagery captured on bare ground conditions, whereas good success was achieved using GPR. Conversely, at Site-4, the UAV imagery was successful and GPR failed to capture the drainage pipes' location. Although UAV imagery seems to be an attractive solution for mapping agricultural subsurface drainage systems as it is cost-effective and can cover large field areas, the results suggest the usefulness of GPR to complement the former as both a mapping and validation technique. Hence, this case study compares and contrasts the suitability of both the methods, provides guidance on the optimal survey timing, and recommends their combined usage given both the technologies are available to deploy for drainage mapping purposes.

Project description:BackgroundThe objective of this study is twofold. First, ascertain the important variables that predict tomato yields from plant height (PH) and vegetation index (VI) maps. The maps were derived from images taken by unmanned aerial vehicles (UAVs). Second, examine the accuracy of predictions of tomato fresh shoot masses (SM), fruit weights (FW), and the number of fruits (FN) from multiple machine learning algorithms using selected variable sets. To realize our objective, ultra-high-resolution RGB and multispectral images were collected by a UAV on ten days in 2020's tomato growing season. From these images, 756 total variables, including first- (e.g., average, standard deviation, skewness, range, and maximum) and second-order (e.g., gray-level co-occurrence matrix features and growth rates of PH and VIs) statistics for each plant, were extracted. Several selection algorithms (i.e., Boruta, DALEX, genetic algorithm, least absolute shrinkage and selection operator, and recursive feature elimination) were used to select the variable sets useful for predicting SM, FW, and FN. Random forests, ridge regressions, and support vector machines were used to predict the yield using the top five selected variable sets.ResultsFirst-order statistics of PH and VIs collected during the early to mid-fruit formation periods, about one month prior to harvest, were important variables for predicting SM. Similar to the case for SM, variables collected approximately one month prior to harvest were important for predicting FW and FN. Furthermore, variables related to PH were unimportant for prediction. Compared with predictions obtained using only first-order statistics, those obtained using the second-order statistics of VIs were more accurate for FW and FN. The prediction accuracy of SM, FW, and FN by models constructed from all variables (rRMSE = 8.8-28.1%) was better than that from first-order statistics (rRMSE = 10.0-50.1%).ConclusionsIn addition to basic statistics (e.g., average and standard deviation), we derived second-order statistics of PH and VIs at the plant level using the ultra-high resolution UAV images. Our findings indicated that our variable selection method reduced the number variables needed for tomato yield prediction, improving the efficiency of phenotypic data collection and assisting with the selection of high-yield lines within breeding programs.

Dataset Information

A Machine Learning Method for Vision-Based Unmanned Aerial Vehicle Systems to Understand Unknown Environments.

Publications

A Machine Learning Method for Vision-Based Unmanned Aerial Vehicle Systems to Understand Unknown Environments.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets