Dataset Information

An FPGA-Based Ultra-High-Speed Object Detection Algorithm with Multi-Frame Information Fusion.

ABSTRACT: An ultra-high-speed algorithm based on Histogram of Oriented Gradient (HOG) and Support Vector Machine (SVM) for hardware implementation at 10,000 frames per second (FPS) under complex backgrounds is proposed for object detection. The algorithm is implemented on the field-programmable gate array (FPGA) in the high-speed-vision platform, in which 64 pixels are input per clock cycle. The high pixel parallelism of the vision platform limits its performance, as it is difficult to reduce the strides between detection windows below 16 pixels, thus introduce non-negligible deviation of object detection. In addition, limited by the transmission bandwidth, only one frame in every four frames can be transmitted to PC for post-processing, that is, 75% image information is wasted. To overcome the mentioned problem, a multi-frame information fusion model is proposed in this paper. Image data and synchronization signals are first regenerated according to image frame numbers. The maximum HOG feature value and corresponding coordinates of each frame are stored in the bottom of the image with that of adjacent frames'. The compensated ones will be obtained through information fusion with the confidence of continuous frames. Several experiments are conducted to demonstrate the performance of the proposed algorithm. As the evaluation result shows, the deviation is reduced with our proposed method compared with the existing one.

SUBMITTER: Long X

PROVIDER: S-EPMC6749355 | biostudies-literature | 2019 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

An FPGA-Based Ultra-High-Speed Object Detection Algorithm with Multi-Frame Information Fusion.

Long Xianlei X Hu Shenhua S Hu Yiming Y Gu Qingyi Q Ishii Idaku I

Sensors (Basel, Switzerland) 20190826 17

An ultra-high-speed algorithm based on Histogram of Oriented Gradient (HOG) and Support Vector Machine (SVM) for hardware implementation at 10,000 frames per second (FPS) under complex backgrounds is proposed for object detection. The algorithm is implemented on the field-programmable gate array (FPGA) in the high-speed-vision platform, in which 64 pixels are input per clock cycle. The high pixel parallelism of the vision platform limits its performance, as it is difficult to reduce the strides ...[more]

PMID: 31455020

Similar Datasets

Project description:OBJECTIVE:To reduce the danger for firefighters and ensure the safety of firefighters as much as possible, based on the back propagation neural network (BPNN) the fire sensor multi-sensor information fusion detection system is investigated. METHOD:According to previous studies, the information sources and information processing methods for the design of this study are first explained. Then, the basic structure and flowchart of the research object in this study are designed. Based on the structure diagram and flowchart, the BPNN is selected to fuse the feature layers in this study, and the fuzzy control is selected to fuse the decision layers in this study. The multi-sensor information fusion detection system collects information for the sensors first, processes the collected information, and sends it to the processor of the robot. The processor analyzes and processes the received signal, and transmits the obtained information to the control terminal through the wireless communication system. RESULTS:Through the tests in this study, it is found that when the number of hidden layer nodes of the BPNN is 7, the optimal training result is obtained. On this basis, the test of BPNN in this study is performed. The test results show that after 127 iterations, the error of the BPNN reaches the lowest target value, indicating that the BPNN achieves an excellent level of accuracy. The trained BPNN has a running time of 0.0276 s and a mean square error of 0.0013. The smaller the mean square error value is, the higher the accuracy of the BPNN is, which shows that the BPNN meets the high precision requirements of this study. CONCLUSION:The research on the multi-sensor information fusion detection system of fire robots in this study can provide theoretical support for the research on forest fire detection in China. Since the proposed BPNN-based robot is applied to the inspection and processing of forest remaining fire, the results are applicable to the forests of various countries, with a wide range of applications.

Dataset Information

An FPGA-Based Ultra-High-Speed Object Detection Algorithm with Multi-Frame Information Fusion.

Publications

An FPGA-Based Ultra-High-Speed Object Detection Algorithm with Multi-Frame Information Fusion.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets