Dataset Information

Influence of the combination of big data technology on the Spark platform with deep learning on elevator safety monitoring efficiency.

ABSTRACT: To effectively minimize elevator safety accidents, big data technology is combined with deep learning technology based on the Spark platform. This study first introduces the relevant theories of elevator safety monitoring technology, namely big data technology and deep learning technology. Then, the fault types that occur in the running state of the elevator are identified, and a finite state machine model is established. An elevator fault monitoring method based on the Spark platform is proposed, namely finite state machine (FSM), and the results of elevator safety fault monitoring are evaluated. Based on deep learning, an elevator fault warning model is constructed and its early warning performance is evaluated. The results show that the study can realize real-time and effective monitoring in the operation state of the elevator, and can determine the fault type of the elevator by binding the abnormal operation state with the corresponding fault. The feasibility of the elevator safety monitoring efficiency is evaluated based on three indexes: mutual information, accuracy, and false positives. Compared with other algorithms, the proposed FSM algorithm has the largest mutual information (0.1337), the highest accuracy (0.9899), the lowest false positive rate (0.0624), and the lowest false negative rate (0.1126); compared with other models, the elevator fault warning model proposed in this study has the lowest root mean-square error (RMSE) value (0.0201), the highest accuracy (0.9834), the lowest Loss value (0.0012), and the shortest convergence time (88.2608s), indicating that the elevator safety monitoring system and elevator fault warning model are feasible. This study establishes a good direction for elevator safety monitoring efficiency in China.

SUBMITTER: Yu J

PROVIDER: S-EPMC7299372 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Influence of the combination of big data technology on the Spark platform with deep learning on elevator safety monitoring efficiency.

Yu Jie J Hu Bo B

PloS one 20200617 6

To effectively minimize elevator safety accidents, big data technology is combined with deep learning technology based on the Spark platform. This study first introduces the relevant theories of elevator safety monitoring technology, namely big data technology and deep learning technology. Then, the fault types that occur in the running state of the elevator are identified, and a finite state machine model is established. An elevator fault monitoring method based on the Spark platform is propose ...[more]

PMID: 32555687

Similar Datasets

Project description:The progress of next-generation sequencing has lead to the availability of massive data sets used by a wide range of applications in biology and medicine. This has sparked significant interest in using modern Big Data technologies to process this large amount of information in distributed memory clusters of commodity hardware. Several approaches based on solutions such as Apache Hadoop or Apache Spark, have been proposed. These solutions allow developers to focus on the problem while the need to deal with low level details, such as data distribution schemes or communication patterns among processing nodes, can be ignored. However, performance and scalability are also of high importance when dealing with increasing problems sizes, making in this way the usage of High Performance Computing (HPC) technologies such as the message passing interface (MPI) a promising alternative. Recently, MetaCacheSpark, an Apache Spark based software for detection and quantification of species composition in food samples has been proposed. This tool can be used to analyze high throughput sequencing data sets of metagenomic DNA and allows for dealing with large-scale collections of complex eukaryotic and bacterial reference genome. In this work, we propose MetaCache-MPI, a fast and memory efficient solution for computing clusters which is based on MPI instead of Apache Spark. In order to evaluate its performance a comparison is performed between the original single CPU version of MetaCache, the Spark version and the MPI version we are introducing. Results show that for 32 processes, MetaCache-MPI is 1.65× faster while consuming 48.12% of the RAM memory used by Spark for building a metagenomics database. For querying this database, also with 32 processes, the MPI version is 3.11× faster, while using 55.56% of the memory used by Spark. We conclude that the new MetaCache-MPI version is faster in both building and querying the database and uses less RAM memory, when compared with MetaCacheSpark, while keeping the accuracy of the original implementation.

Project description:In recent years, the application and wide adoption of Internet of Things (IoT)-based technologies have increased the proliferation of monitoring systems, which has consequently exponentially increased the amounts of heterogeneous data generated. Processing and analysing the massive amount of data produced is cumbersome and gradually moving from classical 'batch' processing-extract, transform, load (ETL) technique to real-time processing. For instance, in environmental monitoring and management domain, time-series data and historical dataset are crucial for prediction models. However, the environmental monitoring domain still utilises legacy systems, which complicates the real-time analysis of the essential data, integration with big data platforms and reliance on batch processing. Herein, as a solution, a distributed stream processing middleware framework for real-time analysis of heterogeneous environmental monitoring and management data is presented and tested on a cluster using open source technologies in a big data environment. The system ingests datasets from legacy systems and sensor data from heterogeneous automated weather systems irrespective of the data types to Apache Kafka topics using Kafka Connect APIs for processing by the Kafka streaming processing engine. The stream processing engine executes the predictive numerical models and algorithms represented in event processing (EP) languages for real-time analysis of the data streams. To prove the feasibility of the proposed framework, we implemented the system using a case study scenario of drought prediction and forecasting based on the Effective Drought Index (EDI) model. Firstly, we transform the predictive model into a form that could be executed by the streaming engine for real-time computing. Secondly, the model is applied to the ingested data streams and datasets to predict drought through persistent querying of the infinite streams to detect anomalies. As a conclusion of this study, a performance evaluation of the distributed stream processing middleware infrastructure is calculated to determine the real-time effectiveness of the framework.

Dataset Information

Influence of the combination of big data technology on the Spark platform with deep learning on elevator safety monitoring efficiency.

Publications

Influence of the combination of big data technology on the Spark platform with deep learning on elevator safety monitoring efficiency.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure