LSTM Learning with Bayesian and Gaussian Processing for Anomaly Detection in Industrial IoT

Di Wu, Zhongkai Jiang, Xiaofeng Xie, Xuetao Wei, Weiren Yu, Renfa Li

Research output: Contribution to journalArticle

Abstract

The data generated by millions of sensors in Industrial Internet of Things (IIoT) is extremely dynamic, heterogeneous, and large scale. It poses great challenges on the real-time analysis and decision making for anomaly detection in IIoT. In this paper, we propose a LSTM-Gauss-NBayes method, which is a synergy of the long short-term memory neural network (LSTM-NN) and the Gaussian Bayes model for outlier detection in IIoT. In a nutshell, the LSTM-NN builds model on normal time series. It detects outliers by utilising the predictive error for the Gaussian Naive Bayes model. Our method exploits advantages of both LSTM and Gaussian Naive Bayes models, which not only has strong prediction capability of LSTM for future time point data, but also achieves an excellent classification performance of Gaussian Naive Bayes model through the predictive error. Empirical studies demonstrate our solution outperforms the best-known competitors, which is a preferable choice for detecting anomalies.
Original languageEnglish
JournalIEEE Transactions on Industrial Informatics
Early online date11 Nov 2019
DOIs
Publication statusE-pub ahead of print - 11 Nov 2019

Fingerprint

Processing
Neural networks
Time series
Decision making
Internet of things
Sensors
Long short-term memory

Bibliographical note

© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Funding: HuXiang Youth Talent Program; National Natural Science Foundation of China.

Cite this

@article{9221e122bf3c4999a805840476c0d0ed,
title = "LSTM Learning with Bayesian and Gaussian Processing for Anomaly Detection in Industrial IoT",
abstract = "The data generated by millions of sensors in Industrial Internet of Things (IIoT) is extremely dynamic, heterogeneous, and large scale. It poses great challenges on the real-time analysis and decision making for anomaly detection in IIoT. In this paper, we propose a LSTM-Gauss-NBayes method, which is a synergy of the long short-term memory neural network (LSTM-NN) and the Gaussian Bayes model for outlier detection in IIoT. In a nutshell, the LSTM-NN builds model on normal time series. It detects outliers by utilising the predictive error for the Gaussian Naive Bayes model. Our method exploits advantages of both LSTM and Gaussian Naive Bayes models, which not only has strong prediction capability of LSTM for future time point data, but also achieves an excellent classification performance of Gaussian Naive Bayes model through the predictive error. Empirical studies demonstrate our solution outperforms the best-known competitors, which is a preferable choice for detecting anomalies.",
author = "Di Wu and Zhongkai Jiang and Xiaofeng Xie and Xuetao Wei and Weiren Yu and Renfa Li",
note = "{\circledC} 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. Funding: HuXiang Youth Talent Program; National Natural Science Foundation of China.",
year = "2019",
month = "11",
day = "11",
doi = "10.1109/TII.2019.2952917",
language = "English",
journal = "IEEE Transactions on Industrial Informatics",
issn = "1551-3203",
publisher = "IEEE",

}

LSTM Learning with Bayesian and Gaussian Processing for Anomaly Detection in Industrial IoT. / Wu, Di; Jiang, Zhongkai; Xie, Xiaofeng; Wei, Xuetao; Yu, Weiren; Li, Renfa.

In: IEEE Transactions on Industrial Informatics, 11.11.2019.

Research output: Contribution to journalArticle

TY - JOUR

T1 - LSTM Learning with Bayesian and Gaussian Processing for Anomaly Detection in Industrial IoT

AU - Wu, Di

AU - Jiang, Zhongkai

AU - Xie, Xiaofeng

AU - Wei, Xuetao

AU - Yu, Weiren

AU - Li, Renfa

N1 - © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. Funding: HuXiang Youth Talent Program; National Natural Science Foundation of China.

PY - 2019/11/11

Y1 - 2019/11/11

N2 - The data generated by millions of sensors in Industrial Internet of Things (IIoT) is extremely dynamic, heterogeneous, and large scale. It poses great challenges on the real-time analysis and decision making for anomaly detection in IIoT. In this paper, we propose a LSTM-Gauss-NBayes method, which is a synergy of the long short-term memory neural network (LSTM-NN) and the Gaussian Bayes model for outlier detection in IIoT. In a nutshell, the LSTM-NN builds model on normal time series. It detects outliers by utilising the predictive error for the Gaussian Naive Bayes model. Our method exploits advantages of both LSTM and Gaussian Naive Bayes models, which not only has strong prediction capability of LSTM for future time point data, but also achieves an excellent classification performance of Gaussian Naive Bayes model through the predictive error. Empirical studies demonstrate our solution outperforms the best-known competitors, which is a preferable choice for detecting anomalies.

AB - The data generated by millions of sensors in Industrial Internet of Things (IIoT) is extremely dynamic, heterogeneous, and large scale. It poses great challenges on the real-time analysis and decision making for anomaly detection in IIoT. In this paper, we propose a LSTM-Gauss-NBayes method, which is a synergy of the long short-term memory neural network (LSTM-NN) and the Gaussian Bayes model for outlier detection in IIoT. In a nutshell, the LSTM-NN builds model on normal time series. It detects outliers by utilising the predictive error for the Gaussian Naive Bayes model. Our method exploits advantages of both LSTM and Gaussian Naive Bayes models, which not only has strong prediction capability of LSTM for future time point data, but also achieves an excellent classification performance of Gaussian Naive Bayes model through the predictive error. Empirical studies demonstrate our solution outperforms the best-known competitors, which is a preferable choice for detecting anomalies.

UR - https://ieeexplore.ieee.org/document/8896029/

U2 - 10.1109/TII.2019.2952917

DO - 10.1109/TII.2019.2952917

M3 - Article

JO - IEEE Transactions on Industrial Informatics

JF - IEEE Transactions on Industrial Informatics

SN - 1551-3203

ER -