A Construction Engineering Domain New Word Detection Method with the Combination of BiLSTM-CRF and Information Entropy

Author(s):  
Ling Sun ◽  
Jing Wan ◽  
Lidong Xing
2021 ◽  
Author(s):  
Xuting Duan ◽  
Huiwen Yan ◽  
Jianshan Zhou

Abstract Because of the rapid development of automobile intelligence and networking, cyber attackers can invade the vehicle network via wired and wireless interfaces, such as physical interfaces, short-range wireless interfaces, and long-range wireless interfaces. Thus, interfering with regular driving will immediately jeopardises the drivers’ and passengers’ personal and property safety. To accomplish security protection for the vehicle CAN (Controller Area Network) bus, we propose an anomaly detection method by calculating the information entropy based on the number of interval messages during the sliding window. It detects periodic attacks on the vehicle CAN bus, such as replay attacks and flooding attacks. First, we calculate the number of interval messages according to the CAN bus baud rate, the number of bits of a single frame message, and the time required to calculate information entropy within the window. Second, we compute the window information entropy of regular packet interval packets and determine the normal threshold range by setting a threshold coefficient. Finally, we calculate the information entropy of the data to be measured, determine whether it is greater than or less than the threshold, and detect the anomaly. The experiment uses CANoe software to simulate the vehicle network. It uses the body frame CAN bus network of a brand automobile body bench as the regular network, simulates attack nodes to attack the regular network periodically, collects message data, and verifies the proposed detection method. The results show that the proposed detection method has lower false-negative and false-positive rates for attack scenarios such as replay attacks and flood attacks across different attack cycles.


2021 ◽  
Vol 2138 (1) ◽  
pp. 012013
Author(s):  
Yongzhi Chen ◽  
Ziao Xu ◽  
Chaoqun Niu

Abstract In the research of flash flood disaster monitoring and early warning, the Internet of Things is widely used in real-time information collection. There are abnormal situations such as noise, repetition and errors in a large amount of data collected by sensors, which will lead to false alarm, lower prediction accuracy and other problems. Aiming at the characteristic that outliers flow of sensors will cause obvious fluctuation of information entropy, this paper proposes a local outlier detection method based on information entropy and optimized by sliding window and LOF (Local Outlier Factor). This method can be used to improve the data quality, thus improving the accuracy of disaster prediction. The method is applied to data stream processing of water sensor, and the experimental results show that the method can accurately detect outliers. Compared with the existing detection methods that only use data distance to determine, the test positive rate is improved and the false positive rate is reduced.


Author(s):  
Guan Wu ◽  
Rui Chen ◽  
Hailong Zhang ◽  
Jun Chen ◽  
Xing Hu

2012 ◽  
Vol 220-223 ◽  
pp. 2273-2279
Author(s):  
Feng Zhao ◽  
Rui Chuan Ma ◽  
Jia Qing Ma

By using information entropy to estimate the distribution uniformity of the pixels with a same gray level, an accurate salt and pepper noise detection method is presented based on the statistical property of salt and pepper noise. And then, a new modified mean filter is designed, which sets up noise-centre filtering windows, Moreover, the weighted means are calculated by merely using the non-noise points in each filtering window. The presented filter can efficiently preserve the details of images, avoid the affection of noise points on the restore points, and reduce the dimness of the noise points. Experimental results show that this algorithm has the better performance on noise detection, noise filtering, and the protection of detail.


Sign in / Sign up

Export Citation Format

Share Document