scholarly journals Optimum partition in flight route anomaly detection

2019 ◽  
Vol 14 (3) ◽  
pp. 1315
Author(s):  
Mohammad Yazdi Pusadan ◽  
Joko Lianto Buliali ◽  
Raden Venantius Hari Ginardi
Keyword(s):  
Anomaly Detection ◽  
Real Time ◽  
Optimal Partition ◽  
False Identification ◽  
Cluster Validity ◽  
Data Set ◽  
Flight Data ◽  
Identification Rate ◽  
Flight Route ◽  
Optimum Partition

Anomaly detection of flight route can be analyzed with the availability of flight data set. Automatic Dependent Surveillance (ADS-B) is the data set used. The parameters used are timestamp, latitude, longitude, and speed. The purpose of the research is to determine the optimum area for anomaly detection through real time approach. The methods used are: a) clustering and cluster validity analysis; and b) False Identification Rate (FIR). The results archieved are four steps, i.e: a) Build segments based on waypoints; b) Partition area based on 3-Dimension features P<sub>1</sub> and P<sub>2</sub>; c) grouping; and d) Measurement of cluster validity. The optimum partition is generated by calculating the minimum percentage of FIR. The results achieved are: i) there are five partitions, i.e: (n/2, n/3, n/4, n/5) and ii) optimal partition of each 3D, that is: for P<sub>1</sub> was five partitions and the P<sub>2</sub> feature was four partitions

scholarly journals Alkalmazott mesterséges intelligencia felhasználási területei és biztonsági kérdései – Mesterséges intelligencia a gyakorlatban

2020 ◽  
Vol 1 (1) ◽  
pp. 35-42
Author(s):  
Péter Ekler ◽  
Dániel Pásztor
Keyword(s):  
Artificial Intelligence ◽  
Big Data ◽  
Anomaly Detection ◽  
Real Time ◽  
Learning Algorithm ◽  
Sensor Data ◽  
Test Field ◽  
Real Time System ◽  
Data Set ◽  
Wide Range

Összefoglalás. A mesterséges intelligencia az elmúlt években hatalmas fejlődésen ment keresztül, melynek köszönhetően ma már rengeteg különböző szakterületen megtalálható valamilyen formában, rengeteg kutatás szerves részévé vált. Ez leginkább az egyre inkább fejlődő tanulóalgoritmusoknak, illetve a Big Data környezetnek köszönhető, mely óriási mennyiségű tanítóadatot képes szolgáltatni. A cikk célja, hogy összefoglalja a technológia jelenlegi állapotát. Ismertetésre kerül a mesterséges intelligencia történelme, az alkalmazási területek egy nagyobb része, melyek központi eleme a mesterséges intelligencia. Ezek mellett rámutat a mesterséges intelligencia különböző biztonsági réseire, illetve a kiberbiztonság területén való felhasználhatóságra. A cikk a jelenlegi mesterséges intelligencia alkalmazások egy szeletét mutatja be, melyek jól illusztrálják a széles felhasználási területet. Summary. In the past years artificial intelligence has seen several improvements, which drove its usage to grow in various different areas and became the focus of many researches. This can be attributed to improvements made in the learning algorithms and Big Data techniques, which can provide tremendous amount of training. The goal of this paper is to summarize the current state of artificial intelligence. We present its history, introduce the terminology used, and show technological areas using artificial intelligence as a core part of their applications. The paper also introduces the security concerns related to artificial intelligence solutions but also highlights how the technology can be used to enhance security in different applications. Finally, we present future opportunities and possible improvements. The paper shows some general artificial intelligence applications that demonstrate the wide range usage of the technology. Many applications are built around artificial intelligence technologies and there are many services that a developer can use to achieve intelligent behavior. The foundation of different approaches is a well-designed learning algorithm, while the key to every learning algorithm is the quality of the data set that is used during the learning phase. There are applications that focus on image processing like face detection or other gesture detection to identify a person. Other solutions compare signatures while others are for object or plate number detection (for example the automatic parking system of an office building). Artificial intelligence and accurate data handling can be also used for anomaly detection in a real time system. For example, there are ongoing researches for anomaly detection at the ZalaZone autonomous car test field based on the collected sensor data. There are also more general applications like user profiling and automatic content recommendation by using behavior analysis techniques. However, the artificial intelligence technology also has security risks needed to be eliminated before applying an application publicly. One concern is the generation of fake contents. These must be detected with other algorithms that focus on small but noticeable differences. It is also essential to protect the data which is used by the learning algorithm and protect the logic flow of the solution. Network security can help to protect these applications. Artificial intelligence can also help strengthen the security of a solution as it is able to detect network anomalies and signs of a security issue. Therefore, the technology is widely used in IT security to prevent different type of attacks. As different BigData technologies, computational power, and storage capacity increase over time, there is space for improved artificial intelligence solution that can learn from large and real time data sets. The advancements in sensors can also help to give more precise data for different solutions. Finally, advanced natural language processing can help with communication between humans and computer based solutions.

scholarly journals Detection of Abnormalities in Real-Time Computer Network Traffic Empowered by Machine Learning

2021 ◽  
Vol 10 (3) ◽  
pp. 2072-2079
Keyword(s):  
Machine Learning ◽  
Anomaly Detection ◽  
Real Time ◽  
Network Traffic ◽  
Computer Network ◽  
Data Gathering ◽  
Network Systems ◽  
Data Set ◽  
Synthetic Network ◽  
Scientific Papers

This research discloses how to utilize machine learning methods for anomaly detection in real-time on a computer network. While utilizing machine learning for this task is definitely not a novel idea, little literature is about the matter of doing it in real-time. Most machine learning research in PC network anomaly detection depends on the KDD '99 data set and means to demonstrate the proficiency of the algorithms introduced. The emphasis on this data set has caused a lack of scientific papers disclosing how to assemble network data, remove features, and train algorithms for use inreal-time networks. It has been contended that utilizing the KDD '99 dataset for anomaly detection is not appropriate for real-time network systems. This research proposes how the data gathering procedure will be possible utilizing a dummy network and generating synthetic network traffic by analyzing the importance of One-class SVM. As the efficiency of k-means clustering and LTSM neural networks is lower than one-class SVM, that is why this research uses the results of existing research of LSTM and k-means clustering for the comparison with reported outcomes of a similar algorithm on the KDD '99 dataset. Precisely, without engaging KDD ’99 data set by using synthetic network traffic, this research achieved the higher accuracy as compared to the previous researches.

scholarly journals Anomaly Intrusion Detection System in Real Time Environment using Ensemble Learning Model

2019 ◽  
Vol 8 (4) ◽  
pp. 4908-4917
Keyword(s):  
Intrusion Detection ◽  
Anomaly Detection ◽  
Real Time ◽  
Network Traffic ◽  
Intrusion Detection System ◽  
Detection System ◽  
False Negative ◽  
Ensemble Classification ◽  
Data Set ◽  
Rule Set

System security is of essential part now days for huge organizations. The Intrusion Detection System (IDS) are getting to be irreplaceable for successful assurance against intrusions that are continually changing in size and intricacy. With information honesty, privacy and accessibility, they must be solid, simple to oversee and with low upkeep cost. Different adjustments are being connected to IDS consistently to recognize new intrusions and handle them. This paper proposes model based on combination of ensemble classification for network traffic anomaly detection. Intrusion detection system is try to perform in real time, but they cannot improved due to the network connections. This research paper is trying to implement intrusion detection system (IDS) using ensemble method for misuse as well anomaly detection for HIDS and NIDS based also. This system used various individual classification methods and its ensemble model on KDD99 and NSL-KDD data set to check the performance of model. It also check the performance on creating real time network traffic using own attack creator and send this to the remote machine which has our proposed IDS system. This system used training rule set as a background knowledge which are generated by genetic algorithm. Ensemble approach contains three algorithms as Naive Bayes, Artificial Neural Network and J48. Ensemble classifiers apply on network packets mapping with GA rule set and generate the result. Finally our proposed model produces highest detection rate and lower false negative ratio compare to others. Also find the accuracy of each attack types.

scholarly journals On the proper choice of datasets and traffic features for real-time anomaly detection

2021 ◽  
Vol 2091 (1) ◽  
pp. 012001
Author(s):  
C Callegari ◽  
S Giordano ◽  
M Pagano
Keyword(s):  
Intrusion Detection ◽  
Anomaly Detection ◽  
Real Time ◽  
Detection System ◽  
Detection Algorithm ◽  
Performance Comparison ◽  
Critical Element ◽  
Correct Identification ◽  
Data Set ◽  
On Line

Abstract Thanks to its ability to face unknown attacks, Anomaly-based Intrusion Detection is a key research topic in network security and different statistical methods, fed by suitable traffic features, have been proposed in the literature. The choice of a proper dataset is a critical element not only for performance comparison, but also for the correct identification of the normal traffic behaviour. In this paper we address the general problem of selecting traffic features from recent real traffic traces (MAWI data set) and verify how the real-time constraint impacts on the general performance. Although a state-of-the-art IDS (Intrusion Detection System) based on deep neural networks is considered, our conclusions can be extended to any anomaly detection algorithm and advocate for a fair comparison of IDSs using representative datasets and traffic features that can be extracted on-line (and do not depend on the entire dataset).

Prediction of aircraft engine emissions using ADS-B flight data

2021 ◽  
pp. 1-25
Author(s):  
A. Filippone ◽  
B. Parkes ◽  
N. Bojdo ◽  
T. Kelly
Keyword(s):  
Real Time ◽  
Water Vapour ◽  
Long Range ◽  
Aircraft Engine ◽  
Software Systems ◽  
Engine Emissions ◽  
Flight Data ◽  
Seasonal Basis ◽  
Emissions Inventories ◽  
Aviation Emissions

ABSTRACT Real-time flight data from the Automatic Dependent Surveillance–Broadcast (ADS-B) has been integrated, through a data interface, with a flight performance computer program to predict aviation emissions at altitude. The ADS-B, along with data from Mode-S, are then used to ‘fly’ selected long-range aircraft models (Airbus A380-841, A330-343 and A350-900) and one turboprop (ATR72). Over 2,500 flight trajectories have been processed to demonstrate the integration between databases and software systems. Emissions are calculated for altitudes greater than 3,000 feet (609m) and exclude landing and take-off cycles. This proof of concept fills a gap in the aviation emissions inventories, since it uses real-time flights and produces estimates at a very granular level. It can be used to analyse emissions of gases such as carbon dioxide ( $\mathrm{CO}_2$ ), carbon monoxide (CO), nitrogen oxides ( $\mathrm{NO}_x$ ) and water vapour on a specific route (city pair), for a specific aircraft, for an entire fleet, or on a seasonal basis. It is shown how $\mathrm{NO}_x$ and water vapour emissions concentrate around tropospheric altitudes only for long-range flights, and that the cruise range is the biggest discriminator in the absolute value of these and other exhaust emissions.

scholarly journals Influence of Features on Accuracy of Anomaly Detection for an Energy Trading System

Sensors ◽  
2021 ◽  
Vol 21 (12) ◽  
pp. 4237
Author(s):  
Hoon Ko ◽  
Kwangcheol Rim ◽  
Isabel Praça
Keyword(s):  
Anomaly Detection ◽  
Real Time ◽  
Feature Detection ◽  
Trading System ◽  
Judgment Accuracy ◽  
Energy Trading ◽  
Real Time Processing ◽  
Detection Model ◽  
Time Required ◽  
The Relationship

The biggest problem with conventional anomaly signal detection using features was that it was difficult to use it in real time and it requires processing of network signals. Furthermore, analyzing network signals in real-time required vast amounts of processing for each signal, as each protocol contained various pieces of information. This paper suggests anomaly detection by analyzing the relationship among each feature to the anomaly detection model. The model analyzes the anomaly of network signals based on anomaly feature detection. The selected feature for anomaly detection does not require constant network signal updates and real-time processing of these signals. When the selected features are found in the received signal, the signal is registered as a potential anomaly signal and is then steadily monitored until it is determined as either an anomaly or normal signal. In terms of the results, it determined the anomaly with 99.7% (0.997) accuracy in f(4)(S0) and in case f(4)(REJ) received 11,233 signals with a normal or 171anomaly judgment accuracy of 98.7% (0.987).

scholarly journals Anomaly Detection and Attack Classification for Train Real-Time Ethernet

IEEE Access ◽  
2021 ◽  
Vol 9 ◽  
pp. 22528-22541
Author(s):  
Ruifeng Duo ◽  
Xiaobo Nie ◽  
Ning Yang ◽  
Chuan Yue ◽  
Yongxiang Wang
Keyword(s):  
Anomaly Detection ◽  
Real Time
Sign in / Sign up

Export Citation Format

Share Document