Real time interpretation and optimization of time series data stream in big data

2018 ◽  
Author(s):  
Zheyuan Jiang ◽  
Ke Liu
Keyword(s):  
Time Series ◽  
Big Data ◽  
Real Time ◽  
Data Stream ◽  
Time Series Data ◽  
Series Data

A Novel Approach to Time Series Forecasting Using Model-Free Adaptive Control Framework

2020 ◽  
Author(s):  
Meenakshi Narayan ◽  
Ann Majewicz Fey
Keyword(s):  
Time Series ◽  
Adaptive Control ◽  
Real Time ◽  
Time Series Data ◽  
Mean Squared Error ◽  
Force Sensor ◽  
Sensor Data ◽  
Series Data ◽  
Model Free ◽  
Control Framework

Abstract Sensor data predictions could significantly improve the accuracy and effectiveness of modern control systems; however, existing machine learning and advanced statistical techniques to forecast time series data require significant computational resources which is not ideal for real-time applications. In this paper, we propose a novel forecasting technique called Compact Form Dynamic Linearization Model-Free Prediction (CFDL-MFP) which is derived from the existing model-free adaptive control framework. This approach enables near real-time forecasts of seconds-worth of time-series data due to its basis as an optimal control problem. The performance of the CFDL-MFP algorithm was evaluated using four real datasets including: force sensor readings from surgical needle, ECG measurements for heart rate, and atmospheric temperature and Nile water level recordings. On average, the forecast accuracy of CFDL-MFP was 28% better than the benchmark Autoregressive Integrated Moving Average (ARIMA) algorithm. The maximum computation time of CFDL-MFP was 49.1ms which was 170 times faster than ARIMA. Forecasts were best for deterministic data patterns, such as the ECG data, with a minimum average root mean squared error of (0.2±0.2).

A hybrid fuzzy quantum time series and linear programming model: Special application on TAIEX index dataset

2019 ◽  
Vol 34 (25) ◽  
pp. 1950201 ◽  
Author(s):  
Pritpal Singh ◽  
Gaurav Dhiman ◽  
Sen Guo ◽  
Ritika Maini ◽  
Harsimran Kaur ◽  
...  
Keyword(s):  
Time Series ◽  
Linear Programming ◽  
Real Time ◽  
Time Series Data ◽  
Programming Model ◽  
Series Data ◽  
Quantum Model ◽  
Quantum Time ◽  
Degree Of Membership ◽  
Quantum Approach

The supremacy of quantum approach is able to provide the solutions which are not practically feasible on classical machines. This paper introduces a novel quantum model for time series data which depends on the appropriate length of intervals. In this study, the effects of these drawbacks are elaborately illustrated, and some significant measures to remove them are suggested, such as use of degree of membership along with mid-value of the interval. All these improvements signify the effective results in case of quantum time series, which are verified and validated with real-time datasets.

A near real-time water surface detection method based on HSV transformation of MODIS multi-spectral time series data

2014 ◽  
Vol 140 ◽  
pp. 704-716 ◽  
Author(s):  
J.-F. Pekel ◽  
C. Vancutsem ◽  
L. Bastin ◽  
M. Clerici ◽  
E. Vanbogaert ◽  
...  
Keyword(s):  
Time Series ◽  
Real Time ◽  
Water Surface ◽  
Time Series Data ◽  
Detection Method ◽  
Series Data ◽  
Surface Detection

scholarly journals PhilDB - The time series database with built-in change logging

2015 ◽  
Author(s):  
Andrew MacDonald
Keyword(s):  
Time Series ◽  
Big Data ◽  
Open Source ◽  
High Performance ◽  
Time Series Data ◽  
Handling Time ◽  
Series Data ◽  
Meta Data ◽  
Static Data ◽  
Data Tracking

PhilDB is an open-source time series database. It supports storage of time series datasets that are dynamic, that is recording updates to existing values in a log as they occur. Recent open-source systems, such as InfluxDB and OpenTSDB, have been developed to indefinitely store long-period, high-resolution time series data. Unfortunately they require a large initial installation investment before use because they are designed to operate over a cluster of servers to achieve high-performance writing of static data in real time. In essence, they have a ‘big data’ approach to storage and access. Other open-source projects for handling time series data that don’t take the ‘big data’ approach are also relatively new and are complex or incomplete. None of these systems gracefully handle revision of existing data while tracking values that changed. Unlike ‘big data’ solutions, PhilDB has been designed for single machine deployment on commodity hardware, reducing the barrier to deployment. PhilDB eases loading of data for the user by utilising an intelligent data write method. It preserves existing values during updates and abstracts the update complexity required to achieve logging of data value changes. PhilDB improves accessing datasets by two methods. Firstly, it uses fast reads which make it practical to select data for analysis. Secondly, it uses simple read methods to minimise effort required to extract data. PhilDB takes a unique approach to meta-data tracking; optional attribute attachment. This facilitates scaling the complexities of storing a wide variety of data. That is, it allows time series data to be loaded as time series instances with minimal initial meta-data, yet additional attributes can be created and attached to differentiate the time series instances as a wider variety of data is needed. PhilDB was written in Python, leveraging existing libraries. This paper describes the general approach, architecture, and philosophy of the PhilDB software.

scholarly journals Unsupervised Anomaly Detection for Energy Consumption in Time Series using Clustering Approach

2021 ◽  
Vol 5 (6) ◽  
pp. 840-854
Author(s):  
Jesmeen M. Z. H. ◽  
J. Hossen ◽  
Azlan Bin Abd. Aziz
Keyword(s):  
Time Series ◽  
Energy Consumption ◽  
Unsupervised Learning ◽  
Real Time ◽  
Smart Home ◽  
Time Series Data ◽  
Economic Cost ◽  
Feature Reduction ◽  
Series Data ◽  
Learning Models

Recent years have seen significant growth in the adoption of smart home devices. It involves a Smart Home System for better visualisation and analysis with time series. However, there are a few challenges faced by the system developers, such as data quality or data anomaly issues. These anomalies can be due to technical or non-technical faults. It is essential to detect the non-technical fault as it might incur economic cost. In this study, the main objective is to overcome the challenge of training learning models in the case of an unlabelled dataset. Another important consideration is to train the model to be able to discriminate abnormal consumption from seasonal-based consumption. This paper proposes a system using unsupervised learning for Time-Series data in the smart home environment. Initially, the model collected data from the real-time scenario. Following seasonal-based features are generated from the time-domain, followed by feature reduction technique PCA to 2-dimension data. This data then passed through four known unsupervised learning models and was evaluated using the Excess Mass and Mass-Volume method. The results concluded that LOF tends to outperform in the case of detecting anomalies in electricity consumption. The proposed model was further evaluated by benchmark anomaly dataset, and it was also proved that the system could work with the different fields containing time-series data. The model will cluster data into anomalies and not. The developed anomaly detector will detect all anomalies as soon as possible, triggering real alarms in real-time for time-series data's energy consumption. It has the capability to adapt to changing values automatically. Doi: 10.28991/esj-2021-01314 Full Text: PDF

Sign in / Sign up

Export Citation Format

Share Document