Design and implementation of the real-time GIS data model and Sensor Web service platform for environmental big data management with the Apache Storm

Author(s):  
Zeqiang Chen ◽  
Nengcheng Chen ◽  
Jianya Gong
2020 ◽  
Vol 14 ◽  
pp. 174830262096239 ◽  
Author(s):  
Chuang Wang ◽  
Wenbo Du ◽  
Zhixiang Zhu ◽  
Zhifeng Yue

With the wide application of intelligent sensors and internet of things (IoT) in the smart job shop, a large number of real-time production data is collected. Accurate analysis of the collected data can help producers to make effective decisions. Compared with the traditional data processing methods, artificial intelligence, as the main big data analysis method, is more and more applied to the manufacturing industry. However, the ability of different AI models to process real-time data of smart job shop production is also different. Based on this, a real-time big data processing method for the job shop production process based on Long Short-Term Memory (LSTM) and Gate Recurrent Unit (GRU) is proposed. This method uses the historical production data extracted by the IoT job shop as the original data set, and after data preprocessing, uses the LSTM and GRU model to train and predict the real-time data of the job shop. Through the description and implementation of the model, it is compared with KNN, DT and traditional neural network model. The results show that in the real-time big data processing of production process, the performance of the LSTM and GRU models is superior to the traditional neural network, K nearest neighbor (KNN), decision tree (DT). When the performance is similar to LSTM, the training time of GRU is much lower than LSTM model.


2017 ◽  
Vol 8 (2) ◽  
pp. 88-105 ◽  
Author(s):  
Gunasekaran Manogaran ◽  
Daphne Lopez

Ambient intelligence is an emerging platform that provides advances in sensors and sensor networks, pervasive computing, and artificial intelligence to capture the real time climate data. This result continuously generates several exabytes of unstructured sensor data and so it is often called big climate data. Nowadays, researchers are trying to use big climate data to monitor and predict the climate change and possible diseases. Traditional data processing techniques and tools are not capable of handling such huge amount of climate data. Hence, there is a need to develop advanced big data architecture for processing the real time climate data. The purpose of this paper is to propose a big data based surveillance system that analyzes spatial climate big data and performs continuous monitoring of correlation between climate change and Dengue. Proposed disease surveillance system has been implemented with the help of Apache Hadoop MapReduce and its supporting tools.


2014 ◽  
Vol 667 ◽  
pp. 201-207
Author(s):  
Qi Deng ◽  
Pin Xu ◽  
Shao Bin Li ◽  
Xin Yao Zhang

In China, closed caption is the latest technology standard separating the caption from the image. In current digital television system, it is an urgent issue to be resolved that how to implement the real-time transmission of closed caption with its host video. This paper proposed a kind of closed caption and its representation method. It also designed a closed caption data structure based on XML and provided a solution about how to package XML file and XML Schema file into MXF files.


2013 ◽  
Vol 816-817 ◽  
pp. 488-492
Author(s):  
Li Xin Li ◽  
Wei Zhou ◽  
Qi Qiang Sun ◽  
Jiao Dai ◽  
Ji Zhong Han ◽  
...  

In order to make the real time database more suitable for the computing features, this article points to the distributed and parallel real time database design and architecture. First, a mapping table from table file to machine nodes is established, and then can use meta-data management system to store and manage the mapping table to meet the characteristics of high concurrent access. The whole network computation can access the unified interface provided by the real-time database, retrive data from each node, then collect the data. Experimental results show that this study and the systems designed can meet the computing requirements of a unified whole network.


Sign in / Sign up

Export Citation Format

Share Document