scholarly journals TORNADO: Intermediate Results Orchestration Based Service-Oriented Data Curation Framework for Intelligent Video Big Data Analytics in the Cloud

Sensors ◽  
2020 ◽  
Vol 20 (12) ◽  
pp. 3581
Author(s):  
Aftab Alam ◽  
Young-Koo Lee

In the recent past, the number of surveillance cameras placed in the public has increased significantly, and an enormous amount of visual data is produced at an alarming rate. Resultantly, there is a demand for a distributed system for video analytics. However, a majority of existing research on video analytics focuses on improving video content management and rely on a traditional client/server framework. In this paper, we develop a scalable and flexible framework called TORNADO on top of general-purpose big data technologies for intelligent video big data analytics in the cloud. The proposed framework acquires video streams from device-independent data-sources utilizing distributed streams and file management systems. High-level abstractions are provided to allow the researcher to develop and deploy video analytics algorithms and services in the cloud under the as-a-service paradigm. Furthermore, a unified IR Middleware has been proposed to orchestrate the intermediate results being generated during video big data analytics in the cloud. We report results demonstrating the performance of the proposed framework and the viability of its usage in terms of better scalability, less fault-tolerance, and better performance.

Web Services ◽  
2019 ◽  
pp. 1430-1443
Author(s):  
Louise Leenen ◽  
Thomas Meyer

The Governments, military forces and other organisations responsible for cybersecurity deal with vast amounts of data that has to be understood in order to lead to intelligent decision making. Due to the vast amounts of information pertinent to cybersecurity, automation is required for processing and decision making, specifically to present advance warning of possible threats. The ability to detect patterns in vast data sets, and being able to understanding the significance of detected patterns are essential in the cyber defence domain. Big data technologies supported by semantic technologies can improve cybersecurity, and thus cyber defence by providing support for the processing and understanding of the huge amounts of information in the cyber environment. The term big data analytics refers to advanced analytic techniques such as machine learning, predictive analysis, and other intelligent processing techniques applied to large data sets that contain different data types. The purpose is to detect patterns, correlations, trends and other useful information. Semantic technologies is a knowledge representation paradigm where the meaning of data is encoded separately from the data itself. The use of semantic technologies such as logic-based systems to support decision making is becoming increasingly popular. However, most automated systems are currently based on syntactic rules. These rules are generally not sophisticated enough to deal with the complexity of decisions required to be made. The incorporation of semantic information allows for increased understanding and sophistication in cyber defence systems. This paper argues that both big data analytics and semantic technologies are necessary to provide counter measures against cyber threats. An overview of the use of semantic technologies and big data technologies in cyber defence is provided, and important areas for future research in the combined domains are discussed.


2020 ◽  
pp. 1499-1521
Author(s):  
Sukhpal Singh Gill ◽  
Inderveer Chana ◽  
Rajkumar Buyya

Cloud computing has transpired as a new model for managing and delivering applications as services efficiently. Convergence of cloud computing with technologies such as wireless sensor networking, Internet of Things (IoT) and Big Data analytics offers new applications' of cloud services. This paper proposes a cloud-based autonomic information system for delivering Agriculture-as-a-Service (AaaS) through the use of cloud and big data technologies. The proposed system gathers information from various users through preconfigured devices and IoT sensors and processes it in cloud using big data analytics and provides the required information to users automatically. The performance of the proposed system has been evaluated in Cloud environment and experimental results show that the proposed system offers better service and the Quality of Service (QoS) is also better in terms of QoS parameters.


Author(s):  
Zhaohao Sun

This paper provides a service-oriented foundation for big data. The foundation has two parts. Part 1 reveals 10 big characteristics of big data. Part 2 presents a service-oriented framework for big data. The framework has fundamental, technological, and socio-economic levels. The fundamental level has four big fundamental characteristics of big data: big volume, big velocity, big variety, and big veracity. The technological level consists of three big technological characteristics of big data: Big intelligence, big analytics, big infrastructure. The socioeconomic level has three big socioeconomic characteristics of big data: big service, big value, and big market. The article looks at each level of the proposed framework from a service-oriented perspective. The multi-level framework will help organizations and researchers understand how the 10 big characteristics relate to big opportunities, big challenges, and big impacts arising from big data. The proposed approach in this paper might facilitate the research and development of big data, big data analytics, business intelligence, and business analytics.


2020 ◽  
Vol 22 (4) ◽  
pp. 60-74
Author(s):  
Emmanuel Wusuhon Yanibo Ayaburi ◽  
Michele Maasberg ◽  
Jaeung Lee

Organizations face both opportunities and risks with big data analytics vendors, and the risks are now profound, as data has been likened to the oil of the digital era. The growing body of research at the nexus of big data analytics and cloud computing is examined from the economic perspective, based on agency theory (AT). A conceptual framework is developed for analyzing these opportunities and challenges regarding the use of big data analytics and cloud computing in e-business environments. This framework allows organizations to engage in contracts that target competitive parity with their service-oriented decision support system (SODSS) to achieve a competitive advantage related to their core business model. A unique contribution of this paper is its perspective on how to engage a vendor contractually to achieve this competitive advantage. The framework provides insights for a manager in selecting a vendor for cloud-based big data services.


2018 ◽  
Vol 9 (4) ◽  
pp. 33-51
Author(s):  
Rostom Mennour ◽  
Mohamed Batouche

Big data analytics and deep learning are nowadays two of the most active research areas in computer science. As the data is becoming bigger and bigger, deep learning has a very important role to play in data analytics, and big data technologies will give it huge opportunities for different sectors. Deep learning brings new challenges especially when it comes to large amounts of data, the volume of datasets has to be processed and managed, also data in various applications come in a streaming way and deep learning approaches have to deal with this kind of applications. In this paper, the authors propose two novel approaches for discriminative deep learning, namely LS-DSN, and StreamDSN that are inspired from the deep stacking network algorithm. Two versions of the gradient descent algorithm were used to train the proposed algorithms. The experiment results have shown that the algorithms gave satisfying accuracy results and scale well when the size of data increases. In addition, StreamDSN algorithm have been applied to classify beats of ECG signals and provided good promising results.


atp magazin ◽  
2016 ◽  
Vol 58 (09) ◽  
pp. 62 ◽  
Author(s):  
Martin Atzmueller ◽  
Benjamin Klöpper ◽  
Hassan Al Mawla ◽  
Benjamin Jäschke ◽  
Martin Hollender ◽  
...  

Big data technologies offer new opportunities for analyzing historical data generated by process plants. The development of new types of operator support systems (OSS) which help the plant operators during operations and in dealing with critical situations is one of these possibilities. The project FEE has the objective to develop such support functions based on big data analytics of historical plant data. In this contribution, we share our first insights and lessons learned in the development of big data applications and outline the approaches and tools that we developed in the course of the project.


2018 ◽  
Vol 7 (2.32) ◽  
pp. 452
Author(s):  
Anjali Mathur ◽  
K Vinitha ◽  
R Shubham ◽  
K Gowtham

A bank merger is a situation in which two banks or all branches of a bank join together to become one bank. The bank merger of State Bank of India was implemented on 1stApril 2017 in India. The bank merger is a good idea to centralize the customer’s data from nationwide. However, it is a difficult task for administrators and technologists. Some high level techniques are required to collect the data from the branches, of the bank present at nationwide, and merge them accordingly. For this huge data Big-Data Analysis techniques can be used to manage and access the data. The big data analytics provides algorithms to compare, classify and cluster the data at local and global level. This research paper proposes big data analytics for education loan provided by State Bank of India. The loan granting process becomes centralized after merger. It affects the processing of granting a loan, as earlier it was according to branches only. The proposed work is for comparative study of the impact of bank merger on education loan provided by State Bank of India.  


Author(s):  
Rostom Mennour ◽  
Mohamed Batouche

Big data analytics and deep learning are nowadays two of the most active research areas in computer science. As the data is becoming bigger and bigger, deep learning has a very important role to play in data analytics, and big data technologies will give it huge opportunities for different sectors. Deep learning brings new challenges especially when it comes to large amounts of data, the volume of datasets has to be processed and managed, also data in various applications come in a streaming way and deep learning approaches have to deal with this kind of applications. In this paper, the authors propose two novel approaches for discriminative deep learning, namely LS-DSN, and StreamDSN that are inspired from the deep stacking network algorithm. Two versions of the gradient descent algorithm were used to train the proposed algorithms. The experiment results have shown that the algorithms gave satisfying accuracy results and scale well when the size of data increases. In addition, StreamDSN algorithm have been applied to classify beats of ECG signals and provided good promising results.


2022 ◽  
pp. 245-261
Author(s):  
Emmanuel Wusuhon Yanibo Ayaburi ◽  
Michele Maasberg ◽  
Jaeung Lee

Organizations face both opportunities and risks with big data analytics vendors, and the risks are now profound, as data has been likened to the oil of the digital era. The growing body of research at the nexus of big data analytics and cloud computing is examined from the economic perspective, based on agency theory (AT). A conceptual framework is developed for analyzing these opportunities and challenges regarding the use of big data analytics and cloud computing in e-business environments. This framework allows organizations to engage in contracts that target competitive parity with their service-oriented decision support system (SODSS) to achieve a competitive advantage related to their core business model. A unique contribution of this paper is its perspective on how to engage a vendor contractually to achieve this competitive advantage. The framework provides insights for a manager in selecting a vendor for cloud-based big data services.


Sign in / Sign up

Export Citation Format

Share Document