Real-Time Predictive Analytics, Big Data & Energy Market Efficiency: Key to Efficient Markets and Lower Prices for Consumers

2014 ◽  
Vol 704 ◽  
pp. 453-458 ◽  
Author(s):  
Benjamin Schmidt ◽  
Patrick Flannery ◽  
Mark DeSantis
Keyword(s):  
Big Data ◽  
Real Time ◽  
Data Science ◽  
Predictive Analytics ◽  
Energy Market ◽  
Optimal Pricing ◽  
Energy Data ◽  
Main Challenge ◽  
The Us ◽  
Big Data Technologies

The combination of evolving deregulation of the US and EU energy markets together with recent advances in data analytics and so called 'Big Data' technologies now offers an unprecedented opportunity for optimal real-time energy pricing for buyers and sellers alike. The main challenge to date for optimal pricing has been optimal real-time bidding and variety of traditional data analysis tools have been applied to this challenge. Yet inefficiencies remain due to the volatile nature of the real-time market. Energy data science is the best solution to protect consumers against the electricity market's inefficiencies. This field is the meeting point between computer programming, machine learning, big data, quantitative analysis and economics. Energy data science is used to help the consumer predict what price they should offer to buy at each hour and closes gaps in the electric markets.

Advanced Threat Detection Based on Big Data Technologies

2018 ◽  
pp. 1-19
Author(s):  
Madhvaraj M. Shetty ◽  
Manjaiah D. H.
Keyword(s):  
Big Data ◽  
Deep Learning ◽  
Data Analytics ◽  
Data Science ◽  
Predictive Analytics ◽  
Big Data Analytics ◽  
Threat Detection ◽  
Cyber Threats ◽  
Threat Intelligence ◽  
Big Data Technologies

Today constant increase in number of cyber threats apparently shows that current countermeasures are not enough to defend it. With the help of huge generated data, big data brings transformative potential for various sectors. While many are using it for better operations, some of them are noticing that it can also be used for security by providing broader view of vulnerabilities and risks. Meanwhile, deep learning is coming up as a key role by providing predictive analytics solutions. Deep learning and big data analytics are becoming two high-focus of data science. Threat intelligence becoming more and more effective. Since it is based on how much data collected about active threats, this reason has taken many independent vendors into partnerships. In this chapter, we explore big data and big data analytics with its benefits. And we provide a brief overview of deep analytics and finally we present collaborative threat Detection. We also investigate some aspects of standards and key functions of it. We conclude by presenting benefits and challenges of collaborative threat detection.

Advanced Threat Detection Based on Big Data Technologies

2020 ◽  
pp. 808-822
Author(s):  
Madhvaraj M. Shetty ◽  
Manjaiah D. H.
Keyword(s):  
Big Data ◽  
Deep Learning ◽  
Data Analytics ◽  
Data Science ◽  
Predictive Analytics ◽  
Big Data Analytics ◽  
Threat Detection ◽  
Cyber Threats ◽  
Threat Intelligence ◽  
Big Data Technologies

Today constant increase in number of cyber threats apparently shows that current countermeasures are not enough to defend it. With the help of huge generated data, big data brings transformative potential for various sectors. While many are using it for better operations, some of them are noticing that it can also be used for security by providing broader view of vulnerabilities and risks. Meanwhile, deep learning is coming up as a key role by providing predictive analytics solutions. Deep learning and big data analytics are becoming two high-focus of data science. Threat intelligence becoming more and more effective. Since it is based on how much data collected about active threats, this reason has taken many independent vendors into partnerships. In this chapter, we explore big data and big data analytics with its benefits. And we provide a brief overview of deep analytics and finally we present collaborative threat Detection. We also investigate some aspects of standards and key functions of it. We conclude by presenting benefits and challenges of collaborative threat detection.

scholarly journals Big Data Usage Patterns in the Health Care Domain: A Use Case Driven Approach Applied to the Assessment of Vaccination Benefits and Risks

2014 ◽  
Vol 23 (01) ◽  
pp. 27-35 ◽  
Author(s):  
S. de Lusignan ◽  
S-T. Liaw ◽  
C. Kuziemsky ◽  
F. Mold ◽  
P. Krause ◽  
...  
Keyword(s):  
Big Data ◽  
Data Processing ◽  
Real Time ◽  
Predictive Analytics ◽  
Regulatory Compliance ◽  
Use Cases ◽  
Data Sources ◽  
Use Case ◽  
Crowd Sourcing ◽  
Big Data Processing

Summary Background: Generally benefits and risks of vaccines can be determined from studies carried out as part of regulatory compliance, followed by surveillance of routine data; however there are some rarer and more long term events that require new methods. Big data generated by increasingly affordable personalised computing, and from pervasive computing devices is rapidly growing and low cost, high volume, cloud computing makes the processing of these data inexpensive. Objective: To describe how big data and related analytical methods might be applied to assess the benefits and risks of vaccines. Method: We reviewed the literature on the use of big data to improve health, applied to generic vaccine use cases, that illustrate benefits and risks of vaccination. We defined a use case as the interaction between a user and an information system to achieve a goal. We used flu vaccination and pre-school childhood immunisation as exemplars. Results: We reviewed three big data use cases relevant to assessing vaccine benefits and risks: (i) Big data processing using crowd-sourcing, distributed big data processing, and predictive analytics, (ii) Data integration from heterogeneous big data sources, e.g. the increasing range of devices in the “internet of things”, and (iii) Real-time monitoring for the direct monitoring of epidemics as well as vaccine effects via social media and other data sources. Conclusions: Big data raises new ethical dilemmas, though its analysis methods can bring complementary real-time capabilities for monitoring epidemics and assessing vaccine benefit-risk balance.

Big-Data-Based Techniques for Predictive Intelligence

2019 ◽  
pp. 1-18
Author(s):  
Dharmpal Singh ◽  
Madhusmita Mishra ◽  
Sudipta Sahana
Keyword(s):  
Big Data ◽  
Competitive Advantage ◽  
Predictive Analytics ◽  
Unstructured Data ◽  
Security Issue ◽  
Operational Costs ◽  
Big Data Technologies ◽  
Ending Process ◽  
Big Data Technology

Big-data-analyzed finding patterns derive meaning and make decisions on data to produce responses to the world with intelligence. It is an emerging area used in business intelligence (BI) for competitive advantage to analyze the structured, semi-structured, and unstructured data stored in different formats. As the big data technology continues to evolve, businesses are turning to predictive intelligence to deepen the engagement to customers with optimization in processes to reduce the operational costs. Predictive intelligence uses sets of advanced technologies that enable organizations to use data stored in real time that move from a historical and descriptive view to a forward-looking perspective of data. The comparison and other security issue of this technology is covered in this book chapter. The combination of big data technology and predictive analytics is sometimes referred to as a never-ending process and has the possibility to deliver significant competitive advantage. This chapter provides an extensive review of literature on big data technologies and its usage in the predictive intelligence.

scholarly journals Personalization as a promise: Can Big Data change the practice of insurance?

2020 ◽  
Vol 7 (1) ◽  
pp. 205395172093514 ◽  
Author(s):  
Laurence Barry ◽  
Arthur Charpentier
Keyword(s):  
Big Data ◽  
Predictive Analytics ◽  
Special Focus ◽  
New Paradigm ◽  
Individual Level ◽  
Big Data Technologies ◽  
State Of Research ◽  
The Individual ◽  
Homogeneity Hypothesis ◽  
The Impact

The aim of this article is to assess the impact of Big Data technologies for insurance ratemaking, with a special focus on motor products.The first part shows how statistics and insurance mechanisms adopted the same aggregate viewpoint. It made visible regularities that were invisible at the individual level, further supporting the classificatory approach of insurance and the assumption that all members of a class are identical risks. The second part focuses on the reversal of perspective currently occurring in data analysis with predictive analytics, and how this conceptually contradicts the collective basis of insurance. The tremendous volume of data and the personalization promise through accurate individual prediction indeed deeply shakes the homogeneity hypothesis behind pooling. The third part attempts to assess the extent of this shift in motor insurance. Onboard devices that collect continuous driving behavioural data could import this new paradigm into these products. An examination of the current state of research on models with telematics data shows however that the epistemological leap, for now, has not happened.

Big Data Analytics Framework for Real-Time Genome Analysis: A Comprehensive Approach

2019 ◽  
Vol 16 (8) ◽  
pp. 3419-3427
Author(s):  
Shishir K. Shandilya ◽  
S. Sountharrajan ◽  
Smita Shandilya ◽  
E. Suganya
Keyword(s):  
Big Data ◽  
Real Time ◽  
Genome Analysis ◽  
High Speed ◽  
High Performance ◽  
Big Data Analytics ◽  
Good Precision ◽  
Entire Genome ◽  
Big Data Technologies ◽  
Sequencing Platforms

Big Data Technologies are well-accepted in the recent years in bio-medical and genome informatics. They are capable to process gigantic and heterogeneous genome information with good precision and recall. With the quick advancements in computation and storage technologies, the cost of acquiring and processing the genomic data has decreased significantly. The upcoming sequencing platforms will produce vast amount of data, which will imperatively require high-performance systems for on-demand analysis with time-bound efficiency. Recent bio-informatics tools are capable of utilizing the novel features of Hadoop in a more flexible way. In particular, big data technologies such as MapReduce and Hive are able to provide high-speed computational environment for the analysis of petabyte scale datasets. This has attracted the focus of bio-scientists to use the big data applications to automate the entire genome analysis. The proposed framework is designed over MapReduce and Java on extended Hadoop platform to achieve the parallelism of Big Data Analysis. It will assist the bioinformatics community by providing a comprehensive solution for Descriptive, Comparative, Exploratory, Inferential, Predictive and Causal Analysis on Genome data. The proposed framework is user-friendly, fully-customizable, scalable and fit for comprehensive real-time genome analysis from data acquisition till predictive sequence analysis.

scholarly journals THE IMPACT OF BIG DATA TECHNOLOGIES ON COMPETITIVE ADVANTAGE OF COMPANIES

2017 ◽  
pp. 255 ◽  
Author(s):  
Jelena Lukić
Keyword(s):  
Big Data ◽  
Competitive Advantage ◽  
Real Time ◽  
New Technologies ◽  
Knowledge And Skills ◽  
Big Data Technologies ◽  
The Impact

The emergence of large quantity of data, from various sources, available in real-time, known as Big Data, have stimulated development of new technologies, techniques, tools, knowledge and skills which allows to work with that data. Big Data represent not only the factor from environment that confronts the companies with avalanche of data, but also very imporant resource which provide opportunities for companies to make value on the basis of collected data. Characteristics and possibilities which Big Data technologies offer have positioned them as a valuable factor for gaining and sustaining the competitive advantage in companies. The aim of this paper is to examine how Big Data technologies impact on competitive advantage of the companies that use them.

scholarly journals DATA SCIENCE, BIG DATA, AND PREDICTIVE ANALYTICS: A PLATFORM FOR CYBERSPACE SECURITY INTELLIGENCE

2017 ◽  
Vol 7 (2) ◽  
Author(s):  
Dicky R. M. Nainggolan
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
Cyber Security ◽  
High Speed ◽  
Data Science ◽  
Predictive Analytics ◽  
Cyber Attacks ◽  
Artificial Intelligence Technology ◽  
Science Methodology ◽  
Cyberspace Security

<p><em><strong>Abstract</strong> – Data are the prominent elements in scientific researches and approaches. Data Science methodology is used to select and to prepare enormous numbers of data for further processing and analysing. Big Data technology collects vast amount of data from many sources in order to exploit the information and to visualise trend or to discover a certain phenomenon in the past, present, or in the future at high speed processing capability. Predictive analytics provides in-depth analytical insights and the emerging of machine learning brings the data analytics to a higher level by processing raw data with artificial intelligence technology. Predictive analytics and machine learning produce visual reports for decision makers and stake-holders. Regarding cyberspace security, big data promises the opportunities in order to prevent and to detect any advanced cyber-attacks by using internal and external security data.</em></p><p><br /><em><strong>Keywords</strong>: Big Data, Cyber Security, Data Science, Intelligence, Predictive Analytics</em></p><p><br /><em><strong>Abstrak</strong> – Data merupakan unsur terpenting dalam setiap penelitian dan pendekatan ilmiah. Metodologi sains data digunakan untuk memilah, memilih dan mempersiapkan sejumlah data untuk diproses dan dianalisis. Teknologi big data mampu mengumpulkan data dengan sangat banyak dari berbagai sumber dengan tujuan untuk mendapatkan informasi dengan visualisasi tren atau menyingkapkan pengetahuan dari suatu peristiwa yang terjadi baik dimasa lalu, sekarang, maupun akan datang dengan kecepatan pemrosesan data sangat tinggi. Analisis prediktif memberikan wawasan analisis lebih dalam dan kemunculan machine learning membawa analisis data ke tingkat yang lebih tinggi dengan bantuan teknologi kecerdasan buatan dalam tahap pemrosesan data mentah. Analisis prediktif dan machine learning menghasilkan laporan berbentuk visual untuk pengambil keputusan dan pemangku kepentingan. Berkenaan dengan keamanan siber, big data menjanjikan kesempatan dalam rangka untuk mencegah dan mendeteksi setiap serangan canggih siber dengan memanfaatkan data keamanan internal dan eksternal.</em></p><p><br /><strong>Kata Kunci</strong>: Analisis Prediktif, Big Data, Intelijen, Keamanan Siber, Sains Data</p>

scholarly journals SAINS DATA, BIG DATA, DAN ANALISIS PREDIKTIF: SEBUAH LANDASAN UNTUK KECERDASAN KEAMANAN SIBER

2017 ◽  
Vol 7 (2) ◽  
Author(s):  
Dicky R. M. Nainggolan
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
Cyber Security ◽  
High Speed ◽  
Data Science ◽  
Predictive Analytics ◽  
Cyber Attacks ◽  
Artificial Intelligence Technology ◽  
Science Methodology ◽  
Many Sources

<p><strong>Abstrak</strong> – Data merupakan unsur terpenting dalam setiap penelitian dan pendekatan ilmiah. Metodologi sains data digunakan untuk memilah, memilih dan mempersiapkan sejumlah data untuk diproses dan dianalisis. Teknologi big data mampu mengumpulkan data dengan sangat banyak dari berbagai sumber dengan tujuan untuk mendapatkan informasi dengan visualisasi tren atau menyingkapkan pengetahuan dari suatu peristiwa yang terjadi baik dimasa lalu, sekarang, maupun akan datang dengan kecepatan pemrosesan data sangat tinggi. Analisis prediktif memberikan wawasan analisis lebih dalam dan kemunculan machine learning membawa analisis data ke tingkat yang lebih tinggi dengan bantuan teknologi kecerdasan buatan dalam tahap pemrosesan data mentah. Analisis prediktif dan machine learning menghasilkan laporan berbentuk visual untuk pengambil keputusan dan pemangku kepentingan. Berkenaan dengan keamanan siber, big data menjanjikan kesempatan dalam rangka untuk mencegah dan mendeteksi setiap serangan canggih siber dengan memanfaatkan data keamanan internal dan eksternal.</p><p><br /><strong>Kata Kunci</strong>: analisis prediktif, big data, intelijen, keamanan siber, sains data</p><p><strong><em>Abstract</em> </strong>– Data are the prominent elements in scientific researches and approaches. Data Science methodology is used to select and to prepare enormous numbers of data for further processing and analysing. Big Data technology collects vast amount of data from many sources in order to exploit the information and to visualise trend or to discover a certain phenomenon in the past, present, or in the future at high speed processing capability. Predictive analytics provides in-depth analytical insights and the emerging of machine learning brings the data analytics to a higher level by processing raw data with artificial intelligence technology. Predictive analytics and machine learning produce visual reports for decision makers and stake-holders. Regarding cyberspace security, big data promises the opportunities in order to prevent and to detect any advanced cyber-attacks by using internal and external security data.</p><p><br /><strong><em>Keywords</em></strong>: big data, cyber security, data science, intelligence, predictive analytics</p>

Sign in / Sign up

Export Citation Format

Share Document