Big Data-Based Smart Grid Data Management Model for Improved Monitoring of Power Consumption

2021 ◽  
pp. 615-624
Author(s):  
Doosetty Padmaja Kalala ◽  
P. Bhargavi
2021 ◽  
Vol 13 (23) ◽  
pp. 13322
Author(s):  
Vinoth Kumar Ponnusamy ◽  
Padmanathan Kasinathan ◽  
Rajvikram Madurai Elavarasan ◽  
Vinoth Ramanathan ◽  
Ranjith Kumar Anandan ◽  
...  

The role of energy is cardinal for achieving the Sustainable Development Goals (SDGs) through the enhancement and modernization of energy generation and management practices. The smart grid enables efficient communication between utilities and the end- users, and enhances the user experience by monitoring and controlling the energy transmission. The smart grid deals with an enormous amount of energy data, and the absence of proper techniques for data collection, processing, monitoring and decision-making ultimately makes the system ineffective. Big data analytics, in association with the smart grid, enable better grid visualization and contribute toward the attainment of sustainability. The current research work deals with the achievement of sustainability in the smart grid and efficient data management using big data analytics, that has social, economic, technical and political impacts. This study provides clear insights into energy data generated in the grid and the possibilities of energy theft affecting the sustainable future. The paper provides insights about the importance of big data analytics, with their effects on the smart grids’ performance towards the achievement of SDGs. The work highlights efficient real-time energy data management involving artificial intelligence and machine learning for a better future, to short out the effects of the conventional smart grid without big data analytics. Finally, the work discusses the challenges and future directions to improve smart grid technologies with big data analytics in action.


Energies ◽  
2019 ◽  
Vol 12 (17) ◽  
pp. 3310 ◽  
Author(s):  
Md. Nazmul Hasan ◽  
Rafia Nishat Toma ◽  
Abdullah-Al Nahid ◽  
M M Manjurul Islam ◽  
Jong-Myon Kim

Among an electricity provider’s non-technical losses, electricity theft has the most severe and dangerous effects. Fraudulent electricity consumption decreases the supply quality, increases generation load, causes legitimate consumers to pay excessive electricity bills, and affects the overall economy. The adaptation of smart grids can significantly reduce this loss through data analysis techniques. The smart grid infrastructure generates a massive amount of data, including the power consumption of individual users. Utilizing this data, machine learning and deep learning techniques can accurately identify electricity theft users. In this paper, an electricity theft detection system is proposed based on a combination of a convolutional neural network (CNN) and a long short-term memory (LSTM) architecture. CNN is a widely used technique that automates feature extraction and the classification process. Since the power consumption signature is time-series data, we were led to build a CNN-based LSTM (CNN-LSTM) model for smart grid data classification. In this work, a novel data pre-processing algorithm was also implemented to compute the missing instances in the dataset, based on the local values relative to the missing data point. Furthermore, in this dataset, the count of electricity theft users was relatively low, which could have made the model inefficient at identifying theft users. This class imbalance scenario was addressed through synthetic data generation. Finally, the results obtained indicate the proposed scheme can classify both the majority class (normal users) and the minority class (electricity theft users) with good accuracy.


2019 ◽  
Vol 6 (1) ◽  
Author(s):  
Mohammad Hasan Ansari ◽  
Vahid Tabatab Vakili ◽  
Behnam Bahrak

AbstractWith the rapid development of smart grids and increasing data collected in these networks, analyzing this massive data for applications such as marketing, cyber-security, and performance analysis, has gained popularity. This paper focuses on analysis and performance evaluation of big data frameworks that are proposed for handling smart grid data. Since obtaining large amounts of smart grid data is difficult due to privacy concerns, we propose and implement a large scale smart grid data generator to produce massive data under conditions similar to those in real smart grids. We use four open source big data frameworks namely Hadoop-Hbase, Cassandra, Elasticsearch, and MongoDB, in our implementation. Finally, we evaluate the performance of different frameworks on smart grid big data and present a performance benchmark that includes common data analysis techniques on smart grid data.


Complexity ◽  
2018 ◽  
Vol 2018 ◽  
pp. 1-21 ◽  
Author(s):  
Yuanjun Guo ◽  
Zhile Yang ◽  
Shengzhong Feng ◽  
Jinxing Hu

Efficient and valuable strategies provided by large amount of available data are urgently needed for a sustainable electricity system that includes smart grid technologies and very complex power system situations. Big Data technologies including Big Data management and utilization based on increasingly collected data from every component of the power grid are crucial for the successful deployment and monitoring of the system. This paper reviews the key technologies of Big Data management and intelligent machine learning methods for complex power systems. Based on a comprehensive study of power system and Big Data, several challenges are summarized to unlock the potential of Big Data technology in the application of smart grid. This paper proposed a modified and optimized structure of the Big Data processing platform according to the power data sources and different structures. Numerous open-sourced Big Data analytical tools and software are integrated as modules of the analytic engine, and self-developed advanced algorithms are also designed. The proposed framework comprises a data interface, a Big Data management, analytic engine as well as the applications, and display module. To fully investigate the proposed structure, three major applications are introduced: development of power grid topology and parallel computing using CIM files, high-efficiency load-shedding calculation, and power system transmission line tripping analysis using 3D visualization. The real-system cases demonstrate the effectiveness and great potential of the Big Data platform; therefore, data resources can achieve their full potential value for strategies and decision-making for smart grid. The proposed platform can provide a technical solution to the multidisciplinary cooperation of Big Data technology and smart grid monitoring.


Author(s):  
Kenneth C. Budka ◽  
Jayant G. Deshpande ◽  
Marina Thottan
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document