scholarly journals Interrelated Patterns of Electricity, Gas, and Water Consumption in Large-Scale Buildings

2020 ◽  
Author(s):  
Ali Movahedi ◽  
Sybil Derrible
Keyword(s):  
New York ◽  
Water Consumption ◽  
Large Scale ◽  
Electricity Consumption ◽  
Gradient Boosting ◽  
Effective Strategies ◽  
Extreme Gradient Boosting ◽  
Gas Consumption ◽  
Local Law ◽  
Key Resources

As cities keep growing worldwide, so does the demand for key resources such as energy (electricity and gas) and water that residents consume. Meeting the demand for these resources can be challenging and requires an understanding of their consumptions patterns. In this work, we apply XGBoost (Extreme Gradient Boosting) to predict and analyze water and energy consumption in large-scale buildings in New York City. For this, the New York City’s local law 84 extensive dataset was merged with the Primary Land Use Tax Lot Output (PLUTO) dataset as well as with other socio-economic databases. Specifically, we developed three models: electricity, gas, and water consumption. Seven major lessons were learnt in terms of interrelationships between electricity, gas, and water consumption. In particular, water and gas consumption are highly interrelated with one another (often because gas is used for water heating). Furthermore, electricity consumption is affected by building type, and electricity and water consumption are particularly interrelated in nonresidential buildings. Overall, the knowledge gained from the models and from the SHAP analysis can help planners, engineers, and policymakers develop more effective strategies and help them manage the demand for energy and water in large-scale buildings.

scholarly journals Experimental Analysis of GBM to Expand the Time Horizon of Irish Electricity Price Forecasts

Energies ◽  
2021 ◽  
Vol 14 (22) ◽  
pp. 7587
Author(s):  
Conor Lynch ◽  
Christian O’Leary ◽  
Preetham Govind Kolar Sundareshan ◽  
Yavuz Akin
Keyword(s):  
Electricity Market ◽  
Electricity Consumption ◽  
Cost Effective ◽  
Absolute Error ◽  
Electricity Price ◽  
Gradient Boosting ◽  
Avant Garde ◽  
Electricity Price Forecasting ◽  
Gradient Boosting Machine ◽  
Extreme Gradient Boosting

In response to the inherent challenges of generating cost-effective electricity consumption schedules for dynamic systems, this paper espouses the use of GBM or Gradient Boosting Machine-based models for electricity price forecasting. These models are applied to data streams from the Irish electricity market and achieve favorable results, relative to the current state-of-the-art. Presently, electricity prices are published 10 h in advance of the trade day of interest. Using the forecasting methodology outlined in this paper, an estimation of these prices can be made available one day in advance of the official price publication, thus extending the time available to plan electricity utilization from the grid to be as cost effectively as possible. Extreme Gradient Boosting Machine (XGBM) models achieved a Mean Absolute Error (MAE) of 9.93 for data from 30 September 2018 to 12 December 2019 which is an 11.4% improvement on the avant-garde. LGBM models achieve a MAE score 9.58 on more recent data: the full year of 2020.

scholarly journals High-Resolution Vegetation Mapping Using eXtreme Gradient Boosting Based on Extensive Features

2019 ◽  
Vol 11 (12) ◽  
pp. 1505 ◽  
Author(s):  
Heng Zhang ◽  
Anwar Eziz ◽  
Jian Xiao ◽  
Shengli Tao ◽  
Shaopeng Wang ◽  
...  
Keyword(s):  
New Zealand ◽  
High Resolution ◽  
Large Scale ◽  
Field Survey ◽  
Terrestrial Ecosystems ◽  
Google Earth ◽  
Gradient Boosting ◽  
Global Changes ◽  
Vegetation Map ◽  
Extreme Gradient Boosting

Accurate mapping of vegetation is a premise for conserving, managing, and sustainably using vegetation resources, especially in conditions of intensive human activities and accelerating global changes. However, it is still challenging to produce high-resolution multiclass vegetation map in high accuracy, due to the incapacity of traditional mapping techniques in distinguishing mosaic vegetation classes with subtle differences and the paucity of fieldwork data. This study created a workflow by adopting a promising classifier, extreme gradient boosting (XGBoost), to produce accurate vegetation maps of two strikingly different cases (the Dzungarian Basin in China and New Zealand) based on extensive features and abundant vegetation data. For the Dzungarian Basin, a vegetation map with seven vegetation types, 17 subtypes, and 43 associations was produced with an overall accuracy of 0.907, 0.801, and 0.748, respectively. For New Zealand, a map of 10 habitats and a map of 41 vegetation classes were produced with 0.946, and 0.703 overall accuracy, respectively. The workflow incorporating simplified field survey procedures outperformed conventional field survey and remote sensing based methods in terms of accuracy and efficiency. In addition, it opens a possibility of building large-scale, high-resolution, and timely vegetation monitoring platforms for most terrestrial ecosystems worldwide with the aid of Google Earth Engine and citizen science programs.

scholarly journals Prediction of hot spots in protein–DNA binding interfaces based on supervised isometric feature mapping and extreme gradient boosting

2020 ◽  
Vol 21 (S13) ◽  
Author(s):  
Ke Li ◽  
Sijia Zhang ◽  
Di Yan ◽  
Yannan Bin ◽  
Junfeng Xia
Keyword(s):  
Feature Selection ◽  
Manifold Learning ◽  
Hot Spots ◽  
Large Scale ◽  
Computational Method ◽  
Gradient Boosting ◽  
Feature Mapping ◽  
Accessible Information ◽  
Extreme Gradient Boosting ◽  
Isometric Feature Mapping

Abstract Background Identification of hot spots in protein-DNA interfaces provides crucial information for the research on protein-DNA interaction and drug design. As experimental methods for determining hot spots are time-consuming, labor-intensive and expensive, there is a need for developing reliable computational method to predict hot spots on a large scale. Results Here, we proposed a new method named sxPDH based on supervised isometric feature mapping (S-ISOMAP) and extreme gradient boosting (XGBoost) to predict hot spots in protein-DNA complexes. We obtained 114 features from a combination of the protein sequence, structure, network and solvent accessible information, and systematically assessed various feature selection methods and feature dimensionality reduction methods based on manifold learning. The results show that the S-ISOMAP method is superior to other feature selection or manifold learning methods. XGBoost was then used to develop hot spots prediction model sxPDH based on the three dimensionality-reduced features obtained from S-ISOMAP. Conclusion Our method sxPDH boosts prediction performance using S-ISOMAP and XGBoost. The AUC of the model is 0.773, and the F1 score is 0.713. Experimental results on benchmark dataset indicate that sxPDH can achieve generally better performance in predicting hot spots compared to the state-of-the-art methods.

scholarly journals Identification of Potential Type II Diabetes in a Large-Scale Chinese Population Using a Systematic Machine Learning Framework

2020 ◽  
Vol 2020 ◽  
pp. 1-12
Author(s):  
Mingyue Xue ◽  
Yinxia Su ◽  
Chen Li ◽  
Shuxia Wang ◽  
Hua Yao
Keyword(s):  
Machine Learning ◽  
Risk Factors ◽  
Decision Tree ◽  
Type Ii Diabetes ◽  
Large Scale ◽  
Systolic Pressure ◽  
Gradient Boosting ◽  
Significant Feature ◽  
Type Ii ◽  
Extreme Gradient Boosting

Background. An estimated 425 million people globally have diabetes, accounting for 12% of the world’s health expenditures, and the number continues to grow, placing a huge burden on the healthcare system, especially in those remote, underserved areas. Methods. A total of 584,168 adult subjects who have participated in the national physical examination were enrolled in this study. The risk factors for type II diabetes mellitus (T2DM) were identified by p values and odds ratio, using logistic regression (LR) based on variables of physical measurement and a questionnaire. Combined with the risk factors selected by LR, we used a decision tree, a random forest, AdaBoost with a decision tree (AdaBoost), and an extreme gradient boosting decision tree (XGBoost) to identify individuals with T2DM, compared the performance of the four machine learning classifiers, and used the best-performing classifier to output the degree of variables’ importance scores of T2DM. Results. The results indicated that XGBoost had the best performance (accuracy=0.906, precision=0.910, recall=0.902, F‐1=0.906, and AUC=0.968). The degree of variables’ importance scores in XGBoost showed that BMI was the most significant feature, followed by age, waist circumference, systolic pressure, ethnicity, smoking amount, fatty liver, hypertension, physical activity, drinking status, dietary ratio (meat to vegetables), drink amount, smoking status, and diet habit (oil loving). Conclusions. We proposed a classifier based on LR-XGBoost which used fourteen variables of patients which are easily obtained and noninvasive as predictor variables to identify potential incidents of T2DM. The classifier can accurately screen the risk of diabetes in the early phrase, and the degree of variables’ importance scores gives a clue to prevent diabetes occurrence.

Forecasting sub-resolution temporal variability of irradiance

2020 ◽  
Author(s):  
Frank Kreuwel ◽  
Chiel van Heerwaarden
Keyword(s):  
Large Scale ◽  
Point Of View ◽  
Surface Radiation ◽  
Gradient Boosting ◽  
Distribution Grid ◽  
Electricity Grid ◽  
Pv Systems ◽  
Extreme Gradient Boosting ◽  
Scale Integration ◽  
Meso Scale

<p>Variability of solar irradiance is an important factor concerning large-scale integration of solar photovoltaics (PV) systems onto the electricity grid. Calculations of irradiance are computationally expensive, leaving operational meso-scale forecasting models struggling to achieve accurate results. Moreover, such models deliver outputs at a temporal resolution in the order of hours, whereas from a grid-integration point of view, minute-to-minute variability is a major concern. In previous work, we found that absolute power peaks in the order of seconds are up to 18% higher compared to 15-minute resolution for irradiance and even upwards of 22% higher for household PV systems. Moreover, these maximum peaks in output power are solely observed under mixed-cloud conditions, for which alse the greatest variability is found. In this work we present a machine-learning model which can forecast sub-resolution variability of irradiance, based on standard meso-scale outputs of the HARMONIE model of the The Royal Netherlands Meteorological Institute (KNMI). For training and validation, irradiance measurements obtained at a 1-second interval are used of the Baseline Surface Radiation Network (BSRN) site of Cabauw. A tree-based model was employed, for which the optimum members were constructed using extreme gradient boosting. In this work, we explore the dominant features of the model and link the machine-learned-relations to meteorological processes and dynamics. This research was executed in collaboration with the Distribution Grid Operator Alliander.</p>

scholarly journals Gully Erosion Susceptibility Mapping in Highly Complex Terrain Using Machine Learning Models

2021 ◽  
Vol 10 (10) ◽  
pp. 680
Author(s):  
Annan Yang ◽  
Chunmei Wang ◽  
Guowei Pang ◽  
Yongqing Long ◽  
Lei Wang ◽  
...  
Keyword(s):  
Machine Learning ◽  
Complex Terrain ◽  
Large Scale ◽  
Area Under The Curve ◽  
Gully Erosion ◽  
Susceptibility Mapping ◽  
Weight Of Evidence ◽  
Gradient Boosting ◽  
Machine Learning Classification ◽  
Extreme Gradient Boosting

Gully erosion is the most severe type of water erosion and is a major land degradation process. Gully erosion susceptibility mapping (GESM)’s efficiency and interpretability remains a challenge, especially in complex terrain areas. In this study, a WoE-MLC model was used to solve the above problem, which combines machine learning classification algorithms and the statistical weight of evidence (WoE) model in the Loess Plateau. The three machine learning (ML) algorithms utilized in this research were random forest (RF), gradient boosted decision trees (GBDT), and extreme gradient boosting (XGBoost). The results showed that: (1) GESM were well predicted by combining both machine learning regression models and WoE-MLC models, with the area under the curve (AUC) values both greater than 0.92, and the latter was more computationally efficient and interpretable; (2) The XGBoost algorithm was more efficient in GESM than the other two algorithms, with the strongest generalization ability and best performance in avoiding overfitting (averaged AUC = 0.947), followed by the RF algorithm (averaged AUC = 0.944), and GBDT algorithm (averaged AUC = 0.938); and (3) slope gradient, land use, and altitude were the main factors for GESM. This study may provide a possible method for gully erosion susceptibility mapping at large scale.

scholarly journals HyP-ABC: A Novel Automated Hyper-Parameter Tuning Algorithm Using Evolutionary Optimization

2021 ◽  
Author(s):  
Leila Zahedi ◽  
Farid Ghareh Mohammadi ◽  
M. Hadi Amini
Keyword(s):  
Real World ◽  
Large Scale ◽  
Convergence Rates ◽  
Parameter Tuning ◽  
Population Based ◽  
Machine Learning Techniques ◽  
Gradient Boosting ◽  
Support Vector ◽  
Wide Range ◽  
Extreme Gradient Boosting

<p>Machine learning techniques lend themselves as promising decision-making and analytic tools in a wide range of applications. Different ML algorithms have various hyper-parameters. In order to tailor an ML model towards a specific application working at its best, its hyper-parameters should be tuned. Tuning the hyper-parameters directly affects the performance. However, for large-scale search spaces, efficiently exploring the ample number of combinations of hyper-parameters is computationally expensive. Many of the automated hyper-parameter tuning techniques suffer from low convergence rates and high experimental time complexities. In this paper, we propose HyP-ABC, an automatic innovative hybrid hyper-parameter optimization algorithm using the modified artificial bee colony approach, to measure the classification accuracy of three ML algorithms: random forest, extreme gradient boosting, and support vector machine. In order to ensure the robustness of the proposed method, the algorithm takes a wide range of feasible hyper-parameter values and is tested using a real-world educational dataset. Experimental results show that HyP-ABC is competitive with state-of-the-art techniques. Also, it has fewer hyper-parameters to be tuned than other population-based algorithms, making it worthwhile for real-world HPO problems.</p>

scholarly journals Predicting Hard Rock Pillar Stability Using GBDT, XGBoost, and LightGBM Algorithms

Mathematics ◽  
2020 ◽  
Vol 8 (5) ◽  
pp. 765 ◽  
Author(s):  
Weizhang Liang ◽  
Suizhi Luo ◽  
Guoyan Zhao ◽  
Hao Wu
Keyword(s):  
Large Scale ◽  
Prediction Models ◽  
Hard Rock ◽  
Gradient Boosting ◽  
Pillar Stability ◽  
Rock Pillar ◽  
Light Gradient ◽  
Gradient Boosting Machine ◽  
Extreme Gradient Boosting ◽  
Hard Rock Mines

Predicting pillar stability is a vital task in hard rock mines as pillar instability can cause large-scale collapse hazards. However, it is challenging because the pillar stability is affected by many factors. With the accumulation of pillar stability cases, machine learning (ML) has shown great potential to predict pillar stability. This study aims to predict hard rock pillar stability using gradient boosting decision tree (GBDT), extreme gradient boosting (XGBoost), and light gradient boosting machine (LightGBM) algorithms. First, 236 cases with five indicators were collected from seven hard rock mines. Afterwards, the hyperparameters of each model were tuned using a five-fold cross validation (CV) approach. Based on the optimal hyperparameters configuration, prediction models were constructed using training set (70% of the data). Finally, the test set (30% of the data) was adopted to evaluate the performance of each model. The precision, recall, and F1 indexes were utilized to analyze prediction results of each level, and the accuracy and their macro average values were used to assess the overall prediction performance. Based on the sensitivity analysis of indicators, the relative importance of each indicator was obtained. In addition, the safety factor approach and other ML algorithms were adopted as comparisons. The results showed that GBDT, XGBoost, and LightGBM algorithms achieved a better comprehensive performance, and their prediction accuracies were 0.8310, 0.8310, and 0.8169, respectively. The average pillar stress and ratio of pillar width to pillar height had the most important influences on prediction results. The proposed methodology can provide a reliable reference for pillar design and stability risk management.

scholarly journals IoT Botnet Attack Detection Based on Optimized Extreme Gradient Boosting and Feature Selection

Sensors ◽  
2020 ◽  
Vol 20 (21) ◽  
pp. 6336 ◽  
Author(s):  
Mnahi Alqahtani ◽  
Hassan Mathkour ◽  
Mohamed Maher Ben Ismail
Keyword(s):  
Feature Selection ◽  
Large Scale ◽  
Feature Selection Method ◽  
Selection Method ◽  
Attack Detection ◽  
Gradient Boosting ◽  
Fisher Score ◽  
Detection Approach ◽  
Extreme Gradient Boosting ◽  
Iot Devices

Nowadays, Internet of Things (IoT) technology has various network applications and has attracted the interest of many research and industrial communities. Particularly, the number of vulnerable or unprotected IoT devices has drastically increased, along with the amount of suspicious activity, such as IoT botnet and large-scale cyber-attacks. In order to address this security issue, researchers have deployed machine and deep learning methods to detect attacks targeting compromised IoT devices. Despite these efforts, developing an efficient and effective attack detection approach for resource-constrained IoT devices remains a challenging task for the security research community. In this paper, we propose an efficient and effective IoT botnet attack detection approach. The proposed approach relies on a Fisher-score-based feature selection method along with a genetic-based extreme gradient boosting (GXGBoost) model in order to determine the most relevant features and to detect IoT botnet attacks. The Fisher score is a representative filter-based feature selection method used to determine significant features and discard irrelevant features through the minimization of intra-class distance and the maximization of inter-class distance. On the other hand, GXGBoost is an optimal and effective model, used to classify the IoT botnet attacks. Several experiments were conducted on a public botnet dataset of IoT devices. The evaluation results obtained using holdout and 10-fold cross-validation techniques showed that the proposed approach had a high detection rate using only three out of the 115 data traffic features and improved the overall performance of the IoT botnet attack detection process.

scholarly journals Comparison of Machine-Learning Algorithms for Near-Surface Air-Temperature Estimation from FY-4A AGRI Data

2020 ◽  
Vol 2020 ◽  
pp. 1-14
Author(s):  
Ke Zhou ◽  
Hailei Liu ◽  
Xiaobo Deng ◽  
Hao Wang ◽  
Shenglan Zhang
Keyword(s):  
Machine Learning ◽  
Air Temperature ◽  
Large Scale ◽  
Weather Prediction ◽  
Surface Air Temperature ◽  
Machine Learning Algorithms ◽  
Gradient Boosting ◽  
Temporal And Spatial Distribution ◽  
Near Surface ◽  
Extreme Gradient Boosting

Six machine-learning approaches, including multivariate linear regression (MLR), gradient boosting decision tree, k-nearest neighbors, random forest, extreme gradient boosting (XGB), and deep neural network (DNN), were compared for near-surface air-temperature (Tair) estimation from the new generation of Chinese geostationary meteorological satellite Fengyun-4A (FY-4A) observations. The brightness temperatures in split-window channels from the Advanced Geostationary Radiation Imager (AGRI) of FY-4A and numerical weather prediction data from the global forecast system were used as the predictor variables for Tair estimation. The performance of each model and the temporal and spatial distribution of the estimated Tair errors were analyzed. The results showed that the XGB model had better overall performance, with R2 of 0.902, bias of −0.087°C, and root-mean-square error of 1.946°C. The spatial variation characteristics of the Tair error of the XGB method were less obvious than those of the other methods. The XGB model can provide more stable and high-precision Tair for a large-scale Tair estimation over China and can serve as a reference for Tair estimation based on machine-learning models.

Sign in / Sign up

Export Citation Format

Share Document