scholarly journals Deep Reinforcement Learning for Autonomous Water Heater Control

Buildings ◽  
2021 ◽  
Vol 11 (11) ◽  
pp. 548
Author(s):  
Kadir Amasyali ◽  
Jeffrey Munk ◽  
Kuldeep Kurte ◽  
Teja Kuruganti ◽  
Helia Zandi

Electric water heaters represent 14% of the electricity consumption in residential buildings. An average household in the United States (U.S.) spends about USD 400–600 (0.45 ¢/L–0.68 ¢/L) on water heating every year. In this context, water heaters are often considered as a valuable asset for Demand Response (DR) and building energy management system (BEMS) applications. To this end, this study proposes a model-free deep reinforcement learning (RL) approach that aims to minimize the electricity cost of a water heater under a time-of-use (TOU) electricity pricing policy by only using standard DR commands. In this approach, a set of RL agents, with different look ahead periods, were trained using the deep Q-networks (DQN) algorithm and their performance was tested on an unseen pair of price and hot water usage profiles. The testing results showed that the RL agents can help save electricity cost in the range of 19% to 35% compared to the baseline operation without causing any discomfort to end users. Additionally, the RL agents outperformed rule-based and model predictive control (MPC)-based controllers and achieved comparable performance to optimization-based control.

2021 ◽  
Vol 13 (23) ◽  
pp. 13040
Author(s):  
Brent B. Skabelund ◽  
Joseph Elio ◽  
Ryan J. Milcarek

Combined heat and power (CHP) systems with an integrated solid oxide fuel cell (SOFC) is a promising technology to increase overall efficiency of traditional residential combustion systems. One potential system is gas tank hot water heaters where partial oxidation of the fuel serves as a means of fuel reforming for SOFCs while producing thermal energy for heating water. In this study, a residential hybrid gas tank hot water heater with an integrated SOFC model was developed and a thorough techno-economic analysis was performed. Fuel-rich combustion characterization was performed at equivalence ratios 1.1 to 1.6 to assess synthesis gas production for the SOFC. The effect of fuel utilization and operating voltage of the model SOFC stack were analyzed to provide an in-depth characterization of the potential of the system. CHP and electrical efficiencies over >90% and >16% were achieved, respectively. The techno-economic analysis considers the four major census regions of the United States to evaluate regional savings based on respective utility costs and hot water demand. The results show the hybrid system is economically feasible for replacement of an electrical water heater with the longest payback period being approximately six years.


2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Mehdi Jahangiri ◽  
Esther T. Akinlabi ◽  
Sam M. Sichilalu

Solar water heaters (SWHs) are one of the most effective plans for general and easy use of solar energy to supply hot water in domestic and industrial sectors. This paper gives the first-ever attempts to assess the optimal localization of SWHs across 22 major cities in Zambia, as well as determine the possibility of hot water generation and model the greenhouse gas (GHG) emission saving. The climate data used is extracted by using the MeteoSyn software which is modeled in TSOL™. Results show the high potential of GHG emission reduction due to nonconsumption of fossil fuels owing to the deployment of SWHs, and three cities Kabwe, Chipata, and Mbala had the highest GHG mitigation by 1552.97 kg/y, 1394.8 kg/y, and 1321.39 kg/y, respectively. On average, SWHs provide 62.47% of space heating and 96.05% of the sanitary hot water requirement of consumers. The findings have shown the potential for the deployment of SWHs in Zambia. The techno-enviro study in this paper can be used by the policymakers of Zambia and countries with similar climates.


Author(s):  
Kaleb Pattawi ◽  
Prateek Munankarmi ◽  
Michael Blonsky ◽  
Jeff Maguire ◽  
Sivasathya Pradha Balamurugan ◽  
...  

Abstract Residential buildings, accounting for 37% of the total electricity consumption in the United States, are suitable for demand response (DR) programs to support effective and economical operation of the power system. A home energy management system (HEMS) enables residential buildings to participate in such programs, but it is also important for HEMS to account for occupant preferences to ensure occupant satisfaction. For example, people who prefer a higher thermal comfort level are likely to consume more energy. In this study, we used foresee™, a HEMS developed by the National Renewable Energy Lab (NREL), to perform a sensitivity analysis of occupant preferences with the following objectives: minimize utility cost, minimize carbon footprint, and maximize thermal comfort. To incorporate the preferences into the HEMS, the SMARTER method was used to derive a set of weighting factors for each objective. We performed week-long building energy simulations using a model of a home in Fort Collins, Colorado, where there is mandatory time-of-use electricity rate structure. The foresee™ HEMS was used to control the home with six different sets of occupant preferences. The study shows that occupant preferences can have a significant impact on energy consumption and is important to consider when modeling residential buildings. Results show that the HEMS could achieve energy reduction ranging from 3% to 21%, cost savings ranging from 5% to 24%, and carbon emission reduction ranging from 3% to 21%, while also maintaining a low thermal discomfort level ranging from 0.78 K-hour to 6.47 K-hour in a one-week period during winter. These outcomes quantify the impact of varying occupant preferences and will be useful in controlling the electrical grid and developing HEMS solutions.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Begmyrat Kulmedov ◽  
Serdar Durdyev

PurposeThe aim of the present study is to assess the selected heating systems (furnace and boiler) commonly used in the dwellings of seven post-USSR (the Union of Soviet Socialist Republics) countries. The systems were assessed in terms of their cost and environmental performance, with natural gas and electricity used as the main source of energy.Design/methodology/approachThe cost-effectiveness and environmental performance of the selected heating systems that have been commonly used in the selected post-USSR countries was assessed. Current energy (natural gas and electricity) prices that are applied in those countries were used.FindingsResults show that the furnace is the cheapest option, while natural gas is the cheapest source of energy, despite its high price in Tajikistan and Kyrgyzstan. Both heating systems could be considered eco-friendly options, although their efficiencies need to be considered at the design stage. Turkmenistan, Uzbekistan and Kazakhstan, which are the top natural gas producers, offer natural gas for the selected heating systems as both cost-effective and eco-friendly options.Practical implicationsA considerable reduction in electricity consumption and less harm to our environment can be achieved through the systems used in residential buildings in the region.Originality/valueThe outcomes of the present study offer value (in terms of cost-effective and eco-friendly options) for the end-users in the region.


Energies ◽  
2019 ◽  
Vol 12 (3) ◽  
pp. 479
Author(s):  
Ignacio Paniagua ◽  
Ángel Álvaro ◽  
Javier Martín ◽  
Celina Fernández ◽  
Rafael Carlier

Although CO 2 as refrigerant is well known for having the lowest global warming potential (GWP), and commercial domestic heat pump water heater systems exist, its long expected wide spread use has not fully unfolded. Indeed, CO 2 poses some technological difficulties with respect to conventional refrigerants, but currently, these difficulties have been largely overcome. Numerous studies show that CO 2 heat pump water heaters can improve the coefficient of performance (COP) of conventional ones in the given conditions. In this study, the performances of transcritical CO 2 and R410A heat pump water heaters were compared for an integrated nearly zero-energy building (NZEB) application. The thermodynamic cycle of two commercial systems were modelled integrating experimental data, and these models were then used to analyse both heat pumps receiving and producing hot water at equal temperatures, operating at the same ambient temperature. Within the range of operation of the system, it is unclear which would achieve the better COP, as it depends critically on the conditions of operation, which in turn depend on the ambient conditions and especially on the actual use of the water. Technology changes on each side of the line of equal performance conditions of operation (EPOC), a useful design tool developed in the study. The transcritical CO 2 is more sensitive to operating conditions, and thus offers greater flexibility to the designer, as it allows improving performance by optimising the global system design.


2013 ◽  
Vol 6 (2) ◽  
pp. 99-114 ◽  
Author(s):  
E. J. Pieterse-Quirijns ◽  
E. J. M. Blokker ◽  
E. van der Blom ◽  
J. H. G. Vreeburg

Abstract. Existing Dutch guidelines for the design of the drinking water and hot water system of non-residential buildings are based on outdated assumptions on peak water demand or on unfounded assumptions on hot water demand. They generally overestimate peak demand values required for the design of an efficient and reliable water system. Recently, a procedure was developed based on the end-use model SIMDEUM to derive design-demand-equations for peak demand values of both cold and hot water during various time steps for several types and sizes of non-residential buildings, viz. offices, hotels and nursing homes. In this paper, the design-demand-equations are validated with measurements of cold and hot water patterns on a per second base and with surveys. The good correlation between the simulated water demand patterns and the measured patterns indicates that the basis of the design-demand-equations, the SIMDEUM simulated standardised buildings, is solid. Surveys were held to investigate whether the construction of the standardised buildings based on the dominant variable corresponds with practice. Surveys show that it is difficult to find relationships to equip the standardised buildings with users and appliances. However, the validation proves that with a proper estimation of the number of users and appliances in only the dominant functional room of the standardised buildings, SIMDEUM renders a realistic cold and hot water diurnal demand pattern. Furthermore, the new design-demand-equations based on these standardised buildings give a better prediction of the measured peak values for cold water flow than the existing guidelines. Moreover, the new design-demand-equations can predict hot water use well. In this paper it is illustrated that the new design-demand-equations lead to reliable and improved designs of building installations and water heater capacity, resulting in more hygienic and economical installations.


2010 ◽  
Vol 129-131 ◽  
pp. 463-466
Author(s):  
Li Li Zhao ◽  
Zhi Jun Zhang ◽  
Shi Wei Zhang

The 3D physical model of the electrical water heater was built. The water-heater performance was resolved by computer fluid dynamics simulation (CFD). The heater performance is characterized by a new method rather than that the discharge efficiency, extraction efficiency and fraction of heat recoverable. The new method is based on the constant discharge water temperature and rate for end user, 5L/min and 43°C that include the hot water from EWH and cold water from outside EWH. But the water discharge rate from EWH was variable as the water temperature discharge from EWH was variable. Compared with the traditional method, it is more close to the user using reality condition.


Green ◽  
2011 ◽  
Vol 1 (2) ◽  
Author(s):  
Brian Norton

AbstractSolar water heating can be considered to be an established mature technology. The achievement of this status is the outcome of over a century of system development that culminated with a flourish of innovation in the last thirty years. Drivers for research and development have been achieving economic viability by devising systems that, for specific applications in particular climate contexts produced more hot water per unit cost. Reductions in both initial capital and installation costs have been achieved as well as in those associated with subsequent operation and maintenance. Research on solar water heating is discussed with the emphasis on overall systems though some key aspects of component development are also outlined. A comprehensive taxonomy is presented of the generic types of solar water heater that have emerged and their features, characteristics and performance are discussed.


2005 ◽  
Vol 297-300 ◽  
pp. 2320-2326
Author(s):  
Dong Jo Yang ◽  
Jae Yeol Kim ◽  
Jae Ho Han

The main purpose of this investigation was to evaluate the performance of the solar hot water heater for dwellings in a long period of time. In order to evaluate the performance, there were 11 solar hot water heaters located in Gwangju Chosun University examined for their performance in 30 month period as a long term. The specific monitoring systems of each heater were constructed for the demonstrational research and the data base associated to each monitoring systems were assembled for an extensive analysis for variety of data obtained. The demonstrational experiments were conducted through following the routine procedures of 4 specific tests (the replicated drainage test, the daily drain test, the daily agitation test, the short-term test). The performance evaluation was based on the performances in insulating and solar collecting and the experimental routines and the performance experiments had incorporated the consumers’ use and need of the product. The ultimate goals of this investigation were to achieve consumers’ trust on the products and to promote the extensive distributions of the solar hot water heaters. The demonstrational research of this investigation was to evaluate the performance of the solar hot water heater for the residents for a long period of time. This research will be continued extensively.


Sign in / Sign up

Export Citation Format

Share Document