Experimentally Verified Transient Models of Data Center Crossflow Heat Exchangers

Author(s):  
Tianyi Gao ◽  
Bahgat Sammakia ◽  
James Geer ◽  
Milnes David ◽  
Roger Schmidt

Heat exchangers are key components that are commonly used in data center cooling systems. Rear door heat exchangers, in-row coolers, overhead coolers and fully contained cabinets are some examples of liquid and hybrid cooling systems used in data centers. A liquid to liquid heat exchanger is one of the main components of the Coolant Distribution Unit (CDU), which supplies chilled water to the heat exchangers mentioned above. Computer Room Air Conditioner (CRAC) units also consist of liquid to air cross flow heat exchangers. Optimizing the energy use and the reliability of IT equipment in data centers requires Computational Fluid Dynamics (CFD) tools that can accurately model data centers for both the steady state and dynamic operations. Typically, data centers operate in dynamic conditions due to workload allocations that change both spatially and temporally. Additional dynamic situations may also arise due to failures in the thermal management and electrical distribution systems. In the computational simulation, individual component models, such as transient heat exchanger models, are therefore needed. It is also important to develop simple, yet accurate, compact models for components, such as heat exchangers, to reduce the computational time without decreasing simulation accuracy. In this study, a method for modeling compact transient heat exchangers using CFD code is presented. The method describes an approach for installing thermal dynamic heat exchanger models in CFD codes. The transient effectiveness concept and model are used in the development of the methodology. Heat exchanger CFD compact models are developed and tested by comparing them with full thermal dynamic models, and also with experimental measurements. The transient responses of the CFD model are presented for step and ramp change in flow rates of the hot and cold fluids, as well as step, ramp, and exponential variation in the inlet temperature. Finally, some practical dynamic scenarios involving IBM buffer liquid to liquid heat exchanger, rear door heat exchanger, and CRAC unit, are parametrically modeled to test the developed methodology. It is shown that the compact heat exchanger model can be used to successfully predict dynamic scenarios in typical data centers.

Author(s):  
Tianyi Gao ◽  
Emad Samadiani ◽  
Bahgat Sammakia ◽  
Roger Schmidt

Data centers consume a considerable amount of energy which is estimated to be about 2 percent of the total electrical energy consumed in the US, and their power consumption continues to increase every year. It is also estimated that roughly 30–40 percent of the total energy used in a data center is due to the thermal management systems. So, there is a strong need for better cooling methods which could improve the cooling capacity and also reduce energy consumption for high density data centers. In this regard, liquid cooling systems have been utilized to deal with demanding cooling and energy efficiency requirements in high density data centers. In this paper, a hybrid cooling system in data centers is investigated. In addition to traditional raised floor, cold aisle-hot aisle configuration, a liquid-air hybrid cooling system consisting of rear door heat exchangers attached to the back of racks is considered. The room is analyzed numerically using two CFD based simulation approaches for modeling rear door heat exchangers that are introduced in this study. The presented model is used in the second section of the paper to compare the hybrid cooling system with traditional air cooling systems. Several case studies are taken into account including the power increases in the racks and CRAC unit failure scenarios. A comparison is made between the hybrid cooling room and a purely air cooled room based on the rack inlet temperatures. Also in this study, total energy consumption by the cooling equipment in both air-cooled and hybrid data centers are modeled and compared with each other for different scenarios. The results show that under some circumstances the hybrid cooling could be an alternative to meet the ASHRAE recommended inlet air temperatures, while at the same time it reduces the cooling energy consumption in high density data centers.


Author(s):  
Roger Schmidt ◽  
Madhusudan Iyengar

The patented [1] rear door heat exchanger mounted to the rear of IT equipment racks was announced in April, 2005 by IBM and has shown improvements in data center energy efficiency and reducing hot spots. It also allows data center operators to more easily implement some of the features of the newly approved ASHRAE data center recommended data center environmental guidelines [2]. This paper will describe several case studies of implementing the rear door heat exchanger in various data center layouts. The implementation of the water cooled rear door in these data centers will show the effects of various failure modes and how the new ASHRAE environmental temperature guidelines are still being met with the failure modes examined.


Author(s):  
Marcelo del Valle ◽  
Alfonso Ortega

Data Center hybrid air/liquid cooling systems such as rear door heat exchangers, overhead and in row cooling systems enable localized, on-demand cooling, or “smart cooling.” At the heart of all hybrid cooling systems is an air to liquid cross flow heat exchanger that regulates the amount of cooling delivered by the system by modulating the liquid or air flows and/or temperatures. Due the central role that the heat exchanger plays in the system response, understanding the transient response of the heat exchanger is crucial for the precise control of hybrid cooling system. This paper reports on the transient experimental characterization of heat exchangers used in data centers applications. An experimental rig designed to introduce controlled transient perturbations in temperature and flow on the inlet air and liquid flow streams of a 12 in. × 12 in. heat exchanger test core is discussed. The conditioned air is delivered to the test core by a suction wind tunnel with upstream air heaters and a frequency variable axial blower to allow the control of air flow rate and bulk temperature. The conditioned water is delivered to the test core by a water delivery system consisting of two separate water circuits, one delivering cold water, and the other hot water. By switching from one circuit to the other or mixing water from both circuits, the rig is capable of generating step, ramp and frequency perturbations in water temperature at constant flow or step, ramp or frequency perturbations in water flow at constant temperature or combinations of temperature and water flow perturbations. Experimental data are presented for a 12×12 heat exchanger core with a single liquid pass under different transient perturbations.


Author(s):  
A. Bhalerao ◽  
A. Ortega ◽  
A. P. Wemhoff

Energy savings in data center cooling systems equate to cost savings for the data center operator. Recently, investigators have considered alternative hybrid liquid-air technologies for data center thermal management such as in-row coolers, rear door heat exchangers, and overhead coolers. This study employs the in-house data center modeling tool Villanova Thermodynamic Analysis of Systems (VTAS) software package to ascertain the influence of hybrid liquid-air components on overall data center exergy destruction. The results show that the exergy destruction decreases for a hybrid liquid-air system using only an in-row cooler. As the in-row cooler removes a greater fraction of heat from the hot aisle, the total exergy destruction in the data center increases by a small amount. This analysis is extended for various configurations containing an in-row cooler, an overhead cooler, a rear door heat exchanger, and a CRAH unit to show that using hybrid liquid-air technologies without a CRAH unit is the most thermodynamically favorable.


Author(s):  
Tianyi Gao ◽  
Marcelo del Valle ◽  
Alfonso Ortega ◽  
Bahgat G. Sammakia

The cross flow heat exchanger is at the heart of most cooling systems for data centers. Air/Water or air/refrigerant heat exchangers are the principal component in Central Room Air Conditioning (CRAC) units that condition data room air that is delivered through an underfloor plenum. Liquid/air heat exchangers are also increasingly deployed in close-coupled cooling systems such as rear door heat exchangers, in-row coolers, and overhead coolers. In all cases, the performance of liquid/air heat exchangers in both steady state and transient scenarios are of principal concern. Transient scenarios occur either by the accidental failure of the cooling system or by intentional dynamic control of the cooling system. In either scenario, transient boundary conditions involve time-dependent air or liquid inlet temperatures and mass flow rates that may be coupled in any number of potential combinations. Understanding and characterizing the performance of the heat exchanger in these transient scenarios is of paramount importance for designing better thermal solutions and improving the operational efficiency of existing cooling systems. In this paper, the transient performance of water to air cross flow heat exchangers is studied using numerical modeling and experimental measurements. Experimental measurements in 12 in. × 12 in. heat exchanger cores were performed, in which the liquid (water) mass flow rate or inlet temperature are varied in time following controlled functional forms (step jump, ramp). The experimental data were used to validate a transient numerical model developed with traditional assumptions of space averaging of heat transfer coefficients, and volume averaging of thermal capacitances. The complete numerical model was combined with the transient effectiveness methodology in which the traditional heat exchanger effectiveness approach is extended into a transient domain, and is then used to model the heat exchanger transient response. Different transient scenarios were parametrically studied to develop an understanding of the impact of critical variables such as, the fluid inlet temperature variation and the fluid mass flow rate variation, and a more comprehensive understanding of the characteristics of the transient effectiveness. Agreement between the novel transient effectiveness modeling approach and the experimental measurements enable use of the models as verified predictive design tools. Several studies are designed based on the practical problems related to data center thermal environments and the results are analyzed.


Author(s):  
Tianyi Gao ◽  
Emad Samadiani ◽  
Roger Schmidt ◽  
Bahgat Sammakia

Thermal management of high power data centers poses challenges due to the high operational cost which is made worse due to the many inefficiencies that arise in them. Additional challenges arise due to the dynamic behaviors that occur during normal operation, and also during emergencies such as power outages or failure of some or all of the cooling equipment. Water and hybrid air plus water cooled data centers are an alternate cooling solution combining liquid cooling systems, such as rear door heat exchangers located within the racks themselves, in addition to the traditional raised floor cold aisle air cooling system. Such a solution may be used when some of the equipment in a data center is upgraded to higher end and higher power equipment which may not be manageable with the existing air cooling system. For a data center with a hybrid cooling system, the cold air supply and the cold water supply should increase in case of an emergency, such as a CRAC (Computer Room Air Conditioner) units’ failure. In this paper, a detailed computational study is conducted to investigate the dynamic response of the impact of a CRAC failure on both water side and air side in a representative hybrid cooling room. The room studied is an air cooled data center using the common cold aisle approach, with rear door heat exchangers installed on all of the racks. CRAC failure is investigated in a hybrid cooling room. The variation and fluctuation in an average rack inlet temperature, and inlet temperatures at different detail locations are presented in plots, showing the dynamic performance of a hybrid cooling data center subjected to the different CRAC failure scenarios. Different response time studies are also presented in this paper.


Author(s):  
Madhusudan Iyengar ◽  
Roger Schmidt ◽  
Vinod Kamath ◽  
Bejoy Kochuparambil

It is now common for data center managers to question the impact on server energy usage of two recent impact factors: (1) the rise in the data center inlet air temperature to servers per 2008 ASHRAE guidelines, and (2) the fan speed increase from the use of rack level heat exchangers such as Rear Door Heat Exchangers. To help acquire a deeper understanding of the relevant issues, a system floor thermal test was built on the IBM New York data center benchmark floor which consisted of a standard 19″ rack filled with 39 3.0 GHz 1U servers that dissipated between 10–17 kW depending on extent of server utilization. Fan speed, chip temperature metrics, and server power data was collected using product debug codes and server level programs. A simulated air heat load was installed right in front of this server rack to allow the manipulation of air inlet temperature into the servers from 20 °C to 32 °C. Two different rack level configurations were considered for the experiments: (i) a perforated front door and no door at the rear, and (ii) a perforated front door and a Rear Door Heat Exchanger at the rear. An exerciser program was used to vary the CPU utilization from Idle to 70% which represented a typical data center work load. Data was collected for 19 servers of the 39 servers (remaining were in use by Benchmark Lab) for the two rack configurations, for 4 inlet server air temperatures, and for two chip exerciser settings, i.e. 16 experiments. For the 70% exerciser setting (typical operation) and the base line rack configuration without rack level heat exchangers, the rise in server power for an increase in inlet air temperature was 5.2% for the 20 °C to 27 °C change and was 17% for the 20 °C to 31 °C change. For the 70% exerciser setting (typical), the increase in server power from the use of rack level heat exchangers (Rear Door Heat Exchanger) was less than 1.3% for all the conditions. Given the broad range of fan speed algorithms and cooling hardware in server products on the market and their change over each generation, significant further study will be required to characterize each category of systems for these conditions. However, the present study provides a template for quantifying server energy usage in a context that data center managers can understand and use.


Author(s):  
Tianyi Gao ◽  
James Geer ◽  
Bahgat G. Sammakia ◽  
Russell Tipton ◽  
Mark Seymour

Cooling power constitutes a large portion of the total electrical power consumption in data centers. Approximately 25%∼40% of the electricity used within a production data center is consumed by the cooling system. Improving the cooling energy efficiency has attracted a great deal of research attention. Many strategies have been proposed for cutting the data center energy costs. One of the effective strategies for increasing the cooling efficiency is using dynamic thermal management. Another effective strategy is placing cooling devices (heat exchangers) closer to the source of heat. This is the basic design principle of many hybrid cooling systems and liquid cooling systems for data centers. Dynamic thermal management of data centers is a huge challenge, due to the fact that data centers are operated under complex dynamic conditions, even during normal operating conditions. In addition, hybrid cooling systems for data centers introduce additional localized cooling devices, such as in row cooling units and overhead coolers, which significantly increase the complexity of dynamic thermal management. Therefore, it is of paramount importance to characterize the dynamic responses of data centers under variations from different cooling units, such as cooling air flow rate variations. In this study, a detailed computational analysis of an in row cooler based hybrid cooled data center is conducted using a commercially available computational fluid dynamics (CFD) code. A representative CFD model for a raised floor data center with cold aisle-hot aisle arrangement fashion is developed. The hybrid cooling system is designed using perimeter CRAH units and localized in row cooling units. The CRAH unit supplies centralized cooling air to the under floor plenum, and the cooling air enters the cold aisle through perforated tiles. The in row cooling unit is located on the raised floor between the server racks. It supplies the cooling air directly to the cold aisle, and intakes hot air from the back of the racks (hot aisle). Therefore, two different cooling air sources are supplied to the cold aisle, but the ways they are delivered to the cold aisle are different. Several modeling cases are designed to study the transient effects of variations in the flow rates of the two cooling air sources. The server power and the cooling air flow variation combination scenarios are also modeled and studied. The detailed impacts of each modeling case on the rack inlet air temperature and cold aisle air flow distribution are studied. The results presented in this work provide an understanding of the effects of air flow variations on the thermal performance of data centers. The results and corresponding analysis is used for improving the running efficiency of this type of raised floor hybrid data centers using CRAH and IRC units.


2021 ◽  
Vol 12 (1) ◽  
pp. 74-83
Author(s):  
Manjunatha S. ◽  
Suresh L.

Data center is a cost-effective infrastructure for storing large volumes of data and hosting large-scale service applications. Cloud computing service providers are rapidly deploying data centers across the world with a huge number of servers and switches. These data centers consume significant amounts of energy, contributing to high operational costs. Thus, optimizing the energy consumption of servers and networks in data centers can reduce operational costs. In a data center, power consumption is mainly due to servers, networking devices, and cooling systems, and an effective energy-saving strategy is to consolidate the computation and communication into a smaller number of servers and network devices and then power off as many unneeded servers and network devices as possible.


Energies ◽  
2020 ◽  
Vol 13 (22) ◽  
pp. 6147
Author(s):  
Jinkyun Cho ◽  
Jesang Woo ◽  
Beungyong Park ◽  
Taesub Lim

Removing heat from high-density information technology (IT) equipment is essential for data centers. Maintaining the proper operating environment for IT equipment can be expensive. Rising energy cost and energy consumption has prompted data centers to consider hot aisle and cold aisle containment strategies, which can improve the energy efficiency and maintain the recommended level of inlet air temperature to IT equipment. It can also resolve hot spots in traditional uncontained data centers to some degree. This study analyzes the IT environment of the hot aisle containment (HAC) system, which has been considered an essential solution for high-density data centers. The thermal performance was analyzed for an IT server room with HAC in a reference data center. Computational fluid dynamics analysis was conducted to compare the operating performances of the cooling air distribution systems applied to the raised and hard floors and to examine the difference in the IT environment between the server rooms. Regarding operating conditions, the thermal performances in a state wherein the cooling system operated normally and another wherein one unit had failed were compared. The thermal performance of each alternative was evaluated by comparing the temperature distribution, airflow distribution, inlet air temperatures of the server racks, and recirculation ratio from the outlet to the inlet. In conclusion, the HAC system with a raised floor has higher cooling efficiency than that with a hard floor. The HAC with a raised floor over a hard floor can improve the air distribution efficiency by 28%. This corresponds to 40% reduction in the recirculation ratio for more than 20% of the normal cooling conditions. The main contribution of this paper is that it realistically implements the effectiveness of the existing theoretical comparison of the HAC system by developing an accurate numerical model of a data center with a high-density fifth-generation (5G) environment and applying the operating conditions.


Sign in / Sign up

Export Citation Format

Share Document