Numerical Modeling of Data Center Clusters: Impact of Model Complexity

Author(s):  
Siddharth Bhopte ◽  
Madhusudan K. Iyengar ◽  
Bahgat Sammakia ◽  
Roger Schmidt ◽  
Dereje Agonafer

Data centers are facilities that house large numbers of computer servers that dissipate high power. With the rapid increase in the heat flux of such systems, their thermal management has become a challenge that needs to be addressed. Computational analyses using a CFD code is a very useful technique that helps the engineer to understand and solve the data center cooling problem. In this paper the state of the art of numerical modeling of data center is discussed. Representative systems are modeled using the two most prominent approaches. Variation in results with the addition of modeling details is presented. The effect of under floor parameters such as the conditioned chilled air supply flow rate, the under floor plenum depth, and the tile opening flow resistance, is discussed. Total flow rate delivered by the Computer Room Air Conditioning (CRAC) unit depends on blower and system characteristic curves, as specified by the vendor. Impact of plenum depth and tile resistance on total CRAC flow rate is discussed. Under floor blockages such as cables, pipes, and random materials, impede the flow of the cold air stream and yield unpredictable air flow patterns. Currently, models with idealized plenums are used for simulation of data centers. The effect of including blockages in CFD analyses is discussed. A novel approach that defines safe and critical paths under plenum for routing the blockages is presented.

Energies ◽  
2019 ◽  
Vol 12 (15) ◽  
pp. 2996 ◽  
Author(s):  
Jinkyun Cho ◽  
Beungyong Park ◽  
Yongdae Jeong

If a data center experiences a system outage or fault conditions, it becomes difficult to provide a stable and continuous information technology (IT) service. Therefore, it is critical to design and implement a backup system so that stability can be maintained even in emergency (unforeseen) situations. In this study, an actual 20 MW data center project was analyzed to evaluate the thermal performance of an IT server room during a cooling system outage under six fault conditions. In addition, a method of organizing and systematically managing operational stability and energy efficiency verification was identified for data center construction in accordance with the commissioning process. Up to a chilled water supply temperature of 17 °C and a computer room air handling unit air supply temperature of 24 °C, the temperature of the air flowing into the IT server room fell into the allowable range specified by the American Society of Heating, Refrigerating, and Air-Conditioning Engineers standard (18–27 °C). It was possible to perform allowable operations for approximately 320 s after cooling system outage. Starting at a chilled water supply temperature of 18 °C and an air supply temperature of 25 °C, a rapid temperature increase occurred, which is a serious cause of IT equipment failure. Due to the use of cold aisle containment and designs with relatively high chilled water and air supply temperatures, there is a high possibility that a rapid temperature increase inside an IT server room will occur during a cooling system outage. Thus, the backup system must be activated within 300 s. It is essential to understand the operational characteristics of data centers and design optimal cooling systems to ensure the reliability of high-density data centers. In particular, it is necessary to consider these physical results and to perform an integrated review of the time required for emergency cooling equipment to operate as well as the backup system availability time.


Author(s):  
Tianyi Gao ◽  
James Geer ◽  
Russell Tipton ◽  
Bruce Murray ◽  
Bahgat G. Sammakia ◽  
...  

The heat dissipated by high performance IT equipment such as servers and switches in data centers is increasing rapidly, which makes the thermal management even more challenging. IT equipment is typically designed to operate at a rack inlet air temperature ranging between 10 °C and 35 °C. The newest published environmental standards for operating IT equipment proposed by ASHARE specify a long term recommended dry bulb IT air inlet temperature range as 18°C to 27°C. In terms of the short term specification, the largest allowable inlet temperature range to operate at is between 5°C and 45°C. Failure in maintaining these specifications will lead to significantly detrimental impacts to the performance and reliability of these electronic devices. Thus, understanding the cooling system is of paramount importance for the design and operation of data centers. In this paper, a hybrid cooling system is numerically modeled and investigated. The numerical modeling is conducted using a commercial computational fluid dynamics (CFD) code. The hybrid cooling strategy is specified by mounting the in row cooling units between the server racks to assist the raised floor air cooling. The effect of several input variables, including rack heat load and heat density, rack air flow rate, in row cooling unit operating cooling fluid flow rate and temperature, in row coil effectiveness, centralized cooling unit supply air flow rate, non-uniformity in rack heat load, and raised floor height are studied parametrically. Their detailed effects on the rack inlet air temperatures and the in row cooler performance are presented. The modeling results and corresponding analyses are used to develop general installation and operation guidance for the in row cooler strategy of a data center.


Author(s):  
Shawn P. Shields ◽  
Yogendra K. Joshi ◽  
Michael Patterson ◽  
Michael Meakins

This paper presents experimental data showing the response of a computer room air conditioning unit (CRAC) to chilled water (CHW) pump restart. The data are offered to improve and develop modeling of cooling equipment restart events following data center power failure. There are estimates that power failures will increase and limits on availability will affect data center operations at more than 90 percent of all companies over the next five years. Because providing backup power to cooling equipment increases data center first cost, it is important to have accurate models for cooling events and processes following power failure that help predict server inlet temperatures during the transient phase caused by a power failure. Since power density of computing equipment continues to rise, the temperature rise of air within the data center has been predicted to rise more quickly to an unacceptable level, increasing concern. Accurate models of CRAC response to pump restart can aid in data center cooling design, backup power infrastructure provisioning, and even compute equipment selection by predicting the air supply temperature after the generator provides power to the chilled water pump. Previous transient models include zonal models with large time scales and CFD/HT models with boundary conditions developed for steady state. These models can be improved by comparison with experimental data. The experiment consists of measuring the response of the CRAC heat exchanger to the step change in CHW flow rate upon pump restart. Inlet and outlet temperatures of both CHW and air were measured, as well CHW flow rate. A point measurement of air at the CRAC fan outlet was also taken to verify that airflow remained relatively constant. Outlet temperatures from the CRAC follow a first order response curve; it is found that the CRAC under consideration has fan outlet temperature time constant of 10 seconds. A delay of 20 seconds is observed between the fan outlet temperature response and the CHW return temperature response.


Energies ◽  
2020 ◽  
Vol 13 (2) ◽  
pp. 393 ◽  
Author(s):  
Heran Jing ◽  
Zhenhua Quan ◽  
Yaohua Zhao ◽  
Lincheng Wang ◽  
Ruyang Ren ◽  
...  

According to the temperature regulations and high energy consumption of air conditioning (AC) system in data centers (DCs), natural cold energy becomes the focus of energy saving in data center in winter and transition season. A new type of air–water heat exchanger (AWHE) for the indoor side of DCs was designed to use natural cold energy in order to reduce the power consumption of AC. The AWHE applied micro-heat pipe arrays (MHPAs) with serrated fins on its surface to enhance heat transfer. The performance of MHPA-AWHE for different inlet water temperatures, water and air flow rates was investigated, respectively. The results showed that the maximum efficiency of the heat exchanger was 81.4% by using the effectiveness number of transfer units (ε-NTU) method. When the max air flow rate was 3000 m3/h and the water inlet temperature was 5 °C, the maximum heat transfer rate was 9.29 kW. The maximum pressure drop of the air side and water side were 339.8 Pa and 8.86 kPa, respectively. The comprehensive evaluation index j/f1/2 of the MHPA-AWHE increased by 10.8% compared to the plate–fin heat exchanger with louvered fins. The energy saving characteristics of an example DCs in Beijing was analyzed, and when the air flow rate was 2500 m3/h and the number of MHPA-AWHE modules was five, the minimum payback period of the MHPA-AWHE system was 2.3 years, which was the shortest and the most economical recorded. The maximum comprehensive energy efficiency ratio (EER) of the system after the transformation was 21.8, the electric power reduced by 28.3% compared to the system before the transformation, and the control strategy was carried out. The comprehensive performance provides a reference for MHPA-AWHE application in data centers.


Author(s):  
Joseph R. H. Schaadt ◽  
Kamran Fouladi ◽  
Aaron P. Wemhoff ◽  
Joseph G. Pigeon

Data centers are most commonly cooled by air delivered to electronic equipment from centralized cooling systems. The research presented here is motivated by the need for strategies to improve and optimize the load capacity and thermal efficiency of data centers by using computational fluid dynamics (CFD). Here, CFD is used to model and optimize the Villanova Steel Orca Research Center (VSORC). VSORC, presently in the design stages, will provide a testing environment as well as the capability to investigate best practices and state of the art strategies including hybrid cooling, IT load distribution, density zones, and hot aisle and cold aisle containment. The results of this study will be used in the overall design and construction of the aforementioned research data center. The objective of this study is to find the optimal operating points and design layout of a data center while still meeting certain design constraints. A focus is on finding both the ideal total supply flow rate of the air conditioning units and the ideal chilled water supply temperature (CHWST) setpoint under different data center design configurations and load capacities. The total supply flow rate of the air conditioning units and the supply temperature setpoint of the chilled water system are varied as design parameters in order to systematically determine the optimal operating points. The study also examines the influence of hot aisle and cold aisle containment strategies in full containment, half containment, and no containment configurations on the determined optimal operating conditions for the modeled research data center.


Author(s):  
Jeffrey D. Rambo ◽  
Yogendra K. Joshi

Data center facilities, which house thousands of servers, storage devices and computing hardware, arranged in 2 meter high racks are providing many thermal challenges. Each rack can dissipate 10–15 kW, and with facilities as large as tens of thousands of square feet, the net power dissipated is typically on the order of several MW. The cost to power these facilities alone can be millions of dollars a year, with the cost to provide adequate cooling not far behind. Significant savings can be realized for the end user by improved design methodology of these high power density data centers. The fundamental need for improved characterization is motivated by inadequacies of simple energy balances to identify local ‘hot spots’ and ultimately provide a reliable modeling framework by which the data centers of the future can be designed. Recent attempts in computational fluid dynamics (CFD) modeling of data centers have been based around a simple rack model, either as a uniform heat generator or specified temperature rise across the rack. This desensitizes the solution to variations of heat load and corresponding flow rate needed to cool the servers throughout the rack. Heat generated at the smaller scales (the chip level) produces changes in the larger length scales of the data center. Accurate simulations of these facilities should attempt to resolve the range of length scales present. In this paper, a multi-scale model where each rack is subdivided into a series of sub-models to better mimic the behavior of individual servers inside the data center is proposed. A Reynolds-averaged Navier-Stokes CFD model of a 110 m2 (1,200 ft2) representative data center with the raised floor cooling scheme was constructed around this multi-scale rack model. Each of the 28 racks dissipated 4.23 kW, giving the data center a power density of 1076 W/m2 (100 W/ft2) based on total floor space. Parametric studies of varying heat loads within the rack and throughout the data center were performed to better characterize the interactions of the sub-rack scale heat generation and the data center. Major results include 1) the presence of a nonlinear thermal response in the upper portion of each rack due to recirculation effects and 2) significant changes in the surrounding racks (up to 10% increase in maximum temperature) observed in response to changes in rack flow rate (50% decrease).


2010 ◽  
Vol 132 (2) ◽  
Author(s):  
Emad Samadiani ◽  
Jeffrey Rambo ◽  
Yogendra Joshi

This paper is centered on quantifying the effect of computer room and computer room air conditioning (CRAC) unit modeling on the perforated tile flow distribution in a representative raised-floor data center. Also, this study quantifies the effect of plenum pipes and perforated tile porosity on the operating points of the CRAC blowers, total CRAC air flow rate, and its distribution. It is concluded that modeling the computer room, the CRAC units, and/or the plenum pipes could make an average change of up to 17% in the tile flow rates with a maximum of up to 135% for the facility with 56% open tiles while the average and maximum changes for the facility with 25% open tiles are 6% and 60%, respectively.


Author(s):  
H. E. Khalifa ◽  
D. W. Demetriou

The work presented in this paper describes a simplified thermodynamic model that can be used for exploring optimization possibilities in air-cooled data centers. The model has been used to identify optimal, energy-efficient designs, operating scenarios, and operating parameters such as flow rates and air supply temperatures. The results of this analysis highlight the important features that need to be considered when optimizing the operation of air-cooled data centers, especially the trade-off between low air supply temperature and increased air flow rate. The model was shown to be especially valuable in defining the optimal operating strategies for enclosed aisle configurations with fixed and variable server flows, and to elucidate the deleterious effect of temperature nonuniformity at the inlet of the racks on the data center cooling infrastructure power consumption. The analysis shows a potential for as much as an ∼58% savings in cooling infrastructure energy consumption by utilizing an optimized enclosed aisle configuration with bypass recirculation, instead of a traditional enclosed aisle, where all the data center exhaust is forced to flow through the computer room air conditioners. The analysis of open-aisle data centers shows that as the temperature at the inlet of the racks becomes more nonuniform, optimal operation tends toward lower recirculation and higher power consumption; again, stressing the importance of providing as uniform a temperature to the racks as possible. It is also revealed that servers with a modest temperature rise (∼10°C) have a wider latitude for cooling infrastructure optimization than those with a high temperature rise (≥20°C), which tend to consume less cooling power when the aisles are enclosed.


Author(s):  
Mullaivendhan Varadharasan ◽  
Dereje Agonafer ◽  
Ahmed Al Khazraji ◽  
Jimil Shah ◽  
Ashwin Siddarth ◽  
...  

Direct evaporative cooling (DEC) is widely used in the data center cooling units to maintain the air condition inside the data centers. Often, the flow rate of the water over the wet cooling media in this DEC process is frequently varied to maintain the air condition inside the data centers based on changing weather conditions. Though the adopted method helps to control the air temperature and relative humidity, the scale formation occurs on the surface of wet cooling media due to the frequent variation of the flow rate and deposition of minerals present in the water at low flow rate values, which increases the total weight of the wet cooling media and it can lead to a wet cooling media collapse. In this paper an alternative and simplified method to control the air condition is presented. A vertically split wet cooling media is designed and tested in a commercial CFD tool to analyze the temperature and relative humidity parameters of the inlet and outlet air to the wet cooling media, in this approach the sections of the media can either be completely wet or completely dry which can potentially avoid the scale formation on the surface of the wet cooling media. In addition to the temperature and relative humidity parameters against the air flow rates, the pressure drop and cooling efficiency values for varied air flow rates are studied. The vertically split wet cooling media configurations are achieved by sectioning the media in to equal and unequal sections. In the equal configuration, media has been tested for 0%, 50% and 100% wetting conditions, and in the unequal configuration, media has been tested for 0%, 33%, 66% and 100% wetting conditions. The test results are used to emphasis the advantage of this staged wetting method and gives a possible solution to the scale formation problem on the wet cooling media during the direct evaporative cooling process in the data center.


Author(s):  
Emad Samadiani ◽  
Jeffrey Rambo ◽  
Yogendra Joshi

This paper is centered on quantifying the effect of computer room and computer room air conditioning (CRAC) unit modeling on the perforated tile flow distribution in a representative raised-floor data center. Also, this study quantifies the effect of plenum pipes and perforated tile porosity on the operating points of the CRAC blowers, total CRAC air flow rate, and its distribution. It is concluded that modeling the computer room, CRAC units, and/or the plenum pipes could change the tile flow distribution by up to 60% for the facility with 25% open perforated tiles and up to 135% for the facility with 56% open perforated tiles.


Sign in / Sign up

Export Citation Format

Share Document