Perimeter Cooling Unit and Localized Row-Based Cooling Unit Transient Air Flow Effects Modeling and Characterization in Data Centers

Author(s):  
Tianyi Gao ◽  
James Geer ◽  
Bahgat G. Sammakia ◽  
Russell Tipton ◽  
Mark Seymour

Cooling power constitutes a large portion of the total electrical power consumption in data centers. Approximately 25%∼40% of the electricity used within a production data center is consumed by the cooling system. Improving the cooling energy efficiency has attracted a great deal of research attention. Many strategies have been proposed for cutting the data center energy costs. One of the effective strategies for increasing the cooling efficiency is using dynamic thermal management. Another effective strategy is placing cooling devices (heat exchangers) closer to the source of heat. This is the basic design principle of many hybrid cooling systems and liquid cooling systems for data centers. Dynamic thermal management of data centers is a huge challenge, due to the fact that data centers are operated under complex dynamic conditions, even during normal operating conditions. In addition, hybrid cooling systems for data centers introduce additional localized cooling devices, such as in row cooling units and overhead coolers, which significantly increase the complexity of dynamic thermal management. Therefore, it is of paramount importance to characterize the dynamic responses of data centers under variations from different cooling units, such as cooling air flow rate variations. In this study, a detailed computational analysis of an in row cooler based hybrid cooled data center is conducted using a commercially available computational fluid dynamics (CFD) code. A representative CFD model for a raised floor data center with cold aisle-hot aisle arrangement fashion is developed. The hybrid cooling system is designed using perimeter CRAH units and localized in row cooling units. The CRAH unit supplies centralized cooling air to the under floor plenum, and the cooling air enters the cold aisle through perforated tiles. The in row cooling unit is located on the raised floor between the server racks. It supplies the cooling air directly to the cold aisle, and intakes hot air from the back of the racks (hot aisle). Therefore, two different cooling air sources are supplied to the cold aisle, but the ways they are delivered to the cold aisle are different. Several modeling cases are designed to study the transient effects of variations in the flow rates of the two cooling air sources. The server power and the cooling air flow variation combination scenarios are also modeled and studied. The detailed impacts of each modeling case on the rack inlet air temperature and cold aisle air flow distribution are studied. The results presented in this work provide an understanding of the effects of air flow variations on the thermal performance of data centers. The results and corresponding analysis is used for improving the running efficiency of this type of raised floor hybrid data centers using CRAH and IRC units.

Author(s):  
Tianyi Gao ◽  
James Geer ◽  
Russell Tipton ◽  
Bruce Murray ◽  
Bahgat G. Sammakia ◽  
...  

The heat dissipated by high performance IT equipment such as servers and switches in data centers is increasing rapidly, which makes the thermal management even more challenging. IT equipment is typically designed to operate at a rack inlet air temperature ranging between 10 °C and 35 °C. The newest published environmental standards for operating IT equipment proposed by ASHARE specify a long term recommended dry bulb IT air inlet temperature range as 18°C to 27°C. In terms of the short term specification, the largest allowable inlet temperature range to operate at is between 5°C and 45°C. Failure in maintaining these specifications will lead to significantly detrimental impacts to the performance and reliability of these electronic devices. Thus, understanding the cooling system is of paramount importance for the design and operation of data centers. In this paper, a hybrid cooling system is numerically modeled and investigated. The numerical modeling is conducted using a commercial computational fluid dynamics (CFD) code. The hybrid cooling strategy is specified by mounting the in row cooling units between the server racks to assist the raised floor air cooling. The effect of several input variables, including rack heat load and heat density, rack air flow rate, in row cooling unit operating cooling fluid flow rate and temperature, in row coil effectiveness, centralized cooling unit supply air flow rate, non-uniformity in rack heat load, and raised floor height are studied parametrically. Their detailed effects on the rack inlet air temperatures and the in row cooler performance are presented. The modeling results and corresponding analyses are used to develop general installation and operation guidance for the in row cooler strategy of a data center.


Author(s):  
Tianyi Gao ◽  
Emad Samadiani ◽  
Bahgat Sammakia ◽  
Roger Schmidt

Data centers consume a considerable amount of energy which is estimated to be about 2 percent of the total electrical energy consumed in the US, and their power consumption continues to increase every year. It is also estimated that roughly 30–40 percent of the total energy used in a data center is due to the thermal management systems. So, there is a strong need for better cooling methods which could improve the cooling capacity and also reduce energy consumption for high density data centers. In this regard, liquid cooling systems have been utilized to deal with demanding cooling and energy efficiency requirements in high density data centers. In this paper, a hybrid cooling system in data centers is investigated. In addition to traditional raised floor, cold aisle-hot aisle configuration, a liquid-air hybrid cooling system consisting of rear door heat exchangers attached to the back of racks is considered. The room is analyzed numerically using two CFD based simulation approaches for modeling rear door heat exchangers that are introduced in this study. The presented model is used in the second section of the paper to compare the hybrid cooling system with traditional air cooling systems. Several case studies are taken into account including the power increases in the racks and CRAC unit failure scenarios. A comparison is made between the hybrid cooling room and a purely air cooled room based on the rack inlet temperatures. Also in this study, total energy consumption by the cooling equipment in both air-cooled and hybrid data centers are modeled and compared with each other for different scenarios. The results show that under some circumstances the hybrid cooling could be an alternative to meet the ASHRAE recommended inlet air temperatures, while at the same time it reduces the cooling energy consumption in high density data centers.


Author(s):  
Veerendra Mulay ◽  
Saket Karajgikar ◽  
Dereje Agonafer ◽  
Roger Schmidt ◽  
Madhusudan Iyengar

The power trend for Server systems continues to grow thereby making thermal management of Data centers a very challenging task. Although various configurations exist, the raised floor plenum with Computer Room Air Conditioners (CRACs) providing cold air is a popular operating strategy. The air cooling of data center however, may not address the situation where more energy is expended in cooling infrastructure than the thermal load of data center. Revised power trend projections by ASHRAE TC 9.9 predict heat load as high as 5000W per square feet of compute servers’ equipment footprint by year 2010. These trend charts also indicate that heat load per product footprint has doubled for storage servers during 2000–2004. For the same period, heat load per product footprint for compute servers has tripled. Amongst the systems that are currently available and being shipped, many racks exceed 20kW. Such high heat loads have raised concerns over limits of air cooling of data centers similar to air cooling of microprocessors. A hybrid cooling strategy that incorporates liquid cooling along with air cooling can be very efficient in these situations. A parametric study of such solution is presented in this paper. A representative data center with 40 racks is modeled using commercially available CFD code. The variation in rack inlet temperature due to tile openings, underfloor plenum depths is reported.


2021 ◽  
Vol 850 (1) ◽  
pp. 012018
Author(s):  
T Renugadevi ◽  
D Hari Prasanth ◽  
Appili Yaswanth ◽  
K Muthukumar ◽  
M Venkatesan

Abstract Data centers are large-scale data storage and processing systems. It is made up of a number of servers that must be capable of handling large amount of data. As a result, data centers generate a significant quantity of heat, which must be cooled and kept at an optimal temperature to avoid overheating. To address this problem, thermal analysis of the data center is carried out using numerical methods. The CFD model consists of a micro data center, where conjugate heat transfer effects are studied. A micro data center consists of servers aligned with air gaps alternatively and cooling air is passed between the air gaps to remove heat. In the present work, the design of data center rack is made in such a way that the cold air is in close proximity to servers. The temperature and airflow in the data center are estimated using the model. The air gap is optimally designed for the cooling unit. Temperature distribution of various load configurations is studied. The objective of the study is to find a favorable loading configuration of the micro data center for various loads and effectiveness of distribution of load among the servers.


Author(s):  
Tianyi Gao ◽  
Bahgat G. Sammakia ◽  
James Geer ◽  
Bruce Murray ◽  
Russell Tipton ◽  
...  

The heat dissipated by electronic equipment inside data centers is increasing at a rapid rate due to the increasing of performance requirement and package density. This ever increasing power leads to critical challenges of thermal management for these high power density data centers. Energy consumption is also a key issue for high density data centers. Roughly 1.5% of all U.S. electricity consumption in the year 2006 was related to data centers, while that number increased to 2% by the year 2010. In 2013, U.S. data centers consumed approximately 91 billion kilowatt-hours of electricity. This amount of the electricity equals the annual output of 34 500-megawatt coal-fired power plants [1]. Cooling systems constitute a significant portion of the energy consumption of data centers, being approximately 25%∼35% of the total energy usage. Therefore, there is a large potential to save energy by optimizing current existing cooling systems and investigating new cooling technologies, and, at the same time, improving the overall cooling capacity and efficiency. This paper describes and investigates a hybrid cooling technology which utilizes in row coolers in existing raised floor air cooled data centers. The in row cooler functions as a liquid-to-air heat exchanger. In addition to the traditional raised floor cold aisle-hot aisle arrangements, the in row cooler is installed between the IT equipment to enable delivering the liquid coolant medium closer to the IT equipment. The in row coolers intake the hot air from the hot aisle, condition it, and supply the chilled air to the cold aisle. Thus, by extracting a large portion of the heat more directly into the cooling liquid through the in row coolers compared with the perimeter CRAH unit, the overall cooling performance and efficiency can potentially be improved. CFD models for an in row cooler and a representative data center room are developed. Experimentally characterized performance data are used to calibrate and validate the models. The models are then used to conduct a detailed computational analysis to assess the effectiveness of different arrangement configurations of in row cooler units in two rows of racks along one cold aisle. The detailed performance of the entire cold aisle is characterized using the rack inlet air temperature and a temperature nonuniformity factor. The impact of CRAH location and room layout are also investigated. This study is based on a practical problem and the corresponding results and analysis provide basic installation and design guidelines for future equipment upgrading in certain parts of the data center.


Author(s):  
Seungho Mok ◽  
Yogendra K. Joshi ◽  
Satish Kumar ◽  
Ronald R. Hutchins

This study focuses on developing computational models for hybrid or liquid cooled data centers that may reutilize waste heat. A data center with 17 fully populated racks with IBM LS20 blade servers, which consumes 408 kW at the maximum load, is considered. The hybrid cooling system uses a liquid to remove the heat produced by high power components, while the remaining low power components are cooled by air. The paper presents three hybrid cooling scenarios. For the first two cases, air is cooled by direct expansion (DX) cooling system with air-side economizer. Unlike the cooling air, two different approaches for cooling water are investigated: air-cooled chiller and ground water through liquid-to-liquid heat exchanger. Waste heat re-use for pre-heating building water in co-located facilities is also investigated for the second scenario. In addition to the hybrid cooling models, a fully liquid cooling system is modeled as the third scenario for comparison with hybrid cooling systems. By linking the computational models, power usage effectiveness (PUE) for all scenarios can be calculated for selected geographical locations and data center parameters. The paper also presents detailed analyses of the cooling components considered and comparisons of the PUE results.


Author(s):  
Tianyi Gao ◽  
Emad Samadiani ◽  
Roger Schmidt ◽  
Bahgat Sammakia

Thermal management of high power data centers poses challenges due to the high operational cost which is made worse due to the many inefficiencies that arise in them. Additional challenges arise due to the dynamic behaviors that occur during normal operation, and also during emergencies such as power outages or failure of some or all of the cooling equipment. Water and hybrid air plus water cooled data centers are an alternate cooling solution combining liquid cooling systems, such as rear door heat exchangers located within the racks themselves, in addition to the traditional raised floor cold aisle air cooling system. Such a solution may be used when some of the equipment in a data center is upgraded to higher end and higher power equipment which may not be manageable with the existing air cooling system. For a data center with a hybrid cooling system, the cold air supply and the cold water supply should increase in case of an emergency, such as a CRAC (Computer Room Air Conditioner) units’ failure. In this paper, a detailed computational study is conducted to investigate the dynamic response of the impact of a CRAC failure on both water side and air side in a representative hybrid cooling room. The room studied is an air cooled data center using the common cold aisle approach, with rear door heat exchangers installed on all of the racks. CRAC failure is investigated in a hybrid cooling room. The variation and fluctuation in an average rack inlet temperature, and inlet temperatures at different detail locations are presented in plots, showing the dynamic performance of a hybrid cooling data center subjected to the different CRAC failure scenarios. Different response time studies are also presented in this paper.


Author(s):  
Veerendra Mulay ◽  
Saket Karajgikar ◽  
Dereje Agonafer ◽  
Roger Schmidt ◽  
Madshusudan Iyengar ◽  
...  

The power trend for server systems continues to grow thereby making thermal management of data centers a very challenging task. Although various configurations exist, the raised floor plenum with Computer Room Air Conditioners (CRACs) providing cold air is a popular operating strategy. In prior work, numerous data center layouts employing raised floor plenum and the impact of design parameters such as plenum depth, ceiling height, cold isle location, tile openings and others on thermal performance of data center were presented. The air cooling of data center however, may not address the situation where more energy is expended in cooling infrastructure than the thermal load of data center. Revised power trend projections by ASHRAE TC 9.9 predict heat loads as high as 5000W per square feet of compute servers’ equipment footprint by year 2010. These trend charts also indicate that heat load per product footprint has doubled for storage servers during 2000–2004. For the same period, heat load per product footprint for compute servers has tripled. Amongst the systems that are currently available and being shipped, many racks exceed 20kW. Such high heat loads have raised concerns over air cooling limits of data centers similar to that of microprocessors. A hybrid cooling strategy that incorporates liquid cooling along with air cooling can be very efficient in such situations. The impact of such an operating strategy on thermal management of data center is discussed in this paper. A representative data center is modeled using commercially available CFD code. The change in rack temperature gradients, recirculation cells and CRAC demand due to use of hybrid cooling is presented in a detailed parametric study. It is shown that the hybrid cooling strategy improves the cooling of data center which may enable full population of rack and better management of system infrastructure.


Author(s):  
Amip J. Shah ◽  
Van P. Carey ◽  
Cullen E. Bash ◽  
Chandrakant D. Patel

Data centers today contain more computing and networking equipment than ever before. As a result, a higher amount of cooling is required to maintain facilities within operable temperature ranges. Increasing amounts of resources are spent to achieve thermal control, and tremendous potential benefit lies in the optimization of the cooling process. This paper describes a study performed on data center thermal management systems using the thermodynamic concept of exergy. Specifically, an exergy analysis has been performed on sample data centers in an attempt to identify local and overall inefficiencies within thermal management systems. The development of a model using finite volume analysis has been described, and potential applications to real-world systems have been illustrated. Preliminary results suggest that such an exergy-based analysis can be a useful tool in the design and enhancement of thermal management systems.


Sign in / Sign up

Export Citation Format

Share Document