CFD Analysis of Thermal Shadowing and Optimization of Heatsinks in 3rd Generation Open Compute Server for Single-Phase Immersion Cooling

Author(s):  
Jimil M. Shah ◽  
Ravya Dandamudi ◽  
Chinmay Bhatt ◽  
Pranavi Rachamreddy ◽  
Pratik Bansode ◽  
...  

Abstract In today’s networking world, utilization of servers and data centers has been increasing significantly. Increasing demand of processing and storage of data causes a corresponding increase in power density of servers. The data center energy efficiency largely depends on thermal management of servers. Currently, air cooling is the most widely used thermal management technology in data centers. However, air cooling has started to reach its limits due to high-powered processors. To overcome these limitations of air cooling in data centers, liquid immersion cooling methods using different dielectric fluids can be a viable option. Thermal shadowing is an effect in which temperature of a cooling medium increases by carrying heat from one source and results in decreasing its heat carrying capacity due to reduction in the temperature difference between the maximum junction temperature of successive heat sink and incoming fluid. Thermal Shadowing is a challenge for both air and low velocity oil flow cooling. In this study, the impact of thermal shadowing in a third-generation open compute server using different dielectric fluids is compared. The heat sink is a critical part for cooling effectiveness at server level. This work also provides an efficient range of heat sinks with computational modelling of third generation open compute server. Optimization of heat sink can allow to cool high-power density servers effectively for single-phase immersion cooling applications. A parametric study is conducted, and significant savings in the volume of a heat sink have been reported.

Author(s):  
Jimil M. Shah ◽  
Chinmay Bhatt ◽  
Pranavi Rachamreddy ◽  
Ravya Dandamudi ◽  
Satyam Saini ◽  
...  

Abstract Networking and computing dependency has been increasing in the modern world, thus, boosting the growth of data centers in leading business domains like banking, education, transportation, social media etc. Data center is a facility that incorporates an organization’s IT operations and equipment, as well as where it stores, processes and manages the data. To fulfill the increasing demands of data storage and data processing, a corresponding increase in server performance is needed. This causes a subsequent increment in power consumption and heat generation in the servers due to high performance processing units. Currently, air cooling is the most widely used thermal management technique in data centers, but it has started to reach its limitations in cooling high packaging densities. Therefore, industries are looking for single-phase immersion cooling using various dielectric fluids to reduce the operational and cooling costs by enhancing the thermal management of servers. This research work aims at increasing the rack density by reducing the form factor of a 3rd Generation Open Compute Server using single-phase immersion cooling. A computational study is conducted in the operational range of temperatures and the thermal efficiency is optimized. A parametric study is conducted by changing the inlet velocities and inlet temperatures of cooling liquid for different heights of the open compute 3rd generation server. A comparative study is then carried out for white mineral oil and synthetic fluid (EC100).


Author(s):  
Dhruvkumar Gandhi ◽  
Uschas Chowdhury ◽  
Tushar Chauhan ◽  
Pratik Bansode ◽  
Satyam Saini ◽  
...  

Abstract Complete immersion of servers in synthetic dielectric fluids is rapidly becoming a popular technique to minimize the energy consumed by data centers for cooling purposes. In general, immersion cooling offers noteworthy advantages over conventional air-cooling methods as synthetic dielectric fluids have high heat dissipation capacities which are roughly about 1200 times greater than air. Other advantages of dielectric fluid immersion cooling include even thermal profile on chips, reduction in noise and addressing reliability and operational enhancements like whisker formation and electrochemical migration. Nevertheless, lack of data published and availability of long-term reliability data on immersion cooling is insufficient which makes most of data centers operators reluctant to implement this technique. The first part of this paper will compare thermal performance of single-phase oil immersion cooled HP ProLiant DL160 G6 server against air cooled server using computational fluid dynamics on 6SigmaET®. Focus of the study are major components of the server like Central Processing Unit (CPU), Dual in Line Memory Module (DIMM), Input/output Hub (IOH) chip and Input/output controller Hub (ICH). The second part of this paper focuses on thermal performance optimization of oil immersion cooled servers by varying inlet oil temperature, flow rate and using different fluid.


Author(s):  
Veerendra Mulay ◽  
Saket Karajgikar ◽  
Dereje Agonafer ◽  
Roger Schmidt ◽  
Madshusudan Iyengar ◽  
...  

The power trend for server systems continues to grow thereby making thermal management of data centers a very challenging task. Although various configurations exist, the raised floor plenum with Computer Room Air Conditioners (CRACs) providing cold air is a popular operating strategy. In prior work, numerous data center layouts employing raised floor plenum and the impact of design parameters such as plenum depth, ceiling height, cold isle location, tile openings and others on thermal performance of data center were presented. The air cooling of data center however, may not address the situation where more energy is expended in cooling infrastructure than the thermal load of data center. Revised power trend projections by ASHRAE TC 9.9 predict heat loads as high as 5000W per square feet of compute servers’ equipment footprint by year 2010. These trend charts also indicate that heat load per product footprint has doubled for storage servers during 2000–2004. For the same period, heat load per product footprint for compute servers has tripled. Amongst the systems that are currently available and being shipped, many racks exceed 20kW. Such high heat loads have raised concerns over air cooling limits of data centers similar to that of microprocessors. A hybrid cooling strategy that incorporates liquid cooling along with air cooling can be very efficient in such situations. The impact of such an operating strategy on thermal management of data center is discussed in this paper. A representative data center is modeled using commercially available CFD code. The change in rack temperature gradients, recirculation cells and CRAC demand due to use of hybrid cooling is presented in a detailed parametric study. It is shown that the hybrid cooling strategy improves the cooling of data center which may enable full population of rack and better management of system infrastructure.


Author(s):  
Tunc Icoz ◽  
Mehmet Arik ◽  
John T. Dardis

Thermal management of electronics is a critical part of maintaining high efficiency and reliability. Adequate cooling must be balanced with weight and volumetric requirements, especially for passive air-cooling solutions in electronics applications where space and weight are at a premium. It should be noted that there are systems where thermal solution takes more than 95% of the total weight of the system. Therefore, it is necessary to investigate and utilize advanced materials to design low weight and compact systems. Many of the advanced materials have anisotropic thermal properties and their performances depend strongly on taking advantage of superior properties in the desired directions. Therefore, control of thermal conductivity plays an important role in utilization of such materials for cooling applications. Because of the complexity introduced by anisotropic properties, thermal performances of advanced materials are yet to be fully understood. Present study is an experimental and computational study on characterization of thermal performances of advanced materials for heat sink applications. Numerical simulations and experiments are performed to characterize thermal performances of four different materials. An estimated weight savings in excess of 75% with lightweight materials are observed compared to the traditionally used heat sinks.


Author(s):  
Mayumi Ouchi ◽  
Yoshiyuki Abe ◽  
Masato Fukagaya ◽  
Takashi Kitagawa ◽  
Haruhiko Ohta ◽  
...  

Energy consumption in data centers has seen a drastic increase in recent years. In data centers, server racks are cooled down in an indirect way by air-conditioning systems installed to cool the entire server room. This air cooling method is inefficient as information technology (IT) equipment is insufficiently cooled down, whereas the room is overcooled. The development of countermeasures for heat generated by IT equipment is one of the urgent tasks to be accomplished. We, therefore, proposed new liquid cooling systems in which IT equipment is cooled down directly and exhaust heat is not radiated into the server room. Three cooling methods have been developed simultaneously. Two of them involve direct cooling; a cooling jacket is directly attached to the heat source (or CPU in this case) and a single-phase heat exchanger or a two-phase heat exchanger is used as the cooling jacket. The other method involves indirect cooling; heat generated by CPU is transported to the outside of the chassis through flat heat pipes and the condensation sections of the heat pipes are cooled down by coolant with liquid manifold. Verification tests have been conducted by using commercial server racks to which these cooling methods are applied while investigating five R&D components that constitute our liquid cooling systems: the single-phase heat exchanger, the two-phase heat exchanger, high performance flat heat pipes, nanofluid technology, and the plug-in connector. As a result, a 44–53% reduction in energy consumption of cooling facilities with the single-phase cooling system and a 42–50% reduction with the flat heat pipe cooling system were realized compared with conventional air cooling system.


Author(s):  
Shuai Shao ◽  
Tianyi Gao ◽  
Huawei Yang ◽  
Jie Zhao ◽  
Jiajun Zhang

Abstract Along with advancements in microelectronics packaging, the power density of processor units has steadily increased over time. Data center servers equipped for high performance computing (HPC) often use multiple central processing units (CPUs) and graphical processing units (GPUs), thereby resulting in an increased power density, exceeding 1 kW per U. Many data center organizations are evaluating single phase immersion technology as a potential energy and resource saving cooling option. In this work immersion cooling was studied at a power level of 2.7kW/U with a 5U-height immersion cooling tank. Heat generated by a simulated GPU server was transferred to the secondary loop coolant, and then exchanged with the primary loop facility coolant through the heat exchanger. The chiller supply and return temperature and flow rate was controlled for the primary loop. The simulated GPU server chassis was designed to provide thermal power equivalent to a high power density server. Eight simulated power heaters, of which each unit was the size of a GPU chipset, was assembled in the comparable location to a real IT equipment on a 4U server chassis. Power for the GPU simulated chassis was able to support up to 2700 W maximum. Three investigations for this immersion cooling system evaluation were performed through comprehensive testing. The first is to identify the key decision making factor(s) for evaluating the thermal performance of 4 hydrocarbon-based dielectric coolants, including power parametric analysis, transient analysis, power cycling test, and fluid temperature profiling. The second is to develop an optimization strategy for the immersion system thermal performance. The third is to verify the capability of an 1U heat sink to support high density processor units over 300 W per GPU in an immersion cooling solution.


Author(s):  
Shankar Krishnan ◽  
Suresh V. Garimella ◽  
Greg M. Chrysler ◽  
Ravi V. Mahajan

The thermal design power trends and power densities for present and future microprocessors are investigated. The trends are derived based on Moore’s law and scaling theory. Both active and stand-by power are discussed and accounted for in the calculations. A brief discussion of various leakage power components and their impact on the power density trends is provided. Two different lower limits of heat dissipation for irreversible logic computers are discussed. These are based on the irreversibility of logic to represent one bit of information, and on the distribution of electrons to represent a bit. These limits are found to be two or more orders of magnitude lower than present-day microprocessor thermal design power trends. Further, these trends are compared to the projected trends for the desktop product sector from the International Technology Roadmap for Semiconductors (ITRS). To evaluate the thermal impact of the projected power densities, heat sink thermal resistances are calculated for a given technology target. Based on the heat sink thermal resistance trends, the evolution of an air-cooling limit consistent with Moore’s law is predicted. One viable alternative to air-cooling, i.e., the use of high-efficiency solid-state thermoelectric coolers (TECs), is explored. The impact of different parasitics on the thermoelectric figure of merit (ZT) is quantified.   This paper was also originally published as part of the Proceedings of the ASME 2005 Heat Transfer Summer Conference.


Author(s):  
Veerendra Mulay ◽  
Saket Karajgikar ◽  
Dereje Agonafer ◽  
Roger Schmidt ◽  
Madhusudan Iyengar

The power trend for Server systems continues to grow thereby making thermal management of Data centers a very challenging task. Although various configurations exist, the raised floor plenum with Computer Room Air Conditioners (CRACs) providing cold air is a popular operating strategy. The air cooling of data center however, may not address the situation where more energy is expended in cooling infrastructure than the thermal load of data center. Revised power trend projections by ASHRAE TC 9.9 predict heat load as high as 5000W per square feet of compute servers’ equipment footprint by year 2010. These trend charts also indicate that heat load per product footprint has doubled for storage servers during 2000–2004. For the same period, heat load per product footprint for compute servers has tripled. Amongst the systems that are currently available and being shipped, many racks exceed 20kW. Such high heat loads have raised concerns over limits of air cooling of data centers similar to air cooling of microprocessors. A hybrid cooling strategy that incorporates liquid cooling along with air cooling can be very efficient in these situations. A parametric study of such solution is presented in this paper. A representative data center with 40 racks is modeled using commercially available CFD code. The variation in rack inlet temperature due to tile openings, underfloor plenum depths is reported.


Author(s):  
Xuchen Zhang ◽  
Xuefei Han ◽  
Thomas E. Sarvey ◽  
Craig E. Green ◽  
Peter A. Kottke ◽  
...  

In this paper, a novel thermal testbed with an embedded micropin-fin heat sink is designed and fabricated. The micropin-fin array has a nominal height of 200 μm and a diameter of 90 μm. Single phase and two phase thermal testing of the micropin-fin array heat sink are performed using deionized (D.I.) water as the coolant below atmospheric pressure. The measured pressure drop is as high as 100 kPa with a mass flux of 1637 kg/m2s at a heat flux of 400 W/cm2 in a two-phase regime. The heat transfer coefficient and the vapor quality are calculated and reported. The impact of microfluidic cooling on the electrical performance of the 3D interconnects is also analyzed. The high aspect ratio through silicon vias (TSVs) used in the electrical analysis have a nominal diameter of 10 μm.


Sign in / Sign up

Export Citation Format

Share Document