Industry’s first integrated rack with immersed, liquid-cooled IT

Solution overview

The Schneider Electric, Iceotope, and Avnet Integrated partnership brings to market the industry’s first commercially available, integrated rack with chassis-based, immersive liquid cooling technology.

Optimized for compute-intensive applications, the solution seals a high-powered GPU server within an energy efficient – and performance enhancing – Iceotope liquid-cooled chassis. Operating in near silence, the chassis is sealed which makes it impervious to dust, heat, and humidity while allowing it to be deployed in the harshest environments.

Integrated by Avnet with Schneider Electric’s NetShelter liquid-cooled enclosure system, this solution is designed for simple deployment into data centers and edge computing environments.

Versatile and future-proof

Iceotope’s liquid cooling technology offers greater efficiency, lower operating costs, smaller footprint, increased reliability, and near silent operation despite the high-power density of the GPUs.

The solution is EcoStruxure Ready as it’s available with next generation data center Infrastructure management software, EcoStruxure IT Expert and EcoStruxure Asset Advisor from Schneider Electric.

Schneider Electric, Iceotope, and Avnet plan to open the partnership up to other server OEMs as demand grows.

A guide for your journey

Avnet Integrated provides a wide variety of professional and product support services to customers and their end users. These services ensure regional and global consumers realize a world class experience which is especially critical when deploying advanced solutions like those that include Schneider and Iceotope. Global services extended by Avnet Integrated include:

Product services

  • Field Installation and Maintenance
  • Advance Exchange
  • Repair/Refurbishment
  • IT Asset Disposition/Value Recovery
  • Renewal Management

Professional services

  • Preinstall Site Readiness Assessment
  • Implementation - Hardware and Application
  • Data Migration and Integration
  • Advanced Analytics

Features

  • Single node solution including 1 immersive cooled server, 56 compute cores / 128 GB of memory / 6 V100 Tesla GPUs
  • Sealed, fan-less server ideal for harsh environments
  • Industry standard servers integrated with Iceotope’s liquid cooling technology
  • Rack includes Schneider Electric rack PDU and NetBotz rack monitor, Lenovo RackSwitch
  • Rack maximum configuration capacity: 14ea 3U Immersive-cooled GPU servers
  • In-rack dielectric fluid fill/drain from front
  • Blind-mate power and fluid connectors
  • Latch locking for quick access service
  • Integrated and supported by Avnet

Benefits

  • Server agnostic
  • pPUE 1.03
  • Lower operating costs
  • Energy effective
  • Negligible water consumption
  • Increased reliability
  • Near silent operation

Liquid-Cooled Server

This rack-mount, high-powered 3U GPU server is cooled via chassis-based, immersive liquid cooling. The system is configured with: (2) Cascade Lake 8276 Xeon processors 28 cores each; 128GB 2933 ECC RDIMM and (6) V100 Nvidia Tesla GPU’s. Iceotope’s innovative chassis-based immersive cooling allows for near silent operation with over 95% of the heat being removed via fluid. By eliminating the IT fans, server power consumption is reduced by up to 10%, providing immediate energy savings. Server maintenance is easily performed by features that include blind-mate dripless connectors in the rear and quick release latches for the chassis lid. The dielectric fluid sealed within the server chassis is touch safe, non-toxic, non-flammable, non-ozone depleting and has a lifespan of at least 20 years. Quick connect couplings are provided on the front of the server to allow for easy extraction of the dielectric fluid if needed for significant server upgrades or maintenance.

The front view of an open server

NetShelter Liquid-Cooled Enclosure Systems

  • 48U, 600mm wide x 1250mm deep
  • 21” Mounting rails
  • 24U option available

Based on the world’s most versatile rack, the Schneider Electric NetShelter Liquid-cooled Enclosure is built for chassis-based, immersive liquid-cooled servers. A fluid manifold comes installed at the rear of the rack for connection to a heat rejection system (not included). 48U-spaces provide the height necessary to scale the solution up to 14 x 3U GPU servers, in addition to accommodating the Lenovo network top-of-rack switch and Netbotz 250 Rack Monitor appliance.

These NetShelter Liquid-cooled racks are designed to address the challenge of rising chip densities and applications ranging from artificial intelligence to high performance computing. With a strong focus on cooling, power distribution, cable management and environmental monitoring, the NetShelter Liquid-cooled enclosure provides a reliable rack-mounting environment for power-dense mission-critical equipment.

NetShelter Metered Rack PDUs

  • 208V, 230V, 400/415V options
  • 0U/1U/2U mount options

Metered rack Power Distribution Units (PDUs) provide real-time remote monitoring of connected loads. User-defined alarms warn of potential circuit overloads before critical IT failures occur.

Schneider Electric NetBotz Rack Monitor 250

The NetBotz Rack Monitor 250 provides cost-effective and flexible environmental monitoring. Accessible through a browser, the NetBotz offers temperature and humidity (sensors included) monitoring to prevent equipment failure due to environmental extremes. A 4.5m NetBotz Spot Fluid Sensor is also included to monitor for leak detection in the heat rejection circuit.

Integrated Liquid Cooled Rack, System Specifications
Rack Dimensions 48U*, 600mm wide x 1250mm deep
Servers 1 to 14 liquid-cooled 3U servers
Power Up to 30kW
Input Power Circuits 400/415V: 4 x 32A; IEC 309, 5 wire, up to 14 servers, redundant (NOTE: if deploying 10 or less servers, only 2 x 32A circuits required)
  208V: 2 x 60A; IEC 309, 3P+P, up to 8 servers, redundant
Input Water Circuit Temperature: non-condensing to 40C (104F)
  Flow rate: Up to 8 l/min per server
  Temperature and flow rate based on 35% glycol mix
Weight 770kg (1692 lbs) fully configured with 14 servers
* 24U 1/2 rack option available

Lenovo ThinkSystem NE1032 RackSwitch

The Lenovo ThinkSystem NE1032 RackSwitch is a 1U rack-mount, 10 Gb Ethernet switch that delivers lossless, low-latency performance with feature-rich design that supports virtualization, Converged Enhanced Ethernet (CEE), high availability, and enterprise class Layer 2 and Layer 3 functionality. The switch delivers line-rate, high-bandwidth switching, filtering, and traffic queuing without delaying data.

For more information about Avnet Integrated, visit avnet.com/integrated or contact us at integrated@avnet.com to learn more.

For more information about Schneider Electric, visit https://www.se.com/ww/en/work/solutions/for-business/data-centers-and-networks/liquid-cooling/

For more information about Iceotope, visit iceotope.com