Innfuse Node H8
4- or 8-GPU A100/H100/H200 Server
Overview
The Innfuse Node H8 is a GPU server built on Dual Intel Xeon or AMD EPYC 9004/9005. It takes 4× or 8× A100, H100 or H200, with up to 8 TB of system memory. Each unit is assembled to your configuration, burn-in tested and shipped ready to run.
Built for
- Multi-GPU training and high-throughput inference
Every Innfuse system includes
- Assembly to your exact configuration
- Burn-in testing before shipping
- Ubuntu with CUDA, PyTorch and vLLM preinstalled, or Windows
- Manufacturer warranty on every component
Specifications
Motherboard
Dual CPU server board.
- AMD EPYC 9005/9004 series processors (Socket SP5).
- OCP 3.0 compliant.
- System on Chip (SoC).
CPU
- AMD EPYC 9005/9004 series processor family
- Dual processors, 5nm
- Up to 192-core, 384 threads per processor
- cTDP up to 400W
Memory
- Up to 6144 GB DDR5 ECC Buffered
- 24 x DIMM slots
- DDR5 memory supported only
- 12-Channel memory per processor architecture
- RDIMM modules up to 64GB supported
- 3DS RDIMM modules up to 256GB supported
NOTE: actual RAM clock speed depends on the CPU specifications and may vary.
Note: Default memory clock speed: 4800Mhz.
Please contact sales for a higher-clock speed.
Expansion Slots
- 8 x PCIe slots (Gen5 x16 link, FH, FL) for dual-slot GPU cards
- 1 x PCIe slot (Gen5 x8 link, LP, HL) for HBA/RAID cards (front)
- 1 x PCIe slot (Gen5 x16 link) for NIC or 1 x OCP3.0 NIC socket (Gen5 x16 link) (rear)
- 1 x PCIe slot (Gen5 x8 link) for NIC (rear)
Storage
Default option
- 8 x 3.5"/2.5" Front Hot-swap Storage Bays
- 1 x M.2 Socket, supports up to 22110 type (PCIe Gen3 x4 link)
G9000-600W option
- 8 x 2.5" Front Hot-swap Storage Bays
- Up to 6 NVMe drives based on HBA/Raid card model installed
LAN
Default option
- 2 x 10GbE LAN ports (Intel X710-AT2)
- 1 x 10/100/1000 management LAN (Dedicated IPMI)
- 25 Gigabit Dual Port Ethernet (2x SFP28) (optional)
- 100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; 1x QSFP) (optional)
- 200 Gbps Dual Port InfiniBand HDR (Mellanox ConnectX-6 VPI Adapter; 2x QSFP) (optional)
- 400 Gbps Single Port InfiniBand NDR (Mellanox ConnectX-7 VPI Adapter; 1x OSFP) (optional)
G9000-600W option
- 1 x 10/100/1000 management LAN (Dedicated IPMI)
- 25 Gigabit Dual Port Ethernet (2x SFP28) (optional)
- 100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; 1x QSFP) (optional)
- 200 Gbps Dual Port InfiniBand HDR (Mellanox ConnectX-6 VPI Adapter; 2x QSFP) (optional)
- 400 Gbps Single Port InfiniBand NDR (Mellanox ConnectX-7 VPI Adapter; 1x OSFP) (optional)
Graphics Cards
Up to 8 Nvidia cards with NVLink support.
Available options:
- Nvidia A100 40Gb (no video outputs)
- Nvidia A100 80Gb (no video outputs)
- Nvidia H100 94Gb NVL (no video outputs)
- Nvidia H200 141Gb NVL (no video outputs)
Power Supply
Default option
- 2+2 Redundant 2600W 80 PLUS Titanium Power Supply
- Rating: 220-240 Vac, 15.5A(x4), 50-60 Hz
NOTE: G9000 comes with 4 x 2600W Redundant (2+2) power supplies. Total 4 power supplies (2 main + 2 backup).
That means that maximum output power is 5200W (2 x 2600W) with 5200W (2 x 2600W) for backup power supplies.
If one power supplies will fail, the other backup power supply starts running to keep the computer powered up.
The switch between the power supplies is seamless, so as not to interrupt the normal use of the computer.
Power cord requirements:
C19 (PSU) to 5-15P (regular US home outlet).
C19 (PSU) to C20 (plug) (PDU).
G9000-600W option
- 3+1 Redundant 3200W 80 PLUS Titanium Power Supply
- Rating: 220-240 Vac, 16.0A(x4), 50-60 Hz
NOTE: G9000-600W comes with 4 x 3200W Redundant (3+1) power supplies. Total 4 power supplies (3 main + 1 backup).
That means that maximum output power is 9600W (3 x 3200W) with 3200W (1 x 3200W) for backup power supplies.
If one power suppliy will fail, the backup power supply starts running to keep the computer powered up.
The switch between the power supplies is seamless, so as not to interrupt the normal use of the computer.
Power cord requirements:
C19 (PSU) to 5-15P (regular US home outlet).
C19 (PSU) to C20 (plug) (PDU).
Dimensions & Weight
Case #1 (default option)
- Rackmountable; 4U; horizontal placement
- Height: 6.85 inches (17.45 cm)
- Width: 17.3 inches (44.0 cm)
- Depth: 31.5 inches (80.0 cm)
Shipping Package
- Height: 17.3 inches (44.4 cm)
- Width: 31.5 inches (80.0 cm)
- Length: 47.2 inches (120.0 cm)
- Weight: 135 lbs (61.2 kg) (shipped on pallet)
Case #2 (G9000-600W)
- Rackmountable; 4U; horizontal placement
- Height: 6.89 inches (17.5 cm)
- Width: 17.28 inches (43.95 cm)
- Depth: 31.5 inches (80.0 cm)
Shipping Package
- Height: 17.3 inches (44.4 cm)
- Width: 31.5 inches (80.0 cm)
- Length: 47.2 inches (120.0 cm)
- Weight: 167.5 lbs (76.2 kg) (shipped on pallet)
Motherboard
Dual CPU server board.
- Intel Xeon Scalable Processors LGA 4677 (Socket E).
- Intel C741 chipset.
CPU
- 4th/5th Generation Intel Xeon Scalable Processors
- Intel Xeon CPU Max Series
- Intel Xeon Platinum Processor, Intel Xeon Gold Processor, Intel Xeon Silver Processor
- Dual processors, 10nm
- Up to 60-core, 120 threads per processor
- cTDP up to 350W
Memory
- Up to 8192 GB DDR5 ECC Buffered
- 32 x DIMM slots
- DDR5 memory supported only
- 8-Channel memory per processor architecture
- RDIMM modules up to 64GB supported
- 3DS RDIMM modules up to 256GB supported
NOTE: actual RAM clock speed depends on the CPU specifications and may vary.
Expansion Slots
- 8 x PCIe slots (Gen5 x16 link, FH,FL) for dual-slot GPU cards
- 1 x PCIe slot (Gen5 x8 link, LP,HL) for HBA/RAID cards (front)
- 1 x PCIe slot (Gen5 x16 link) for NIC (rear)
- 1 x PCIe slot (Gen5 x8 link) for NIC (rear)
Storage
Default option
- 8 x 3.5"/2.5" Gen5 NVMe (front hot-swap)
- 1 x M.2 (2280/22110), PCIe Gen3 x4
G9000-600W option
- 8 x 2.5" Front Hot-swap Storage Bays
- Up to 6 NVMe devices based on HBA/Raid card model installed
- 2 x M.2 socket (Gen 5 x4 link, up to 22110)
LAN
Default option
- 2 x 10Gb/s LAN ports (Intel X710-AT2)
- 1 x 10/100/1000 management LAN (Dedicated IPMI)
- 25 Gigabit Dual Port Ethernet (2x SFP28) (optional)
- 100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; 1x QSFP) (optional)
- 200 Gbps Dual Port InfiniBand HDR (Mellanox ConnectX-6 VPI Adapter; 2x QSFP) (optional)
- 400 Gbps Single Port InfiniBand NDR (Mellanox ConnectX-7 VPI Adapter; 1x OSFP) (optional)
G9000-600W option
- 1 x 10/100/1000 management LAN (Dedicated IPMI)
- 25 Gigabit Dual Port Ethernet (2x SFP28) (optional)
- 100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; 1x QSFP) (optional)
- 200 Gbps Dual Port InfiniBand HDR (Mellanox ConnectX-6 VPI Adapter; 2x QSFP) (optional)
- 400 Gbps Single Port InfiniBand NDR (Mellanox ConnectX-7 VPI Adapter; 1x OSFP) (optional)
Graphics Cards
Up to 8 Nvidia cards with NVLink support.
Available options:
- Nvidia A100 40Gb (no video outputs)
- Nvidia A100 80Gb (no video outputs)
- Nvidia H100 94Gb NVL (no video outputs)
- Nvidia H200 141Gb NVL (no video outputs)
Power Supply
Default option
- 2+2 Redundant 2600W 80 PLUS Titanium Power Supply
- Rating: 220-240 Vac, 15.5A(x4), 50-60 Hz
NOTE: G9000 comes with 4 x 2600W Redundant (2+2) power supplies. Total 4 power supplies (2 main + 2 backup).
That means that maximum output power is 5200W (2 x 2600W) with 5200W (2 x 2600W) for backup power supplies.
If one power supplies will fail, the other backup power supply starts running to keep the computer powered up.
The switch between the power supplies is seamless, so as not to interrupt the normal use of the computer.
Power cord requirements:
C19 (PSU) to 5-15P (regular US home outlet).
C19 (PSU) to C20 (plug) (PDU).
G9000-600W option
- 3+1 Redundant 3200W 80 PLUS Titanium Power Supply
- Rating: 220-240 Vac, 16.0A(x4), 50-60 Hz
NOTE: G9000-600W comes with 4 x 3200W Redundant (3+1) power supplies. Total 4 power supplies (3 main + 1 backup).
That means that maximum output power is 9600W (3 x 3200W) with 3200W (1 x 3200W) for backup power supplies.
If one power suppliy will fail, the backup power supply starts running to keep the computer powered up.
The switch between the power supplies is seamless, so as not to interrupt the normal use of the computer.
Power cord requirements:
C19 (PSU) to 5-15P (regular US home outlet).
C19 (PSU) to C20 (plug) (PDU).
Dimensions & Weight
Case #1 (default option)
- Rackmountable; 4U; horizontal placement
- Height: 6.69 inches (17.45 cm)
- Width: 17.3 inches (44.0 cm)
- Depth: 31.5 inches (80.0 cm)
Shipping Package
- Height: 17.3 inches (44.4 cm)
- Width: 31.5 inches (80.0 cm)
- Length: 47.2 inches (120.0 cm)
- Weight: 135 lbs (61.2 kg) (shipped on pallet)
Case #2 (G9000-600W)
- Rackmountable; 4U; horizontal placement
- Height: 6.89 inches (17.5 cm)
- Width: 17.28 inches (43.95 cm)
- Depth: 31.5 inches (80.0 cm)
Shipping Package
- Height: 17.3 inches (44.4 cm)
- Width: 31.5 inches (80.0 cm)
- Length: 47.2 inches (120.0 cm)
- Weight: 167.5 lbs (76.2 kg) (shipped on pallet)
Buying this system
Related systems
Node X4
Node4-GPU Intel Xeon GPU Server
- GPU
- Up to 4× RTX PRO 6000 Blackwell, A100, H100 or H200
- CPU
- Single Intel Xeon
- Memory
- Up to 2 TB
Node E4
Node4-GPU AMD EPYC GPU Server
- GPU
- Up to 4× RTX PRO 6000 Blackwell, A100, H100 or H200
- CPU
- Single AMD EPYC 9004/9005, up to 192 cores
- Memory
- Up to 2 TB
Node X8
Node8-GPU Dual Xeon GPU Server
- GPU
- Up to 8× A100, H100, H200, L40S or RTX PRO 6000 Blackwell
- CPU
- Dual Intel Xeon Scalable, 4th/5th gen
- Memory
- Up to 8 TB ECC