Innfuse Apex B200
8× NVIDIA B200 HGX Server
Overview
The Innfuse Apex B200 is an 8-GPU NVIDIA HGX server with 8× NVIDIA B200 SXM, 192 GB each (1.5 TB HBM3e), NVLink, on Dual Intel Xeon or AMD EPYC with up to 8 TB ECC of memory. It is built and tested by the platform manufacturer, and Innfuse supplies it configured to your order.
Built for
- Multi-GPU training and high-throughput inference
Every Innfuse system includes
- Factory-built and tested by the platform manufacturer
- Configured and supplied to your order
- Ubuntu with CUDA, PyTorch and vLLM preinstalled, or Windows
- Manufacturer warranty on every component
Specifications
Motherboard
Dual CPU server board.
- AMD EPYC 9005/9004 series processors (Socket SP5).
- System on Chip (SoC).
CPU
- AMD EPYC 9005/9004 series processor family
- Dual processors, 5nm
- Up to 192-core, 384 threads per processor
- cTDP up to 500W
Memory
- Up to 3072 GB DDR5 ECC Buffered
- 24 x DIMM slots
- DDR5 memory supported only
- 12-Channel memory per processor architecture
- RDIMM modules up to 128GB supported
- 3DS RDIMM modules up to 256GB supported
NOTE: actual RAM clock speed depends on the CPU specifications and may vary.
Note: Default memory clock speed: 4800Mhz.
Please contact sales for a higher-clock speed.
LAN
Front:
- 2 x 10Gb/s LAN ports (Intel X710-AT2)
- 1 x 10/100/1000 management LAN (Dedicated IPMI)
- 25 Gigabit Dual Port Ethernet (2x SFP28) (optional)
- 100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; 1x QSFP) (optional)
- 200 Gbps Dual Port InfiniBand HDR (Mellanox ConnectX-6 VPI Adapter; 2x QSFP) (optional)
- 400 Gbps Single Port InfiniBand NDR (Mellanox ConnectX-7 VPI Adapter; 1x OSFP) (optional)
Rear:
- 1 x 10/100/1000 management LAN (Dedicated IPMI)
Graphics Cards
8 x NVIDIA B200 Tensor Core 192 GB GPUs (SXM5)
Storage
- 8 x 2.5" Gen5 NVMe (front hot-swap)
- 1 x M.2 (2280/22110), PCIe Gen3 x4, from CPU_1 (internal)
- 1 x M.2 (2280/22110), PCIe Gen3 x1, from CPU_0 (internal)
Peripheral Drives
N/A
Expansion Slots
- 8 x FHHL x16 (Gen5 x16), from PEX89104
- 4 x FHHL x16 (Gen5 x16), from PEX89048
Backplane I/O
- Speed and bandwidth: PCIe Gen5 x4 or SATA 6Gb/s
Power Supply
- 12 x 3000W (240V) 80 PLUS Titanium redundant power supply
AC Input:
- 100-127V~/ 14.2A, 50-60Hz
- 200-220V~/ 15.8A, 50-60Hz
- 220-240V~/ 14.9A, 50-60Hz
DC Input:
- 240Vdc/ 14A
DC Output:
- Max 1450W/ 100-127V~
- +54V/ 26.6A
- +12Vsb/ 3A
- Max 2900W/ 200-220V
- +54V/ 53.4A
- +12Vsb/ 3A
- Max 3002.4W/ 220-240V
- +54V/ 55.6A
- +12Vsb/ 3A
NOTE: X9000 G4 comes with 12 x 3000W Redundant (6+6) power supplies. Total 12 power supplies (6 main + 6 backups).
That means that maximum output power is 18000 W (6 x 3000W) with 18000W (6 x 3000W) for backup power supplies.
If one or two power supplies will fail, the other backup power supply starts running to keep the computer powered up.
The switch between the power supplies is seamless, so as not to interrupt the normal use of the computer.
Power cord requirements:
C19 (PSU) to C20 (plug) (PDU).
Dimensions & Weight
Case
- Rackmountable; 8U; horizontal placement
- Height: 13.8 inches (35.1 cm)
- Width: 17.3 inches (44.7 cm)
- Depth: 36.2 inches (92.0 cm)
Shipping Package
- Height: 27.6 inches (70.0 cm)
- Width: 35 inches (89.0 cm)
- Length: 47.2 inches (120.0 cm)
- Weight: 185.2 lbs (84.5 kg) (shipped on a pallet)
Motherboard
Dual CPU server board.
- Intel Xeon Scalable Processors LGA 4677 (Socket E).
- Intel C741 chipset.
CPU
- 4th/5th Generation Intel Xeon Scalable Processors
- Intel Xeon CPU Max Series
- Intel Xeon Platinum Processor, Intel Xeon Gold Processor, Intel Xeon Silver Processor
- Dual processors, 10nm
- Up to 64-core, 128 threads per processor
- cTDP up to 400W
Memory
- Up to 4096 GB DDR5 ECC Buffered
- 32 x DIMM slots
- DDR5 memory supported only
- 8-Channel memory per processor architecture
- RDIMM modules up to 64GB supported
- 3DS RDIMM modules up to 256GB supported
NOTE: actual RAM clock speed depends on the CPU specifications and may vary.
Note: Default memory clock speed: 4800Mhz.
Please contact sales for a higher-clock speed.
LAN
Front:
- 2 x 10Gb/s LAN ports (Intel X710-AT2)
- 1 x 10/100/1000 management LAN (Dedicated IPMI)
- 25 Gigabit Dual Port Ethernet (2x SFP28) (optional)
- 100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; 1x QSFP) (optional)
- 200 Gbps Dual Port InfiniBand HDR (Mellanox ConnectX-6 VPI Adapter; 2x QSFP) (optional)
- 400 Gbps Single Port InfiniBand NDR (Mellanox ConnectX-7 VPI Adapter; 1x OSFP) (optional)
Rear:
- 1 x 10/100/1000 management LAN (Dedicated IPMI)
Graphics Cards
8 x NVIDIA B200 Tensor Core 192 GB GPUs (SXM5)
Storage
- 8 x 2.5" Gen5 NVMe/SATA (front hot-swap)
- 1 x M.2 (2280/22110), PCIe Gen3 x2, from PCH (internal)
- 1 x M.2 (2280/22110), PCIe Gen3 x1, from PCH (internal)
Peripheral Drives
N/A
Expansion Slots
- 8 x FHHL x16 (Gen5 x16), from PEX89104
- 4 x FHHL x16 (Gen5 x16), from PEX89048
Backplane I/O
- Speed and bandwidth: PCIe Gen5 x4 or SATA 6Gb/s
Power Supply
- 12 x 3000W (240V) 80 PLUS Titanium redundant power supply
AC Input:
- 100-127V~/ 14.2A, 50-60Hz
- 200-220V~/ 15.8A, 50-60Hz
- 220-240V~/ 14.9A, 50-60Hz
DC Input:
- 240Vdc/ 14A
DC Output:
- Max 1450W/ 100-127V~
- +54V/ 26.6A
- +12Vsb/ 3A
- Max 2900W/ 200-220V
- +54V/ 53.4A
- +12Vsb/ 3A
- Max 3002.4W/ 220-240V
- +54V/ 55.6A
- +12Vsb/ 3A
NOTE: X9000 G4 comes with 12 x 3000W Redundant (6+6) power supplies. Total 12 power supplies (6 main + 6 backups).
That means that maximum output power is 18000 W (6 x 3000W) with 18000W (6 x 3000W) for backup power supplies.
If one or two power supplies will fail, the other backup power supply starts running to keep the computer powered up.
The switch between the power supplies is seamless, so as not to interrupt the normal use of the computer.
Power cord requirements:
C19 (PSU) to 5-15P (regular US home outlet).
C19 (PSU) to C20 (plug) (PDU).
Dimensions & Weight
Case
- Rackmountable; 8U; horizontal placement
- Height: 13.8 inches (35.1 cm)
- Width: 17.3 inches (44.7 cm)
- Depth: 36.2 inches (92.0 cm)
Shipping Package
- Height: 27.6 inches (70.0 cm)
- Width: 35 inches (89.0 cm)
- Length: 47.2 inches (120.0 cm)
- Weight: 185.2 lbs (84.5 kg) (shipped on a pallet)