ND MI300X v5 is Microsoft’s eight-way MI300X VM and node. It is built on the same node platform as the ND H100 v5 server, but with an 8-way OAM baseboard in place of the HGX board.
Each VM has:1
- 96 Intel Xeon (Sapphire Rapids) cores (physically two 56-core sockets)
- 1,850 GiB DDR5
- 1,000 GiB of local storage
- 1x 80G Ethernet NIC (physically 100G Azure SmartNIC)
- 8x 400G ConnectX-7 NDR InfiniBand HCAs
- 8x AMD Instinct MI300X GPUs
This is what it looks like:2
Footnotes
-
ND-MI300X-v5 size series - Azure Virtual Machines | Microsoft Learn ↩
-
I took this photo at SC’23. ↩