ND A100 v4 is Microsoft’s eight-way A100 VM type and compute node. It comes in two varieties:
| Name | Instance | Config |
|---|---|---|
| ND A100 v4 | Standard_ND96asr_A100_v4 | Has 40 GB HBM per GPU |
| NDm A100 v4 | Standard_ND96amsr_A100_v4 | Has 80 GB HBM per GPU |
The physical node looks like this:1

Footnotes
-
Microsoft booth at SC22. See Microsoft Azure at SC22 and The Enormous AMD EPYC Genoa Heatsink on HBv4 (servethehome.com) for more. ↩