Microsoft adds that the ND A100 v4 is built to take advantage of de-facto industry standard high performance computing (HPC) and Artificial Intelligence (AI) tools and libraries, and can be used without any special software or frameworks.
- We've put together a list of the best workstations on the market
- Need something more portable? Check out the best mobile workstations
- These are the best cloud analytics services
According to internal Microsoft benchmarks, 164 ND A100 v4 virtual machines (VM) yielded a High-Performance Linpack (HPL) result of 16.59 petaflops.
To put it in comparison, this HPL result would place the cloud instance within the Top 20 of the Top 500 list of the fastest supercomputers in the world, as of November 2020.
Microsoft shares that the ND A100 v4 starts with a single VM and eight Nvidia Ampere architecture-based A100 Tensor Core GPUs, and can scale up to thousands of GPUs in a single cluster.
Using one Nvidia HDR 200Gb/s InfiniBand links for each GPU, they can deliver a phenomenal 1.6 Tb/s of interconnect bandwidth per VM.
Furthermore, Azure has paired every eight-GPU VM with a full complement of Nvidia’s NVLink connections to ensure that GPU to GPU connectivity within the VM is in excess of 600 GB/s.
For users of Azure Machine Learning, Microsoft also provides a tuned VM that’s pre-installed with all the required drivers and libraries, and optimized for the ND A100 v4.
As of now, the ND A100 v4 service is available in four Azure regions, namely East United States, West United States 2, West Europe, and South Central United States.
- Check out our list of the best cloud computing services right now