In a recent blog post, Google announced the introduction of the Accelerator-Optimized VM (A2) family on Google Compute Engine, based on the NVIDIA Ampere A100 Tensor Core GPU. A2 provides up to 16 GPUs in a single VM and is the first A100-based offering in the public cloud.
Google designed the A2-family of VMs to boost training and inference computing performance for its customers. The A2 features the NVIDIA A-100 Tensor Core graphics processing unit based up the newly NVIDIA Ampere architecture. According to the blog post, the A-100 offers up to 20 times the compute performance compared to the previous generation GPU, and comes with 40 GB of high performance HBM2 GPU memory.
