Virtual machines with GPUs

The evroc cloud allows users to create VMs that have access to GPUs.

Each GPU is dedicated to the consuming VM (rather than e.g. timeshared across different VMs).

Resource profiles

A VM can be created with access to GPUs by using one of the VM resource profiles under "GPU virtual machines" here.

High-performance local disk

GPU VMs are also given access to a high-performance local disk. This disk is included in the cost of the GPU VM, and is not billed separately. This local disk is ephemeral - the data may be lost (e.g. if the VM's host fails), and it cannot be transferred or mounted to another VM.

VM initialisation

By default, GPU VMs come preinstalled with the nvidia-open drivers and the NVIDIA container toolkit. Note that this initialisation requires outbound access to https://developer.download.nvidia.com/ and https://nvidia.github.io/, as well as to the default APT repository URLs, so if adding one or more non-default security groups, this traffic needs to be allowed.

This default initialisation can be overridden using custom cloud-init, as described here.

Quotas

GPU VMs are subject to their own quotas. See "Resource limits" here.