Using Instinct™ GPUs on Azure

Using Instinct™ GPUs on Azure#

Getting Started with AMD Instinct MI300X on Azure

This guide will walk you through provisioning an ND MI300X v5 virtual machine on Azure.

Getting Started with AMD Instinct MI300X on Azure
Setting up Azure Kubernetes Service with AMD Instinct MI300X

This guide provides instructions for setting up an AKS cluster with ND MI300X v5 virtual machines.

Setting up Azure Kubernetes Service with AMD Instinct MI300X
Azure Kubernetes Service Compatibility AMD Instinct MI300X

Compatibility of VM sizes, operating systems, and software versions with GPU types and ROCm versions.

Azure Kubernetes Service Compatibility AMD Instinct MI300X
Setting up Kubernetes with AMD Instinct MI300X on Azure

This guide covers how to set up RKE2, including kubectl, Helm, and more to run AI workloads.

Setting up Kubernetes with AMD Instinct MI300X on Azure
Deploy Azure CycleCloud Workspace for Slurm with AMD Instinct MI300X

In this tutorial, you’ll learn how to deploy a Slurm cluster with MI300X VMs using the CLI.

Deploy Azure CycleCloud Workspace for Slurm with AMD Instinct MI300X
Model Inference with AMD Instinct MI300X on Azure using vLLM

Learn how to run model inference workloads using MI300X GPUs on Azure with vLLM.

Model Inference with AMD Instinct MI300X on Azure Using vLLM
Fine-tuning Llama-3.2 3B with LoRA on Azure

This tutorial demonstrates how to apply LoRA to fine-tune Llama-3.2 3B model on instruction-following data.

Fine-tuning Llama-3.2 3B with LoRA on Azure