DirectML Flow

Prerequisites

• DirectX12 capable Windows OS (Windows 11 recommended)

• Latest AMD GPU device driver installed

• Microsoft Olive for model conversion and optimization

• Latest ONNX Runtime DirectML EP

You can ensure GPU driver and DirectX version from Windows Task Manager -> Performance -> GPU

Running models on Ryzen AI GPU

Running models on the Ryzen AI GPU is accomplished in two simple steps:

Model Conversion and Optimization: After the model is trained, Microsoft Olive Optimizer can be used to convert the model to ONNX and optimize it for optimal target execution.

For additional information, refer to the Microsoft Olive Documentation

Deployment: Once the model is in the ONNX format, the ONNX Runtime DirectML EP (DmlExecutionProvider) is used to run the model on the AMD Ryzen AI GPU.

For additional information, refer to the ONNX Runtime documentation for the DirectML Execution Provider

Examples

• Optimizing and running ResNet on Ryzen AI GPU

Additional Resources

• Article on how AMD and Black Magic Design worked together to accelerate Davinci Resolve Studio workload on AMD hardware:

  • AI Accelerated Video Editing with DaVinci Resolve 18.6 & AMD Radeon Graphics

• Blog posts on using the Ryzen AI Software for various generative AI workloads on GPU:

  • Automatic1111 Stable Diffusion WebUI with DirectML Extension on AMD GPUs

  • Running Optimized Llama2 with Microsoft DirectML on AMD Radeon Graphics

  • AI-Assisted Mobile Workstation Workflows Powered by AMD Ryzen™ AI