DirectML Flow Instructions#

Prerequisites#

You can ensure GPU driver and DirectX version from Windows Task Manager -> Performance -> GPU

Running models on Ryzen AI GPU#

Running model on Ryzen AI GPU can be summarized in a couple of easy steps:

Model Conversion and Optimization: After the model is trained, if the model is not already in ONNX format, you can use Microsoft Olive Optimizer to convert your models to ONNX first and then optimize using Olive optimizer for optimal target execution.

For Olive flow please refer to Microsoft Olive Documentation

Deployment: Once the model is in ONNX format, you deploy and run the model with ONNX Runtime DirectML EP (DmlExecutionProvider) to accelerate with AMD Ryzen AI GPU device.

For DirectML related information please refer DirectML documentation

Examples#

Optimizing and running ResNet on Ryzen AI GPU