The Ryzen AI Software Platform supports AMD Ryzen 7040U, 7040HS series mobile processors with Windows 11 OS.
Prepare Client Device#
Download the IPU Driver and install it by following these steps:
Extract the downloaded zip file.
Open a terminal in administrator mode and execute the
Ensure that the IPU driver is installed from
Device Manager ->
System Devices ->
AMD IPU Device as shown in the following image.
Note: If you see the “Windows could not verify the digital signature of this driver” error message, follow this tutorial to disable signature checking.
To enable the development and deployment of IPU-based inference on the client device, you must have the following software installed, along with their minimum versions.
version >= 3.26
version >= 3.9 (3.9.13 64bit recommended)
Anaconda or Miniconda
AMD IPU driver
Download the setup package
ryzen-ai-sw-0.9.tar.gz and extract.
Before running the installation script ensure all the prerequisites outlined above have been met and the Windows PATH variable is properly set for each component. Make sure to set the PATH variable using “Environment Variables” window from the “System Properties”. For example, Anaconda requires following paths to set the PATH variable
Open the Windows Command Prompt and run the below command
The installation script,
install.bat does the following
Creates a conda environment
Installs Vitis AI ONNX Quantizer
Installs ONNX Runtime
Installs Vitis AI Execution Provider
Sets the environment variable to specify 1x4.xclbin binary
Prints the name of the conda environment before exiting
Thereafter you can activate the created conda environment to get the work environment.
To provide a specific name of the conda work environment run the
install.bat as shown below
.\install.bat -env <env name>
Instead of the bundled installation process using
install.bat, if you choose to install each component manually please refer to Manual Installation page.
If you require to install Vitis AI PyTorch/TensorFlow or Microsoft Olive Quantizer, please refer to Alternate Quantizer Setup page.
Runtime Environment Setup#
Runtime IPU Binary Selection#
The IPU binaries are located inside the setup package. Selecting an IPU binary is a required step every time the application is run from a new terminal. For example, IPU binary 1x4.xclbin is selected as below
Ryzen AI Software platform provides multiple IPU binaries using different configurations on the IPU device. Refer to the Runtime Setup page for more details on IPU binaries.
Runtime Configuration File#
The Execution Provider setup package contains the Vitis AI Execution Provider runtime configuration file
vaip_config.json. This file is required when configuring Vitis AI Execution Provider (VAI EP) inside the ONNX Runtime code.