Skip to content

Little console app to run an ONNX model through ONNX Runtime via the DirectML execution provider.

License

Notifications You must be signed in to change notification settings

fdwr/OnnxRuntimeDirectMLEPSample

Repository files navigation

ONNX Runtime DirectML Execution Provider Sample

Dwayne Robinson 2022-04-06..2023-06-22

What is it?

Just testing the DirectML execution provider in ONNX Runtime via D3D resources instead of CPU tensors (which incur synchronization costs). All the code is in MainFullExample.cpp, with MainMinimalExample.cpp being a much simpler introductory sample (no GPU binding and hard-coded to the given model).

Usage

  • OS: Windows 10+.
  • GPU: DirectX 12 compute capable.
  • Running: Command line app.
  • License: License.txt tldr: Do whatever you want with the code.

Building

  • Standard Visual Studio msbuild project.
  • The Nuget dependencies onnxruntime.dll 1.13 and directml.dll 1.10.1 should automatically be copied into your build folder (and after building, it all just works 🤞).

Related

About

Little console app to run an ONNX model through ONNX Runtime via the DirectML execution provider.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages