Skip to content

Add CUDA Plugin EP CI and fix Windows plugin build support#27959

Open
tianleiwu wants to merge 10 commits intomainfrom
tlwu/20260402/cuda_plugin_ci
Open

Add CUDA Plugin EP CI and fix Windows plugin build support#27959
tianleiwu wants to merge 10 commits intomainfrom
tlwu/20260402/cuda_plugin_ci

Conversation

@tianleiwu
Copy link
Copy Markdown
Contributor

Summary

This PR improves CUDA Plugin EP development and validation in three areas:

Fixes the Windows CUDA Plugin EP build so the plugin can be compiled successfully with MSVC.
Adds dedicated Windows and Linux GitHub Actions workflows for building and testing the CUDA Plugin EP.
Expands the quick start documentation with instructions for running the CUDA Plugin EP Python tests locally.

Changes

Windows build fixes

  • Update the CUDA plugin CMake configuration to use the correct forced-include flags on Windows/MSVC.
  • Keep the existing forced-include behavior for non-MSVC toolchains.
  • Add the missing GetEnvironmentVar(const std::string&) forward declaration needed by plugin builds on Windows.

CI coverage for CUDA Plugin EP

Add a Windows CUDA Plugin EP workflow that:

  • builds ONNX Runtime with onnxruntime_BUILD_CUDA_EP_AS_PLUGIN=ON
  • uploads build artifacts
  • installs the built wheel
  • sets ORT_CUDA_PLUGIN_PATH
  • runs test_cuda_plugin_ep.py

Add a similar Linux CUDA Plugin EP workflow.

Documentation updates

  • Add a Running Tests section to the CUDA Plugin EP quick start.
  • Document test prerequisites, dependency installation, and ORT_CUDA_PLUGIN_PATH.
  • Clarify that CPU-only PyTorch is sufficient for test_cuda_plugin_ep.py because it is used for CPU-side reference computations.

Copy link
Copy Markdown
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can commit the suggested changes from lintrunner.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant