Skip to content

Add Whisper VitisAI recipes#425

Open
NiranjanRaviGit wants to merge 15 commits into
microsoft:mainfrom
NiranjanRaviGit:whisperPR
Open

Add Whisper VitisAI recipes#425
NiranjanRaviGit wants to merge 15 commits into
microsoft:mainfrom
NiranjanRaviGit:whisperPR

Conversation

@NiranjanRaviGit
Copy link
Copy Markdown

@NiranjanRaviGit NiranjanRaviGit commented May 19, 2026

  • Adds VitisAI NPU recipes for running OpenAI Whisper small, medium, and large-v3-turbo.
  • Enables Whisper encoder execution through ONNX Runtime VitisAI EP with WinML provider registration.
  • Provides end-to-end speech-to-text inference scripts using local WAV input and Whisper decoding.
  • Includes setup instructions for required Windows App SDK, ONNX encoder model, and VitisAI cache files.
  • Adds model-specific configuration and sample audio to help users run the recipes.
  • Preserves OpenAI Whisper MIT license attribution for the reused Whisper components.

Copilot AI review requested due to automatic review settings May 19, 2026 17:24
@NiranjanRaviGit
Copy link
Copy Markdown
Author

@microsoft-github-policy-service agree company="AMD"

@VishalX
Copy link
Copy Markdown
Contributor

VishalX commented May 26, 2026

@jambayk / @xieofxie / @devang-ml could you pls review this?

Comment thread openai-whisper-small/VitisAI/LICENSE Outdated
@@ -0,0 +1,22 @@
MIT License
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

model license should be put in the root folder of model

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you, I have removed the License from child folders and updated the license file in root folder of the models.


if use_npu and ep_policy == "NPU":
register_execution_providers()
session_options = ort.SessionOptions()
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it looks like not used

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants