Title: Add Ryzen AI NPU/Hybrid support for Hy-MT2-7B model testing
Problem
The app currently works with the "AMD Lemonade / TurnkeyML" backend and can detect the available Lemonade model:
Hy-MT2-7B-GGUF-Q4_K_M-VulkanClean
However, this model appears to be a GGUF/VulkanClean variant, which likely runs on Vulkan/iGPU rather than the Ryzen AI NPU.
I want to test and customize the Hy-MT2-7B model path so the app can use Ryzen AI NPU acceleration when available.
Current Behavior
The app shows:
Backend: AMD Lemonade / TurnkeyML
Model: Hy-MT2-7B-GGUF-Q4_K_M-VulkanClean (Lemonade)
Base URL: http://127.0.0.1:13305/api/v1
Translation can be started through the Local LLM Translation page, but there is no clear way to confirm or select whether the model is running on:
- CPU
- Vulkan/iGPU
- Ryzen AI NPU
- Hybrid NPU + iGPU
Expected Behavior
Add support for testing Hy-MT2-7B with Ryzen AI NPU/Hybrid execution.
The app should allow the user to:
- Detect available Lemonade models from:
http://127.0.0.1:13305/api/v1/models
- Distinguish model/runtime variants, for example:
GGUF / Vulkan / iGPU
ONNX / OGA / NPU
Hybrid / Ryzen AI
-
Select a Hy-MT2-7B NPU or Hybrid model if available.
-
Save the selected model into the runtime config.
-
Show clearly on the UI which runtime is being used:
AMD Lemonade - Vulkan/iGPU
AMD Lemonade - Ryzen AI NPU
AMD Lemonade - Hybrid NPU+iGPU
- Provide a small test button to verify the selected model with a short Chinese-to-Vietnamese translation, for example:
今天我们学习导数。
Expected output:
Hôm nay chúng ta học đạo hàm.
Suggested Implementation
Please keep the change minimal and avoid refactoring unrelated parts of the app.
Suggested steps:
- Only inspect the files related to runtime model configuration, Lemonade backend selection, and the UI model settings page.
- Add model variant detection based on model name keywords such as:
NPU
Hybrid
OGA
ONNX
RyzenAI
Vulkan
GGUF
- Add or improve the model selector so the user can select the exact Lemonade model returned by "/models".
- Persist the selected model in the existing runtime config.
- Update the Local LLM Translation page header to display the selected backend/model/runtime clearly.
- Add a quick test action that sends one short request to the selected backend/model.
- Do not change the translation pipeline, parser, subtitle logic, or file handling unless strictly necessary.
Validation
Run only the relevant checks.
Manual test:
- Start Lemonade server at:
http://127.0.0.1:13305/api/v1
- Open the app:
http://localhost:3000
- Go to the model configuration page.
- Refresh or load the Lemonade model list.
- Select a Hy-MT2-7B NPU/Hybrid model if available.
- Save configuration.
- Return to the Local LLM Translation page.
- Confirm the header displays the selected runtime/model.
- Run a short translation test.
- Check Windows Task Manager Performance tab to see whether NPU usage increases when using an NPU/Hybrid model.
Notes
If only the following model is available:
Hy-MT2-7B-GGUF-Q4_K_M-VulkanClean
then the app should clearly indicate that this is likely a GGUF/Vulkan/iGPU path, not an NPU path.
The app should not assume that any Hy-MT2-7B model automatically uses NPU. It should display the detected runtime type based on model name or backend metadata when available.
Title: Add Ryzen AI NPU/Hybrid support for Hy-MT2-7B model testing
Problem
The app currently works with the "AMD Lemonade / TurnkeyML" backend and can detect the available Lemonade model:
Hy-MT2-7B-GGUF-Q4_K_M-VulkanClean
However, this model appears to be a GGUF/VulkanClean variant, which likely runs on Vulkan/iGPU rather than the Ryzen AI NPU.
I want to test and customize the Hy-MT2-7B model path so the app can use Ryzen AI NPU acceleration when available.
Current Behavior
The app shows:
Backend: AMD Lemonade / TurnkeyML
Model: Hy-MT2-7B-GGUF-Q4_K_M-VulkanClean (Lemonade)
Base URL: http://127.0.0.1:13305/api/v1
Translation can be started through the Local LLM Translation page, but there is no clear way to confirm or select whether the model is running on:
Expected Behavior
Add support for testing Hy-MT2-7B with Ryzen AI NPU/Hybrid execution.
The app should allow the user to:
http://127.0.0.1:13305/api/v1/models
GGUF / Vulkan / iGPU
ONNX / OGA / NPU
Hybrid / Ryzen AI
Select a Hy-MT2-7B NPU or Hybrid model if available.
Save the selected model into the runtime config.
Show clearly on the UI which runtime is being used:
AMD Lemonade - Vulkan/iGPU
AMD Lemonade - Ryzen AI NPU
AMD Lemonade - Hybrid NPU+iGPU
今天我们学习导数。
Expected output:
Hôm nay chúng ta học đạo hàm.
Suggested Implementation
Please keep the change minimal and avoid refactoring unrelated parts of the app.
Suggested steps:
NPU
Hybrid
OGA
ONNX
RyzenAI
Vulkan
GGUF
Validation
Run only the relevant checks.
Manual test:
http://127.0.0.1:13305/api/v1
http://localhost:3000
Notes
If only the following model is available:
Hy-MT2-7B-GGUF-Q4_K_M-VulkanClean
then the app should clearly indicate that this is likely a GGUF/Vulkan/iGPU path, not an NPU path.
The app should not assume that any Hy-MT2-7B model automatically uses NPU. It should display the detected runtime type based on model name or backend metadata when available.