Skip to content

Commit 9e83142

Browse files
taylor-yb-leefbxai
authored andcommitted
[None][fix] Uncomment Qwen3.5 and DSR1 from model registry so that they can run f… (NVIDIA#15001)
Signed-off-by: Taylor Yeonbok Lee <249374542+taylor-yb-lee@users.noreply.github.com> Signed-off-by: NVFB <186336021+NVFB@users.noreply.github.com>
1 parent 35c9ef3 commit 9e83142

1 file changed

Lines changed: 9 additions & 12 deletions

File tree

examples/auto_deploy/model_registry/models.yaml

Lines changed: 9 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -310,10 +310,9 @@ models:
310310
# - name: deepseek-ai/DeepSeek-R1
311311
# config_id: deepseek_r1
312312
# yaml_extra: ['dashboard_default.yaml', 'world_size_8.yaml', 'deepseek-r1.yaml', 'enable_sharder_ir.yaml']
313-
# OOM during AutoDeploy run.
314-
# - name: deepseek-ai/DeepSeek-R1-0528
315-
# config_id: deepseek_r1
316-
# yaml_extra: ['dashboard_default.yaml', 'world_size_8.yaml', 'deepseek-r1.yaml', 'enable_sharder_ir.yaml']
313+
- name: deepseek-ai/DeepSeek-R1-0528
314+
config_id: deepseek_r1
315+
yaml_extra: ['dashboard_default.yaml', 'world_size_8.yaml', 'deepseek-r1.yaml', 'enable_sharder_ir.yaml']
317316
# OOM during AutoDeploy run.
318317
# - name: deepseek-ai/DeepSeek-Coder-V2-Instruct
319318
# config_id: deepseek_v2_ep
@@ -374,14 +373,12 @@ models:
374373
# config_id: default_ws_4
375374
# yaml_extra: ['dashboard_default.yaml', 'world_size_4.yaml']
376375
# --- Qwen3.5 MoE (Feb 2026) ---
377-
# tensorrt_llm.executor.utils.RequestError: Ran into a kwarg keyword mismatch.
378-
# - name: Qwen/Qwen3.5-35B-A3B
379-
# config_id: qwen3_5_moe_35b
380-
# yaml_extra: ['dashboard_default.yaml', 'world_size_2.yaml', 'qwen3.5_moe_35b.yaml', 'enable_sharder_ir.yaml']
381-
# OOM during AutoDeploy run.
382-
# - name: Qwen/Qwen3.5-397B-A17B
383-
# config_id: qwen3_5_moe_400b
384-
# yaml_extra: ['dashboard_default.yaml', 'world_size_8.yaml', 'qwen3.5_moe_400b.yaml', 'enable_sharder_ir.yaml']
376+
- name: Qwen/Qwen3.5-35B-A3B
377+
config_id: qwen3_5_moe_35b
378+
yaml_extra: ['dashboard_default.yaml', 'world_size_2.yaml', 'qwen3.5_moe_35b.yaml', 'enable_sharder_ir.yaml']
379+
- name: Qwen/Qwen3.5-397B-A17B
380+
config_id: qwen3_5_moe_400b
381+
yaml_extra: ['dashboard_default.yaml', 'world_size_8.yaml', 'qwen3.5_moe_400b.yaml', 'enable_sharder_ir.yaml']
385382
# --- GLM-5 (Feb 2026) ---
386383
- name: zai-org/GLM-5
387384
config_id: glm_5

0 commit comments

Comments
 (0)