[Feature]: ROCm H3 support

[functionstackx]

🚀 The feature, motivation and pitch

hi @andyluo7 can we get an ROCm MiniMax H3 support in vllm-omni. seems like quite an popular model

currently it is only supported on CUDA https://recipes.vllm.ai/MiniMaxAI/MiniMax-H3

Alternatives

No response

Additional context

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[hsliuustc0106]

@akshatvishu @tjtanaa PTAL

[haic0]

@functionstackx @andyluo7 i am working on it, thanks!

[Xunzhuo]

Cool @haic0 lets bring it into ROCm.

@david6666666 please assign this issue to me and @haic0, thanks!

[akshatvishu]

if you want any additional help with ROCm integration feel free to tag @haic0 ! Would love to colab!

[GoldenGrapeGentleman]

MI300X validation update:

• vllm/vllm-omni-rocm:minimax-h3@sha256:29d1946af9c69e3e0a7128c247bdc8c82437ead43fbc366fed443533cf6ce9e8
• 4x MI300X, BF16, AITER, U4, text-encoder TP4, VPP4 tile, regional compile
• T2VA 50-step / 209-frame / 1344x768: 267.42 s client E2E
• FL2VA 50-step / 209-frame / 1344x768: 287.07 s client E2E
• both outputs: H.264 24 FPS + 32 kHz stereo AAC

The published image was built from pre-merge #5691 commit 0eee3b186: T2VA/FL2VA work, but image+audio Ref2VA fails because TorchCodec is absent and the image predates #5699's soundfile fallback. Video-reference Ref2VA also needs ffmpeg, which is not bundled. A docker/Dockerfile.rocm build from v0.26.0 completed image+audio Ref2VA, video-reference Ref2VA, and 2048x1088 T2VA on the same host.

Recipe PR: vllm-project/recipes#729

For the vLLM-Omni support PR, the remaining release-facing work appears to be the AMD support matrix/ROCm guide plus refreshing the image from v0.26.0; no ROCm-only model math change was required for the documented 1344x768 shapes.

[akshatvishu]

@haic0 if you want additional help with ROCm; feel free to tag me!

[hsliuustc0106]

Cool @haic0 lets bring it into ROCm.

@david6666666 please assign this issue to me and @haic0, thanks!

nice to meet you here :)