Enable VLM context parallel training#2909

Closed

hubert-marek wants to merge 30 commits into

mainfrom

feat/multimodal-cp

Commits on Jun 14, 2026

fix qwen3.5 mrope vlm model
eligotts
committed

Commits on Jun 27, 2026

Commits on Jun 28, 2026

fix(trainer): clean up multimodal packing defaults

hubert-marek
and
cursoragent
committed
Merge branch 'main' into feat/rl-mm-packing
hubert-marek
committed
fix(trainer): remove unused batch variable

hubert-marek
and
cursoragent
committed
fix(trainer): update multimodal packing validation tests

hubert-marek
and
cursoragent
committed
fix(config): reject multimodal packing with cp

hubert-marek
and
cursoragent
committed
fix(config): disable multimodal packing for cp configs
hubert-marek
committed
Enable Ulysses CP for Qwen VLM training

eligotts
authored and
hubert-marek
committed
Enable Ulysses CP for Qwen VLM with frozen vision encoder + embeddings

authored and
hubert-marek
committed

Commits on Jun 29, 2026

Commits on Jun 30, 2026