Enhance multi-modal support#111

Open

ehsk wants to merge 22 commits into

mainfrom

multimodal-tweaks

Commits on Nov 26, 2025

argument for freezing vision encoder parameters added
ehsk
committed
freezing vision tower code simplified
ehsk
committed
minor issue fixed
ehsk
committed

Commits on Nov 27, 2025

removed unnecessary logs
ehsk
committed
non-trainable parameters excluded from grouped_parameters
ehsk
committed

Commits on Nov 28, 2025

Commits on Dec 2, 2025

epsilons for chartqa added
ehsk
committed
max_stream_size added for redis to avoid OOM
ehsk
committed

Commits on Dec 5, 2025

mini-batch size can be greater than 1
ehsk
committed

Commits on Dec 18, 2025

a fix for configs in VLMs like Qwen3-VL or Apriel where there's a text_config inside config that creates problems for deepspeed integration
ehsk
committed

Commits on Jan 26, 2026

Commits on Apr 9, 2026

Merge remote-tracking branch 'origin/main' into multimodal-tweaks
ehsk
committed

Commits on May 8, 2026

Commits on May 11, 2026

Commits on May 27, 2026

Merge branch 'main' into multimodal-tweaks
rafapi
committed