Commits · a3d087adecadd4f6f83b72181ade40ec2de92aef · OpenDAS / vllm_cscc

19 Sep, 2025 2 commits
- [Bugfix][Perf] Misc fixes for Qwen3 VL (#25238) · 1dfea5f4
  Roger Wang authored Sep 19, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  1dfea5f4
- [Perf] Optimize memory peak during EAGLE model loading. (#24585) · 1a0a04da
  Chen Ding authored Sep 19, 2025
```
Signed-off-by: Chen Ding <candy.dc@alibaba-inc.com>
```
  1a0a04da
18 Sep, 2025 13 commits

[feat]: Create interface for model-specific M-RoPE (#24194) · 38db529f

Aziz authored Sep 18, 2025

Signed-off-by: AzizCode92 <azizbenothman76@gmail.com>
Signed-off-by: Aziz <azizbenothman76@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

38db529f

[fix]: remove data type hardcoding from gptoss model implementation (#23807) · 064cac7b
Nikhil Gupta authored Sep 18, 2025
```
Signed-off-by: Nikhil Gupta <nikhil.gupta2@arm.com>
```
064cac7b
[spec decode] Fix MTP inference path for MiMo-7B model (#25136) · c4cb0af9
qizixi authored Sep 18, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
c4cb0af9

[New Model] Support BertForTokenClassification / Named Entity Recognition (NER) task (#24872) · 5f696c33

wang.yuqi authored Sep 18, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

5f696c33

[PERF] Add `conv1d` metadata to GDN attn (#25105) · 072d7e53
Vadim Gimpelson authored Sep 18, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
072d7e53

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

[Doc] Fix cross-reference warnings (#25058) · 05b044e6

Punitvara authored Sep 18, 2025

Signed-off-by: Punit Vara <punitvara@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

05b044e6

[Qwen] Add fp8 checkpoint support for qwen3-next. (#25079) · ef7eefe1
Tao He authored Sep 18, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
ef7eefe1
Retrieve `sliding_window` from text config in Gemma3 MM (#25085) · f4cd80f9
Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
f4cd80f9
[EPLB] Add EPLB support for hunyuan_v1 (#23078) · 9d8a2d86
YiwenC authored Sep 17, 2025

9d8a2d86

[Model] enable data parallel for InternVL vision encoder (#23909) · 52bc9d5b

YiwenC authored Sep 17, 2025


Signed-off-by: Yiwen Chen <yiwen66@berkeley.edu>
Signed-off-by: YiwenC <54658925+666even666@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

52bc9d5b

[Bugfix][Qwen3-Next] add prefixes to shared_expert in qwen3-next and mlp in... · 027d37df

toncao authored Sep 18, 2025


[Bugfix][Qwen3-Next] add prefixes to shared_expert in qwen3-next and mlp in qwen2moe to successfully load ignored params in quantized models (#24960)
Signed-off-by: toncao <cpatonn@gmail.com>
Co-authored-by: toncao <cpatonn@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

027d37df

[MM Encoder] Apply DP ViT for Qwen3-VL model series (#24955) · 3127274d

Roger Wang authored Sep 17, 2025

Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huang Jie <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: 松灵 <26085463+wulipc@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

3127274d

17 Sep, 2025 7 commits

[Kernel] Delegate construction of FusedMoEQuantConfig to FusedMoEMethodBase subclasses (#22537) · 5963b98b
bnellnm authored Sep 17, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
5963b98b
[Bugfix][Qwen3-Next] fixes the varlen issue in qwen3-next's MTP implementation. (#24957) · dd6a910a
Tao He authored Sep 17, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
dd6a910a

Add RADIO Vision Encoder Support to vLLM (#24595) · 252ada55

danielafrimi authored Sep 17, 2025


Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: root <root@cw-dfw-h100-001-305-026.cm.cluster>

252ada55

[Model] Apply SharedFusedMoE to glm4_moe. (#24849) · c15309a7
whx authored Sep 17, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
c15309a7
[Model] Pass param prefix to LLMHead (#24862) · 4a9375fe
whx authored Sep 17, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
4a9375fe

[EPLB] Support EPLB for Mixtral Model (#22842) · b77bf34e

rouchenzi authored Sep 17, 2025


Signed-off-by: rouchenzi <ruochenwen@gmail.com>
Signed-off-by: rouchenzi <40842833+rouchenzi@users.noreply.github.com>
Co-authored-by: Bowen Wang <abmfy@icloud.com>

b77bf34e

[Model] Support Qwen3-VL Model Series (#24727) · 0f7acdd7

Roger Wang authored Sep 16, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huang Jie <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: 松灵 <26085463+wulipc@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

0f7acdd7

16 Sep, 2025 4 commits
- [Misc] Add removed encoder-decoder models to previously supported models list (#24961) · d593cf28
  Isotr0py authored Sep 17, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d593cf28
- [Model] Clean up and simplify Mamba2 Metadata Usage in both V0 and V1 (#24331) · 73cfb3c5
  Chih-Chieh Yang authored Sep 16, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
  73cfb3c5
- [Bug] [Spec Dec]: Fix kv_cache dtype mismatch for Eagle3 drafter on FP8 target (#24505) · 8c546102
  vllmellm authored Sep 16, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  8c546102
- Remove V0 Encoder-Decoder Support (#24907) · 759ef49b
  Woosuk Kwon authored Sep 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  759ef49b
15 Sep, 2025 5 commits
- Move `MultiModalConfig` from `config/__init__.py` to `config/multimodal.py` (#24659) · c4afdb69
  Harry Mellor authored Sep 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c4afdb69
- [Bugfix] Fix GLM4.1V multimodal processor with compatability for Transformers v4.56 (#24822) · 0e219cd5
  Isotr0py authored Sep 15, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  0e219cd5
- [Model]: support Ling2.0 (#24627) · 72c99f2a
  ant-yy authored Sep 15, 2025
```
Signed-off-by: vito.yy <vito.yy@antgroup.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  72c99f2a
- [Doc]: fix typos in various files (#24821) · 4979eb79
  Didier Durand authored Sep 15, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  4979eb79
- [Bugfix] MiDashengLM model contact error under concurrent testing (#24738) · a8c0f599
  bingchen-mi authored Sep 15, 2025
```
Signed-off-by: chenbing8 <chenbing8@xiaomi.com>
Signed-off-by: bingchen-mi <chenbing8@xiaomi.com>
```
  a8c0f599
14 Sep, 2025 1 commit
- [Multi Modal][Performance] Fused Q,K's apply_rope into one (#24511) · cc3173ae
  Wenlong Wang authored Sep 14, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cc3173ae
13 Sep, 2025 3 commits
- [Doc]: fix typos in various files (#24798) · 41ae4a1e
  Didier Durand authored Sep 13, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  41ae4a1e
- [Docs] Fix warnings in mkdocs build (continued) (#24791) · 9a8966bc
  Hyogeun Oh (오효근) authored Sep 13, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  9a8966bc
- [Model] Add Olmo3 model implementation (#24534) · 89e08d6d
  Shane A authored Sep 12, 2025
```
Signed-off-by: Shane A <shanea@allenai.org>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  89e08d6d
12 Sep, 2025 5 commits
- Invert pattern order to make sure that out_proj layers are identified (#24781) · c89ed8de
  Alexandre Marques authored Sep 12, 2025
```
Signed-off-by: Alexandre Marques <almarque@redhat.com>
```
  c89ed8de
- [Compilation Bug] Fix Inductor Graph Output with Shape Issue (#24772) · 3beadc2f
  Wentao Ye authored Sep 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3beadc2f
- [Model] Switch to Fused RMSNorm in GLM-4.1V model (#24733) · f17c0758
  Samit authored Sep 13, 2025
```
Signed-off-by: SamitHuang <285365963@qq.com>
```
  f17c0758
- [Models] Prevent CUDA sync in Qwen2.5-VL (#24741) · b0d1213a
  Lukas Geiger authored Sep 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  b0d1213a
- [Models] Optimise and simplify `_validate_and_reshape_mm_tensor` (#24742) · 57f94e88
  Lukas Geiger authored Sep 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  57f94e88