Commits · 138f0d1e752d3a35cd959f3df8bf00370a2ace7b · OpenDAS / vllm_cscc

19 Sep, 2025 12 commits
- [Docs] add __init__.py to... · 138f0d1e
  samzong authored Sep 20, 2025
```
[Docs] add __init__.py to vllm/model_executor/layers/quantization/compressed_tensors/transform (#24974)
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  138f0d1e
- Encoder model support for the Transformers backend (#25174) · 12aed7e4
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  12aed7e4
- Remove Redundant Assignment in Qwen3_VisionPatchMerger (#25224) · d90e212a
  LJH-LBJ authored Sep 20, 2025
```
Signed-off-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  d90e212a
- Move `ModelConfig` from `config/__init__.py` to `config/model.py` (#25252) · aed16879
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aed16879
- [Qwen] Remove cuda hard-code in qwen3 next (#25243) · 838d7116
  Icey authored Sep 19, 2025
```
Signed-off-by: Icey <1790571317@qq.com>
```
  838d7116
- [V0 Deprecation] Remove V0 logic from `get_input_embeddings` interface (#25242) · 5089fd74
  Cyrus Leung authored Sep 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5089fd74
- [Bugfix][Perf] Misc fixes for Qwen3 VL (#25238) · 1dfea5f4
  Roger Wang authored Sep 19, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  1dfea5f4
- [Kernel][Performance] Add Triton kernel for Qwen3-VL interleaved MRoPE (#25055) · cea91a32
  Isotr0py authored Sep 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cea91a32
- [Bugfix][CPU] Add placeholder to avoid import errors when using fused_moe ops... · 825fdb11
  Li, Jiang authored Sep 19, 2025
```
[Bugfix][CPU] Add placeholder to avoid import errors when using fused_moe ops on platforms without triton (#25137)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  825fdb11
- [CPU] Disable oneDNN linear on non-x86 platforms (#25166) · 8c1d4acb
  Li, Jiang authored Sep 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  8c1d4acb
- [OOT] Support sync_model_loading for OOT (#25126) · a6149aa5
  Chendi.Xue authored Sep 19, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
  a6149aa5
- [Perf] Optimize memory peak during EAGLE model loading. (#24585) · 1a0a04da
  Chen Ding authored Sep 19, 2025
```
Signed-off-by: Chen Ding <candy.dc@alibaba-inc.com>
```
  1a0a04da
18 Sep, 2025 18 commits

[BugFix] Fix DeepGEMM warmup, no m.weight_scale_inv (#25206) · 9fac6aa3
Lucas Wilkinson authored Sep 18, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
9fac6aa3

[feat]: Create interface for model-specific M-RoPE (#24194) · 38db529f

Aziz authored Sep 18, 2025

Signed-off-by: AzizCode92 <azizbenothman76@gmail.com>
Signed-off-by: Aziz <azizbenothman76@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

38db529f

[fix]: remove data type hardcoding from gptoss model implementation (#23807) · 064cac7b
Nikhil Gupta authored Sep 18, 2025
```
Signed-off-by: Nikhil Gupta <nikhil.gupta2@arm.com>
```
064cac7b
[spec decode] Fix MTP inference path for MiMo-7B model (#25136) · c4cb0af9
qizixi authored Sep 18, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
c4cb0af9

[New Model] Support BertForTokenClassification / Named Entity Recognition (NER) task (#24872) · 5f696c33

wang.yuqi authored Sep 18, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

5f696c33

[PERF] Add `conv1d` metadata to GDN attn (#25105) · 072d7e53
Vadim Gimpelson authored Sep 18, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
072d7e53
Refactor dense FP8 tensor/channel/block utils and add CT FP8 block (#21404) · fbd6523a
Michael Goin authored Sep 18, 2025

fbd6523a
[Bugfix][Mamba] - Fix Conv State Kernel FP32 Support (#24883) · 66072b36
Asaf Joseph Gardin authored Sep 18, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
66072b36
[Model] Improve Pooling Model (#25149) · 37970105
Jee Jee Li authored Sep 18, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
37970105

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

[Doc] Fix cross-reference warnings (#25058) · 05b044e6

Punitvara authored Sep 18, 2025

Signed-off-by: Punit Vara <punitvara@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

05b044e6

[Qwen] Add fp8 checkpoint support for qwen3-next. (#25079) · ef7eefe1
Tao He authored Sep 18, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
ef7eefe1
Retrieve `sliding_window` from text config in Gemma3 MM (#25085) · f4cd80f9
Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
f4cd80f9
[EPLB] Add EPLB support for hunyuan_v1 (#23078) · 9d8a2d86
YiwenC authored Sep 17, 2025

9d8a2d86

[Model] enable data parallel for InternVL vision encoder (#23909) · 52bc9d5b

YiwenC authored Sep 17, 2025


Signed-off-by: Yiwen Chen <yiwen66@berkeley.edu>
Signed-off-by: YiwenC <54658925+666even666@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

52bc9d5b

[Kernels] Overlap shared experts with combine instead of dispatch (#24254) · dc2979c5
bnellnm authored Sep 18, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
dc2979c5

[Bugfix][Qwen3-Next] add prefixes to shared_expert in qwen3-next and mlp in... · 027d37df

toncao authored Sep 18, 2025


[Bugfix][Qwen3-Next] add prefixes to shared_expert in qwen3-next and mlp in qwen2moe to successfully load ignored params in quantized models (#24960)
Signed-off-by: toncao <cpatonn@gmail.com>
Co-authored-by: toncao <cpatonn@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

027d37df

[MM Encoder] Apply DP ViT for Qwen3-VL model series (#24955) · 3127274d

Roger Wang authored Sep 17, 2025

Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huang Jie <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: 松灵 <26085463+wulipc@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

3127274d

17 Sep, 2025 9 commits

[Kernel] Delegate construction of FusedMoEQuantConfig to FusedMoEMethodBase subclasses (#22537) · 5963b98b
bnellnm authored Sep 17, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
5963b98b
[Bugfix][Qwen3-Next] fixes the varlen issue in qwen3-next's MTP implementation. (#24957) · dd6a910a
Tao He authored Sep 17, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
dd6a910a

Add RADIO Vision Encoder Support to vLLM (#24595) · 252ada55

danielafrimi authored Sep 17, 2025


Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: root <root@cw-dfw-h100-001-305-026.cm.cluster>

252ada55

[Model] Apply SharedFusedMoE to glm4_moe. (#24849) · c15309a7
whx authored Sep 17, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
c15309a7
[Model] Pass param prefix to LLMHead (#24862) · 4a9375fe
whx authored Sep 17, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
4a9375fe

[EPLB] Support EPLB for Mixtral Model (#22842) · b77bf34e

rouchenzi authored Sep 17, 2025


Signed-off-by: rouchenzi <ruochenwen@gmail.com>
Signed-off-by: rouchenzi <40842833+rouchenzi@users.noreply.github.com>
Co-authored-by: Bowen Wang <abmfy@icloud.com>

b77bf34e

[Rocm] [quantization] Fix quark ptpc moe and add test case (#24649) · ca2d1925
haoyangli-amd authored Sep 17, 2025
```
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
Co-authored-by: Haoyang Li <haoyang.li@amd.com>
```
ca2d1925

[Model] Support Qwen3-VL Model Series (#24727) · 0f7acdd7

Roger Wang authored Sep 16, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huang Jie <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: 松灵 <26085463+wulipc@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

0f7acdd7

[FP8] Extend per-token-group quantization support to QuantFP8 (#24342) · cef32104

Tahsin Tunan authored Sep 17, 2025

Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

cef32104

16 Sep, 2025 1 commit

[CI][Bugfix] Fix failing Blackwell test (#24993) · d119fc86

Matthew Bonanni authored Sep 16, 2025


Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

d119fc86