Commits · 27ed39a347c56ac23f25169b7c86d7f459b1ac7f · OpenDAS / vllm_cscc

10 Oct, 2025 8 commits

Fix some typing issues found by `mypy==1.18.2` (#26596) · 7c12763b
Harry Mellor authored Oct 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
7c12763b

Add Qwen3-Omni moe thinker (#25550) · 19a9b169

Xiong Wang authored Oct 11, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Xiong Wang <feizi.wx@alibaba-inc.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

19a9b169

[Transform] [Quantization] Add QuTLASS support to vLLM (#24440) · 96ad65b7

Roberto L. Castro authored Oct 10, 2025


Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: Andrei Panferov <andrei@panferov.org>
Co-authored-by: Andrei Panferov <andrei@panferov.org>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

96ad65b7

[Model] Add FlexOlmo model implementation (#24923) · 8d2b8c0f
Shane A authored Oct 10, 2025
```
Signed-off-by: Shane A <shanea@allenai.org>
```
8d2b8c0f

[Model][Qwen3VL] Compute `cu_seqlens` on CPU to remove (#26496) · b2155ed3

Lukas Geiger authored Oct 10, 2025


Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b2155ed3

Silu v2 (#25074) · 7b03584d

Elvir Crnčević authored Oct 10, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: elvircrn <elvircrn@gmail.com>
Signed-off-by: Elvir Crnčević <elvircrn@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>

7b03584d

[Bugfix] Convert untraceable GroupShape to list for AMD impl (#26535) · 213b6445
Lucas Kabela authored Oct 10, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
213b6445

[Spec-Decode] Support piecewise cudagraphs for Eagle head (#25109) · 29255cfc

Lucas Wilkinson authored Oct 10, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

29255cfc

09 Oct, 2025 14 commits
- Refactor MistralTokenizer (#26358) · c6187f55
  Julien Denize authored Oct 10, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  c6187f55
- [Bug] Fix modular_kernel: ZeroDivisionError: integer division or modulo by zero (#26528) · 1ee35382
  Wentao Ye authored Oct 09, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1ee35382
- [Bugfix] Disable moe inplace for torch >= 2.9 (#26497) · a462331e
  bnellnm authored Oct 09, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  a462331e
- [Model] Apply shared experts overlap optimization to all models with shared experts (#26145) · 47e66c24
  bnellnm authored Oct 09, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  47e66c24
- [Models][Qwen] Replace `pad` with `cat` for better performance (#26486) · 2c1c7dfb
  Lukas Geiger authored Oct 09, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  2c1c7dfb
- Revert #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate... · 5728da11
  Jiangyun Zhu authored Oct 09, 2025
```
Revert  #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops" (#26472)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  5728da11
- [V0 deprecation] Remove `QKVCrossParallelLinear` implementation (#26475) · d1ddf340
  Isotr0py authored Oct 09, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d1ddf340
- [Models][Qwen3VL] Optimise `_validate_and_reshape_mm_tensor` (#26426) · 0426e3c5
  Lukas Geiger authored Oct 09, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  0426e3c5
- [torchao] Add support for ModuleFqnToConfig using regex (#26001) · a83ff278
  Jerry Zhang authored Oct 09, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  a83ff278
- Add: Support for multiple hidden layers in Eagle3 (#26164) · cf4cd6c2
  Rahul Tuli authored Oct 09, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  cf4cd6c2
- Enable `RMSNorm` substitution for Transformers backend (#26353) · b9604418
  Harry Mellor authored Oct 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b9604418
- [Model] Gemma3: Fix GGUF loading and quantization (#26189) · 1317028a
  Luciano Martins authored Oct 09, 2025
```
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  1317028a
- [Hybrid]: Decouple Kernel Block Size from KV Page Size (#24486) · d24cf322
  Zhiyuan Li authored Oct 09, 2025
```
Signed-off-by: lizhiyuan <uniartisan2017@gmail.com>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  d24cf322
- Separate MLAAttention class from Attention (#25103) · e614ab78
  Naveenraj Kamalakannan authored Oct 08, 2025
```
Signed-off-by: Naveenraj Kamalakannan <therealnaveenkamal@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  e614ab78
08 Oct, 2025 9 commits

[Kernels] Modular kernel refactor (#24812) · da364615
bnellnm authored Oct 08, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
da364615
[Models] Improve iteration over layers (#26425) · 93f2c0aa
Lukas Geiger authored Oct 08, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
93f2c0aa

[Refactor] Refactor FP8 & INT8 Quant Folder inside `w8a8` (#25293) · 241b4cfe

Wentao Ye authored Oct 08, 2025


Signed-off-by: nicole-lihui <nicole.li@daocloud.io>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: courage17340 <courage17340@163.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Jacob Kahn <jacobkahn1@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Agata Dobrzyniewicz <adobrzyniewicz@habana.ai>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: zxw <1020938856@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: chenlang <chen.lang5@zte.com.cn>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
Signed-off-by: jiang1.li <jiang1...

241b4cfe

Tidy `vllm/config/__init__.py` to only add classes and functions (#26405) · 2f99f2f5
Harry Mellor authored Oct 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2f99f2f5
[Model] Allow passing custom number of max tiles to Nano 2 VL (#26403) · f9582fd8
Eugene Khvedchenya authored Oct 08, 2025
```
Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
```
f9582fd8
[Misc] add `usedforsecurity=False` in md5 hash call (#26357) · f377333b
Daniele authored Oct 08, 2025
```
Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
```
f377333b

[TPU] Rename tpu_commons to tpu_inference (#26279) · 335b28f7

Utkarsh Sharma authored Oct 08, 2025


Signed-off-by: Utkarsh Sharma <utksharma@google.com>
Co-authored-by: Utkarsh Sharma <utksharma@google.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>

335b28f7

Add SwigluOAI implementation for CPUFusedMOE (#26347) · 046118b9
isharif168 authored Oct 08, 2025
```
Signed-off-by: Sharif Inamdar <sharif.inamdar@arm.com>
```
046118b9
[torchao] safetensors integration (#25969) · b32260ab
liangel-02 authored Oct 07, 2025
```
Signed-off-by: Angel Li <liangel@meta.com>
```
b32260ab

07 Oct, 2025 9 commits

[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in... · 0c824fc4

Morrison Turnansky authored Oct 07, 2025


[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops (#26113)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>

0c824fc4

[Bug] Fix Shape Validation for Fallback while Enabling E8M0 for DeepGEMM (#26322) · 8f36850f
Wentao Ye authored Oct 07, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
8f36850f
[deepseek] add EP8 FusedMOE config for H200 and B200 (#26331) · 29fd2662
Chen Zhang authored Oct 08, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
29fd2662
[Model] Lfm2Moe (#26344) · 320feae6
Paul Pak authored Oct 08, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
320feae6

[Model] Add support for ModernBertForTokenClassification (#26340) · 6f59beaf

antrec authored Oct 07, 2025

Signed-off-by: Antoine Recanati Le Goat <antoine.recanati@sancare.fr>
Signed-off-by: antrec <antoine.recanati@gmail.com>
Co-authored-by: Antoine Recanati Le Goat <antoine.recanati@sancare.fr>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

6f59beaf

[Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166) · 41f1cf38
fxmarty-amd authored Oct 07, 2025

41f1cf38
[Model] Use `merge_by_field_config` for MM models (Ovis family) (#26308) · 08d26a1b
Isotr0py authored Oct 07, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
08d26a1b

Add topk logits torch op for DS3.2. (#25945) · e1098ced

Daniel Cámpora authored Oct 07, 2025

Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Signed-off-by: Daniel Cámpora <961215+dcampora@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

e1098ced

[Model] Define merge_by_field_config MM interface (R-T) (#26260) · de342585

Ayush Satyam authored Oct 07, 2025


Signed-off-by: Ayush Satyam <ayushsatyam146@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

de342585