Commits · 8a0af6a5610b7eb6232bc5f66fda40a46b275869 · OpenDAS / vllm_cscc

14 Oct, 2025 1 commit
- [UX] Replace VLLM_ALL2ALL_BACKEND with --all2all-backend (#26732) · 3e051bda
  Michael Goin authored Oct 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3e051bda
13 Oct, 2025 13 commits

[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate... · e3fdb627

Morrison Turnansky authored Oct 13, 2025


[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops  (#26502)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>

e3fdb627

[Bug] Fix Assertion error DeepEP/csrc/kernels/intranode.cu:928: 'false and... · 7200a21c

Wentao Ye authored Oct 13, 2025


[Bug] Fix Assertion error DeepEP/csrc/kernels/intranode.cu:928: 'false and Unsupported type' (#26532)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

7200a21c

[Quantization] [Performance] Enable Marlin GEMM kernels for the... · 89342ce4

Alex Kogan authored Oct 13, 2025


[Quantization] [Performance] Enable Marlin GEMM kernels for the calibration-free RTN-based quantization (#26051)
Signed-off-by: Alex Kogan <alex.kogan@oracle.com>
Signed-off-by: Alex Kogan <82225080+sakogan@users.noreply.github.com>

89342ce4

[Model] Use merge_by_field_config for MM models (M-N) (#26710) · afc47e4d
Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
afc47e4d
[Bugfix][Speculative Decoding] Extend Eagle quantization config fix to llama_eagle.py (#26590) · e3b90c1b
Rahul Tuli authored Oct 13, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
e3b90c1b
[CI/Build] upgrade compressed-tensors to 0.12.2 to address LGPLv3 (#26501) · a1b2d658
Sangyeon Cho authored Oct 14, 2025
```
Signed-off-by: Sangyeon Cho <josang1204@gmail.com>
```
a1b2d658

[UX] Speedup DeepGEMM warmup with heuristics (#25619) · 0d21b9b5

Michael Goin authored Oct 13, 2025

Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

0d21b9b5

[unrevert] Add batch invariant kernel override for FlashInfer backend [2/n] (#26373) · 32637990
Bram Wasti authored Oct 13, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
```
32637990
[Bugfix] Fix out of bound index issue for Jina-embedding-v3 RoPE with cuda graph (#26687) · 8e67b255
Isotr0py authored Oct 13, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
8e67b255
[Model][0/N] Improve all pooling task | clean up (#25817) · 767c3ab8
wang.yuqi authored Oct 13, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
767c3ab8
[Model] Fix Skywork R1V mlp (#26673) · 98f30b8c
Jee Jee Li authored Oct 13, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
98f30b8c
[FIX] Throwing an exception when the model does not support pool tasks (#25840) (#25855) · 46ad7395
yyzxw authored Oct 13, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
Co-authored-by: wang.yuqi <noooop@126.com>
```
46ad7395
[Misc] cache result of disable_inplace (#26666) · 60e419c1
bnellnm authored Oct 12, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
60e419c1

12 Oct, 2025 7 commits

[easy] fix pre commit error on trunk (#26665) · 4fca1a1b
Huamin Li authored Oct 12, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
4fca1a1b
[Models][Qwen3VL] Speedup `fast_pos_embed_interpolate` (#26647) · a6049be7
Lukas Geiger authored Oct 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
a6049be7
[Feature] Add support for naver/splade-v3 (BERT-based sparse embedding model) (#26339) · 18ed7746
gjgjos authored Oct 13, 2025
```
Signed-off-by: gjgjos <gjgjos@naver.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
18ed7746
Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
8fcaaf6a
[Bugfix][CI/Build] Fix failing Mteb CI (#26638) · 045b396d
Isotr0py authored Oct 12, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
045b396d

[PERF] [Qwen3-next] Speed up gated RMSNorm (#26207) · 82e64c7a

Vadim Gimpelson authored Oct 12, 2025

Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

82e64c7a

[EPLB] Support ernie4.5-moe (#22100) · c5c8f5ea

Haisheng Chen authored Oct 11, 2025


Signed-off-by: Haisheng Chen <langzs335@outlook.com>
Signed-off-by: Haisheng Chen <60504847+HsChen-sys@users.noreply.github.com>
Signed-off-by: Haisheng Chen <hac048@ucsd.edu>
Co-authored-by: Haisheng Chen <langzs335@outlook.com>

c5c8f5ea

11 Oct, 2025 6 commits

[Bugfix] Fix qwen-moe packed_modules_mapping (#26634) · f0a30a06
Jee Jee Li authored Oct 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
f0a30a06

[Bugfix][Qwen3VL] fix deepstack in qwen3vl (#26626) · 9d6cff3e

JJJYmmm authored Oct 11, 2025


Signed-off-by: liuye.hj <liuye.hj@alibaba-inc.com>
Signed-off-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: liuye.hj <liuye.hj@alibaba-inc.com>

9d6cff3e

Add EAGLE-3 Speculative Decoding Support for Qwen3 MoE (#26485) · d2a71530
Rahul Tuli authored Oct 11, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
d2a71530

[Refactor]: Use M-RoPE interface directly while defining model class instead... · 727144be

dsinghvi authored Oct 11, 2025


[Refactor]: Use M-RoPE interface directly while defining model class instead of maintaining model specific M-RoPE implementation in mrope.py (#24172)
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: wwl2755 <wangwenlong2755@gmail.com>

727144be

[Bugfix][Multi Modal] Fix incorrect Molmo image processing (#26563) · 55392bc8
sangho.lee authored Oct 11, 2025
```
Signed-off-by: sanghol <sanghol@allenai.org>
```
55392bc8

[MM] Move Qwen3Omni MRoPE impl to model file (#26608) · ddaff293

Roger Wang authored Oct 10, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ddaff293

10 Oct, 2025 8 commits

Fix some typing issues found by `mypy==1.18.2` (#26596) · 7c12763b
Harry Mellor authored Oct 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
7c12763b

Add Qwen3-Omni moe thinker (#25550) · 19a9b169

Xiong Wang authored Oct 11, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Xiong Wang <feizi.wx@alibaba-inc.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

19a9b169

[Transform] [Quantization] Add QuTLASS support to vLLM (#24440) · 96ad65b7

Roberto L. Castro authored Oct 10, 2025


Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: Andrei Panferov <andrei@panferov.org>
Co-authored-by: Andrei Panferov <andrei@panferov.org>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

96ad65b7

[Model] Add FlexOlmo model implementation (#24923) · 8d2b8c0f
Shane A authored Oct 10, 2025
```
Signed-off-by: Shane A <shanea@allenai.org>
```
8d2b8c0f

[Model][Qwen3VL] Compute `cu_seqlens` on CPU to remove (#26496) · b2155ed3

Lukas Geiger authored Oct 10, 2025


Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b2155ed3

Silu v2 (#25074) · 7b03584d

Elvir Crnčević authored Oct 10, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: elvircrn <elvircrn@gmail.com>
Signed-off-by: Elvir Crnčević <elvircrn@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>

7b03584d

[Bugfix] Convert untraceable GroupShape to list for AMD impl (#26535) · 213b6445
Lucas Kabela authored Oct 10, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
213b6445

[Spec-Decode] Support piecewise cudagraphs for Eagle head (#25109) · 29255cfc

Lucas Wilkinson authored Oct 10, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

29255cfc

09 Oct, 2025 5 commits
- Refactor MistralTokenizer (#26358) · c6187f55
  Julien Denize authored Oct 10, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  c6187f55
- [Bug] Fix modular_kernel: ZeroDivisionError: integer division or modulo by zero (#26528) · 1ee35382
  Wentao Ye authored Oct 09, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1ee35382
- [Bugfix] Disable moe inplace for torch >= 2.9 (#26497) · a462331e
  bnellnm authored Oct 09, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  a462331e
- [Model] Apply shared experts overlap optimization to all models with shared experts (#26145) · 47e66c24
  bnellnm authored Oct 09, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  47e66c24
- [Models][Qwen] Replace `pad` with `cat` for better performance (#26486) · 2c1c7dfb
  Lukas Geiger authored Oct 09, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  2c1c7dfb