Commits · 5c3bae1a6a73aad8c0883a097079448b506fbfcc · OpenDAS / vllm_cscc

"benchmarks/vscode:/vscode.git/clone" did not exist on "d76fc11ef5d40f86019811873ae340c8dcb64e3a"

15 Oct, 2025 5 commits
- [Fix] Remove divisibility requirement between num_kv_heads and tp_size in bailing_moe (#26876) · 5c3bae1a
  ant-yy authored Oct 15, 2025
```
Signed-off-by: vito.yy <vito.yy@antgroup.com>
```
  5c3bae1a
- [Deepseek-V3.2][Kernel] Integrate cuda indexer k cache gather (#26456) · f5ed68ef
  Yongye Zhu authored Oct 15, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  f5ed68ef
- [DSA][MLA] Tiny refactor on DeepSeek to make it reusable for different backends (#26656) · 302ef403
  Mengqing Cao authored Oct 15, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  302ef403
- [Bugfix][Multi Modal] Fix incorrect Molmo token processing (#26873) · 8865da15
  sangho.lee authored Oct 15, 2025
```
Signed-off-by: sanghol <sanghol@allenai.org>
```
  8865da15
- [Bugfix] Fix qwen3-omni audio truncation issue (#26815) · 8c851f6d
  Isotr0py authored Oct 15, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8c851f6d
14 Oct, 2025 5 commits
- Adjusted the model order of the model registration file (#26798) · e9f1b8c9
  汪志鹏 authored Oct 14, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  e9f1b8c9
- [Chore] Remove `SupportsV0Only` interface and update supported models docs (#26783) · 9c4cb683
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9c4cb683
- [Model] Use merge_by_field_config for MM models (O-P) (#26776) · 74704d45
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  74704d45
- [Bugfix] Standardize merging multimodal embeddings (#26771) · d2f816d6
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2f816d6
- [Model][Bugfix]fix ernie45 load failed due to ernie45 eplb code (#26684) · 01ad27fa
  CSWYF3634076 authored Oct 14, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  01ad27fa
13 Oct, 2025 6 commits
- [Model] Use merge_by_field_config for MM models (M-N) (#26710) · afc47e4d
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  afc47e4d
- [Bugfix][Speculative Decoding] Extend Eagle quantization config fix to llama_eagle.py (#26590) · e3b90c1b
  Rahul Tuli authored Oct 13, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  e3b90c1b
- [Bugfix] Fix out of bound index issue for Jina-embedding-v3 RoPE with cuda graph (#26687) · 8e67b255
  Isotr0py authored Oct 13, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8e67b255
- [Model][0/N] Improve all pooling task | clean up (#25817) · 767c3ab8
  wang.yuqi authored Oct 13, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  767c3ab8
- [Model] Fix Skywork R1V mlp (#26673) · 98f30b8c
  Jee Jee Li authored Oct 13, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  98f30b8c
- [FIX] Throwing an exception when the model does not support pool tasks (#25840) (#25855) · 46ad7395
  yyzxw authored Oct 13, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
Co-authored-by: wang.yuqi <noooop@126.com>
```
  46ad7395
12 Oct, 2025 5 commits
- [easy] fix pre commit error on trunk (#26665) · 4fca1a1b
  Huamin Li authored Oct 12, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  4fca1a1b
- [Models][Qwen3VL] Speedup `fast_pos_embed_interpolate` (#26647) · a6049be7
  Lukas Geiger authored Oct 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  a6049be7
- [Feature] Add support for naver/splade-v3 (BERT-based sparse embedding model) (#26339) · 18ed7746
  gjgjos authored Oct 13, 2025
```
Signed-off-by: gjgjos <gjgjos@naver.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  18ed7746
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
- [EPLB] Support ernie4.5-moe (#22100) · c5c8f5ea
  Haisheng Chen authored Oct 11, 2025
```
Signed-off-by: Haisheng Chen <langzs335@outlook.com>
Signed-off-by: Haisheng Chen <60504847+HsChen-sys@users.noreply.github.com>
Signed-off-by: Haisheng Chen <hac048@ucsd.edu>
Co-authored-by: Haisheng Chen <langzs335@outlook.com>
```
  c5c8f5ea
11 Oct, 2025 6 commits

[Bugfix] Fix qwen-moe packed_modules_mapping (#26634) · f0a30a06
Jee Jee Li authored Oct 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
f0a30a06

[Bugfix][Qwen3VL] fix deepstack in qwen3vl (#26626) · 9d6cff3e

JJJYmmm authored Oct 11, 2025


Signed-off-by: liuye.hj <liuye.hj@alibaba-inc.com>
Signed-off-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: liuye.hj <liuye.hj@alibaba-inc.com>

9d6cff3e

Add EAGLE-3 Speculative Decoding Support for Qwen3 MoE (#26485) · d2a71530
Rahul Tuli authored Oct 11, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
d2a71530

[Refactor]: Use M-RoPE interface directly while defining model class instead... · 727144be

dsinghvi authored Oct 11, 2025


[Refactor]: Use M-RoPE interface directly while defining model class instead of maintaining model specific M-RoPE implementation in mrope.py (#24172)
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: wwl2755 <wangwenlong2755@gmail.com>

727144be

[Bugfix][Multi Modal] Fix incorrect Molmo image processing (#26563) · 55392bc8
sangho.lee authored Oct 11, 2025
```
Signed-off-by: sanghol <sanghol@allenai.org>
```
55392bc8

[MM] Move Qwen3Omni MRoPE impl to model file (#26608) · ddaff293

Roger Wang authored Oct 10, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ddaff293

10 Oct, 2025 4 commits

Add Qwen3-Omni moe thinker (#25550) · 19a9b169

Xiong Wang authored Oct 11, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Xiong Wang <feizi.wx@alibaba-inc.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

19a9b169

[Model] Add FlexOlmo model implementation (#24923) · 8d2b8c0f
Shane A authored Oct 10, 2025
```
Signed-off-by: Shane A <shanea@allenai.org>
```
8d2b8c0f

[Model][Qwen3VL] Compute `cu_seqlens` on CPU to remove (#26496) · b2155ed3

Lukas Geiger authored Oct 10, 2025


Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b2155ed3

[Spec-Decode] Support piecewise cudagraphs for Eagle head (#25109) · 29255cfc

Lucas Wilkinson authored Oct 10, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

29255cfc

09 Oct, 2025 9 commits
- Refactor MistralTokenizer (#26358) · c6187f55
  Julien Denize authored Oct 10, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  c6187f55
- [Model] Apply shared experts overlap optimization to all models with shared experts (#26145) · 47e66c24
  bnellnm authored Oct 09, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  47e66c24
- [Models][Qwen] Replace `pad` with `cat` for better performance (#26486) · 2c1c7dfb
  Lukas Geiger authored Oct 09, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  2c1c7dfb
- [Models][Qwen3VL] Optimise `_validate_and_reshape_mm_tensor` (#26426) · 0426e3c5
  Lukas Geiger authored Oct 09, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  0426e3c5
- Add: Support for multiple hidden layers in Eagle3 (#26164) · cf4cd6c2
  Rahul Tuli authored Oct 09, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  cf4cd6c2
- Enable `RMSNorm` substitution for Transformers backend (#26353) · b9604418
  Harry Mellor authored Oct 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b9604418
- [Model] Gemma3: Fix GGUF loading and quantization (#26189) · 1317028a
  Luciano Martins authored Oct 09, 2025
```
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  1317028a
- [Hybrid]: Decouple Kernel Block Size from KV Page Size (#24486) · d24cf322
  Zhiyuan Li authored Oct 09, 2025
```
Signed-off-by: lizhiyuan <uniartisan2017@gmail.com>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  d24cf322
- Separate MLAAttention class from Attention (#25103) · e614ab78
  Naveenraj Kamalakannan authored Oct 08, 2025
```
Signed-off-by: Naveenraj Kamalakannan <therealnaveenkamal@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  e614ab78