Commits · 8290d15d2c6a4a82e4fd0af86b352aa522178a68 · OpenDAS / vllm_cscc

10 Aug, 2025 13 commits
- Move `CacheConfig` from `config/__init__.py` to `config/cache.py` (#22586) · 8290d15d
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8290d15d
- [Misc] Replace flaky image urls in pixtral test (#22574) · 049c2451
  Isotr0py authored Aug 10, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  049c2451
- [Docs] Fix warnings in docs build (#22588) · 00976db0
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  00976db0
- [Misc] Further refine type annotations in parallel state (#22499) · d411df02
  Cyrus Leung authored Aug 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d411df02
- [Doc] Fix API doc link in side navigation (#22585) · 010e0e39
  22quinn authored Aug 10, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  010e0e39
- [Misc] code clean duplicate set_current_vllm_config in _set_vllm_config (#22566) · 32697629
  Ning Xie authored Aug 10, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  32697629
- [Minor] Fix pre-commit error on main (#22579) · 7e8d6857
  Isotr0py authored Aug 10, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  7e8d6857
- Refactor sliding window configuration to Transformers best practice (#21927) · c4984839
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c4984839
- [TPU] kv cache update kernel doesn't need to be padded slices to multiple of... · 2a84fb42
  Chengji Yao authored Aug 09, 2025
```
[TPU] kv cache update kernel doesn't need to be padded slices to multiple of num_slices_per_block (#22394)
Signed-off-by: Chengji Yao <chengjiyao@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@gmail.com>
```
  2a84fb42
- Improve fast_topk function with type hints and documentation (#22530) · 534c45b9
  ZiTian Zhao authored Aug 10, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  534c45b9
- [Config] add "qwen" as a native eagle3 target supported model (#22333) · 3d7363e6
  Le Chen authored Aug 10, 2025
```
Signed-off-by: lechen <lecself@163.com>
Signed-off-by: LeChen <lecself@163.com>
```
  3d7363e6
- [oss] Init gpt-oss bf16 support (#22508) · 0c5254b8
  Jee Jee Li authored Aug 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0c5254b8
- [V1] [Hybrid] Enable Full CUDA Graph (decode-only) for Mamba layers (#21401) · 61f67d8a
  Thomas Parnell authored Aug 10, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  61f67d8a
09 Aug, 2025 23 commits

[FEAT] [Performance] Add triton mrope to replace the torch code path (#22375) · 42172ad1
TJian authored Aug 09, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
42172ad1
[Bugfix] Fix basic models tests hanging due to mm processor creation (#22571) · fbd8595c
Isotr0py authored Aug 10, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
fbd8595c

[Model] Gemma3n MM (#20495) · 5a16fa61

Nicolò Lucchesi authored Aug 09, 2025


Signed-off-by: ShriKode <shrikode@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: ShriKode <shrikode@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>

5a16fa61

Move `ParallelConfig` from `config/__init__.py` to `config/parallel.py` (#22565) · 2d18256e
Harry Mellor authored Aug 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2d18256e
[Docs] Reduce noise in docs and `--help` from the JSON tip (#22567) · 56186474
Harry Mellor authored Aug 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
56186474
[CI] [Hybrid] Speed up hybrid models test by removing large models (#22563) · 1bf5e1f2
Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
1bf5e1f2

GLM-4.5V with new class name at transformers (#22520) · a6022e6f

Yuxuan Zhang authored Aug 09, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a6022e6f

Update docs for Minimax-Text support (#22562) · 2be07a0d
Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
2be07a0d
[Bugfix] Fix CI moe kernel failure (#22556) · 0edc0cd5
Jee Jee Li authored Aug 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
0edc0cd5
[Bugfix] Fix failing GPT-OSS initialization test (#22557) · 7920e9b1
Isotr0py authored Aug 09, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
7920e9b1
[ROCm][Misc] Rename the context_len to seq_len in ROCm custom paged attention kernel (#22097) · b7c0942b
Charlie Fu authored Aug 09, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
b7c0942b
[TPU] Add support for online w8a8 quantization (#22425) · 9a0c5ded
Kyuyeun Kim authored Aug 08, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
9a0c5ded
Fix loading of quantized BigCode models (#22463) · 10a02535
Eldar Kurtić authored Aug 09, 2025
```
Signed-off-by: Eldar Kurtic <eldar@neuralmagic.com>
```
10a02535
[Misc] Use config definitions from Transformers library (#21913) · 65552b47
Cyrus Leung authored Aug 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
65552b47
v1: Pass KVConnectorOutput to scheduler-side (#22157) · 7ad7adb6
Or Ozeri authored Aug 09, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
7ad7adb6
[V1] [Hybrid] Support Minimax-Text-01 in V1 (#22151) · 6ade99ea
Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
6ade99ea
[Log] Add Warning for Deprecation of DeepGEMM old version (#22194) · 3157aebb
Wentao Ye authored Aug 09, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
3157aebb

Remove mamba_ssm from vLLM requirements; install inside test container using... · 8a0ffd62

Thomas Parnell authored Aug 09, 2025


Remove mamba_ssm from vLLM requirements; install inside test container using `--no-build-isolation` (#22541)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

8a0ffd62

[Doc] Add usage of implicit text-only mode (#22561) · 23472ff5
Roger Wang authored Aug 08, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
```
23472ff5

Implicit language-model-only mode via limit-mm-per-prompt (#22299) · 08b751ba

Roger Wang authored Aug 08, 2025


Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Andy Xie <andy.xning@gmail.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: XIn Li <xinli@nvidia.com>
Signed-off-by: Junhao Li <junhao@ubicloud.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
Signed-off-by: zitian zhao <zitian.zhao@tencentmusic.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Signed-off-by: Linkun <github@lkchen.net>
Co-authored-by: Ning Xie <andy.xning@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Zhiyu <zhiyuc@nvidia.com>
Co-authored-by: Shu Wang <shuw@nvidia.com>
Co-authored-by: XIn Li <xinli@nvidia.com>
Co-authored-by: Junhao Li <streaver91@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Yuxuan Zhang <2448370773@qq.com>
Co-authored-by: ZiTian Zhao <zitian.zhao@tencentmusic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Hong Hanh <hanh.usth@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: lkchen <github@lkchen.net>

08b751ba

[Bugfix] Fix ModernBert cuda graph capturing in v1 (#21901) · 429e4e2d
Isotr0py authored Aug 09, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
429e4e2d

[BugFix] [P/D] Handle lookahead token count edge-case with Eagle Spec Decoding and P/D (#22317) · 35afe1b3

Pradyun92 authored Aug 08, 2025


Signed-off-by: Pradyun Ramadorai <pradyunr@amazon.com>
Signed-off-by: Pradyun92 <142861237+Pradyun92@users.noreply.github.com>
Co-authored-by: Pradyun Ramadorai <pradyunr@amazon.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>