Commits · 326976291b541f0fd5bef34aa1ff4a84bf8fb37d · OpenDAS / vllm_cscc

10 Aug, 2025 8 commits
- [Misc] code clean duplicate set_current_vllm_config in _set_vllm_config (#22566) · 32697629
  Ning Xie authored Aug 10, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  32697629
- [Minor] Fix pre-commit error on main (#22579) · 7e8d6857
  Isotr0py authored Aug 10, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  7e8d6857
- Refactor sliding window configuration to Transformers best practice (#21927) · c4984839
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c4984839
- [TPU] kv cache update kernel doesn't need to be padded slices to multiple of... · 2a84fb42
  Chengji Yao authored Aug 09, 2025
```
[TPU] kv cache update kernel doesn't need to be padded slices to multiple of num_slices_per_block (#22394)
Signed-off-by: Chengji Yao <chengjiyao@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@gmail.com>
```
  2a84fb42
- Improve fast_topk function with type hints and documentation (#22530) · 534c45b9
  ZiTian Zhao authored Aug 10, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  534c45b9
- [Config] add "qwen" as a native eagle3 target supported model (#22333) · 3d7363e6
  Le Chen authored Aug 10, 2025
```
Signed-off-by: lechen <lecself@163.com>
Signed-off-by: LeChen <lecself@163.com>
```
  3d7363e6
- [oss] Init gpt-oss bf16 support (#22508) · 0c5254b8
  Jee Jee Li authored Aug 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0c5254b8
- [V1] [Hybrid] Enable Full CUDA Graph (decode-only) for Mamba layers (#21401) · 61f67d8a
  Thomas Parnell authored Aug 10, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  61f67d8a
09 Aug, 2025 23 commits

[FEAT] [Performance] Add triton mrope to replace the torch code path (#22375) · 42172ad1
TJian authored Aug 09, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
42172ad1
[Bugfix] Fix basic models tests hanging due to mm processor creation (#22571) · fbd8595c
Isotr0py authored Aug 10, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
fbd8595c

[Model] Gemma3n MM (#20495) · 5a16fa61

Nicolò Lucchesi authored Aug 09, 2025


Signed-off-by: ShriKode <shrikode@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: ShriKode <shrikode@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>

5a16fa61

Move `ParallelConfig` from `config/__init__.py` to `config/parallel.py` (#22565) · 2d18256e
Harry Mellor authored Aug 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2d18256e
[Docs] Reduce noise in docs and `--help` from the JSON tip (#22567) · 56186474
Harry Mellor authored Aug 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
56186474
[CI] [Hybrid] Speed up hybrid models test by removing large models (#22563) · 1bf5e1f2
Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
1bf5e1f2

GLM-4.5V with new class name at transformers (#22520) · a6022e6f

Yuxuan Zhang authored Aug 09, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a6022e6f

Update docs for Minimax-Text support (#22562) · 2be07a0d
Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
2be07a0d
[Bugfix] Fix CI moe kernel failure (#22556) · 0edc0cd5
Jee Jee Li authored Aug 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
0edc0cd5
[Bugfix] Fix failing GPT-OSS initialization test (#22557) · 7920e9b1
Isotr0py authored Aug 09, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
7920e9b1
[ROCm][Misc] Rename the context_len to seq_len in ROCm custom paged attention kernel (#22097) · b7c0942b
Charlie Fu authored Aug 09, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
b7c0942b
[TPU] Add support for online w8a8 quantization (#22425) · 9a0c5ded
Kyuyeun Kim authored Aug 08, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
9a0c5ded
Fix loading of quantized BigCode models (#22463) · 10a02535
Eldar Kurtić authored Aug 09, 2025
```
Signed-off-by: Eldar Kurtic <eldar@neuralmagic.com>
```
10a02535
[Misc] Use config definitions from Transformers library (#21913) · 65552b47
Cyrus Leung authored Aug 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
65552b47
v1: Pass KVConnectorOutput to scheduler-side (#22157) · 7ad7adb6
Or Ozeri authored Aug 09, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
7ad7adb6
[V1] [Hybrid] Support Minimax-Text-01 in V1 (#22151) · 6ade99ea
Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
6ade99ea
[Log] Add Warning for Deprecation of DeepGEMM old version (#22194) · 3157aebb
Wentao Ye authored Aug 09, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
3157aebb

Remove mamba_ssm from vLLM requirements; install inside test container using... · 8a0ffd62

Thomas Parnell authored Aug 09, 2025


Remove mamba_ssm from vLLM requirements; install inside test container using `--no-build-isolation` (#22541)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

8a0ffd62

[Doc] Add usage of implicit text-only mode (#22561) · 23472ff5
Roger Wang authored Aug 08, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
```
23472ff5

Implicit language-model-only mode via limit-mm-per-prompt (#22299) · 08b751ba

Roger Wang authored Aug 08, 2025


Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Andy Xie <andy.xning@gmail.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: XIn Li <xinli@nvidia.com>
Signed-off-by: Junhao Li <junhao@ubicloud.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
Signed-off-by: zitian zhao <zitian.zhao@tencentmusic.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Signed-off-by: Linkun <github@lkchen.net>
Co-authored-by: Ning Xie <andy.xning@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Zhiyu <zhiyuc@nvidia.com>
Co-authored-by: Shu Wang <shuw@nvidia.com>
Co-authored-by: XIn Li <xinli@nvidia.com>
Co-authored-by: Junhao Li <streaver91@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Yuxuan Zhang <2448370773@qq.com>
Co-authored-by: ZiTian Zhao <zitian.zhao@tencentmusic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Hong Hanh <hanh.usth@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: lkchen <github@lkchen.net>

08b751ba

[Bugfix] Fix ModernBert cuda graph capturing in v1 (#21901) · 429e4e2d
Isotr0py authored Aug 09, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
429e4e2d

[BugFix] [P/D] Handle lookahead token count edge-case with Eagle Spec Decoding and P/D (#22317) · 35afe1b3

Pradyun92 authored Aug 08, 2025


Signed-off-by: Pradyun Ramadorai <pradyunr@amazon.com>
Signed-off-by: Pradyun92 <142861237+Pradyun92@users.noreply.github.com>
Co-authored-by: Pradyun Ramadorai <pradyunr@amazon.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

35afe1b3

[XPU] upgrade torch 2.8 on for XPU (#22300) · 81c57f60
Kunshang Ji authored Aug 09, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
81c57f60

08 Aug, 2025 9 commits
- Drop flaky test_healthcheck_response_time (#22539) · 311d8756
  Russell Bryant authored Aug 08, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  311d8756
- Extract `CompilationConfig` from `config.py` (#22524) · e3edc0a7
  Harry Mellor authored Aug 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e3edc0a7
- [Frontend] Add unix domain socket support (#18097) · baece8c3
  yyweiss authored Aug 09, 2025
```
Signed-off-by: <yyweiss@gmail.com>
Signed-off-by: yyw <yyweiss@gmail.com>
```
  baece8c3
- [Docs] fix broken links in metrics.md (#22315) · 2fcf6b27
  Guy Stone authored Aug 08, 2025
```
Signed-off-by: Guy Stone <guys@spotify.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2fcf6b27
- Skip Qwen 1 in CI because remote code is no longer compatible with Transformers (#22536) · 41b96557
  Harry Mellor authored Aug 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  41b96557
- [Bugfix] Update FA commit hash (#22546) · bd875d2e
  Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  bd875d2e
- [Misc] DeepGEMM : Avoid JIT generation in the hot-path (#22215) · f703b923
  Varun Sundar Rabindranath authored Aug 08, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  f703b923
- [BugFix] Fix IMA FlashMLA full cuda-graph and DP + Update FlashMLA (#21691) · cd9b9de1
  Lucas Wilkinson authored Aug 08, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  cd9b9de1
- [gpt-oss] Support tool call and implement MCP tool server (#22427) · fe6d8257
  Chen Zhang authored Aug 08, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  fe6d8257