Commits · 0c5254b82acc625112ce7adc10811514f1a42d52 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "97608dc276c292d9217eb6d334d969c5e89913c6"

10 Aug, 2025 1 commit
- [V1] [Hybrid] Enable Full CUDA Graph (decode-only) for Mamba layers (#21401) · 61f67d8a
  Thomas Parnell authored Aug 10, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  61f67d8a
09 Aug, 2025 10 commits

[FEAT] [Performance] Add triton mrope to replace the torch code path (#22375) · 42172ad1
TJian authored Aug 09, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
42172ad1

[Model] Gemma3n MM (#20495) · 5a16fa61

Nicolò Lucchesi authored Aug 09, 2025


Signed-off-by: ShriKode <shrikode@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: ShriKode <shrikode@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>

5a16fa61

[CI] [Hybrid] Speed up hybrid models test by removing large models (#22563) · 1bf5e1f2
Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
1bf5e1f2

GLM-4.5V with new class name at transformers (#22520) · a6022e6f

Yuxuan Zhang authored Aug 09, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a6022e6f

[Bugfix] Fix CI moe kernel failure (#22556) · 0edc0cd5
Jee Jee Li authored Aug 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
0edc0cd5
[Bugfix] Fix failing GPT-OSS initialization test (#22557) · 7920e9b1
Isotr0py authored Aug 09, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
7920e9b1
[TPU] Add support for online w8a8 quantization (#22425) · 9a0c5ded
Kyuyeun Kim authored Aug 08, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
9a0c5ded

Remove mamba_ssm from vLLM requirements; install inside test container using... · 8a0ffd62

Thomas Parnell authored Aug 09, 2025


Remove mamba_ssm from vLLM requirements; install inside test container using `--no-build-isolation` (#22541)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

8a0ffd62

Implicit language-model-only mode via limit-mm-per-prompt (#22299) · 08b751ba

Roger Wang authored Aug 08, 2025


Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Andy Xie <andy.xning@gmail.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: XIn Li <xinli@nvidia.com>
Signed-off-by: Junhao Li <junhao@ubicloud.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
Signed-off-by: zitian zhao <zitian.zhao@tencentmusic.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Signed-off-by: Linkun <github@lkchen.net>
Co-authored-by: Ning Xie <andy.xning@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Zhiyu <zhiyuc@nvidia.com>
Co-authored-by: Shu Wang <shuw@nvidia.com>
Co-authored-by: XIn Li <xinli@nvidia.com>
Co-authored-by: Junhao Li <streaver91@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Yuxuan Zhang <2448370773@qq.com>
Co-authored-by: ZiTian Zhao <zitian.zhao@tencentmusic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Hong Hanh <hanh.usth@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: lkchen <github@lkchen.net>

08b751ba

[Bugfix] Fix ModernBert cuda graph capturing in v1 (#21901) · 429e4e2d
Isotr0py authored Aug 09, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
429e4e2d

08 Aug, 2025 9 commits
- Drop flaky test_healthcheck_response_time (#22539) · 311d8756
  Russell Bryant authored Aug 08, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  311d8756
- Extract `CompilationConfig` from `config.py` (#22524) · e3edc0a7
  Harry Mellor authored Aug 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e3edc0a7
- [Frontend] Add unix domain socket support (#18097) · baece8c3
  yyweiss authored Aug 09, 2025
```
Signed-off-by: <yyweiss@gmail.com>
Signed-off-by: yyw <yyweiss@gmail.com>
```
  baece8c3
- Skip Qwen 1 in CI because remote code is no longer compatible with Transformers (#22536) · 41b96557
  Harry Mellor authored Aug 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  41b96557
- [gpt-oss] triton kernel mxfp4 (#22421) · e789cad6
  Yongye Zhu authored Aug 08, 2025
```
Signed-off-by: <zyy1102000@gmail.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  e789cad6
- [Misc] Begin deprecation of `get_tensor_model_*_group` (#22494) · 43c4f3d7
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  43c4f3d7
- [Bugfix] Fix RuntimeError: Index put requires the source and destination dtypes match (#22065) · 17eaaef5
  Chauncey authored Aug 08, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  17eaaef5
- [ROCm] [V1] [SpecDec] Enable Speculative Decoding on ROCm V1 Engine (#21496) · 1ee5ead5
  TJian authored Aug 07, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  1ee5ead5
- [Misc] normalize multiprocessing Queue usage (#22371) · acf8aeb7
  Ning Xie authored Aug 08, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  acf8aeb7
07 Aug, 2025 14 commits
- Remove `from_dict` from `SpeculativeConfig` (#22451) · 7e3a8dc9
  Harry Mellor authored Aug 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7e3a8dc9
- [Frontend] Use engine argument to control MM cache size (#22441) · 139d1557
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  139d1557
- [gpt-oss] Generate ResponseOutputItem from Harmony Message (#22410) · 4815b00f
  Chen Zhang authored Aug 07, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  4815b00f
- [Core] Store only the keys for multi-modal data in P0 (#22198) · 766bc816
  Cyrus Leung authored Aug 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  766bc816
- feat: Add --enable-log-outputs flag for logging model generations (#20707) · 8e8e0b6a
  Adrián García García authored Aug 07, 2025
```
Signed-off-by: Adrian Garcia <adrian.garcia@inceptionai.ai>
```
  8e8e0b6a
- [Misc] Support routing logic simulation (#21990) · 82216dc2
  Ming Yang authored Aug 06, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  82216dc2
- [Frontend] Update OpenAI error response to upstream format (#22099) · 37066185
  Moritz Sanft authored Aug 07, 2025
```
Signed-off-by: Moritz Sanft <58110325+msanft@users.noreply.github.com>
```
  37066185
- [CI] Skip the pooling models that do not support transformers v4.55 (#22411) · 2a4c8255
  wang.yuqi authored Aug 07, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2a4c8255
- [Bugfix]: Fix the streaming output for function calls in the minimax (#22015) · 5e9455ae
  qscqesze authored Aug 07, 2025
```
Signed-off-by: QscQ <qscqesze@gmail.com>
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  5e9455ae
- Use float32 for test_completion.py (#22385) · a00d8b23
  Michael Goin authored Aug 06, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  a00d8b23
- [Attention] Support multiple attention metadata builders per kv_cache_spec +... · 1dc8a70b
  Lucas Wilkinson authored Aug 06, 2025
```
[Attention] Support multiple attention metadata builders per kv_cache_spec  + proper local attention no hybrid kv cache fix (#21588)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  1dc8a70b
- Support encoder_only attention for FlexAttention (#22273) · f825c6bd
  Maximilien de Bayser authored Aug 06, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  f825c6bd
- [model] Support MiniCPM-V 4.0 (#22166) · 41b67f42
  tc-mb authored Aug 07, 2025
```
Co-authored-by: imning3 <hbning@pku.edu.cn>
```
  41b67f42
- [v1] - Mamba1 Attention Metadata (#21249) · 46a13949
  Asaf Joseph Gardin authored Aug 07, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  46a13949
06 Aug, 2025 4 commits

[Misc] Clean up duplicated hf overrides (#22311) · fa00c5d7
Isotr0py authored Aug 06, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
fa00c5d7
Add GPT-OSS model code and config [1/N] (#22327) · de98252f
Woosuk Kwon authored Aug 05, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
de98252f

Update transformers to `v4.55` (#21931) · 796bae07

Harry Mellor authored Aug 06, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

796bae07

[Bugfix] Remove faulty test for oot attention backend (#22286) · 35509fc5
Michael Goin authored Aug 05, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
35509fc5

05 Aug, 2025 2 commits
- [V1] port xformers backend to v1 (#21342) · 469b3ffa
  Giancarlo Delfin authored Aug 05, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  469b3ffa
- [V0 Deprecation][TPU] Remove V1 flag check from tests (#22248) · 0c275ad5
  Nicolò Lucchesi authored Aug 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  0c275ad5