Commits · 11eddf02f0234f79435d747f2d3dce117ab39aa1 · OpenDAS / vllm_cscc · GitLab

27 Aug, 2025 25 commits
- [FlashInfer] Cache hyper params in metadata builder (#23732) · 11eddf02
  Woosuk Kwon authored Aug 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  11eddf02
- [Misc] Move CpuGpuBuffer to vllm/v1/utils.py (#23728) · 04ff1e43
  Woosuk Kwon authored Aug 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  04ff1e43
- Optimize input preparation for FlashInfer [2/N] (#23174) · 6578e873
  Woosuk Kwon authored Aug 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6578e873
- [Docs] Fix an admonition important (#23726) · 5bd9f841
  Michael Yao authored Aug 27, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  5bd9f841
- [CI/Build] Remove redundant register in model init tests (#23715) · 91e382c9
  Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  91e382c9
- [XPU]fix cuda event used in XPU model runner (#23708) · 64466778
  Kunshang Ji authored Aug 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  64466778
- [Core] Use key-only cache for `BaseMultiModalProcessor` (#23018) · 69244e67
  Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  69244e67
- [Bugfix] fix when config.yaml config value is list parse error (#23528) · 8dbf6ed7
  rongfu.leng authored Aug 27, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  8dbf6ed7
- [CI/Build] Remove redundant LoRA model tests (#23706) · 9de25c29
  Jee Jee Li authored Aug 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9de25c29
- [XPU] Add xpu torch.compile support (#22609) · fce10dbe
  Kunshang Ji authored Aug 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  fce10dbe
- [Quantization] Expand compressed-tensors MoE matching logic to support NFP4 + FP8 MoEs (#22674) · d272415e
  Dipika Sikka authored Aug 27, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
  d272415e
- [Frontend] Optimize beam search performance by limiting concurrency (#23599) · 142ac080
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  142ac080
- [Frontend] Add --log-error-stack to print stack trace for error response (#22960) · 32102644
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  32102644
- [Model] Add Ernie4.5 VL Model Support (#22514) · 644d57d5
  CSWYF3634076 authored Aug 27, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  644d57d5
- [Core] Asynchronous h2d in merge_multimodal_embeddings via pinned memory. (#23686) · c905684c
  Chenheli Hua authored Aug 26, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  c905684c
- [Bugfix]: Qwen3 Coder Tool Parser (#23099) · 78683580
  Yiheng Xu authored Aug 27, 2025
```
Signed-off-by: Yiheng Xu <charlesyihengxu@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
```
  78683580
- [Bugfix][gpt-oss] passing the cache config in gpt-oss (#23613) · fecbb7c7
  Wei authored Aug 26, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  fecbb7c7
- [Docs] Fix math rendering in docs (#23676) · 6dab89b8
  Harry Mellor authored Aug 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6dab89b8
- [Bugfix] Lazy import gpt_oss_triton_kernels_moe for mxfp4 (#23678) · de02b07d
  Michael Goin authored Aug 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  de02b07d
- [gpt-oss] Enable unit test for response API harmony integration (#23533) · eb199516
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  eb199516
- [quantization] use channel scales for w4a8 + misc fixes (#23570) · 2c2b140a
  czhu-cohere authored Aug 26, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  2c2b140a
- fix pynccl reduce_scatter (#23648) · c7c80af0
  yzds authored Aug 27, 2025
```
Co-authored-by: hongchao <hongchao@msh.team>
```
  c7c80af0
- [Feature][Responses API] Support MCP tool in background mode (#23494) · 6891205b
  wuhang authored Aug 27, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  6891205b
- feat: add triton fused moe config for GLM-4.5-Air-FP8 on B200 (#23695) · b1625dbe
  zixuanzhang226 authored Aug 26, 2025
```
Signed-off-by: Zixuan Zhang <zixuanzhang@bytedance.com>
```
  b1625dbe
- [Bugfix] UnboundLocalError when GptOss reasoning specified (#23054) · 585e0bde
  Federico authored Aug 27, 2025
```
Signed-off-by: Federico <65908512+coval3nte@users.noreply.github.com>
```
  585e0bde
26 Aug, 2025 15 commits
- [Compile] Fix Cmake Warning (#23689) · 714872f1
  Wentao Ye authored Aug 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  714872f1
- [V1] [Hybrid] Enable Full CUDA graph by default for hybrid models in V1 (#22594) · 5f1af97f
  Thomas Parnell authored Aug 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  5f1af97f
- [V1][P/D]P2pNcclConnector supports flashinfer (#23536) · c3b0fd1e
  Zhonghua Deng authored Aug 27, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  c3b0fd1e
- [Docs] Move quant supported hardware table to README (#23663) · 6421b66b
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6421b66b
- Enhance the pre-notification policy (#23532) · 2f13319f
  Huzaifa Sidhpurwala authored Aug 27, 2025
```
Signed-off-by: Huzaifa Sidhpurwala <huzaifas@redhat.com>
```
  2f13319f
- [doc] Hybrid KV Cache Manager design doc (#22688) · d696f86e
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d696f86e
- [Model] Enable video support for InternVL3.5 models (#23658) · 9816b81f
  Isotr0py authored Aug 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9816b81f
- [Misc] Fix comments in `tests/kernels/quantization` (#23675) · c37c0af9
  Jiangyun Zhu authored Aug 27, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  c37c0af9
- [Bugfix] Fix incorrect original shape in hashing (#23672) · 9715f7bb
  Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  9715f7bb
- [v1] Add cross-attention KV cache support for encoder-decoder models (#23664) · 98aa16ff
  Russell Bryant authored Aug 26, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  98aa16ff
- [Docs] [V1] [Hybrid] Update docs to remove FlashInfer constraint for hybrid models (#23665) · 227e231b
  Thomas Parnell authored Aug 26, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  227e231b
- [Docs] Fix warnings in `mkdocs build` (#23649) · 730d0ac8
  Hyogeun Oh (오효근) authored Aug 27, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  730d0ac8
- [Bugfix] Fix cuda event usage with CPU model runner (#23643) · 9b018700
  Li, Jiang authored Aug 27, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  9b018700
- [CI] [Doc]: Add GH Action for auto labeling issues with `rocm` tag (#20988) · 44ac25ea
  vllmellm authored Aug 27, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  44ac25ea
- [Misc] Add override for allreduce fusion thresholds (#23639) · 7ea22e42
  nvjullin authored Aug 26, 2025
```
Signed-off-by: Julien Lin <jullin@nvidia.com>
```
  7ea22e42