Commits · de02b07db4741cc9ed40b8262d7a67e6bce30211 · OpenDAS / vllm_cscc · GitLab

27 Aug, 2025 7 commits
- [Bugfix] Lazy import gpt_oss_triton_kernels_moe for mxfp4 (#23678) · de02b07d
  Michael Goin authored Aug 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  de02b07d
- [gpt-oss] Enable unit test for response API harmony integration (#23533) · eb199516
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  eb199516
- [quantization] use channel scales for w4a8 + misc fixes (#23570) · 2c2b140a
  czhu-cohere authored Aug 26, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  2c2b140a
- fix pynccl reduce_scatter (#23648) · c7c80af0
  yzds authored Aug 27, 2025
```
Co-authored-by: hongchao <hongchao@msh.team>
```
  c7c80af0
- [Feature][Responses API] Support MCP tool in background mode (#23494) · 6891205b
  wuhang authored Aug 27, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  6891205b
- feat: add triton fused moe config for GLM-4.5-Air-FP8 on B200 (#23695) · b1625dbe
  zixuanzhang226 authored Aug 26, 2025
```
Signed-off-by: Zixuan Zhang <zixuanzhang@bytedance.com>
```
  b1625dbe
- [Bugfix] UnboundLocalError when GptOss reasoning specified (#23054) · 585e0bde
  Federico authored Aug 27, 2025
```
Signed-off-by: Federico <65908512+coval3nte@users.noreply.github.com>
```
  585e0bde
26 Aug, 2025 33 commits
- [Compile] Fix Cmake Warning (#23689) · 714872f1
  Wentao Ye authored Aug 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  714872f1
- [V1] [Hybrid] Enable Full CUDA graph by default for hybrid models in V1 (#22594) · 5f1af97f
  Thomas Parnell authored Aug 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  5f1af97f
- [V1][P/D]P2pNcclConnector supports flashinfer (#23536) · c3b0fd1e
  Zhonghua Deng authored Aug 27, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  c3b0fd1e
- [Docs] Move quant supported hardware table to README (#23663) · 6421b66b
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6421b66b
- Enhance the pre-notification policy (#23532) · 2f13319f
  Huzaifa Sidhpurwala authored Aug 27, 2025
```
Signed-off-by: Huzaifa Sidhpurwala <huzaifas@redhat.com>
```
  2f13319f
- [doc] Hybrid KV Cache Manager design doc (#22688) · d696f86e
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d696f86e
- [Model] Enable video support for InternVL3.5 models (#23658) · 9816b81f
  Isotr0py authored Aug 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9816b81f
- [Misc] Fix comments in `tests/kernels/quantization` (#23675) · c37c0af9
  Jiangyun Zhu authored Aug 27, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  c37c0af9
- [Bugfix] Fix incorrect original shape in hashing (#23672) · 9715f7bb
  Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  9715f7bb
- [v1] Add cross-attention KV cache support for encoder-decoder models (#23664) · 98aa16ff
  Russell Bryant authored Aug 26, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  98aa16ff
- [Docs] [V1] [Hybrid] Update docs to remove FlashInfer constraint for hybrid models (#23665) · 227e231b
  Thomas Parnell authored Aug 26, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  227e231b
- [Docs] Fix warnings in `mkdocs build` (#23649) · 730d0ac8
  Hyogeun Oh (오효근) authored Aug 27, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  730d0ac8
- [Bugfix] Fix cuda event usage with CPU model runner (#23643) · 9b018700
  Li, Jiang authored Aug 27, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  9b018700
- [CI] [Doc]: Add GH Action for auto labeling issues with `rocm` tag (#20988) · 44ac25ea
  vllmellm authored Aug 27, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  44ac25ea
- [Misc] Add override for allreduce fusion thresholds (#23639) · 7ea22e42
  nvjullin authored Aug 26, 2025
```
Signed-off-by: Julien Lin <jullin@nvidia.com>
```
  7ea22e42
- [model] support qwen2audio embedding input (#23625) · 9d4183dd
  Yuekai Zhang authored Aug 26, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  9d4183dd
- [Bugfix] fix bf16 multimodal model hash (#23623) · 513298f1
  Yuekai Zhang authored Aug 26, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  513298f1
- [Docs] Reduce requirements for docs build (#23651) · 379f828f
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  379f828f
- [ROCm] Starting to add AMD code reviewers for ROCm components (#23496) · 1fdc7324
  Hongxia Yang authored Aug 26, 2025
```
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
```
  1fdc7324
- [CPU] add cpu fused moe pytorch native implementation (#23146) · f58675bf
  TianyuLi0 authored Aug 26, 2025
```
Signed-off-by: Tianyu Li <tianyu.li@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  f58675bf
- [Doc]: fix various spelling issues in multiple files (#23636) · 7c04779a
  Didier Durand authored Aug 26, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7c04779a
- [Kernel] Added flashinfer fp8 per-tensor gemms (#22895) · f66673a3
  nvjullin authored Aug 26, 2025
```
Signed-off-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  f66673a3
- [Hardware][Mac] Fix the installation fail for Apple Silicon (CPU) (#23565) · b78bed1b
  En Ouyang authored Aug 26, 2025
```
Signed-off-by: oye93 <en.ouyang93@outlook.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  b78bed1b
- [Docs] Fix broken links to `docs/api/summary.md` (#23637) · 164b2273
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  164b2273
- Support FlashAttention Backend for Hybrid SSM Models (#23299) · 2b4fc9bd
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  2b4fc9bd
- feat: add usage to TranscriptionResponse (text and json response_format) (#23576) · ebd5a77b
  Guillaume Calmettes authored Aug 26, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  ebd5a77b
- [Bugfix] Add missing enable_log_outputs parameter to init_app_state function (#23634) · 384dd1b0
  Matúš Námešný authored Aug 26, 2025
```
Signed-off-by: Matúš Námešný <matus.namesny@ameria.com>
```
  384dd1b0
- [Model] fix DeepSeek e_score_correction_bias dtype to fp32 (#23640) · fdeb3dac
  Jee Jee Li authored Aug 26, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fdeb3dac
- [Perf] Remove duplicated NVFP4 blockscales to save memory (#23379) · d52358c1
  Michael Goin authored Aug 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d52358c1
- Fix writing benchmark results with tuple keys (#23633) · 6ace2f72
  Huy Do authored Aug 26, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  6ace2f72
- Fix nits from #20059 (#23548) · b00e69f8
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b00e69f8
- [V1] Enable V1 for compute capability < 8.0 + FP32 (#23614) · 50fede66
  Cyrus Leung authored Aug 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  50fede66
- [Bugfix] Fix scheduling when repeated images in one request (#23544) · b5d34af3
  Roger Wang authored Aug 26, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
```
  b5d34af3