Commits · e303dcf523344a982c5e6937ddc8946b2b9860cc · OpenDAS / vllm_cscc · GitLab

02 Jul, 2025 19 commits
- [Model] Add Ernie4.5 and Ernie4.5MoE Model Support (#20220) · e303dcf5
  CSWYF3634076 authored Jul 02, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  e303dcf5
- [Docs] Make TPU ref prettier in google_tpu.md (#20356) · ae9c4d41
  Michael Yao authored Jul 02, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  ae9c4d41
- [Docs] Fix indentations for 2-level items in deprecation_policy.md (#20352) · d853520b
  Michael Yao authored Jul 02, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  d853520b
- [Bugfix] Keye-VL compatibility with `tok_kwargs` (#20058) (#20353) · ba51aea6
  Cyrus Leung authored Jul 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba51aea6
- [Model][VLM] Support Keye-VL-8B-Preview (#20126) · 8452946c
  Kwai-Keye authored Jul 02, 2025
```
Signed-off-by: Kwai-Keye <Keye@kuaishou.com>
```
  8452946c
- [Frontend] Support configurable mm placeholder strings & flexible video... · 2e7cbf2d
  Chenheli Hua authored Jul 01, 2025
```
[Frontend] Support configurable mm placeholder strings & flexible video sampling policies via CLI flags. (#20105)
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  2e7cbf2d
- [TPU] kv cache update kernel supports dynamic grid (#20235) · 7da296be
  Chengji Yao authored Jul 01, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  7da296be
- [Doc][TPU] Add models and features supporting matrix. (#20230) · b205e846
  QiliangCui authored Jul 01, 2025
```
Signed-off-by: Qiliang Cui <cuiq@google.com>
```
  b205e846
- fix[Docs]: link anchor is incorrect #20309 (#20315) · be0cfb2b
  yyzxw authored Jul 02, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
```
  be0cfb2b
- [Bugfix] Fix dynamic rotary embedding (#20343) · 1a03dd49
  Cyrus Leung authored Jul 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1a03dd49
- [FIX][Intel GPU]fix ipex flash_attn_varlen_func api missing parameter (#20348) · 27b80176
  Kunshang Ji authored Jul 02, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  27b80176
- [Misc][Doc] Add missing comment for LLM (#20285) · 9ec1e306
  Lifans authored Jul 01, 2025
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
  9ec1e306
- [Refactor] Remove Unused Env `VLLM_ENABLE_MOE_ALIGN_BLOCK_SIZE_TRITON` (#20334) · 9dae7d46
  Wentao Ye authored Jul 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  9dae7d46
- [Refactor] Remove duplicate `find_free_port` (#20333) · 7058d7dd
  Wentao Ye authored Jul 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7058d7dd
- [UT][intel GPU] use current_platform instead of device hardcode in v1 tests (#20169) · a0389e05
  Liangliang Ma authored Jul 02, 2025
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
```
  a0389e05
- [Kernel][Bugfix] Fixup some warnings in nvfp4_blockwise_moe when CUDA < 12.8 (#20324) · 3be8d312
  Tyler Michael Smith authored Jul 01, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  3be8d312
- Enable group size 64 for Machete (#20290) · 3abfe221
  czhu-cohere authored Jul 01, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  3abfe221
- [Refactor] Refactor import utils (#20269) · e81fbefe
  Wentao Ye authored Jul 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e81fbefe
- remove unused variables in marlin_template.h (#20236) · 9290de56
  周周周 authored Jul 02, 2025
  
  9290de56
01 Jul, 2025 21 commits
- [Optimization] Cache sampled token ids in model runner (#20291) · 7f280d69
  Woosuk Kwon authored Jul 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f280d69
- [V1] [ROCm] Enable EP with AITER Fused MoE (#20270) · 02cabff2
  TJian authored Jul 01, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  02cabff2
- [Frontend] Expand tools even if tool_choice="none" (#17177) · 3d19d47d
  Shintarou Okada authored Jul 02, 2025
```
Signed-off-by: okada shintarou <okada@preferred.jp>
```
  3d19d47d
- [CUDA graphs] Enable full cuda graphs with FA3 AoT scheduling (#20301) · 8acb4bad
  Woosuk Kwon authored Jul 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  8acb4bad
- [Docs] Update transcriptions API to use openai client with `stream=True` (#20271) · 314af861
  Nicolò Lucchesi authored Jul 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  314af861
- [Misc] Minor refactoring for scheduler (#20299) · 0e96cc9b
  Woosuk Kwon authored Jul 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0e96cc9b
- [Model]Add Tencent HunYuanMoEV1 Model Support (#20114) · ecad851c
  aiyiwang2025 authored Jul 01, 2025
```
Signed-off-by: aiyiwang <aiyiwang@tencent.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: quinnrong <quinnrong@tencent.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  ecad851c
- Add GLM4.1V model (Draft) (#19331) · ed70f3c6
  Yuxuan Zhang authored Jul 01, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ed70f3c6
- [Misc] Minor refactor of NIXL background handshake (#20068) · 650d5dbd
  Nicolò Lucchesi authored Jul 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  650d5dbd
- [Quant] [Bugfix] Fix quantization config matching with `hf_to_vllm_mapper` (#20046) · 9025a9a7
  Kyle Sayers authored Jul 01, 2025
  
  9025a9a7
- [Perf] Validate @config in pre-commit instead of dynamically (#20200) · c05596f1
  Lionel Villard authored Jul 01, 2025
```
Signed-off-by: Lionel Villard <villard@us.ibm.com>
```
  c05596f1
- [doc] fix the incorrect logo in dark mode (#20289) · 787b1338
  Reid authored Jul 01, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  787b1338
- [BugFix][V1][ROCm] Triton MLA uses V0 backend on V1 engine (#19067) · 96453cfa
  TY-AMD authored Jul 01, 2025
```
Signed-off-by: Tianyuan Wu <Tianyuan.Wu@amd.com>
```
  96453cfa
- [Misc] remove redundant char (#20287) · b1c1fe35
  Kebe authored Jul 01, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  b1c1fe35
- [Bugfix] Fix deepep tests (#20288) · 08d81f10
  Varun Sundar Rabindranath authored Jul 01, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  08d81f10
- [CPU] Update custom ops for the CPU backend (#20255) · 6cc1e7d9
  Li, Jiang authored Jul 01, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  6cc1e7d9
- Enable ZP Support for Machete (#20268) · 9909726d
  czhu-cohere authored Jul 01, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  9909726d
- [Misc] add xgrammar for arm64 (#18359) · 22e9d420
  Prashant Gupta authored Jul 01, 2025
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
```
  22e9d420
- Fix `numel()` downcast in vllm/csrc/moe/moe_align_sum_kernels.cu +2 (#17082) · 86debab5
  Richard Barnes authored Jul 01, 2025
```
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  86debab5
- [V1] Only print cudagraph tqdm on rank 0 with `is_global_first_rank` (#19516) · be250bbc
  Michael Goin authored Jul 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  be250bbc
- [Feature] A calibration-free RTN-based quantization for accurate and... · 27949354
  Alex Kogan authored Jul 01, 2025
```
[Feature] A calibration-free RTN-based quantization for accurate and accelerated INT4/INT8 inference (#18768)
Signed-off-by: Alex Kogan <alex.kogan@oracle.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  27949354