Commits · b26b70bec4faa3dae487db1f3eebaddd86c1d828 · OpenDAS / vllm_cscc

18 Oct, 2025 4 commits

[Misc] Refactor `get_kv_cache_spec` into `AttentionLayerBase` (#26587) · b26b70be
Nicolò Lucchesi authored Oct 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
b26b70be
[fix][cpu] fix prefill attention in CPU attention backend (#27035) · ab4be40f
Fadi Arafeh authored Oct 18, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
ab4be40f

[Chore] Separate out `vllm.utils.mem_utils` (#27143) · 1d165d6d

iAmir97 authored Oct 18, 2025

Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

1d165d6d

[GPT-OSS] Structure_Tag support for gpt-oss tool-call in cot (#25515) · 7c572544

Hanchenli authored Oct 17, 2025


Signed-off-by: Hanchenli <lihanc2002@gmail.com>
Signed-off-by: Hanchenli <61769611+Hanchenli@users.noreply.github.com>
Signed-off-by: Wei Wei <wwei6@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Wei Wei <wwei6@meta.com>
Co-authored-by: Wei Wei <weiweinpu@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

7c572544

17 Oct, 2025 7 commits
- [V1][Spec Decode] Fix greedy temperature detection after sampler refactor (#27077) · acedc74b
  Pradyun92 authored Oct 17, 2025
```
Signed-off-by: Pradyun Ramadorai <pradyunr@amazon.com>
Co-authored-by: Pradyun Ramadorai <pradyunr@amazon.com>
```
  acedc74b
- [Data-parallel] Allow DP>1 for world_size > num_gpus on node (8) (#26367) · b038d9c4
  Patrick von Platen authored Oct 17, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
```
  b038d9c4
- [Docs] Replace `rst` style double-backtick with `md` single-backtick (#27091) · 6c9fdbf7
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c9fdbf7
- [Kernel] Lazy import FlashInfer (#26977) · fec2b341
  Jee Jee Li authored Oct 17, 2025
  
  fec2b341
- [Core] Change `execute_model_with_error_logging()` to be a ctx manager (#27060) · fe3b9372
  Nick Hill authored Oct 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  fe3b9372
- Remove unused imports (#26972) · 4d055ef4
  Lukas Geiger authored Oct 17, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  4d055ef4
- [Chore] Separate out `vllm.utils.importlib` (#27022) · 4d4d6bad
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4d4d6bad
16 Oct, 2025 8 commits
- [small][batch invariance] Rename the env and internal flags to simplify usage (#26855) · b2f78cba
  Bram Wasti authored Oct 16, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  b2f78cba
- [Feature] Add process_weights_after_loading to AttentionImpl (#26870) · 5afd3276
  rongfu.leng authored Oct 16, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  5afd3276
- [Chore] Separate out `vllm.utils.collections` (#26990) · d2740faf
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2740faf
- [Hardware][CPU][PowerPC]Disable torch.compile() in toptopk sampling (#26987) · f7d318de
  Akash kaothalkar authored Oct 16, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
```
  f7d318de
- Deepseek-v3 Batch Invariant on 8xH100 (#26609) · 7d8975de
  Bram Wasti authored Oct 15, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  7d8975de
- [PERF] Qwen3-next MTP speedup (change bool mask indexing to index_select /... · 785d8b64
  Vadim Gimpelson authored Oct 16, 2025
```
[PERF] Qwen3-next MTP speedup (change bool mask indexing to index_select / index_copy to reduce d2h) (#26437)
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  785d8b64
- [Chore] Rename `utils` submodules (#26920) · f6cdc9a0
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f6cdc9a0
- [bugfix] Fix SP + PP without specifying compile size (#26955) · e19b16dd
  Angela Yi authored Oct 15, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  e19b16dd
15 Oct, 2025 8 commits
- Move query quantization to attention layer for Flashinfer & Triton. (#26534) · 0a9ef0cf
  Adrian Abeyta authored Oct 15, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Adrian Abeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  0a9ef0cf
- [Chore] Separate out `vllm.utils.async_utils` (#26913) · 828523ad
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  828523ad
- [Chore] Separate out `vllm.utils.func` (#26904) · 136a17fe
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  136a17fe
- [Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370) · f54f8512
  wang.yuqi authored Oct 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f54f8512
- [Easy] Get rid of unnecessary paraenthesis in kv_cache_manager (#26842) · 7f83b4ee
  Jialin Ouyang authored Oct 15, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  7f83b4ee
- [Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a
  Morrison Turnansky authored Oct 14, 2025
```
[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  96b9aa5a
- Disable FlashInfer sampler by default (#26859) · e66d787b
  Michael Goin authored Oct 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e66d787b
- [Core][Easy] Use envs.__getattr__ for all Unify to environment variable access (#26810) · 07ca70af
  Jialin Ouyang authored Oct 14, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  07ca70af
14 Oct, 2025 13 commits
- [WideEP][P/D] Add usage stats for DP+EP and KV Connector (#26836) · 579d2e54
  Tyler Michael Smith authored Oct 14, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  579d2e54
- [Core] Streamline some structured output related code (#26737) · 4aed506b
  Nick Hill authored Oct 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4aed506b
- remove attn output view kernel (#26680) · a86b4c58
  Boyuan Feng authored Oct 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Boyuan Feng <fby.1994@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  a86b4c58
- [Minor] Group async_scheduling related fields in model runner init (#26736) · ff4810ba
  Nick Hill authored Oct 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ff4810ba
- [Perf] Cache vllm.env.__getattr__ result to avoid recomputation (#26146) · 380f1752
  Jialin Ouyang authored Oct 14, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  380f1752
- [Core] Reuse empty block lists whenever possible in KVCacheBlocks to mitigate GC costs (#24964) · acaa2c0a
  Jialin Ouyang authored Oct 14, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  acaa2c0a
- [Attention][Spec Decode] FlashMLA spec decode support (#26541) · 82af928c
  Matthew Bonanni authored Oct 14, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  82af928c
- [Config] Remove Unused Environment Variable `VLLM_DISABLE_PAD_FOR_CUDAGRAPH` (#26743) · 6d87a283
  Wentao Ye authored Oct 14, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6d87a283
- [KVConnector][Metrics] Aggregate scheduler-side KVConnectorStats (#26046) · 720394de
  Qier Li authored Oct 14, 2025
```
Signed-off-by: Qier Li <kevin44036@gmail.com>
```
  720394de
- [DCP] Support Decode Context Parallel (DCP) for GQA with FlashAttention (#24864) · ea97940d
  Jaya Yuan authored Oct 14, 2025
```
Signed-off-by: yuanyongjie.yyj <yuanyongjie.yyj@antgroup.com>
Signed-off-by: FENP <32334296+FENP@users.noreply.github.com>
Signed-off-by: Jaya Yuan <yuanyongjie.yyj@antgroup.com>
```
  ea97940d
- Fix lora tests failure in TPU CI due to the removal of LoRA bias (#26723) · 4497c8f8
  XiongfeiWei authored Oct 13, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  4497c8f8
- [UX] Replace VLLM_ALL2ALL_BACKEND with --all2all-backend (#26732) · 3e051bda
  Michael Goin authored Oct 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3e051bda
- [Misc][DP] support customized aggregated logger for dp (#24354) · 8317f723
  Lucia Fang authored Oct 13, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  8317f723