Commits · d2740fafbf2527f4026863854bf1aeaa383c1a8e · OpenDAS / vllm_cscc

"docs/source/design/arch_overview.md" did not exist on "382b6a4852b9afc9a740b02736688e20f7d58446"

16 Oct, 2025 6 commits
- [Chore] Separate out `vllm.utils.collections` (#26990) · d2740faf
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2740faf
- [Hardware][CPU][PowerPC]Disable torch.compile() in toptopk sampling (#26987) · f7d318de
  Akash kaothalkar authored Oct 16, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
```
  f7d318de
- Deepseek-v3 Batch Invariant on 8xH100 (#26609) · 7d8975de
  Bram Wasti authored Oct 15, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  7d8975de
- [PERF] Qwen3-next MTP speedup (change bool mask indexing to index_select /... · 785d8b64
  Vadim Gimpelson authored Oct 16, 2025
```
[PERF] Qwen3-next MTP speedup (change bool mask indexing to index_select / index_copy to reduce d2h) (#26437)
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  785d8b64
- [Chore] Rename `utils` submodules (#26920) · f6cdc9a0
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f6cdc9a0
- [bugfix] Fix SP + PP without specifying compile size (#26955) · e19b16dd
  Angela Yi authored Oct 15, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  e19b16dd
15 Oct, 2025 8 commits
- Move query quantization to attention layer for Flashinfer & Triton. (#26534) · 0a9ef0cf
  Adrian Abeyta authored Oct 15, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Adrian Abeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  0a9ef0cf
- [Chore] Separate out `vllm.utils.async_utils` (#26913) · 828523ad
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  828523ad
- [Chore] Separate out `vllm.utils.func` (#26904) · 136a17fe
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  136a17fe
- [Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370) · f54f8512
  wang.yuqi authored Oct 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f54f8512
- [Easy] Get rid of unnecessary paraenthesis in kv_cache_manager (#26842) · 7f83b4ee
  Jialin Ouyang authored Oct 15, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  7f83b4ee
- [Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a
  Morrison Turnansky authored Oct 14, 2025
```
[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  96b9aa5a
- Disable FlashInfer sampler by default (#26859) · e66d787b
  Michael Goin authored Oct 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e66d787b
- [Core][Easy] Use envs.__getattr__ for all Unify to environment variable access (#26810) · 07ca70af
  Jialin Ouyang authored Oct 14, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  07ca70af
14 Oct, 2025 13 commits
- [WideEP][P/D] Add usage stats for DP+EP and KV Connector (#26836) · 579d2e54
  Tyler Michael Smith authored Oct 14, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  579d2e54
- [Core] Streamline some structured output related code (#26737) · 4aed506b
  Nick Hill authored Oct 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4aed506b
- remove attn output view kernel (#26680) · a86b4c58
  Boyuan Feng authored Oct 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Boyuan Feng <fby.1994@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  a86b4c58
- [Minor] Group async_scheduling related fields in model runner init (#26736) · ff4810ba
  Nick Hill authored Oct 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ff4810ba
- [Perf] Cache vllm.env.__getattr__ result to avoid recomputation (#26146) · 380f1752
  Jialin Ouyang authored Oct 14, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  380f1752
- [Core] Reuse empty block lists whenever possible in KVCacheBlocks to mitigate GC costs (#24964) · acaa2c0a
  Jialin Ouyang authored Oct 14, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  acaa2c0a
- [Attention][Spec Decode] FlashMLA spec decode support (#26541) · 82af928c
  Matthew Bonanni authored Oct 14, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  82af928c
- [Config] Remove Unused Environment Variable `VLLM_DISABLE_PAD_FOR_CUDAGRAPH` (#26743) · 6d87a283
  Wentao Ye authored Oct 14, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6d87a283
- [KVConnector][Metrics] Aggregate scheduler-side KVConnectorStats (#26046) · 720394de
  Qier Li authored Oct 14, 2025
```
Signed-off-by: Qier Li <kevin44036@gmail.com>
```
  720394de
- [DCP] Support Decode Context Parallel (DCP) for GQA with FlashAttention (#24864) · ea97940d
  Jaya Yuan authored Oct 14, 2025
```
Signed-off-by: yuanyongjie.yyj <yuanyongjie.yyj@antgroup.com>
Signed-off-by: FENP <32334296+FENP@users.noreply.github.com>
Signed-off-by: Jaya Yuan <yuanyongjie.yyj@antgroup.com>
```
  ea97940d
- Fix lora tests failure in TPU CI due to the removal of LoRA bias (#26723) · 4497c8f8
  XiongfeiWei authored Oct 13, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  4497c8f8
- [UX] Replace VLLM_ALL2ALL_BACKEND with --all2all-backend (#26732) · 3e051bda
  Michael Goin authored Oct 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3e051bda
- [Misc][DP] support customized aggregated logger for dp (#24354) · 8317f723
  Lucia Fang authored Oct 13, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  8317f723
13 Oct, 2025 6 commits
- [Log] Optimize Startup Log (#26601) · e251e457
  Wentao Ye authored Oct 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e251e457
- [P/D] [NixlConnector] kv load recovery integration (#26171) · 53c9a7ce
  Will Eaton authored Oct 13, 2025
```
Signed-off-by: Will Eaton <weaton@redhat.com>
```
  53c9a7ce
- [Hardware][CPU] Disable torch.compile for RISC-V to prevent APIError (#26693) · 4a61950f
  ihb2032 authored Oct 13, 2025
```
Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn>
Signed-off-by: ihb2032 <1355790728@qq.com>
Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn
```
  4a61950f
- [unrevert] Add batch invariant kernel override for FlashInfer backend [2/n] (#26373) · 32637990
  Bram Wasti authored Oct 13, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
```
  32637990
- [FIX] Throwing an exception when the model does not support pool tasks (#25840) (#25855) · 46ad7395
  yyzxw authored Oct 13, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
Co-authored-by: wang.yuqi <noooop@126.com>
```
  46ad7395
- [Bugfix][Core]Fix block table out-of-range issue in priority scheduling (#26661) · 41f38844
  quanliu authored Oct 13, 2025
```
Signed-off-by: quanliu <18646313696@163.com>
```
  41f38844
12 Oct, 2025 2 commits
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
- [MISC] Rename the torch profiler filename as instance_id+rank_id for merging... · 76852017
  wang.yuqi authored Oct 12, 2025
```
[MISC] Rename the torch profiler filename as instance_id+rank_id for merging the Profiler results of each Rank (#25867)
Signed-off-by: wang.yuqi <noooop@126.com>
```
  76852017
11 Oct, 2025 2 commits

[Refactor]: Use M-RoPE interface directly while defining model class instead... · 727144be

dsinghvi authored Oct 11, 2025


[Refactor]: Use M-RoPE interface directly while defining model class instead of maintaining model specific M-RoPE implementation in mrope.py (#24172)
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: wwl2755 <wangwenlong2755@gmail.com>

727144be

[MM] Move Qwen3Omni MRoPE impl to model file (#26608) · ddaff293

Roger Wang authored Oct 10, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ddaff293

10 Oct, 2025 3 commits
- [BugFix] Make penalties and bad_words work with async scheduling (#26467) · 5bc26c43
  Nick Hill authored Oct 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5bc26c43
- [BugFix] Fix async scheduling + request preemption (#26385) · 949cb017
  Nick Hill authored Oct 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  949cb017
- [BUG] Qwen3-next MTP. Fix attn metadata build bug (#26564) · e94cfd51
  Vadim Gimpelson authored Oct 10, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  e94cfd51