Commits · 76e4dcf225e4de115bdc20b00a78d49bec767c09 · OpenDAS / vllm_cscc

11 Nov, 2025 2 commits
- [NIXL] Generalize block-first backend layouts (FlashInfer-like) (#28282) · a7ef3eb0
  Nicolò Lucchesi authored Nov 11, 2025
  
  a7ef3eb0
- [Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03
  Matthew Bonanni authored Nov 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  b30dfa03
10 Nov, 2025 2 commits
- [Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905) · 6d54336a
  Rémi Delacourt authored Nov 10, 2025
```
Signed-off-by: Rémi Delacourt <remi@mistral.ai>
Signed-off-by: remi <remi@mistral.ai>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  6d54336a
- [Metrics] Refactor LoRA state tracking (#26801) · 6f7de33b
  Mark McLoughlin authored Nov 10, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  6f7de33b
09 Nov, 2025 3 commits
- Fix cu_num_generated_tokens slicing logic in LogprobsLists.slice() method (#28214) · 4a8d6bd1
  usberkeley authored Nov 10, 2025
```
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
```
  4a8d6bd1
- [Core] Simplify async KV output aggregation (#28327) · 289eb6c5
  Nick Hill authored Nov 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  289eb6c5
- [CI] Fix flaky `test_eagle_correctness` test (#28364) · 19d91ece
  Nicolò Lucchesi authored Nov 09, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  19d91ece
08 Nov, 2025 4 commits

[DCP] Support dcp kv_cache interleave size > 1 (#26696) · 2108a571

zhangsicheng5 authored Nov 09, 2025


Signed-off-by: zhangsicheng5 <zhangsicheng5@huawei.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: Qiu <qiuchunshuo@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

2108a571

[Bugfix] Spec decode + structured output + spec model max len edge case (#28298) · 47604137
Andy Lo authored Nov 08, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
47604137
`reasoning_content` -> `reasoning` (#27752) · d9ab1ad9
Harry Mellor authored Nov 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
d9ab1ad9

[Bugfix][LoRA][Spec Decode] Support LoRA with speculative decoding (#21068) · d0c77920

Xiaohong (Sean) Chen authored Nov 07, 2025

Signed-off-by: Sean Chen <xiaohong_chen1991@hotmail.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Danielle Robinson <dcmaddix@gmail.com>
Co-authored-by: Haipeng Li <li2haipeng@gmail.com>
Co-authored-by: li2haipeng <44383182+li2haipeng@users.noreply.github.com>

d0c77920

07 Nov, 2025 3 commits
- [PerfFix] Avoid separate thread for MP executor shm spin (take 2) (#28319) · 67a2da89
  Nick Hill authored Nov 07, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  67a2da89
- [Core] Rework handling of async scheduling config (#28250) · da786e33
  Nick Hill authored Nov 07, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  da786e33
- Revert "[PerfFix] Avoid separate thread for MP executor shm spin (#28012)" (#28289) · 68a72a5c
  Nicolò Lucchesi authored Nov 07, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  68a72a5c
06 Nov, 2025 3 commits
- [Test] Add non-MoE DP test coverage (#28235) · ca90f503
  Matthew Bonanni authored Nov 06, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  ca90f503
- [Frontend] OpenAI Responses API supports Tool/Function calling - non-harmony (#26874) · 59a50afa
  Chauncey authored Nov 06, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  59a50afa
- [V0 deprecation]clean up is_v1_supported_oracle (#28116) · c3ee80a0
  wangxiyuan authored Nov 06, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  c3ee80a0
05 Nov, 2025 7 commits
- [CI/Build] Fix `test_defaults_with_usage_context` in AMD CI (#27926) · 0b8e871e
  Zhewen Li authored Nov 05, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  0b8e871e
- [Feature]: Add corrupted request metric to V1 metrics system. (#27306) · e1560178
  Snehlata authored Nov 06, 2025
```
Signed-off-by: atalhens <sneh.lata@nutanix.com>
```
  e1560178
- [Feature] Extend batch invariant torch.compile to B200 (#27856) · faedbb4d
  Paul Zhang authored Nov 05, 2025
```
Signed-off-by: PaulZhang12 <paulzhan@fb.com>
```
  faedbb4d
- [CI]: Add LMCacheConnector Unit Tests (#27852) · 40db1944
  Samuel Shen authored Nov 05, 2025
```
Signed-off-by: Samuel Shen <slshen@uchciago.edu>
Co-authored-by: Samuel Shen <slshen@uchciago.edu>
Co-authored-by: Yihua Cheng <yihua98@uchicago.edu>
```
  40db1944
- [Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f5a4b64
- [Hybrid allocator + kv connector] revert connector test changes related to... · 86dca07d
  Kuntai Du authored Nov 05, 2025
```
[Hybrid allocator + kv connector] revert connector test changes related to hybrid allocator (#28011)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  86dca07d
- [V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955) · 428bc7bf
  wangxiyuan authored Nov 05, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  428bc7bf
04 Nov, 2025 3 commits
- [AsyncScheduling] Don't schedule past request max_tokens (#27922) · 938a8169
  Nick Hill authored Nov 04, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  938a8169
- [PerfFix] Avoid separate thread for MP executor shm spin (#28012) · c9f66da8
  Nick Hill authored Nov 04, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c9f66da8
- [KV Connector] Make KVCacheConfig an explicit constructor argument (#27887) · 58279c60
  Mark McLoughlin authored Nov 04, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  58279c60
03 Nov, 2025 5 commits
- Add TP parameter to attention tests (#27683) · 01baefe6
  Matthew Bonanni authored Nov 03, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  01baefe6
- [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) · 2c19d967
  Aurick Qiao authored Nov 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  2c19d967
- [CI/Testing] Add basic single node dual batch overlap test (#27235) · 4bc400f4
  Lucas Wilkinson authored Nov 04, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  4bc400f4
- [Bugfix] Padded Eagle Specdec with Chunked Prefill (#26263) · cec7c288
  Rémi Delacourt authored Nov 03, 2025
```
Signed-off-by: Rémi Delacourt <remi@mistral.ai>
Signed-off-by: Rémi Delacourt <54138269+Flechman@users.noreply.github.com>
Signed-off-by: remi <remi@mistral.ai>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
```
  cec7c288
- [BugFix][LoRA] use adapter_id instead of id field of lora_request (#27728) · 1bf43ae3
  Biswa Panda authored Nov 02, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  1bf43ae3
01 Nov, 2025 2 commits

[Add] cmdline argument parsing for KV cache offloading modules (#27621) · e6751188

Yihua Cheng authored Nov 01, 2025

Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e6751188

[Core] Async scheduling + structured outputs compatibility (#26866) · 0cdbe7b7
Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
0cdbe7b7

31 Oct, 2025 3 commits
- [Hybrid] A simpler algorithm to find kernel_block_size (#26476) · df334868
  Chen Zhang authored Oct 31, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  df334868
- Add FLASHINFER_MLA to test_mla_backends and add B200 CI run (#27663) · f29aeb5a
  Matthew Bonanni authored Oct 31, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  f29aeb5a
- [Bugfix] Missing NIXL metadata for handshake initialization if instance spans multi-node (#26338) · d6517be3
  GuanLuo authored Nov 01, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  d6517be3
30 Oct, 2025 3 commits
- [KV offload] Enable CPU KV offload on CUDA alike Platforms (#27770) · 0fe01404
  Zhewen Li authored Oct 30, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  0fe01404
- [BugFix] Reordering extend logic fix (#27739) · b5d70751
  Lucas Wilkinson authored Oct 30, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  b5d70751
- [BugFix] Handle unscheduled requests properly when async scheduling (#27756) · 2ce5c5d3
  Nick Hill authored Oct 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2ce5c5d3