Commits · f36292dbee27a5ebe0e7115c061b82f6f5372dcf · OpenDAS / vllm_cscc

15 Nov, 2025 5 commits
- [Misc] Make `SchedulerConfig.max_model_len` init-only (#28733) · 638e4196
  Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  638e4196
- [RL] [V1] Remove unused device argument from reset_kv_cache (#28766) · dd6ac1c2
  Zhuohan Li authored Nov 14, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  dd6ac1c2
- [Redo] #26368 (#28771) · 98b4d389
  Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  98b4d389
- Revert "[Core] Performance: Use list[np.ndarray] instead of list[list… (#28773) · ac86bff8
  Nick Hill authored Nov 14, 2025
  
  ac86bff8
- [Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output... · 186352b2
  Jialin Ouyang authored Nov 14, 2025
```
[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output tokens for GC optimization (#26368)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  186352b2
14 Nov, 2025 12 commits
- [Log] Save profiler results to file instead of stdout (#28144) · ba041d98
  rasmith authored Nov 14, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  ba041d98
- Avoid bytecode hook and simplify TorchCompileWrapperWithCustomDipatch (#25110) · 2e0ad629
  Laith Sakka authored Nov 14, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  2e0ad629
- [Chore] Rename `SchedulerConfig.chunked_prefill_enabled` (#28735) · e2741f6c
  Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e2741f6c
- [DisaggEverything] Tokens in<>out `/generate` endpoint (#24261) · 6f1e7f72
  Nicolò Lucchesi authored Nov 14, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6f1e7f72
- [Bugfix][Nixl] Fix kernel physical<>logical block_size issue (#28677) · 96b23b8e
  Nicolò Lucchesi authored Nov 14, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  96b23b8e
- [BugFix] Fix FA3 IMA with FULL_AND_PIECEWISE and cascade attention (default) (#28702) · db56a599
  Lucas Wilkinson authored Nov 14, 2025
  
  db56a599
- Fix KV sharing fast prefill with cudagraph enabled (#28537) · 9324e102
  Yong Hoon Shin authored Nov 14, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  9324e102
- [DCP] Support Decode Context Parallel (DCP) for GQA with Flashinfer (#25438) · 4516d44b
  Jingchun Gao authored Nov 14, 2025
```
Signed-off-by: gaojc <1055866782@qq.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: gaojingchun (A) <g00955623@china.huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>
```
  4516d44b
- [Metrics] Log number of preempted requests (#28522) · ecf8230d
  lyn610 authored Nov 14, 2025
```
Add tracking and periodic logging for the number of preempted requests in the
metrics logger. This helps monitor system behavior under load.
Signed-off-by: Yining Liu <610lyn@gmail.com>
```
  ecf8230d
- [BugFix] Fix multi-modal async scheduling race condition (#28706) · bc3e4306
  Nick Hill authored Nov 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  bc3e4306
- use default CCL_ZE_IPC_EXCHANGE (#28700) · 529cea34
  Yan Ma authored Nov 14, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  529cea34
- [Misc] Remove `warn_for_unimplemented_methods` (#28613) · 01bea115
  Cyrus Leung authored Nov 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  01bea115
13 Nov, 2025 12 commits
- [CI] Bug: Fix ci entrypoint pooling (#28684) · e64011f2
  Wentao Ye authored Nov 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e64011f2
- [bugfix] correct local_chunk_len for DCP in reorg_kvcache with long context (#28526) · 968060c1
  Qiu authored Nov 14, 2025
```
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  968060c1
- [Perf] Support stream interval for reducing host overhead (#27869) · 5d6ce2b9
  elvischenv authored Nov 14, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  5d6ce2b9
- [Attention][Bugfix] Fix FA sink support (#28660) · f9f3b596
  Matthew Bonanni authored Nov 13, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  f9f3b596
- [Bugfix] Fix validate model input for decoder models (#27099) · 119c4927
  Yannick Schnider authored Nov 13, 2025
```
Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
Signed-off-by: Yannick Schnider <Yannick.Schnider1@ibm.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  119c4927
- [CI Failure] Fix backend selection for encoder-only models (#28534) · 07a606aa
  Huamin Li authored Nov 13, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  07a606aa
- [ROCm][BugFix]Fix `get_cu_count` in rocm_aiter_fa.py (#28618) · 8da2f28f
  Pleaplusone authored Nov 13, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  8da2f28f
- [Bugfix] Prevent crash on empty grammar string (#28210) · 4504e802
  tjandy98 authored Nov 13, 2025
```
Signed-off-by: tjandy98 <3953059+tjandy98@users.noreply.github.com>
```
  4504e802
- [ROCm][BugFix] Remove the usage of `device_info` from aiter (#28383) · ca00b1bf
  Pleaplusone authored Nov 13, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  ca00b1bf
- [n-gen] DO NOT repeatedly return finished child requests (#28591) · a1d3866d
  Jialin Ouyang authored Nov 12, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  a1d3866d
- Rename clashing method names for vLLM model protocol (#27583) · 97d1c993
  Harry Mellor authored Nov 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97d1c993
- [Bugfix] Fix SM100 gpt-oss regression due to faulty attn sink support (#28561) · a543e678
  Michael Goin authored Nov 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a543e678
12 Nov, 2025 9 commits

[Misc]Fix typo in llm_engine.py (#28584) · 478ee511
Wei Wei authored Nov 12, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
478ee511
[BugFix] Priority scheduling and spec tokens preemption (#28558) · 58ce8d12
Andy Lo authored Nov 12, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
58ce8d12

Implement ARC KV cache eviction policy for CPU offloader (#27039) · bac90456

alberto authored Nov 12, 2025


Signed-off-by: Alberto Perdomo <aperdomo@redhat.com>
Signed-off-by: alberto <aperdomo@redhat.com>
Co-authored-by: Or Ozeri <or@ozery.com>

bac90456

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding... · 30441957

Benjamin Chislett authored Nov 12, 2025


[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>

30441957

Remove deprecated fields from `CompilationConfig` (#27593) · a742134c
Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a742134c

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233) · 4ccffe56

Chenguang Zheng authored Nov 12, 2025


Signed-off-by: n00909098 <nguyen.kha.long@huawei.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Signed-off-by: Khuong Le <khuong.le.manh@huawei.com>
Signed-off-by: Khuong Le <lemanhkhuong2611@gmail.com>
Co-authored-by: n00909098 <nguyen.kha.long@huawei.com>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Khuong Le <khuong.le.manh@huawei.com>
Co-authored-by: Khuong Le <lemanhkhuong2611@gmail.com>

4ccffe56

`VLLM_USE_TRITON_FLASH_ATTN` V0 variable deprecation (#27611) · 9f0247cf

Andreas Karatzas authored Nov 11, 2025


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>

9f0247cf

[CPU] Refactor CPU attention backend (#27954) · 7f829be7
Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
7f829be7
[Performance] Cache loaded custom logitsprocs to avoid overheads (#28462) · 3f770f44
Isotr0py authored Nov 12, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
3f770f44

11 Nov, 2025 2 commits

[Feature] Allow configuring FlashInfer workspace size (#28269) · 412e153d

Max Hu authored Nov 11, 2025


Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

412e153d

[Misc] Cleanup Executor interface (#28441) · d4902ba5
wangxiyuan authored Nov 12, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
d4902ba5