Commits · a1d3866dda6539a0e9e2cfc49e9cb1e887baaaec · OpenDAS / vllm_cscc

13 Nov, 2025 3 commits
- [n-gen] DO NOT repeatedly return finished child requests (#28591) · a1d3866d
  Jialin Ouyang authored Nov 12, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  a1d3866d
- Rename clashing method names for vLLM model protocol (#27583) · 97d1c993
  Harry Mellor authored Nov 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97d1c993
- [Bugfix] Fix SM100 gpt-oss regression due to faulty attn sink support (#28561) · a543e678
  Michael Goin authored Nov 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a543e678
12 Nov, 2025 9 commits

[Misc]Fix typo in llm_engine.py (#28584) · 478ee511
Wei Wei authored Nov 12, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
478ee511
[BugFix] Priority scheduling and spec tokens preemption (#28558) · 58ce8d12
Andy Lo authored Nov 12, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
58ce8d12

Implement ARC KV cache eviction policy for CPU offloader (#27039) · bac90456

alberto authored Nov 12, 2025


Signed-off-by: Alberto Perdomo <aperdomo@redhat.com>
Signed-off-by: alberto <aperdomo@redhat.com>
Co-authored-by: Or Ozeri <or@ozery.com>

bac90456

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding... · 30441957

Benjamin Chislett authored Nov 12, 2025


[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>

30441957

Remove deprecated fields from `CompilationConfig` (#27593) · a742134c
Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a742134c

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233) · 4ccffe56

Chenguang Zheng authored Nov 12, 2025


Signed-off-by: n00909098 <nguyen.kha.long@huawei.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Signed-off-by: Khuong Le <khuong.le.manh@huawei.com>
Signed-off-by: Khuong Le <lemanhkhuong2611@gmail.com>
Co-authored-by: n00909098 <nguyen.kha.long@huawei.com>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Khuong Le <khuong.le.manh@huawei.com>
Co-authored-by: Khuong Le <lemanhkhuong2611@gmail.com>

4ccffe56

`VLLM_USE_TRITON_FLASH_ATTN` V0 variable deprecation (#27611) · 9f0247cf

Andreas Karatzas authored Nov 11, 2025


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>

9f0247cf

[CPU] Refactor CPU attention backend (#27954) · 7f829be7
Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
7f829be7
[Performance] Cache loaded custom logitsprocs to avoid overheads (#28462) · 3f770f44
Isotr0py authored Nov 12, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
3f770f44

11 Nov, 2025 6 commits
- [Feature] Allow configuring FlashInfer workspace size (#28269) · 412e153d
  Max Hu authored Nov 11, 2025
```
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  412e153d
- [Misc] Cleanup Executor interface (#28441) · d4902ba5
  wangxiyuan authored Nov 12, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  d4902ba5
- [Misc] fix typo in DCP comment (#28389) · 8c32c6e4
  Jie Luo authored Nov 12, 2025
```
Signed-off-by: Livinfly <luojie3m@gmail.com>
```
  8c32c6e4
- [Perf] Use np.ndarray instead of list[list[int]] to reduce GC overhead (#28245) · 4228be79
  Jialin Ouyang authored Nov 11, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  4228be79
- [Model] Pass `mm_features` directly into `get_mrope_input_positions` (#28399) · afffd3cc
  Cyrus Leung authored Nov 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  afffd3cc
- [Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03
  Matthew Bonanni authored Nov 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  b30dfa03
10 Nov, 2025 7 commits
- [Bugfix] Ensure calculated KV scales are applied in attention. (#27232) · a5a790ee
  Adrian Abeyta authored Nov 10, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
  a5a790ee
- [Perf] Move gc.freeze logic from EngineCoreProc to EngineCore for better coverage (#27896) · b30372cb
  Jialin Ouyang authored Nov 10, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  b30372cb
- [Misc] Add more scoping for improved trace (#28329) · bf6a3d0f
  Wei Wei authored Nov 10, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  bf6a3d0f
- [Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905) · 6d54336a
  Rémi Delacourt authored Nov 10, 2025
```
Signed-off-by: Rémi Delacourt <remi@mistral.ai>
Signed-off-by: remi <remi@mistral.ai>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  6d54336a
- [RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like... · f080a835
  vllmellm authored Nov 10, 2025
```
[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like `_custom_ops` and `_ipex_ops` (#24490)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  f080a835
- [Metrics] Refactor LoRA state tracking (#26801) · 6f7de33b
  Mark McLoughlin authored Nov 10, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  6f7de33b
- [V0 deprecation] Remove no longer used `get_metadata_cls` (#28370) · e8697faf
  Lucas Wilkinson authored Nov 10, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  e8697faf
09 Nov, 2025 4 commits
- Fix cu_num_generated_tokens slicing logic in LogprobsLists.slice() method (#28214) · 4a8d6bd1
  usberkeley authored Nov 10, 2025
```
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
```
  4a8d6bd1
- [Core] Separate out attention metadata building logic from prepare inputs (#26764) · 636efd10
  Lucas Wilkinson authored Nov 09, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  636efd10
- [Core] Simplify async KV output aggregation (#28327) · 289eb6c5
  Nick Hill authored Nov 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  289eb6c5
- [Misc] fix typo and add detailed log (#28178) · e5e9067e
  Ning Xie authored Nov 09, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  e5e9067e
08 Nov, 2025 6 commits

[Feat] Drop-in Torch CUDA Profiler (#27841) · 975676d1
Benjamin Chislett authored Nov 08, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
975676d1

[DCP] Support dcp kv_cache interleave size > 1 (#26696) · 2108a571

zhangsicheng5 authored Nov 09, 2025


Signed-off-by: zhangsicheng5 <zhangsicheng5@huawei.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: Qiu <qiuchunshuo@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>