Commits · a5a790eea6035760c71eae1861c1e5f369bc6d08 · OpenDAS / vllm_cscc

"csrc/quantization/w8a8/int8/scaled_quant.cu" did not exist on "c3fab5f7691c55e9fd0de5ed373f4dd5fb2152cf"

10 Nov, 2025 7 commits
- [Bugfix] Ensure calculated KV scales are applied in attention. (#27232) · a5a790ee
  Adrian Abeyta authored Nov 10, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
  a5a790ee
- [Perf] Move gc.freeze logic from EngineCoreProc to EngineCore for better coverage (#27896) · b30372cb
  Jialin Ouyang authored Nov 10, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  b30372cb
- [Misc] Add more scoping for improved trace (#28329) · bf6a3d0f
  Wei Wei authored Nov 10, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  bf6a3d0f
- [Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905) · 6d54336a
  Rémi Delacourt authored Nov 10, 2025
```
Signed-off-by: Rémi Delacourt <remi@mistral.ai>
Signed-off-by: remi <remi@mistral.ai>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  6d54336a
- [RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like... · f080a835
  vllmellm authored Nov 10, 2025
```
[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like `_custom_ops` and `_ipex_ops` (#24490)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  f080a835
- [Metrics] Refactor LoRA state tracking (#26801) · 6f7de33b
  Mark McLoughlin authored Nov 10, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  6f7de33b
- [V0 deprecation] Remove no longer used `get_metadata_cls` (#28370) · e8697faf
  Lucas Wilkinson authored Nov 10, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  e8697faf
09 Nov, 2025 4 commits
- Fix cu_num_generated_tokens slicing logic in LogprobsLists.slice() method (#28214) · 4a8d6bd1
  usberkeley authored Nov 10, 2025
```
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
```
  4a8d6bd1
- [Core] Separate out attention metadata building logic from prepare inputs (#26764) · 636efd10
  Lucas Wilkinson authored Nov 09, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  636efd10
- [Core] Simplify async KV output aggregation (#28327) · 289eb6c5
  Nick Hill authored Nov 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  289eb6c5
- [Misc] fix typo and add detailed log (#28178) · e5e9067e
  Ning Xie authored Nov 09, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  e5e9067e
08 Nov, 2025 6 commits

[Feat] Drop-in Torch CUDA Profiler (#27841) · 975676d1
Benjamin Chislett authored Nov 08, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
975676d1

[DCP] Support dcp kv_cache interleave size > 1 (#26696) · 2108a571

zhangsicheng5 authored Nov 09, 2025


Signed-off-by: zhangsicheng5 <zhangsicheng5@huawei.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: Qiu <qiuchunshuo@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

2108a571

[Bugfix] Spec decode + structured output + spec model max len edge case (#28298) · 47604137
Andy Lo authored Nov 08, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
47604137
[Attention] Remove max cudagraph size limit of 992 (#27840) · 608bb144
22quinn authored Nov 07, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
608bb144
[bugfix] support eagle with lora cudagraph specialization (#28318) · 70af44fd
gnovack authored Nov 07, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
```
70af44fd

[Bugfix][LoRA][Spec Decode] Support LoRA with speculative decoding (#21068) · d0c77920

Xiaohong (Sean) Chen authored Nov 07, 2025

Signed-off-by: Sean Chen <xiaohong_chen1991@hotmail.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Danielle Robinson <dcmaddix@gmail.com>
Co-authored-by: Haipeng Li <li2haipeng@gmail.com>
Co-authored-by: li2haipeng <44383182+li2haipeng@users.noreply.github.com>

d0c77920

07 Nov, 2025 6 commits
- [PerfFix] Avoid separate thread for MP executor shm spin (take 2) (#28319) · 67a2da89
  Nick Hill authored Nov 07, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  67a2da89
- [Core] Rework handling of async scheduling config (#28250) · da786e33
  Nick Hill authored Nov 07, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  da786e33
- Revert "[PerfFix] Avoid separate thread for MP executor shm spin (#28012)" (#28289) · 68a72a5c
  Nicolò Lucchesi authored Nov 07, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  68a72a5c
- [Core][MM] Add mechanism to configure multimodal fields which should stay on CPU (#28168) · e0919f33
  Lukas Geiger authored Nov 07, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  e0919f33
- [CPU]Avoid repeated random sample compile (#28260) · 7bdb42b2
  Zhang Xiangze authored Nov 07, 2025
```
Signed-off-by: Zhang Xiangze <Xiangze.Zhang@arm.com>
```
  7bdb42b2
- [Perf] Introduce FlattenLogprobs to store logprobs results to reduce GC overhead (#28171) · ccd98b59
  Jialin Ouyang authored Nov 07, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  ccd98b59
06 Nov, 2025 4 commits
- [HARDWARE][CPU] Add Option for Disabling Binding to Specific CPU Cores (#27953) · e52e4da9
  StanHatko authored Nov 06, 2025
```
Signed-off-by: Stan Hatko <stan_hatko@live.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  e52e4da9
- [CPU] Enable torch profiling (#28130) · 3755c145
  Aditya Tewari authored Nov 06, 2025
```
Signed-off-by: Aditya Tewari <aditya.tewari@arm.com>
```
  3755c145
- [Debugging] Add annotation for easier trace analysis (#22496) · 17676585
  Dayeol Lee authored Nov 05, 2025
  
  17676585
- [Core][Hybrid allocator + connector 2/n] Unify `remove_skipped_blocks` by... · efe73e9b
  Kuntai Du authored Nov 05, 2025
```
[Core][Hybrid allocator + connector 2/n] Unify `remove_skipped_blocks` by `get_last_useful_token` (#25431)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  efe73e9b
05 Nov, 2025 10 commits
- [Feature]: Add corrupted request metric to V1 metrics system. (#27306) · e1560178
  Snehlata authored Nov 06, 2025
```
Signed-off-by: atalhens <sneh.lata@nutanix.com>
```
  e1560178
- [FlashInfer] Avoid FlashInfer block_size 16 + head_size 256 on blackwell (#27994) · c765f0b4
  Chen Zhang authored Nov 05, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  c765f0b4
- [Core] add support for reasoning parser plugins (#28075) · 752ddeac
  Walter Beller-Morales authored Nov 05, 2025
```
Signed-off-by: walter beller-morales <walter.beller.morales@gmail.com>
```
  752ddeac
- [Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f5a4b64
- [ROCm][MLA] Support block-size > 1 for AITER MLA backend (#27224) · 6cae1e53
  Pleaplusone authored Nov 05, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
Co-authored-by: wuhuikx <hattie.wu@amd.com>
```
  6cae1e53
- [BugFix] Support EP/DP + EPLB with MTP (#25311) · e50c4546
  Ilya Markov authored Nov 05, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
```
  e50c4546
- [DCP] check return_lse for all layers in dcp (#27929) · 5d16d0fa
  Chen Zhang authored Nov 05, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  5d16d0fa
- [bugfix] fix wrong `dcp_local_seq_lens` calc (#27518) · 16b37f31
  Qiu authored Nov 05, 2025
```
Signed-off-by: Qiu <qiuchunshuo@huawei.com>
```
  16b37f31
- [BugFix] Fix DCP Assert (AssertionError: DCP not support reorder_batch_threshold > 1 now.) (#28100) · d43ad5a7
  Lucas Wilkinson authored Nov 05, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  d43ad5a7
- [XPU] Add gpt-oss model support for Intel GPU (#27786) · 18b39828
  Kunshang Ji authored Nov 05, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  18b39828
04 Nov, 2025 3 commits
- [ROCm][Perf] New design on ROCm AITER MHA backend Implementation (#25763) · dc937175
  Pleaplusone authored Nov 05, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  dc937175
- [AsyncScheduling] Don't schedule past request max_tokens (#27922) · 938a8169
  Nick Hill authored Nov 04, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  938a8169
- [PerfFix] Avoid separate thread for MP executor shm spin (#28012) · c9f66da8
  Nick Hill authored Nov 04, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c9f66da8