Commits · cd9890544b9773882a274f944f82c0414df9c991 · OpenDAS / vllm_cscc · GitLab

08 Oct, 2025 5 commits
- fix(v1/kv_cache): resolve async KV transfer bug in cascade attention (#23485) · cd989054
  Ayush Satyam authored Oct 08, 2025
```
Signed-off-by: Ayush Satyam <ayushsatyam146@gmail.com>
```
  cd989054
- [Core] Simplify setting new_token_ids in CachedRequestData (#26388) · 067da2d1
  Nick Hill authored Oct 07, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  067da2d1
- Add SwigluOAI implementation for CPUFusedMOE (#26347) · 046118b9
  isharif168 authored Oct 08, 2025
```
Signed-off-by: Sharif Inamdar <sharif.inamdar@arm.com>
```
  046118b9
- [torchao] safetensors integration (#25969) · b32260ab
  liangel-02 authored Oct 07, 2025
```
Signed-off-by: Angel Li <liangel@meta.com>
```
  b32260ab
- [Misc] Clean up cruft from previous FlashMLA sparse implementation (#26125) · f80e7866
  Lucas Wilkinson authored Oct 07, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  f80e7866
07 Oct, 2025 33 commits
- Revert #24446 and #26168 (#26332) · 31a4b3e6
  Thomas Parnell authored Oct 08, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  31a4b3e6
- [Bugfix] Fix MTP+FlashInfer crash when trtllm kernels are available but disabled (#26361) · caf8b1c0
  Benjamin Chislett authored Oct 07, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  caf8b1c0
- Add more libraries to rlhf.md (#26374) · 1b86bd8e
  Michael Goin authored Oct 07, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  1b86bd8e
- [TPU] update TPU benchmark threshold (#25713) · 59012df9
  Johnny Yang authored Oct 07, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  59012df9
- [Spec Decode] Enable efficient speculative decoding with FlashInfer-MLA (#25984) · 3d1f6761
  Benjamin Chislett authored Oct 07, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  3d1f6761
- [V1] Logit processors for rejection sampler (#19482) · 6ebaf43e
  Sergei Skvortsov authored Oct 07, 2025
```
Signed-off-by: southfreebird <yvorott@gmail.com>
Signed-off-by: Sergei Skvortsov <sergeyskv@nebius.com>
Signed-off-by: Sergei Skvortsov <yvorott@gmail.com>
Co-authored-by: Sergei Skvortsov <sergeyskv@nebius.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  6ebaf43e
- [Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in... · 0c824fc4
  Morrison Turnansky authored Oct 07, 2025
```
[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops (#26113)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
```
  0c824fc4
- [Bugfix] Add missing sink tensor into flash attn cascade attn implementation (#26325) · eb577e46
  Pei-Lun Liao authored Oct 07, 2025
  
  eb577e46
- [Bug] Fix Shape Validation for Fallback while Enabling E8M0 for DeepGEMM (#26322) · 8f36850f
  Wentao Ye authored Oct 07, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  8f36850f
- [deepseek] add EP8 FusedMOE config for H200 and B200 (#26331) · 29fd2662
  Chen Zhang authored Oct 08, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  29fd2662
- [CI] Add Qwen3 MoE NVFP4 to Blackwell lm-eval (#26316) · 30a3e5af
  Michael Goin authored Oct 07, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  30a3e5af
- [ci] Rename `test_mxfp4_moe.py` to `test_ocp_mx_moe.py` (#26364) · a38c1bfe
  fxmarty-amd authored Oct 07, 2025
```
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
```
  a38c1bfe
- [Model] Lfm2Moe (#26344) · 320feae6
  Paul Pak authored Oct 08, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
  320feae6
- [V0 Deprecation] Remove `VLLM_USE_V1` from tests (#26341) · 1e4ecca1
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1e4ecca1
- [Misc] Move `LRUCache` into its own file (#26342) · c0a7b89d
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c0a7b89d
- [Model] Add support for ModernBertForTokenClassification (#26340) · 6f59beaf
  antrec authored Oct 07, 2025
```
Signed-off-by: Antoine Recanati Le Goat <antoine.recanati@sancare.fr>
Signed-off-by: antrec <antoine.recanati@gmail.com>
Co-authored-by: Antoine Recanati Le Goat <antoine.recanati@sancare.fr>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  6f59beaf
- [Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166) · 41f1cf38
  fxmarty-amd authored Oct 07, 2025
  
  41f1cf38
- [Model] Use `merge_by_field_config` for MM models (Ovis family) (#26308) · 08d26a1b
  Isotr0py authored Oct 07, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  08d26a1b
- [Docs] add docs for cuda graph v1 (#24374) · 63773a62
  fhl2000 authored Oct 07, 2025
```
Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  63773a62
- Add TRL example notebook to RLHF docs (#26346) · 883b4289
  Sergio Paniego Blanco authored Oct 07, 2025
```
Signed-off-by: sergiopaniego <sergiopaniegoblanco@gmail.com>
```
  883b4289
- Add topk logits torch op for DS3.2. (#25945) · e1098ced
  Daniel Cámpora authored Oct 07, 2025
```
Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Signed-off-by: Daniel Cámpora <961215+dcampora@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  e1098ced
- Optimize KV cache distribution for asymmetric pipeline parallelism (#25164) · d100d78e
  Grant Holmes (Ren) authored Oct 07, 2025
```
Signed-off-by: gholmes829 <g.holmes429@gmail.com>
```
  d100d78e
- [V0 Deprecation] Remove `VLLM_USE_V1` from docs and scripts (#26336) · 7e4cd070
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7e4cd070
- [BugFix] Update KV block hash type from BlockHash to ExternalBlockHash in... · 46b07799
  Snehlata authored Oct 07, 2025
```
[BugFix] Update KV block hash type from BlockHash to ExternalBlockHash in kv_events_subscriber - #26264 (#26265)
Signed-off-by: atalhens <sneh.lata@nutanix.com>
```
  46b07799
- [Model] Define merge_by_field_config MM interface (R-T) (#26260) · de342585
  Ayush Satyam authored Oct 07, 2025
```
Signed-off-by: Ayush Satyam <ayushsatyam146@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  de342585
- [responsesAPI][bugfix] serialize harmony messages (#26185) · 185d8ed4
  Andrew Xia authored Oct 07, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  185d8ed4
- [Deprecation] Deprecate `LLM.set_tokenizer` (#26333) · d9836d45
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d9836d45
- [Model] Define merge_by_field_config MM interface (U-Z) (#26261) · 5f7e8a91
  Ayush Satyam authored Oct 07, 2025
```
Signed-off-by: Ayush Satyam <ayushsatyam146@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5f7e8a91
- [BUG] Fix file parsing for load_format runai_streamer_sharded (#26324) · 4dbdf4a2
  ahao-anyscale authored Oct 06, 2025
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  4dbdf4a2
- [UX] Support nested dicts in hf_overrides (#25727) · c6873c4e
  Michael Goin authored Oct 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c6873c4e
- [Core] Simplify the Dp padding/should ubatch coordination logic (#25768) · 2111b464
  Sage Moore authored Oct 06, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  2111b464
- [Docs][DBO] Add initial doc that describes the DBO implementation (#26024) · c50901f3
  Sage Moore authored Oct 06, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  c50901f3
- [Misc] Define EP kernel arch list in Dockerfile (#25635) · 8229280a
  Simon Mo authored Oct 06, 2025
```
Signed-off-by: Simon Mo <simon.mo@hey.com>
```
  8229280a
06 Oct, 2025 2 commits
- [Perf] Add decode full-graph support to FlashInfer-MLA backend (#26313) · f77df946
  Benjamin Chislett authored Oct 06, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  f77df946
- [ROCm] Split AITER unified attention into its own backend (#25507) · f231e5bc
  Gregory Shtrasberg authored Oct 06, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  f231e5bc