Commits · 47b93395463d9d2ddc2c1176d6815fdc8e505afc · OpenDAS / vllm_cscc · GitLab

03 Oct, 2025 5 commits
- [DeepSeek] Improve performance of DS MLA cache kernel (#26132) · 47b93395
  Matthew Bonanni authored Oct 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  47b93395
- [CI/Build] Conditionally register cutlass_fp4_group_mm to fix building on Hopper (#26138) · 5d5146ee
  Michael Goin authored Oct 02, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  5d5146ee
- [Attention] Move Backend enum into registry (#25893) · 2aaa4238
  Matthew Bonanni authored Oct 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2aaa4238
- [Bug][Benchmark] Fix duplicate req in oversampling (#26140) · ad2d7880
  Ekagra Ranjan authored Oct 02, 2025
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  ad2d7880
- [Log] Optimize DeepGEMM Missing Log (#26106) · 36ce76c6
  Wentao Ye authored Oct 02, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  36ce76c6
02 Oct, 2025 20 commits
- [Bugfix] Disable cascade attention with FlashInfer (#26130) · f1fc2107
  Michael Goin authored Oct 02, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  f1fc2107
- Fix MTP with deepep_low_latency (#25904) · 13cdc021
  Matthew Bonanni authored Oct 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  13cdc021
- [Perf] Fix and reapply move apply w8a8 block fp8 linear to class (#25696) · 502640c3
  ElizaWszola authored Oct 02, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: ElizaWszola <elizaw.9289@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
```
  502640c3
- [Mamba][KVCacheManager] Simplify kv cache manage logic for mamba + MTP (#25119) · 3d5f1c86
  Chen Zhang authored Oct 02, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  3d5f1c86
- EAGLE 3: Fix preamble so that measured speedup over Eagle 1 becomes 32%... · 1cab2f9c
  Ekagra Ranjan authored Oct 02, 2025
```
EAGLE 3: Fix preamble so that measured speedup over Eagle 1 becomes 32% instead of 5% on MTBench (#25916)
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  1cab2f9c
- [Deepseek v3.2] Support indexer prefill chunking (#25999) · 1e50f1be
  Chen Zhang authored Oct 02, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  1e50f1be
- [Small] Prevent bypassing media domain restriction via HTTP redirects (#26035) · ad87ba92
  Chenheli Hua authored Oct 02, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  ad87ba92
- [BugFix] Fix FI accuracy issue when used for MLA prefill (#26063) · decf7f79
  Lucas Wilkinson authored Oct 02, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  decf7f79
- [CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm... · d00d6529
  Cyrus Leung authored Oct 03, 2025
```
[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm serve` command (#25967)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d00d6529
- [CI] Add Blackwell DeepSeek FP8 FlashInfer MoE tests (#26040) · 3b279a84
  Michael Goin authored Oct 02, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3b279a84
- [Qwen][ROCm] Flash Attention Rotary Embeddings (#24642) · 5e4a8223
  vllmellm authored Oct 02, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  5e4a8223
- [Platform][CI] Added OOT platform interface e2e test that running on Ascend NPU (#25470) · e51de388
  leo-pony authored Oct 02, 2025
```
Signed-off-by: leo-pony <nengjunma@outlook.com>
```
  e51de388
- [Model] Use `merge_by_field_config` for MM models (D-F) (#26076) · cc253b73
  Cyrus Leung authored Oct 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cc253b73
- [Model] Use `merge_by_field_config` for MM models (A-C) (#26073) · 7d6fb905
  Cyrus Leung authored Oct 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7d6fb905
- [FA/Chore] Bump vllm-flash-attention (#25537) · 418d111f
  Lucas Wilkinson authored Oct 02, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  418d111f
- Change size of single CUDA graph for CI to 4 (#26089) · be8921fb
  Thomas Parnell authored Oct 02, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  be8921fb
- Update base image to 22.04 (jammy) (#26065) · d4e7a115
  Huy Do authored Oct 02, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  d4e7a115
- Run:ai model streamer add GCS package support (#24909) · be22bb6f
  pwschuurman authored Oct 01, 2025
```
Signed-off-by: Peter Schuurman <psch@google.com>
```
  be22bb6f
- [Misc] Make handling of SamplingParams clearer in n>1 case (#26032) · 169313b9
  Nick Hill authored Oct 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  169313b9
- [ROCm][Bugfix] Add missing parameter to ROCm backend (#26029) · 0b018d8b
  Gregory Shtrasberg authored Oct 01, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  0b018d8b
01 Oct, 2025 15 commits
- Support RL online quantization with torchao (#23014) · c3124680
  Jerry Zhang authored Oct 01, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  c3124680
- [BugFix] ChunkedLocalAttention is currently not CG compatible (#26034) · 4134312b
  Lucas Wilkinson authored Oct 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  4134312b
- [Bug] Fix Negative Cuda Memory Usage (#25683) · da554f93
  Wentao Ye authored Oct 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  da554f93
- [ROCm][Build] Add support for AMD Ryzen AI MAX / AI 300 Series (#25908) · aac622e0
  Hosang authored Oct 01, 2025
```
Signed-off-by: Hosang Yoon <hosang.yoon@amd.com>
```
  aac622e0
- [BugFix][DP/EP] Fix CUTLASS MLA hang under load (#26026) · 1726e93e
  Lucas Wilkinson authored Oct 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
```
  1726e93e
- [CI] Tweaks to GPT-OSS Eval (Blackwell) for stability (#26030) · ee04c0cd
  Michael Goin authored Oct 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  ee04c0cd
- Fix test_mamba_ssm_ssd.py due to missing _query_start_loc_to_chunk_indices_offsets (#25995) · c36f0aa3
  Huamin Li authored Oct 01, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  c36f0aa3
- [NVIDIA] Blackwell Family (#24673) · 5234dc74
  Johnny authored Oct 01, 2025
```
Signed-off-by: Johnny <johnnynuca14@gmail.com>
Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: Johnny <johnnync13@gmail.com>
Signed-off-by: Salvatore Cena <cena@cenas.it>
Co-authored-by: Aidyn-A <31858918+Aidyn-A@users.noreply.github.com>
Co-authored-by: Salvatore Cena <cena@cenas.it>
```
  5234dc74
- [Bugfix] Apply same sampling parameters for both `n=1` and `n>1` (#26005) · 3b7c20a6
  Kenichi Maehashi authored Oct 01, 2025
```
Signed-off-by: Kenichi Maehashi <maehashi@preferred.jp>
```
  3b7c20a6
- [Benchmark] Finish documented v0.11.0 deprecation of --endpoint-type (#26007) · f9e71481
  Nathan Scott authored Oct 01, 2025
```
Signed-off-by: Nathan Scott <nathans@redhat.com>
```
  f9e71481
- [MISC] Fix misleading batch_size_capture_list when cuda_graph_sizes < 4 (#25829) · 2518230d
  billishyahao authored Oct 01, 2025
```
Signed-off-by: billishyahao <bill.he@amd.com>
Co-authored-by: Luka Govedic <ProExpertProg@users.noreply.github.com>
```
  2518230d
- [CI] Only capture a single CUDA graph size in CI by default (#25951) · a332b845
  Harry Mellor authored Oct 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a332b845
- [Misc] Factor out common `_apply_feature_select_strategy` (#26003) · 1405f0c7
  Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1405f0c7
- [BugFix][MM] Fix Nonetype error when video is cache in qwen2.5-omni-thinker (#26004) · 84d57342
  Wenlong Wang authored Oct 01, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  84d57342
- [Doc] updating torch.compile doc link (#25989) · 57b46d76
  nadathurv authored Oct 01, 2025
```
Signed-off-by: nadathurv <work.vnadathur@gmail.com>
Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Co-authored-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
```
  57b46d76