Commits · eef921f45e7d3efb2ed2ccab80ee20ee2e4ebe38 · OpenDAS / vllm_cscc

10 Oct, 2025 6 commits
- [BugFix] Fix async scheduling + request preemption (#26385) · 949cb017
  Nick Hill authored Oct 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  949cb017
- [Bugfix] Make DP padding optional in coordinate_batch_across_dp (#26375) · ae9d0e7d
  Sage Moore authored Oct 10, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  ae9d0e7d
- [Metrics] Log multi-modal cache stats and fix reset (#26285) · ad430a67
  Cyrus Leung authored Oct 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad430a67
- [deepseek] kernel block size for UniformTypeKVCacheSpecs (#26559) · 6f0f570c
  Chen Zhang authored Oct 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  6f0f570c
- [Spec-Decode] Support piecewise cudagraphs for Eagle head (#25109) · 29255cfc
  Lucas Wilkinson authored Oct 10, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  29255cfc
- [Core] Small simplification in `GPUModelRunner._update_states()` (#26508) · aafb99a4
  Nick Hill authored Oct 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  aafb99a4
09 Oct, 2025 5 commits
- [Core] Remove unused `prev_sampled_token_ids_invalid_indices` input batch field (#26514) · 2e54db4d
  Nick Hill authored Oct 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2e54db4d
- [Attention][DCP] Support DCP with query length > 1 (MTP) with FA3 (#25049) · 3b736e1c
  Ming Yang authored Oct 09, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3b736e1c
- [Misc] Misc code simplifications (#26450) · ddcbc2f3
  Nick Hill authored Oct 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ddcbc2f3
- [Hybrid]: Decouple Kernel Block Size from KV Page Size (#24486) · d24cf322
  Zhiyuan Li authored Oct 09, 2025
```
Signed-off-by: lizhiyuan <uniartisan2017@gmail.com>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  d24cf322
- Separate MLAAttention class from Attention (#25103) · e614ab78
  Naveenraj Kamalakannan authored Oct 08, 2025
```
Signed-off-by: Naveenraj Kamalakannan <therealnaveenkamal@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  e614ab78
07 Oct, 2025 3 commits

Revert #24446 and #26168 (#26332) · 31a4b3e6
Thomas Parnell authored Oct 08, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
31a4b3e6

[V1] Logit processors for rejection sampler (#19482) · 6ebaf43e

Sergei Skvortsov authored Oct 07, 2025


Signed-off-by: southfreebird <yvorott@gmail.com>
Signed-off-by: Sergei Skvortsov <sergeyskv@nebius.com>
Signed-off-by: Sergei Skvortsov <yvorott@gmail.com>
Co-authored-by: Sergei Skvortsov <sergeyskv@nebius.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

6ebaf43e

[Core] Simplify the Dp padding/should ubatch coordination logic (#25768) · 2111b464

Sage Moore authored Oct 06, 2025


Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

2111b464

06 Oct, 2025 3 commits
- [BugFix] Pad input buffers in _dummy_run (#26209) · f23b4c04
  Varun Sundar Rabindranath authored Oct 06, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  f23b4c04
- Support llama3 eagle3 head with llama4 verifier (#25961) · 05f6846e
  Rahul Tuli authored Oct 06, 2025
```
Signed-off-by: rahul-tuli <rtuli@redhat.com>
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  05f6846e
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
05 Oct, 2025 2 commits
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit

[V1] [Hybrid] Mamba2 Automatic Prefix Caching (#25752) · ea507c3a

Stan Wozniak authored Oct 04, 2025


Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>

ea507c3a

03 Oct, 2025 2 commits
- [Bugfix] Re-enable prefill of max model length (#24446) · 8ee846c2
  Yannick Schnider authored Oct 03, 2025
```
Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
```
  8ee846c2
- [Bug]: Limit num_reqs in dummy_run when max_num_seqs is small (#26144) · 6a7796e8
  Benjamin Chislett authored Oct 03, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  6a7796e8
01 Oct, 2025 1 commit
- [Bug] Fix Negative Cuda Memory Usage (#25683) · da554f93
  Wentao Ye authored Oct 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  da554f93
30 Sep, 2025 4 commits

[V1] [P/D] Add Support for KV Load Failure Recovery (#19330) · 9a9f48df
David Ben-David authored Oct 01, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
9a9f48df
[perf] Use CPU tensor to reduce GPU->CPU sync (#25884) · e184c9c5
Lehua Ding authored Sep 30, 2025
```
Signed-off-by: Lehua Ding <lehuading@tencent.com>
```
e184c9c5

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

[BugFix] Fix DP/EP hang (#25906) · 23194d83
Lucas Wilkinson authored Sep 30, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
23194d83

29 Sep, 2025 2 commits
- [BugFix][torch.compile] KV scale calculation issues with FP8 quantization (#25513) · c42ff4f4
  Adrian Abeyta authored Sep 29, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
  c42ff4f4
- [Nixl][P/D] Add cuda2cpu support (HD->DH transfer) (#24690) · d0d138bc
  Chenxi Yang authored Sep 29, 2025
```
Signed-off-by: Chenxi Yang <cxyang@fb.com>
Co-authored-by: Chenxi Yang <cxyang@fb.com>
```
  d0d138bc
28 Sep, 2025 1 commit
- [MM] Optimize memory profiling for scattered multimodal embeddings (#25810) · 69311446
  Roger Wang authored Sep 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  69311446
27 Sep, 2025 3 commits

[Core] Refactor self.model() to call a helper for subclassing. (#25084) · b65e56ba
Patrick C. Toulme authored Sep 27, 2025
```
Signed-off-by: Patrick Toulme <ptoulme@meta.com>
Signed-off-by: Patrick Toulme <pctoulme+1@gmail.com>
```
b65e56ba

[Bugfix] Merge MM embeddings by index instead of token IDs (#16229) · 27d7638b

Cyrus Leung authored Sep 27, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

27d7638b

[Multimodal][Speculative Decoding]Eagle Eagle3 mm support, enablement on qwen2.5vl (#22872) · f1d53d15

WeiQing Chen authored Sep 27, 2025


Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>

f1d53d15

26 Sep, 2025 7 commits
- Kernel-override Determinism [1/n] (#25603) · dc48ba0c
  Bram Wasti authored Sep 26, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  dc48ba0c
- Reduce the Cuda Graph memory footprint when running with DBO (#25779) · 4778b426
  Sage Moore authored Sep 26, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  4778b426
- [V1] address post issues related to #20059 (part 1) (#23046) · f075693d
  fhl2000 authored Sep 27, 2025
```
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  f075693d
- [BugFix] Fix using `dbo_decode_token_threshold` always (and ignoring... · 984d1849
  Lucas Wilkinson authored Sep 26, 2025
```
[BugFix] Fix using `dbo_decode_token_threshold` always (and ignoring `dbo_prefill_token_threshold`) (#25622)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  984d1849
- [Qwen3-Next][GDN] fixes cuda graph capturing bug in GDN metadata and a stride... · 99b3a504
  Tao He authored Sep 26, 2025
```
[Qwen3-Next][GDN] fixes cuda graph capturing bug in GDN metadata and a stride bug in causal_conv_1d. (#25743)
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  99b3a504
- perf: Avoid copying inputs_embeds tensors to GPU unless prompt_embeds is enabled (#25739) · d48f4d6d
  Andrew Sansom authored Sep 26, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  d48f4d6d
- EVS Support (Video tokens pruning) (#22980) · 392edee3
  Eugene Khvedchenya authored Sep 26, 2025
```
Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Eugene Khvedchenya <ekhvedchenya@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  392edee3