Commits · 6042e66cd5304fc043d96aaa0c22d56f939af320 · OpenDAS / vllm_cscc

26 Feb, 2026 4 commits

[ROCm] Add extra step in config initialization to populate custom ops before... · 6042e66c

Gregory Shtrasberg authored Feb 26, 2026


[ROCm] Add extra step in config initialization to populate custom ops before compilation config init (#34848)
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>

6042e66c

[torch.compile] Sequence Parallelism threshold compile ranges (#28672) · 9d379410

Jason Li authored Feb 25, 2026


Signed-off-by: jasonlizhengjian <jasonlizhengjian@gmail.com>
Signed-off-by: Jason Li <jasonlizhengjian@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

9d379410

[UX] Add `--performance-mode {balanced,interactivity,throughput}` (#34936) · cbf8f702
Michael Goin authored Feb 25, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
cbf8f702

[offloader] v2: Hide weight onloading latency via prefetching (#29941) · 6831650c

Ming Yang authored Feb 25, 2026


Signed-off-by: Ming Yang <minos.future@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

6831650c

25 Feb, 2026 1 commit
- [ROCm]: Enable customop and rope+kvcache fusion for AITER RoPE (#35180) · f38f8c97
  Rohan Potdar authored Feb 24, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  f38f8c97
24 Feb, 2026 2 commits

[Model][Spec Decode] Nemotron-H MTP and Mamba Speculative Decoding Support (#33726) · f5972a87

Benjamin Chislett authored Feb 24, 2026


Signed-off-by: Shahar Mor <smor@nvidia.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: Roi Koren <roik@nvidia.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>

f5972a87

[ROCm] AITER fused RoPE+KVCache (#33443) · 2ff4e511

Rohan Potdar authored Feb 23, 2026


Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: charlifu <charlifu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>

2ff4e511

22 Feb, 2026 1 commit
- [Bug] Refactor max_num_batched_tokens to account for drafting (#34898) · 682566b1
  Benjamin Chislett authored Feb 22, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  682566b1
20 Feb, 2026 1 commit
- [CI] Revert PRs 34818 and 33600 (#34979) · aaefc58e
  Lucas Wilkinson authored Feb 20, 2026
  
  aaefc58e
19 Feb, 2026 1 commit

[Bugfix] Fix Basic Models Test (#34818) · 662205d3

Matthew Bonanni authored Feb 19, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

662205d3

18 Feb, 2026 1 commit
- [torch.compile] Turn on silu+fp4 quant fusion by default for O1+ (#34718) · 02e8f26c
  Luka Govedič authored Feb 17, 2026
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
```
  02e8f26c
15 Feb, 2026 1 commit

[torch.compile] Disable ar-rms fusion for ds3-fp4 & DP, fix CI test (#34392) · 23d825ab

Luka Govedič authored Feb 15, 2026

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

23d825ab

14 Feb, 2026 1 commit
- [Hybrid] Enable mamba prefix cache "align" mode with async scheduling (#33997) · d5fe3f70
  Thomas Parnell authored Feb 14, 2026
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  d5fe3f70
13 Feb, 2026 2 commits
- [Misc] vLLM's --enforce-eager should turn off compile and cudagraphs only (#34523) · 87789c83
  Richard Zou authored Feb 13, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  87789c83
- [BugFix] Add block_size validation for mamba cache align mode (#34445) · 6f019e6e
  Harry Huang authored Feb 13, 2026
```
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
```
  6f019e6e
11 Feb, 2026 2 commits

[Docs] Fix typo ("defult") and double spacing (#34348) · 48134a2c

SorenDreano authored Feb 11, 2026

Signed-off-by: SorenDreano <71752785+SorenDreano@users.noreply.github.com>
Co-authored-by: Soren Dreano <soren@numind.ai>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

48134a2c

[torch.compile] Enable AR+rms fusion by default available for `-O2` (#34299) · addac0e6
Luka Govedič authored Feb 11, 2026
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
```
addac0e6

08 Feb, 2026 1 commit
- [torch.compile] Add an option to force-enable the MOE cold start optimization (#33735) · 4df841fe
  Richard Zou authored Feb 08, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  4df841fe
07 Feb, 2026 2 commits

[Kernel] Add KernelConfig flag to enable/disable FlashInfer autotune (#34006) · dd6a6e11

Mohammad Miadh Angkad authored Feb 07, 2026

Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

dd6a6e11

[CI][AMD]Bugfix] Check that model_config is not None in enable_norm_pad_fusion (#34007) · ec28784f
rasmith authored Feb 06, 2026
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
ec28784f

05 Feb, 2026 3 commits

[Spec Decode] Unified Parallel Drafting (#32887) · af3162d3
Benjamin Chislett authored Feb 05, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
af3162d3

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) · c1858b7e

Aaron Hao authored Feb 05, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>

c1858b7e

[CI][torch.compile] Reduce e2e fusion test time (#33293) · 4d951353

Luka Govedič authored Feb 04, 2026


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

4d951353

03 Feb, 2026 1 commit
- Turn `@config` into a `dataclass_transform` (#31541) · 61e632ae
  Harry Mellor authored Feb 03, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  61e632ae
30 Jan, 2026 3 commits

Disable Cascade Attention for Batch Invariance (#32561) · 8f5d5120

Frank Wang authored Jan 30, 2026

Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Signed-off-by: Frank Wang <41319051+frankwang28@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

8f5d5120

[BugFix] Disable async scheduling for Mamba prefix caching (#33352) · ec51831a
Harry Huang authored Jan 30, 2026
```
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
```
ec51831a
Fix `tie_word_embeddings` for multimodal models in Transformers v5 (#33359) · 80b918f2
Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
80b918f2

29 Jan, 2026 1 commit
- [Misc] Remove missed `pad_for_cudagraph` (#33283) · a650ad15
  Lucas Wilkinson authored Jan 29, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  a650ad15
28 Jan, 2026 1 commit
- Use aiter triton fused_add_rmsnorm_pad for gpt-oss (#30976) · 59bcc5b6
  Rohan Potdar authored Jan 28, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  59bcc5b6
24 Jan, 2026 1 commit

[Bugfix]: resolve torch.compile cache conflict between mm_encoder_tp_modes (#32842) · 1209b784

Hiroken. authored Jan 24, 2026


Signed-off-by: Hongjian Zhang <zhanghongjian@xiaohongshu.com>
Signed-off-by: Xingran Wang <wangxingran123456@outlook.com>
Co-authored-by: Xingran Wang <wangxingran123456@outlook.com>

1209b784

23 Jan, 2026 1 commit

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877) · 5206e5e2

Harry Huang authored Jan 24, 2026


Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

5206e5e2

21 Jan, 2026 1 commit
- [Misc] Omit "disable NCCL for DP sync" startup log when not applicable (#32707) · 9b693d02
  Nick Hill authored Jan 21, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  9b693d02
19 Jan, 2026 1 commit
- feat: spec decode with draft models (#24322) · 4a5299c9
  Tomas Ruiz authored Jan 19, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  4a5299c9
15 Jan, 2026 2 commits
- [UX] Use kv_offloading_backend=native by default (#32421) · 1be5a735
  Michael Goin authored Jan 15, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1be5a735
- [Feature] Support async scheduling + PP (#32359) · b34474bf
  Wentao Ye authored Jan 15, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b34474bf
13 Jan, 2026 2 commits
- [Misc] improve warning/assert messages (#32226) · 15b33ff0
  cjackal authored Jan 13, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  15b33ff0
- [Misc] Allow enabling NCCL for DP sync when async scheduling (#32197) · 9273a427
  Nick Hill authored Jan 12, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  9273a427
12 Jan, 2026 2 commits

OffloadingConnector: Add cpu_bytes_to_use configuration (#24498) · 9cddbdba
Or Ozeri authored Jan 12, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
9cddbdba

[Feature] Support recording expert indices for rollout router replay (#28284) · 49e6b86c

Hongxin Xu authored Jan 12, 2026


Signed-off-by: xhx1022 <1737006628@qq.com>
Signed-off-by: Hongxin Xu <70438206+xhx1022@users.noreply.github.com>
Signed-off-by: arlenxu <arlenxu@tencent.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>

49e6b86c

09 Jan, 2026 1 commit
- [Misc] Enable async scheduling by default with spec decoding (#31998) · 3adffd5b
  Nick Hill authored Jan 09, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  3adffd5b