Commits · b69bf2f0b170ac5b43f72f4dd4139c5388fa5de8 · OpenDAS / vllm_cscc

27 Mar, 2026 27 commits

[Perf] Use torch compile to fuse pack topk in trtllm moe (#37695) · b69bf2f0

Wei Zhao authored Mar 27, 2026


Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>

b69bf2f0

Add nvidia h800 moe config (#31201) · 88149b63
rongfu.leng authored Mar 28, 2026
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
88149b63

[ROCm][Documentation] update quickstart and installation to include rocm... · 83a4df04

Hongxia Yang authored Mar 27, 2026


[ROCm][Documentation] update quickstart and installation to include rocm nightly docker tips (#38367)
Signed-off-by: Hongxia Yang <hongxiay.yang@amd.com>
Co-authored-by: Hongxia Yang <hongxiay.yang@amd.com>

83a4df04

[ROCm][CI/Build] ROCm 7.2.1 release version; torch 2.10; triton 3.6 (#38252) · 731285c9
Gregory Shtrasberg authored Mar 27, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
731285c9

[NVIDIA] Fix DGX Spark logic (#38126) · 97d19197

Johnny authored Mar 27, 2026


Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Signed-off-by: Sathish Sanjeevi <sathish.krishnan.p.s@gmail.com>
Signed-off-by: guillaume_guy <guillaume.guy@airbnb.com>
Signed-off-by: Guillaume Guy <guillaume.c.guy@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Sathish Sanjeevi <SKPsanjeevi@users.noreply.github.com>
Co-authored-by: Guillaume Guy <guillaume.c.guy@gmail.com>
Co-authored-by: guillaume_guy <guillaume.guy@airbnb.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

97d19197

[Model Runner V2] Rebuild attention metadata before eagle decode full… (#38311) · 384e4d5f
Giancarlo Delfin authored Mar 27, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
384e4d5f
[CI] Skip failing test (#38369) · 44a65280
Nicolò Lucchesi authored Mar 27, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
44a65280
[QeRL] Compose online quantization with quantized reloading (#38032) · 648edcf7
Kyle Sayers authored Mar 27, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
648edcf7
Add short flag `-sc` for `--speculative-config` argument (#38380) · 7ba425e9
Michael Goin authored Mar 27, 2026
```
Co-authored-by: Claude <noreply@anthropic.com>
```
7ba425e9
[ROCm] Fix GPT-OSS import for triton 3.6 (#37453) · b8665383
Gregory Shtrasberg authored Mar 27, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
b8665383

{ROCm]: gpt-oss fusion/padding fixes (#38043) · 0e9358c1

Rohan Potdar authored Mar 27, 2026


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>

0e9358c1

Remove need for explicit `\n` in docstring lists for `--help` formatting (#38350) · 21d2b53f

Harry Mellor authored Mar 27, 2026


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

21d2b53f

enable skipping of SW attention layers when using FP8 KV cache (#33695) · 98e7f223
Jonas M. Kübler authored Mar 27, 2026
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
98e7f223

fix(security): Add VLLM_MAX_N_SEQUENCES environment variable and enforce limit (#37952) · b111f8a6

Juan Pérez de Algaba authored Mar 27, 2026


Signed-off-by: jperezde <jperezde@redhat.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

b111f8a6

[EPLB] Cleanup the transfer logic for the various eplb maps (#34520) · 497e234d
Sage Moore authored Mar 27, 2026
```
Signed-off-by: Sage Moore <sagmoore@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
497e234d
[P/D] Mooncake: Add unit tests and minor fixes for mooncake connector (#36946) · 6287e7fa
dtc authored Mar 27, 2026
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
```
6287e7fa

[CI/Build] Move nightly wheel index generation to a single post-build step (#38322) · 84e439a9

Shengqi Chen authored Mar 27, 2026

Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

84e439a9

[Doc] Clarify Helm chart location in deployment guide (#38328) · a1746ff9

Yuichiro Utsumi authored Mar 27, 2026

Signed-off-by: Yuichiro Utsumi <utsumi.yuichiro@fujitsu.com>
Signed-off-by: Yuichiro Utsumi <81412151+utsumi-fj@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

a1746ff9

[Bugfix] Fix Hermes tool parser when stream interval > 1 (#38168) · aee4c146
Flora Feng authored Mar 27, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
aee4c146
[Refactor] Move FusedMoE hidden_size roundup to quant_method (#34285) · 0ae89f18
Bowen Bao authored Mar 26, 2026
```
Signed-off-by: Bowen Bao <bowenbao@amd.com>
```
0ae89f18
[CI] Add xpu auto-label rule for Intel GPU/XPU PRs (#38320) · c2b17d71
wenjun liu authored Mar 27, 2026
```
Signed-off-by: wendyliu235 <wenjun.liu@intel.com>
```
c2b17d71
[CPU] Support CT W4A16 on CPU MP kernel (#38219) · becaed6e
Li, Jiang authored Mar 27, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
becaed6e
[Model] Extract GatedDeltaNetAttention into shared layer for Qwen3Next and Qwen3.5 (#37975) · a8eab8f3
Xiaoshuang Wang authored Mar 27, 2026
```
Signed-off-by: wxsIcey <1790571317@qq.com>
Signed-off-by: Icey <1790571317@qq.com>
```
a8eab8f3
[frontend] dump openai responses type by alias (#38262) · 2babac0b
cjackal authored Mar 27, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
2babac0b
[kv_offload+HMA][7/N]: Support register_kv_caches for hybrid models (#37853) · 7cc302dd
Or Ozeri authored Mar 27, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
7cc302dd
[Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789) · 999dfc16
Bvicii authored Mar 26, 2026
```
Signed-off-by: Bvicii <yizhanhuang2002@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
999dfc16
[CI/Build] enable Intel XPU test flow with prebuilt image (#37447) · d8606012
wenjun liu authored Mar 27, 2026
```
Signed-off-by: wendyliu235 <wenjun.liu@intel.com>
```
d8606012

26 Mar, 2026 13 commits
- Various Transformers v5 config fixes (#38247) · f73bcb1c
  Harry Mellor authored Mar 26, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f73bcb1c
- [Bugfix] Add missing f-string prefix in xgrammar choices error message (#38162) · 28048bd6
  yzong-rh authored Mar 26, 2026
```
Signed-off-by: Yifan Zong <yzong@redhat.com>
```
  28048bd6
- [Model Runner V2] Enable forcing a specific acceptance rate during rejection sampling (#38045) · c32e9760
  Giancarlo Delfin authored Mar 26, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  c32e9760
- Fix multi-node allreduce fusion (#38136) · 0904b655
  Wei Zhao authored Mar 26, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: root <root@theia0053.lyris.clusters.nvidia.com>
```
  0904b655
- [Bugfix][ROCm] Fix lru_cache on paged_mqa_logits_module (#37547) · f26fcdfb
  Stig-Arne Grönroos authored Mar 26, 2026
```
Signed-off-by: Stig-Arne Grönroos <stig-arne.gronroos@amd.com>
```
  f26fcdfb
- [ROCm] [Bugfix] [Release] Fix nightly rocm release pipeline (#38263) · bc9c6fbb
  TJian authored Mar 27, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  bc9c6fbb
- [ROCm][CI] Override PYTORCH_ROCM_ARCH with detected GPU arch in test containers (#38165) · bff9a1c2
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  bff9a1c2
- [ROCm][CI] Add uv pip compile workflow for rocm-test.txt lockfile (#37930) · db01535e
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  db01535e
- [ROCM][Bugfix] Use correct stride in cp_mha_gather_cache_kernel for hybrid model (#37228) (#37228) · a4cf9b22
  jennyyyyzhen authored Mar 26, 2026
```
Signed-off-by: jennyyyyzhen <yzhen@hmc.edu>
Co-authored-by: yZhen <yZhen@fb.com>
```
  a4cf9b22
- [ROCm][CI] Add LM Eval Qwen3.5 Models test for MI355 (#38155) · 9c3ae04b
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  9c3ae04b
- [CI] Fix conch kernel crash on 3D input by reshaping to 2D before GEMM (#38178) · a8e48a7b
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  a8e48a7b
- [Mamba][APC] Add test case to compare apc outputs (#34977) · b9dbc5c4
  Divakar Verma authored Mar 26, 2026
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  b9dbc5c4
- [Releases] [ROCm] Enable Nightly Docker Image and Wheel Releases for ROCm (#37283) · 60af7b96
  TJian authored Mar 27, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Hongxia Yang <hongxiay.yang@amd.com>
```
  60af7b96