Commits · d28d86e8a34bf2617be294c235d6e6ef3321917b · OpenDAS / vllm_cscc

29 Mar, 2026 6 commits
- [QeRL] Fix online quantized reloading (#38442) · d28d86e8
  Kyle Sayers authored Mar 29, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d28d86e8
- [Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9%... · 995dea13
  Wentao Ye authored Mar 29, 2026
```
[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  995dea13
- [Transformers v5] fix missing pixtral/voxtral multimodal dispatch (#38410) · 8c0b6267
  allgather authored Mar 29, 2026
```
Signed-off-by: allgather <all2allops@gmail.com>
```
  8c0b6267
- [ROCm][CI] Fix cross-attention dispatch for encoder-decoder models (#38450) · 43cc5138
  Andreas Karatzas authored Mar 29, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  43cc5138
- [Spec Decode, BugFix] Propagate norm_before_fc from Eagle3 speculator (#38111) · 5b8c30d6
  Shubhra Pandit authored Mar 28, 2026
```
Signed-off-by: Shubhra Pandit <shubhra.pandit@gmail.com>
```
  5b8c30d6
- [Feature] Add Qwen3-ForcedAligner support via token classification pooling (#35367) · d39b8daf
  haosdent authored Mar 29, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  d39b8daf
28 Mar, 2026 10 commits
- [BugFix][Frontend] apply task instruction as system prompt in cohere v2/embed (#38362) · fafca38a
  Walter Beller-Morales authored Mar 28, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  fafca38a
- [CI]revert initialize_model context manager (#38426) · aa4eb0db
  Kunshang Ji authored Mar 29, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  aa4eb0db
- [ROCm][CI] Fix UV install in Dockerfile.rocm to detect curl failures and retry (#38415) · af89140e
  Andreas Karatzas authored Mar 28, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  af89140e
- [CI] Fix Ernie4.5-VL initialization test (#38429) · b2bc736b
  haosdent authored Mar 28, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  b2bc736b
- [Misc]: clean up non-core lint issues (#37049) · 58c959a7
  whyiug authored Mar 28, 2026
```
Signed-off-by: whyiug <whyiug@hotmail.com>
```
  58c959a7
- [Bugfix] Disallow renderer_num_workers > 1 with mm processor cache (#38418) · bda3eda8
  Bvicii authored Mar 28, 2026
```
Signed-off-by: Bvicii <yizhanhuang2002@gmail.com>
```
  bda3eda8
- [CI Bugfix] Pre-download missing FlashInfer headers in Docker build (#38391) · 2bf5b70a
  Michael Goin authored Mar 28, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  2bf5b70a
- [Test] Fix flaky race condition in test_abort_final_step (#38414) · 6dad4c57
  yzong-rh authored Mar 28, 2026
```
Signed-off-by: Yifan <yzong@redhat.com>
```
  6dad4c57
- Fix Device Index for ROCm Ray Workers in MoE Benchmark (#38108) · 171775f3
  Liwen authored Mar 28, 2026
```
Signed-off-by: Liwen <53441624+li-liwen@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  171775f3
- [ROCm] [Release] Update ROCm variant from rocm700 to rocm721 (#38413) · 58a249bc
  TJian authored Mar 28, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  58a249bc
27 Mar, 2026 24 commits

[Bugfix]fix output Nan/Inf in marlin if dtype=float16 (#33972) · 148a5c12
IriKa authored Mar 28, 2026
```
Signed-off-by: IriKa Qiu <qiujie.jq@gmail.com>
```
148a5c12

[Perf] Use torch compile to fuse pack topk in trtllm moe (#37695) · b69bf2f0

Wei Zhao authored Mar 27, 2026


Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>

b69bf2f0

Add nvidia h800 moe config (#31201) · 88149b63
rongfu.leng authored Mar 28, 2026
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
88149b63

[ROCm][Documentation] update quickstart and installation to include rocm... · 83a4df04

Hongxia Yang authored Mar 27, 2026


[ROCm][Documentation] update quickstart and installation to include rocm nightly docker tips (#38367)
Signed-off-by: Hongxia Yang <hongxiay.yang@amd.com>
Co-authored-by: Hongxia Yang <hongxiay.yang@amd.com>

83a4df04

[ROCm][CI/Build] ROCm 7.2.1 release version; torch 2.10; triton 3.6 (#38252) · 731285c9
Gregory Shtrasberg authored Mar 27, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
731285c9

[NVIDIA] Fix DGX Spark logic (#38126) · 97d19197

Johnny authored Mar 27, 2026


Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Signed-off-by: Sathish Sanjeevi <sathish.krishnan.p.s@gmail.com>
Signed-off-by: guillaume_guy <guillaume.guy@airbnb.com>
Signed-off-by: Guillaume Guy <guillaume.c.guy@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Sathish Sanjeevi <SKPsanjeevi@users.noreply.github.com>
Co-authored-by: Guillaume Guy <guillaume.c.guy@gmail.com>
Co-authored-by: guillaume_guy <guillaume.guy@airbnb.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

97d19197

[Model Runner V2] Rebuild attention metadata before eagle decode full… (#38311) · 384e4d5f
Giancarlo Delfin authored Mar 27, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
384e4d5f
[CI] Skip failing test (#38369) · 44a65280
Nicolò Lucchesi authored Mar 27, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
44a65280
[QeRL] Compose online quantization with quantized reloading (#38032) · 648edcf7
Kyle Sayers authored Mar 27, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
648edcf7
Add short flag `-sc` for `--speculative-config` argument (#38380) · 7ba425e9
Michael Goin authored Mar 27, 2026
```
Co-authored-by: Claude <noreply@anthropic.com>
```
7ba425e9
[ROCm] Fix GPT-OSS import for triton 3.6 (#37453) · b8665383
Gregory Shtrasberg authored Mar 27, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
b8665383

{ROCm]: gpt-oss fusion/padding fixes (#38043) · 0e9358c1

Rohan Potdar authored Mar 27, 2026


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>

0e9358c1

Remove need for explicit `\n` in docstring lists for `--help` formatting (#38350) · 21d2b53f

Harry Mellor authored Mar 27, 2026


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

21d2b53f

enable skipping of SW attention layers when using FP8 KV cache (#33695) · 98e7f223
Jonas M. Kübler authored Mar 27, 2026
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
98e7f223

fix(security): Add VLLM_MAX_N_SEQUENCES environment variable and enforce limit (#37952) · b111f8a6

Juan Pérez de Algaba authored Mar 27, 2026


Signed-off-by: jperezde <jperezde@redhat.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

b111f8a6

[EPLB] Cleanup the transfer logic for the various eplb maps (#34520) · 497e234d
Sage Moore authored Mar 27, 2026
```
Signed-off-by: Sage Moore <sagmoore@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
497e234d
[P/D] Mooncake: Add unit tests and minor fixes for mooncake connector (#36946) · 6287e7fa
dtc authored Mar 27, 2026
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
```
6287e7fa

[CI/Build] Move nightly wheel index generation to a single post-build step (#38322) · 84e439a9

Shengqi Chen authored Mar 27, 2026

Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

84e439a9

[Doc] Clarify Helm chart location in deployment guide (#38328) · a1746ff9

Yuichiro Utsumi authored Mar 27, 2026

Signed-off-by: Yuichiro Utsumi <utsumi.yuichiro@fujitsu.com>
Signed-off-by: Yuichiro Utsumi <81412151+utsumi-fj@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

a1746ff9

[Bugfix] Fix Hermes tool parser when stream interval > 1 (#38168) · aee4c146
Flora Feng authored Mar 27, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
aee4c146
[Refactor] Move FusedMoE hidden_size roundup to quant_method (#34285) · 0ae89f18
Bowen Bao authored Mar 26, 2026
```
Signed-off-by: Bowen Bao <bowenbao@amd.com>
```
0ae89f18
[CI] Add xpu auto-label rule for Intel GPU/XPU PRs (#38320) · c2b17d71
wenjun liu authored Mar 27, 2026
```
Signed-off-by: wendyliu235 <wenjun.liu@intel.com>
```
c2b17d71
[CPU] Support CT W4A16 on CPU MP kernel (#38219) · becaed6e
Li, Jiang authored Mar 27, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
becaed6e
[Model] Extract GatedDeltaNetAttention into shared layer for Qwen3Next and Qwen3.5 (#37975) · a8eab8f3
Xiaoshuang Wang authored Mar 27, 2026
```
Signed-off-by: wxsIcey <1790571317@qq.com>
Signed-off-by: Icey <1790571317@qq.com>
```
a8eab8f3