Commits · cfad6a509c37e863733805a5b351c076e3b0c0db · OpenDAS / vllm_cscc

"docs/vscode:/vscode.git/clone" did not exist on "92f6754e6e2b76dbe9c26743d3bd2898208c6b04"

01 Apr, 2026 7 commits

[Misc] Rename think_start_str/think_end_str to reasoning_start_str/reasoning_end_str (#38242) · 3a30a1a6
Chauncey authored Apr 02, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
(cherry picked from commit cbe7d180)
```
3a30a1a6
(security) Enforce frame limit in VideoMediaIO (#38636) · 29982d48
Juan Pérez de Algaba authored Apr 01, 2026
```
Signed-off-by: jperezde <jperezde@redhat.com>
(cherry picked from commit 58ee6142)
```
29982d48

[Feat][v1] Simple yet General CPU KV Cache Offloading (#37160) · 1dbbafd3

Yifan Qiao authored Mar 31, 2026


Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
(cherry picked from commit 91e4521f)

1dbbafd3

[Bugfix][MLA] Add logits size budget to sparse indexer prefill chunking (#36178) · 0ee3b7fc
Lucas Wilkinson authored Apr 01, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
(cherry picked from commit eb474549)
```
0ee3b7fc

[Bugfix][Async] Fix async spec decoding with hybrid models (#38556) · 268bed9c

Matthew Bonanni authored Mar 31, 2026


Signed-off-by: SandishKumarHN <sandishkumarhn@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: SandishKumarHN <sandishkumarhn@gmail.com>
(cherry picked from commit 757068dc)

268bed9c

[CI] fix LM Eval Qwen3.5 Models (B200) (#38632) · bcc0fdd0
Jiangyun Zhu authored Mar 31, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
(cherry picked from commit ea7bfde6)
```
bcc0fdd0

[CI Failure] pin colmodernvbert revision (#38612) · 69b8bd4b

wang.yuqi authored Mar 31, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
(cherry picked from commit 719735d6)

69b8bd4b

31 Mar, 2026 1 commit
- [CI] Fix SPLADE pooler test broken by #38139 (#38495) · b92312df
  haosdent authored Mar 30, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
(cherry picked from commit a08b7733)
```
  b92312df
30 Mar, 2026 3 commits
- [CI] Add temperature=0.0, reduce max_tokens, and add debug prints to audio_in_video tests (#38492) · bea23536
  Andreas Karatzas authored Mar 30, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  bea23536
- [Bugfix] Support multi-type params parsing for DeepSeek v3.2 (#33703) · a6db99ba
  Stanislav Kirillov authored Mar 30, 2026
```
Signed-off-by: Stanislav Kirillov <stas@nebius.com>
Co-authored-by: Stanislav Kirillov <stas@nebius.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  a6db99ba
- [ROCm][CI] Enable hybrid chunked prefill test (#38317) · 4f2ed5fd
  Andreas Karatzas authored Mar 29, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  4f2ed5fd
29 Mar, 2026 4 commits
- [QeRL] Fix online quantized reloading (#38442) · d28d86e8
  Kyle Sayers authored Mar 29, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d28d86e8
- [Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9%... · 995dea13
  Wentao Ye authored Mar 29, 2026
```
[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  995dea13
- [ROCm][CI] Fix cross-attention dispatch for encoder-decoder models (#38450) · 43cc5138
  Andreas Karatzas authored Mar 29, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  43cc5138
- [Feature] Add Qwen3-ForcedAligner support via token classification pooling (#35367) · d39b8daf
  haosdent authored Mar 29, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  d39b8daf
28 Mar, 2026 4 commits
- [BugFix][Frontend] apply task instruction as system prompt in cohere v2/embed (#38362) · fafca38a
  Walter Beller-Morales authored Mar 28, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  fafca38a
- [CI] Fix Ernie4.5-VL initialization test (#38429) · b2bc736b
  haosdent authored Mar 28, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  b2bc736b
- [Bugfix] Disallow renderer_num_workers > 1 with mm processor cache (#38418) · bda3eda8
  Bvicii authored Mar 28, 2026
```
Signed-off-by: Bvicii <yizhanhuang2002@gmail.com>
```
  bda3eda8
- [Test] Fix flaky race condition in test_abort_final_step (#38414) · 6dad4c57
  yzong-rh authored Mar 28, 2026
```
Signed-off-by: Yifan <yzong@redhat.com>
```
  6dad4c57
27 Mar, 2026 10 commits
- [CI] Skip failing test (#38369) · 44a65280
  Nicolò Lucchesi authored Mar 27, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  44a65280
- [QeRL] Compose online quantization with quantized reloading (#38032) · 648edcf7
  Kyle Sayers authored Mar 27, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  648edcf7
- enable skipping of SW attention layers when using FP8 KV cache (#33695) · 98e7f223
  Jonas M. Kübler authored Mar 27, 2026
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
  98e7f223
- fix(security): Add VLLM_MAX_N_SEQUENCES environment variable and enforce limit (#37952) · b111f8a6
  Juan Pérez de Algaba authored Mar 27, 2026
```
Signed-off-by: jperezde <jperezde@redhat.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  b111f8a6
- [EPLB] Cleanup the transfer logic for the various eplb maps (#34520) · 497e234d
  Sage Moore authored Mar 27, 2026
```
Signed-off-by: Sage Moore <sagmoore@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  497e234d
- [P/D] Mooncake: Add unit tests and minor fixes for mooncake connector (#36946) · 6287e7fa
  dtc authored Mar 27, 2026
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
```
  6287e7fa
- [Bugfix] Fix Hermes tool parser when stream interval > 1 (#38168) · aee4c146
  Flora Feng authored Mar 27, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  aee4c146
- [CPU] Support CT W4A16 on CPU MP kernel (#38219) · becaed6e
  Li, Jiang authored Mar 27, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  becaed6e
- [kv_offload+HMA][7/N]: Support register_kv_caches for hybrid models (#37853) · 7cc302dd
  Or Ozeri authored Mar 27, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  7cc302dd
- [Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789) · 999dfc16
  Bvicii authored Mar 26, 2026
```
Signed-off-by: Bvicii <yizhanhuang2002@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  999dfc16
26 Mar, 2026 11 commits
- [Model Runner V2] Enable forcing a specific acceptance rate during rejection sampling (#38045) · c32e9760
  Giancarlo Delfin authored Mar 26, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  c32e9760
- [ROCm][CI] Add LM Eval Qwen3.5 Models test for MI355 (#38155) · 9c3ae04b
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  9c3ae04b
- [Mamba][APC] Add test case to compare apc outputs (#34977) · b9dbc5c4
  Divakar Verma authored Mar 26, 2026
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  b9dbc5c4
- [ROCm][CI] Fix AITER state leak in shared_fused_moe_routed_transform test (#38137) · bdc1719e
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  bdc1719e
- Revert "[MoE Kernel] Flashinfer nvfp4 cutedsl moe kernel integration" (#38050) (#38169) · be1a85b7
  Zhewen Li authored Mar 26, 2026
```
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>
```
  be1a85b7
- [Renderer] Consolidate factory methods (#38218) · 2e225f7b
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2e225f7b
- [CI] Reorganize scoring tests (#38207) · dcdc1458
  wang.yuqi authored Mar 26, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  dcdc1458
- [ROCm][CI] Fix flaky GPTQ compile correctness test (#38161) · f2d16207
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f2d16207
- [ROCm][CI] Fix wvSplitKrc mock argument order in test_rocm_unquantized_gemm (#38167) · 37a83007
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  37a83007
- [Refactor] Remove unused utils (#38153) · bf5eec63
  Wentao Ye authored Mar 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  bf5eec63
- [Bugfix] Fix DeepGemm E8M0 accuracy degradation for Qwen3.5 FP8 on Blackwell (#38083) · 52069012
  Vadim Gimpelson authored Mar 26, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  52069012