Commits · becaed6ec885b8f599429650262c56a60b1cbf8f · OpenDAS / vllm_cscc · GitLab

27 Mar, 2026 3 commits
- [CPU] Support CT W4A16 on CPU MP kernel (#38219) · becaed6e
  Li, Jiang authored Mar 27, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  becaed6e
- [kv_offload+HMA][7/N]: Support register_kv_caches for hybrid models (#37853) · 7cc302dd
  Or Ozeri authored Mar 27, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  7cc302dd
- [Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789) · 999dfc16
  Bvicii authored Mar 26, 2026
```
Signed-off-by: Bvicii <yizhanhuang2002@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  999dfc16
26 Mar, 2026 14 commits
- [Model Runner V2] Enable forcing a specific acceptance rate during rejection sampling (#38045) · c32e9760
  Giancarlo Delfin authored Mar 26, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  c32e9760
- [ROCm][CI] Add LM Eval Qwen3.5 Models test for MI355 (#38155) · 9c3ae04b
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  9c3ae04b
- [Mamba][APC] Add test case to compare apc outputs (#34977) · b9dbc5c4
  Divakar Verma authored Mar 26, 2026
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  b9dbc5c4
- [ROCm][CI] Fix AITER state leak in shared_fused_moe_routed_transform test (#38137) · bdc1719e
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  bdc1719e
- Revert "[MoE Kernel] Flashinfer nvfp4 cutedsl moe kernel integration" (#38050) (#38169) · be1a85b7
  Zhewen Li authored Mar 26, 2026
```
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>
```
  be1a85b7
- [Renderer] Consolidate factory methods (#38218) · 2e225f7b
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2e225f7b
- [CI] Reorganize scoring tests (#38207) · dcdc1458
  wang.yuqi authored Mar 26, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  dcdc1458
- [ROCm][CI] Fix flaky GPTQ compile correctness test (#38161) · f2d16207
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f2d16207
- [ROCm][CI] Fix wvSplitKrc mock argument order in test_rocm_unquantized_gemm (#38167) · 37a83007
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  37a83007
- [Refactor] Remove unused utils (#38153) · bf5eec63
  Wentao Ye authored Mar 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  bf5eec63
- [Bugfix] Fix DeepGemm E8M0 accuracy degradation for Qwen3.5 FP8 on Blackwell (#38083) · 52069012
  Vadim Gimpelson authored Mar 26, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  52069012
- Add `/v1/chat/completions/batch` endpoint for batched chat completions (#38011) · 29080945
  Matej Rojec authored Mar 26, 2026
```
Signed-off-by: Matej Rojec <64556640+MatejRojec@users.noreply.github.com>
```
  29080945
- Relocate Encoder CUDA graph manager (#38116) · 144030c8
  Woosuk Kwon authored Mar 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  144030c8
- Various Transformers v5 fixes (#38127) · 3c3c0842
  Harry Mellor authored Mar 26, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3c3c0842
25 Mar, 2026 19 commits
- [Cohere] Enable Cohere-Transcribe (#38120) · 7b54f60d
  Ekagra Ranjan authored Mar 25, 2026
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  7b54f60d
- [MultiModal] add support for numpy array embeddings (#38119) · 70a21528
  Guillaume Guy authored Mar 25, 2026
```
Signed-off-by: guillaume_guy <guillaume.guy@airbnb.com>
Signed-off-by: Guillaume Guy <guillaume.c.guy@gmail.com>
Co-authored-by: guillaume_guy <guillaume.guy@airbnb.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  70a21528
- [ROCm] Fix MoE kernel test failures on gfx950 (#37833) · 7d6917be
  Andreas Karatzas authored Mar 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  7d6917be
- [Frontend] Move APIServerProcessManager target server fn (#38115) · 72cad44d
  Nick Hill authored Mar 25, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  72cad44d
- [Misc] Reorganize inputs (#35182) · ba2f0acc
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba2f0acc
- [MoE Kernel] Flashinfer nvfp4 cutedsl moe kernel integration (#38050) · 678b3c99
  Yongye Zhu authored Mar 25, 2026
  
  678b3c99
- [compile] Add some more startup tests for top models (#38046) · 6e37c46b
  Richard Zou authored Mar 25, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  6e37c46b
- [Refactor] Rename `WAITING_FOR_FSM` to `WAITING_FOR_STRUCTURED_OUTPUT_GRAMMAR` (#38048) · 1bf2ddd0
  Wentao Ye authored Mar 25, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1bf2ddd0
- [Feature] EPLB Support for GPU Model Runner v2 (#37488) · d7e93e13
  Wentao Ye authored Mar 25, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
```
  d7e93e13
- [Feature] Support per-draft-model MoE backend via `--speculative-config` (#37880) · cd764301
  Andrii Skliar authored Mar 25, 2026
```
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Signed-off-by: [Andrii Skliar] <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
```
  cd764301
- [Mypy] Better fixes for the `mypy` issues in `vllm/config` (#37902) · d215d1ef
  Harry Mellor authored Mar 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d215d1ef
- [Bugfix] Pass drafter quant_config to ParallelLMHead in Eagle3 (#37280) · a889b7f5
  Matthias Gehre authored Mar 25, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  a889b7f5
- Fix offline mode test for Transformers v5 (#38095) · ba2910f7
  Harry Mellor authored Mar 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ba2910f7
- [ROCm][CI] Fix flaky Cohere/OpenAI embedding parity test (#37616) · f262a62a
  Andreas Karatzas authored Mar 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f262a62a
- [CI] Fix realtime WebSocket timeout deadlock and unhandled model validation errors (#37483) · 9ac2fcaf
  Andreas Karatzas authored Mar 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  9ac2fcaf
- [ROCm][CI] Increase OpenAPI schema test timeouts (#38088) · 04cec4f9
  Andreas Karatzas authored Mar 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  04cec4f9
- [ROCm] Attention selector reordering (#36702) · 189ddefb
  Gregory Shtrasberg authored Mar 25, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
```
  189ddefb
- [ROCm][Test] Fix ROCM_AITER_UNIFIED_ATTN attn+quant fusion test (#37640) · 42e95479
  vllmellm authored Mar 25, 2026
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  42e95479
- [Bugfix][ROCm][MoE] Fix mxfp4 oracle regressions from #37128 (#37787) · 679c6a3e
  Andreas Karatzas authored Mar 24, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  679c6a3e
24 Mar, 2026 4 commits
- [Perf] Disable inductor runtime asserts by default for serving perfor… (#37485) · 82580b10
  Terry Gao authored Mar 24, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
Co-authored-by: Tianren Gao <tianren@fb.com>
```
  82580b10
- [FlexAttention] allow custom mask mod (#37692) · 8c47fdfd
  liangel-02 authored Mar 24, 2026
```
Signed-off-by: Angel Li <liangel@meta.com>
```
  8c47fdfd
- [BugFix] fix VLLM_USE_STANDALONE_COMPILE=0 (#38015) · 89f572db
  Richard Zou authored Mar 24, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  89f572db
- [Model] Add Granite 4.0 1B speech to supported models (#38019) · 935c46dd
  Nick Cao authored Mar 24, 2026
```
Signed-off-by: Nick Cao <ncao@redhat.com>
```
  935c46dd