Commits · e5a77a5015e663784119d88d7ff9e77ce7419aef · OpenDAS / vllm_cscc

20 Mar, 2026 3 commits
- [CI] Update mergify tool-calling label paths (#37478) · e5a77a50
  Flora Feng authored Mar 19, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  e5a77a50
- Fix DP coordinator ZMQ port TOCTOU (#37452) · ca1ac1a4
  Itay Alroy authored Mar 20, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
```
  ca1ac1a4
- [ROCm][Bugfix] fix cache block size mismatch for aiter unified attention (#37606) · 4ca3fa6b
  Divakar Verma authored Mar 19, 2026
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  4ca3fa6b
19 Mar, 2026 37 commits

[Bugfix] Fix Deepseekv32 tool parser when stream interval > 1 (#36056) · be12afd2
Flora Feng authored Mar 19, 2026

be12afd2
[Bug] Fix EmbedIOprocessor "classify" <-> "embed" (#37573) · df3c0291
Wentao Ye authored Mar 19, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
df3c0291
[Refactor] Remove dead code in pooling model (#37572) · 2be1a0f7
Wentao Ye authored Mar 19, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
2be1a0f7

Fix AttributeError in Qwen3.5 GDN layers with quantized models (#37448) · 4120a05f

Jim Smith authored Mar 19, 2026


Signed-off-by: Jim Smith <jim@joshua8.ai>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Xin Yang <105740670+xyang16@users.noreply.github.com>

4120a05f

[CI][BugFix][AMD] Don't set VLLM_ROCM_USE_AITER anymore in... · 98ff0429

rasmith authored Mar 19, 2026


[CI][BugFix][AMD] Don't set VLLM_ROCM_USE_AITER anymore in test_rocm_aiter_topk since its not necessary (#36996)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

98ff0429

[Performance] Enable Triton autotuning disk cache by default (#37188) · b55156ea
Artem Perevedentsev authored Mar 19, 2026
```
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
```
b55156ea
test Qwen/Qwen3-4B-Instruct-2507 for unbacked (#36064) · 112944fa
Laith Sakka authored Mar 19, 2026
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
112944fa
[MoE Refactor] Rename "naive" all2all backend (#36294) · 91be5f9b
bnellnm authored Mar 19, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
91be5f9b
Comment fix for async rl example (#35244) · 4ee847e4
Aaron Hao authored Mar 19, 2026
```
Signed-off-by: hao-aaron <ahao@anyscale.com>
```
4ee847e4
[ROCm][CI] Cleaning and restructuring amd-ci legacy pipeline (#34839) · 040a505f
Andreas Karatzas authored Mar 19, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
040a505f
[MoE Refactor] DefaultMoERunner simplifcation (#33049) · 9279c59a
bnellnm authored Mar 19, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
9279c59a
[Log] Log once in local node by default (#37568) · 74540961
Wentao Ye authored Mar 19, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
74540961
[CI] Add retry with 4x backoff to HTTP fetches for transient failures (#37218) · fb8b5e05
Andreas Karatzas authored Mar 19, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
fb8b5e05
Fix `SpeculatorsConfig` now that `PreTrainedConfig` is a `dataclass` in Transformers (#37574) · e5d96dc8
Harry Mellor authored Mar 19, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
e5d96dc8

[Bugfix] Fix AttributeError when serving MXFP8 models with DeepGEMM installed (#37358) · daa05bf3

EdalatiAli authored Mar 19, 2026


Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

daa05bf3

[torch.compile][BE][Multimodal] Remove requirement to set_model_tag to avoid... · 7769b583

Lucas Kabela authored Mar 19, 2026


[torch.compile][BE][Multimodal] Remove requirement to set_model_tag to avoid cache conflict (#37345)
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>

7769b583

[P/D] AnthropicMessages add kv_transfer_params for PD disaggregation (#37535) · 2f9f946b
Chauncey authored Mar 20, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
2f9f946b
[CPU][UX] Do not crash when tcmalloc/libiomp are not ldpreloaded (#37561) · 2890aecc
Fadi Arafeh authored Mar 19, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
2890aecc
[CI] Gate pre-commit on `ready` label or number of contributions (#37544) · 34f093b4
Harry Mellor authored Mar 19, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
34f093b4
Run MacOS smoke test on daily `cron` job instead of every commit (#37567) · 4dce8321
Harry Mellor authored Mar 19, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
4dce8321
[Misc] Cleanup more configs and processors (#37560) · 657855ab
Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
657855ab
[Bug] Fix fp8 trtllm MoE modular kernel supported routing methods (#37346) · e27b8ba3
Wei Zhao authored Mar 19, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
e27b8ba3
[MRV2] Use fp32 for draft logits (#37526) · 40b8363b
Woosuk Kwon authored Mar 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
40b8363b
[1/n] Migrate permute_cols to libtorch stable ABI (#31509) · 8b10e4fb
mikaylagawarecki authored Mar 19, 2026
```
Signed-off-by: Mikayla Gawarecki <mikaylagawarecki@gmail.com>
```
8b10e4fb

Remove deprecated reasoning_content message field(part-2) (#37480) · 104605cb

Ifta khairul Alam Adil authored Mar 19, 2026


Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Ifta Khairul Alam Adil <ikaadil007@gmail.com>
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Philip Ottesen <phiott256@gmail.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Signed-off-by: Andy Lo <andy@mistral.ai>
Signed-off-by: Thillai Chithambaram <thillaichithambaram.a@gmail.com>
Signed-off-by: sihao.li <sihao.li@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: JartX <sagformas@epdcenter.es>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Philip Ottesen <phiott256@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Giancarlo Delfin <32987265+TheEpicDolphin@users.noreply.github.com>
Co-authored-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Thillai Chithambaram <79466435+thillai-c@users.noreply.github.com>
Co-authored-by: sihao_li <165983188+1643661061leo@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

104605cb

[LoRA] Minor improvements to LoRA log (#37557) · 96266f11

Jee Jee Li authored Mar 19, 2026


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

96266f11

Cap the number of API servers to 1 when using Elastic EP. (#37466) · 7c0cf3bc
Sage Moore authored Mar 19, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
7c0cf3bc
Stop bench CLI from recursively casting all configs to `dict` (#37559) · 572b4329
Harry Mellor authored Mar 19, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
572b4329
[Misc] Clean up processing logic (#37541) · 9515c208
Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
9515c208
[Bugfix] Add Kimi-K2.5 reasoning/tool parser aliases and tool_call_id support (#37438) · c63ca2b2
DorBernsohn authored Mar 19, 2026
```
Signed-off-by: DorBernsohn <dor.bernsohn@gmail.com>
```
c63ca2b2
[CI] Merge `cleanup_pr_body.yml` and `reminder_comment.yml` (#37552) · a32eaf5b
Harry Mellor authored Mar 19, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a32eaf5b
Fix KV Offloading + MLA AssertionError by using num_kv_heads=1 in cpu… (#37536) · e390742c
XueLiang Yang authored Mar 19, 2026
```
Signed-off-by: xueliangyang-oeuler <yxl546827391@gmail.com>
Co-authored-by: xueliangyang-oeuler <yxl546827391@gmail.com>
```
e390742c
[Model] Remove unnecessary `get_language_model` (#37545) · 7a6ebcbf
Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
7a6ebcbf
[CI/Build] Split out MM pooling tests (#37542) · c7bc12c2
Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
c7bc12c2

[Docs] Reorganize pooling docs. (#35592) · f9e2a383

wang.yuqi authored Mar 19, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

f9e2a383

Don't log `exc_info` when vLLM tries to doenload a file that doesn't exist (#37458) · 4426447b
Harry Mellor authored Mar 19, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
4426447b
[Bugfix] Avoid more OpenMP thread reallocation in CPU torch compile (#37538) · 3322e264
Li, Jiang authored Mar 19, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
3322e264