Commits · 47a1f11bffdd12cd59d90d79ff9867b7b3ac5b69 · OpenDAS / vllm_cscc

18 Mar, 2026 1 commit

[docs] Add docs for new RL flows (#36188) · 47a1f11b

Aaron Hao authored Mar 18, 2026

Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47a1f11b

17 Mar, 2026 3 commits
- [Model] Add ColQwen3.5 4.5B support (#36887) · c0745a85
  Athrael Soju authored Mar 17, 2026
```
Signed-off-by: Athrael Soju <athrael.soju@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  c0745a85
- [Perf] Set Flashinfer sparse MLA as default backend for FP8 kv cache (#37252) · b36adfa3
  Wei Zhao authored Mar 17, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  b36adfa3
- [Misc][LoRA] Add --lora-target-modules to restrict LoRA to specific modules (#34984) · 3717a4dd
  Bhoomit authored Mar 17, 2026
```
Signed-off-by: Bhoomit Vasani <bhoomit.2010@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3717a4dd
16 Mar, 2026 9 commits
- [Feature][Frontend] add support for Cohere Embed v2 API (#37074) · 061980c3
  Walter Beller-Morales authored Mar 16, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  061980c3
- [Doc] Clarify schema enforcement behavior for tool_choice modes (#37064) · 31a458c0
  Yuchen Fama authored Mar 16, 2026
```
Signed-off-by: yfama <yuchengu@gmail.com>
```
  31a458c0
- [Misc] Add `float16` to `CacheDType` (#37199) · 93f3c8e5
  Matthew Bonanni authored Mar 16, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  93f3c8e5
- [torch.compile][BE] Modify cudagraph callable to check for is_forward_context_set (#36288) · 714c6e0e
  Lucas Kabela authored Mar 16, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  714c6e0e
- Add simple granite4 tool parser (#36827) · 9f9ecff4
  Max de Bayser authored Mar 16, 2026
```
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  9f9ecff4
- [Docs] Make the link to hardware plugins clearer (#37174) · 9b005edc
  Harry Mellor authored Mar 16, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9b005edc
- [Misc] Sync pre-commit to 4.5.1 in workflows and docs (#36675) · d8f8a7aa
  SoluMilken authored Mar 16, 2026
```
Signed-off-by: SoluMilken <ypiheyn.imm02g@g2.nctu.edu.tw>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d8f8a7aa
- [Kernel] Add FlashInfer MoE A2A Kernel (#36022) · 2754231b
  leo-cf-tian authored Mar 16, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Leo Tian <lctian@nvidia.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: root <root@lyris0267.lyris.clusters.nvidia.com>
```
  2754231b
- [Model] Add HyperCLOVAX-SEED-Think-14B language model support (#37107) · 2390d442
  bigshanedogg authored Mar 16, 2026
```
Signed-off-by: bigshanedogg <bigshane319@gmail.com>
```
  2390d442
15 Mar, 2026 1 commit
- [Feature] Add Azure Blob Storage support for RunAI Model Streamer (#34614) · a3e2e250
  Hari authored Mar 15, 2026
```
Signed-off-by: hasethuraman <hsethuraman@microsoft.com>
```
  a3e2e250
14 Mar, 2026 2 commits

[Feature] Add InstantTensor weight loader (#36139) · 8c29042b
arlo authored Mar 15, 2026

8c29042b

[UX] Improve UX of CPU backend (#36968) · 092ace9e

Li, Jiang authored Mar 14, 2026

Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

092ace9e

13 Mar, 2026 2 commits
- [Model] Add support for BERT-like Chinese ERNIE pooling models (#36385) · 1ce13cf9
  whyiug authored Mar 13, 2026
```
Signed-off-by: whyiug <whyiug@hotmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  1ce13cf9
- [Model] Add ColPali late interaction model for multi-modal retrieval (#36818) · 10f08ded
  Nikita authored Mar 13, 2026
```
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  10f08ded
12 Mar, 2026 9 commits

[Feature]: Remove Chunking From FusedMoE (#34086) · 2cdf9222

Xinan Miao authored Mar 13, 2026


Signed-off-by: SouthWest7 <am1ao@qq.com>
Signed-off-by: Southwest <1403572259@qq.com>
Signed-off-by: southwest <am1ao@qq.com>
Signed-off-by: Xinan Miao <1403572259@qq.com>
Co-authored-by: SouthWest7 <am1ao@qq.com>

2cdf9222

Add `AGENTS.md` (#36877) · e39257a5

Harry Mellor authored Mar 12, 2026


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

e39257a5

[Kernel] Add FP8 KV cache support to Triton MLA decode attention (#34597) · a1257fd1
grimulkan authored Mar 12, 2026
```
Signed-off-by: grimulkan <grimulkan@gmail.com>
```
a1257fd1
[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
53ec16a7
[docs] Add lightweight AI assisted contribution policy (#30947) · 5282c7d4
Mark McLoughlin authored Mar 12, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
5282c7d4
[KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328) · 8cb24d3a
sfeiqiang authored Mar 12, 2026
```
Signed-off-by: phaedonsun <phaedonsun@tencent.com>
Co-authored-by: phaedonsun <phaedonsun@tencent.com>
```
8cb24d3a
more models for vLLM Benchmark Suite (#35086) · 17852aa5
Louie Tsai authored Mar 11, 2026
```
Signed-off-by: louie-tsai <louie.tsai@intel.com>
```
17852aa5
[XPU][Doc] Remove manual OneAPI install step, now handled by torch-xpu (#36831) · 513949f9
Kunshang Ji authored Mar 12, 2026
```
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
```
513949f9

[Frontend] Exclude anthropic billing header to avoid prefix cache miss (#36829) · 262b76a0

Nick Hill authored Mar 11, 2026


Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

262b76a0

11 Mar, 2026 4 commits

Correct link to supported hardware on vllm.ai (#36798) · 35db669f
Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
35db669f
Add XPU MLA Sparse backend for DeepSeek v3.2 (#33230) · e584dce5
Wuxun Zhang authored Mar 11, 2026
```
Signed-off-by: Zhang, Wuxun <wuxun.zhang@intel.com>
```
e584dce5

[Bugfix] Add Multiple of 16 block_size to triton fallback on rocm Attention to... · a40ee486

JartX authored Mar 11, 2026


[Bugfix] Add Multiple of 16 block_size to triton fallback on rocm Attention to support qwen3_5 (#35923)
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: akaratza <akaratza@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

a40ee486

[Model] Add support for moonshotai/Kimi-Audio-7B-Instruct (#36127) · 42fadebe

tunglinwood authored Mar 11, 2026


Signed-off-by: tunglinwood <tunglinwood@gmail.com>
Signed-off-by: tunglinwood <tomwu.tunglin@gmail.com>
Signed-off-by: tunglinwood <113751333+tunglinwood@users.noreply.github.com>

42fadebe

10 Mar, 2026 1 commit
- [Model] Add HyperCLOVAX-SEED-Think-32B vision-language model support (#31471) · 0836be3b
  Hojin Yang authored Mar 10, 2026
```
Signed-off-by: effortprogrammer <yhjhoward7@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  0836be3b
09 Mar, 2026 8 commits
- [BE] Rename `should_torch_compile_mm_vit` to `should_torch_compile_mm_encoder` (#36281) · 3fd03f1e
  Lucas Kabela authored Mar 09, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  3fd03f1e
- [Docs] Remove the reo beacon (#36528) · fe0c085c
  Simon Mo authored Mar 09, 2026
```
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
```
  fe0c085c
- [Docs] Expand --allowed-media-domains security guidance with threat details (#36506) · d460a18f
  Russell Bryant authored Mar 09, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  d460a18f
- [ROCm][CI] Fix ROCm attention backend validation for head sizes, block sizes,... · c174d54f
  Andreas Karatzas authored Mar 09, 2026
```
[ROCm][CI] Fix ROCm attention backend validation for head sizes, block sizes, and compute capability checks (#36292)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  c174d54f
- [CI] Fix edge case that could lead to broken docs builds on main (#36515) · 74a9f54c
  Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  74a9f54c
- [Deprecation][1/2] Remove items deprecated in v0.18 (#36470) · f96c3ab0
  Cyrus Leung authored Mar 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f96c3ab0
- [Frontend] Add Support for MM Encoder/Decoder Beam Search (Online Transcriptions) (#36160) · 65a4da15
  Alex Brooks authored Mar 08, 2026
```
Signed-off-by: Alex Brooks <albrooks@redhat.com>
```
  65a4da15
- [Examples][1/n] Resettle basic examples. (#35579) · dcf8862f
  wang.yuqi authored Mar 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  dcf8862f