Commits · 10f08dedfa1636dd477f1ac970827c64f234aad4 · OpenDAS / vllm_cscc

13 Mar, 2026 1 commit
- [Model] Add ColPali late interaction model for multi-modal retrieval (#36818) · 10f08ded
  Nikita authored Mar 13, 2026
```
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  10f08ded
12 Mar, 2026 9 commits

[Feature]: Remove Chunking From FusedMoE (#34086) · 2cdf9222

Xinan Miao authored Mar 13, 2026


Signed-off-by: SouthWest7 <am1ao@qq.com>
Signed-off-by: Southwest <1403572259@qq.com>
Signed-off-by: southwest <am1ao@qq.com>
Signed-off-by: Xinan Miao <1403572259@qq.com>
Co-authored-by: SouthWest7 <am1ao@qq.com>

2cdf9222

Add `AGENTS.md` (#36877) · e39257a5

Harry Mellor authored Mar 12, 2026


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

e39257a5

[Kernel] Add FP8 KV cache support to Triton MLA decode attention (#34597) · a1257fd1
grimulkan authored Mar 12, 2026
```
Signed-off-by: grimulkan <grimulkan@gmail.com>
```
a1257fd1
[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
53ec16a7
[docs] Add lightweight AI assisted contribution policy (#30947) · 5282c7d4
Mark McLoughlin authored Mar 12, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
5282c7d4
[KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328) · 8cb24d3a
sfeiqiang authored Mar 12, 2026
```
Signed-off-by: phaedonsun <phaedonsun@tencent.com>
Co-authored-by: phaedonsun <phaedonsun@tencent.com>
```
8cb24d3a
more models for vLLM Benchmark Suite (#35086) · 17852aa5
Louie Tsai authored Mar 11, 2026
```
Signed-off-by: louie-tsai <louie.tsai@intel.com>
```
17852aa5
[XPU][Doc] Remove manual OneAPI install step, now handled by torch-xpu (#36831) · 513949f9
Kunshang Ji authored Mar 12, 2026
```
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
```
513949f9

[Frontend] Exclude anthropic billing header to avoid prefix cache miss (#36829) · 262b76a0

Nick Hill authored Mar 11, 2026


Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

262b76a0

11 Mar, 2026 4 commits

Correct link to supported hardware on vllm.ai (#36798) · 35db669f
Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
35db669f
Add XPU MLA Sparse backend for DeepSeek v3.2 (#33230) · e584dce5
Wuxun Zhang authored Mar 11, 2026
```
Signed-off-by: Zhang, Wuxun <wuxun.zhang@intel.com>
```
e584dce5

[Bugfix] Add Multiple of 16 block_size to triton fallback on rocm Attention to... · a40ee486

JartX authored Mar 11, 2026


[Bugfix] Add Multiple of 16 block_size to triton fallback on rocm Attention to support qwen3_5 (#35923)
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: akaratza <akaratza@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

a40ee486

[Model] Add support for moonshotai/Kimi-Audio-7B-Instruct (#36127) · 42fadebe

tunglinwood authored Mar 11, 2026


Signed-off-by: tunglinwood <tunglinwood@gmail.com>
Signed-off-by: tunglinwood <tomwu.tunglin@gmail.com>
Signed-off-by: tunglinwood <113751333+tunglinwood@users.noreply.github.com>

42fadebe

10 Mar, 2026 1 commit
- [Model] Add HyperCLOVAX-SEED-Think-32B vision-language model support (#31471) · 0836be3b
  Hojin Yang authored Mar 10, 2026
```
Signed-off-by: effortprogrammer <yhjhoward7@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  0836be3b
09 Mar, 2026 11 commits
- [BE] Rename `should_torch_compile_mm_vit` to `should_torch_compile_mm_encoder` (#36281) · 3fd03f1e
  Lucas Kabela authored Mar 09, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  3fd03f1e
- [Docs] Remove the reo beacon (#36528) · fe0c085c
  Simon Mo authored Mar 09, 2026
```
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
```
  fe0c085c
- [Docs] Expand --allowed-media-domains security guidance with threat details (#36506) · d460a18f
  Russell Bryant authored Mar 09, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  d460a18f
- [ROCm][CI] Fix ROCm attention backend validation for head sizes, block sizes,... · c174d54f
  Andreas Karatzas authored Mar 09, 2026
```
[ROCm][CI] Fix ROCm attention backend validation for head sizes, block sizes, and compute capability checks (#36292)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  c174d54f
- [CI] Fix edge case that could lead to broken docs builds on main (#36515) · 74a9f54c
  Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  74a9f54c
- [Deprecation][1/2] Remove items deprecated in v0.18 (#36470) · f96c3ab0
  Cyrus Leung authored Mar 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f96c3ab0
- [Frontend] Add Support for MM Encoder/Decoder Beam Search (Online Transcriptions) (#36160) · 65a4da15
  Alex Brooks authored Mar 08, 2026
```
Signed-off-by: Alex Brooks <albrooks@redhat.com>
```
  65a4da15
- [Examples][1/n] Resettle basic examples. (#35579) · dcf8862f
  wang.yuqi authored Mar 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  dcf8862f
- [Dependency] Remove default ray dependency (#36170) · 384425f8
  Wentao Ye authored Mar 08, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  384425f8
- Allow `markdownlint` to run locally (#36398) · a0f44bb6
  Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a0f44bb6
- [XPU][Doc] update xpu document about triton dependency/conflict issue. (#36301) · fde4771b
  Kunshang Ji authored Mar 09, 2026
```
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
```
  fde4771b
07 Mar, 2026 3 commits
- [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891) · 379689d5
  Wei Zhao authored Mar 07, 2026
  
  379689d5
- Adding support to Sarvam's MoE models (#33942) · 85f50eb4
  rahul-sarvam authored Mar 08, 2026
```
Signed-off-by: rahul-sarvam <140298821+rahul-sarvam@users.noreply.github.com>
```
  85f50eb4
- [V0 Deprecation] Remove unused swap_space parameter (#36216) · 00b814ba
  lif authored Mar 07, 2026
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: mcelrath
```
  00b814ba
06 Mar, 2026 4 commits

[docs][torch.compile] Add fusions.md — kernel/operator fusion reference page (#35538) · ce8546a1

Copilot authored Mar 06, 2026

Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: ProExpertProg <luka.govedic@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

ce8546a1

[ROCm][CI] Fix tool use test stability - disable skinny GEMM, prefix caching,... · 807d6803

Andreas Karatzas authored Mar 06, 2026


[ROCm][CI] Fix tool use test stability - disable skinny GEMM, prefix caching, eliminate batch variance (#35553)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>

807d6803

docs: fix wrong cc in int8.md (#36209) · e68de8ad
Xiang Shi authored Mar 06, 2026
```
Signed-off-by: Xiang Shi <realkevin@tutanota.com>
```
e68de8ad
Reenable features for ROCm attention backends (#36185) · c5362c73
Rohan Potdar authored Mar 05, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
c5362c73

05 Mar, 2026 7 commits
- [Model] Add support for OLMo Hybrid (#32550) · a911f4dd
  Yanhong Li authored Mar 05, 2026
  
  a911f4dd
- [Bugfix][CI] fix typos (#34934) · 6a895197
  Jiayi Yan authored Mar 06, 2026
```
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6a895197
- [ROCm] Refactor ROCm attention backend selection logic (#35246) · 8c760b6a
  Sage Moore authored Mar 05, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  8c760b6a
- [Docs] Only build docs if `documentation` or `ready` labels are present (#36135) · 8df52335
  Harry Mellor authored Mar 05, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8df52335
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
- [Docs] add Dynamo/aibrix integration and kubeai/aks link (#32767) · 7493c51c
  Paco Xu authored Mar 05, 2026
```
Signed-off-by: Paco Xu <paco.xu@daocloud.io>
```
  7493c51c
- [Docs] Update docs to include mm processor + encoder benchmarks (#34083) · ac773bbe
  Reagan Lee authored Mar 05, 2026
```
Signed-off-by: Reagan <reaganjlee@gmail.com>
```
  ac773bbe