Commits · 8d6b3d5dda293231c7c2fc9301002113f270a534 · OpenDAS / vllm_cscc

09 Mar, 2026 9 commits

[Docs] Expand --allowed-media-domains security guidance with threat details (#36506) · d460a18f
Russell Bryant authored Mar 09, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
d460a18f

[ROCm][CI] Fix ROCm attention backend validation for head sizes, block sizes,... · c174d54f

Andreas Karatzas authored Mar 09, 2026


[ROCm][CI] Fix ROCm attention backend validation for head sizes, block sizes, and compute capability checks (#36292)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>

c174d54f

[CI] Fix edge case that could lead to broken docs builds on main (#36515) · 74a9f54c
Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
74a9f54c
[Deprecation][1/2] Remove items deprecated in v0.18 (#36470) · f96c3ab0
Cyrus Leung authored Mar 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
f96c3ab0
[Frontend] Add Support for MM Encoder/Decoder Beam Search (Online Transcriptions) (#36160) · 65a4da15
Alex Brooks authored Mar 08, 2026
```
Signed-off-by: Alex Brooks <albrooks@redhat.com>
```
65a4da15

[Examples][1/n] Resettle basic examples. (#35579) · dcf8862f

wang.yuqi authored Mar 09, 2026

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

dcf8862f

[Dependency] Remove default ray dependency (#36170) · 384425f8

Wentao Ye authored Mar 08, 2026

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

384425f8

Allow `markdownlint` to run locally (#36398) · a0f44bb6
Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a0f44bb6
[XPU][Doc] update xpu document about triton dependency/conflict issue. (#36301) · fde4771b
Kunshang Ji authored Mar 09, 2026
```
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
```
fde4771b

07 Mar, 2026 3 commits
- [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891) · 379689d5
  Wei Zhao authored Mar 07, 2026
  
  379689d5
- Adding support to Sarvam's MoE models (#33942) · 85f50eb4
  rahul-sarvam authored Mar 08, 2026
```
Signed-off-by: rahul-sarvam <140298821+rahul-sarvam@users.noreply.github.com>
```
  85f50eb4
- [V0 Deprecation] Remove unused swap_space parameter (#36216) · 00b814ba
  lif authored Mar 07, 2026
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: mcelrath
```
  00b814ba
06 Mar, 2026 4 commits

[docs][torch.compile] Add fusions.md — kernel/operator fusion reference page (#35538) · ce8546a1

Copilot authored Mar 06, 2026

Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: ProExpertProg <luka.govedic@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

ce8546a1

[ROCm][CI] Fix tool use test stability - disable skinny GEMM, prefix caching,... · 807d6803

Andreas Karatzas authored Mar 06, 2026


[ROCm][CI] Fix tool use test stability - disable skinny GEMM, prefix caching, eliminate batch variance (#35553)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>

807d6803

docs: fix wrong cc in int8.md (#36209) · e68de8ad
Xiang Shi authored Mar 06, 2026
```
Signed-off-by: Xiang Shi <realkevin@tutanota.com>
```
e68de8ad
Reenable features for ROCm attention backends (#36185) · c5362c73
Rohan Potdar authored Mar 05, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
c5362c73

05 Mar, 2026 8 commits
- [Model] Add support for OLMo Hybrid (#32550) · a911f4dd
  Yanhong Li authored Mar 05, 2026
  
  a911f4dd
- [Bugfix][CI] fix typos (#34934) · 6a895197
  Jiayi Yan authored Mar 06, 2026
```
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6a895197
- [ROCm] Refactor ROCm attention backend selection logic (#35246) · 8c760b6a
  Sage Moore authored Mar 05, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  8c760b6a
- [Docs] Only build docs if `documentation` or `ready` labels are present (#36135) · 8df52335
  Harry Mellor authored Mar 05, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8df52335
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
- [Docs] add Dynamo/aibrix integration and kubeai/aks link (#32767) · 7493c51c
  Paco Xu authored Mar 05, 2026
```
Signed-off-by: Paco Xu <paco.xu@daocloud.io>
```
  7493c51c
- [Docs] Update docs to include mm processor + encoder benchmarks (#34083) · ac773bbe
  Reagan Lee authored Mar 05, 2026
```
Signed-off-by: Reagan <reaganjlee@gmail.com>
```
  ac773bbe
- [Doc] Add Parallel Draft Models (#35973) · d106bf39
  zihaoanllm authored Mar 05, 2026
```
Signed-off-by: <zihaoan2@amd.com>
Signed-off-by: zihaoanllm <zihaoan2@amd.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d106bf39
04 Mar, 2026 13 commits

[Docs] Document security risks of GPT-OSS Python tool (#35139) · 636ee223
Russell Bryant authored Mar 04, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
636ee223

[Docs] Clarify structured outputs configuration for Qwen3 reasoning mode (#32441) · 138d891d

Davina Zaman authored Mar 04, 2026

Signed-off-by: Davina Zaman <davzaman@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

138d891d

docs: update CPU Docker images to reference Docker Hub instead of AWS ECR (#34882) · 32224f56

Maxime Grenu authored Mar 04, 2026

Signed-off-by: Maxime Grenu <69890511+cluster2600@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

32224f56

docs: add version requirement note for --profiler-config flag (#32454) · f3dc292e
Abhishek Mathukiya authored Mar 04, 2026
```
Signed-off-by: abhishkh <mathukiya.a@northeastern.edu>
```
f3dc292e

[Docs] Add RunPod GPU deployment guide for vLLM (#34531) · 138c5fa1

Chen authored Mar 04, 2026

Signed-off-by: lisperz <zhuchen200245@163.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

138c5fa1

[Docs] Upgrade dynamic LoRA warning to admonition block (#35218) · 2f2c1d73
Russell Bryant authored Mar 04, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
2f2c1d73
[Docs] Update design/multiprocessing.md (#30677) · fd3bfe74
Michael Yao authored Mar 05, 2026
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
fd3bfe74
docs(cpu): Clarify pre-built wheels requirement for CPU Python-only build (#35090) · d25c1ec3
Sage authored Mar 04, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
d25c1ec3
[Doc] Add MTP docs and update speculative decoding guidance (#35197) · 7cc6058a
Xing Liu authored Mar 05, 2026
```
Signed-off-by: liuxing <945764858@qq.com>
```
7cc6058a
fix(docs): use static rdzv backend in multi-node troubleshooting script (#34784) · 28028dff
Manrique Vargas authored Mar 04, 2026
```
Signed-off-by: machov <mv1742@nyu.edu>
```
28028dff

[Doc] Fix GPU Worker count in Process Count Summary (#36000) · e86221de

simone-dotolo authored Mar 04, 2026

Signed-off-by: simone-dotolo <simonedotolo@libero.it>
Signed-off-by: simone-dotolo <84937474+simone-dotolo@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

e86221de

[model] support FireRedASR2 (#35727) · c1d96340

AllenDou authored Mar 04, 2026


Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

c1d96340

[PluggableLayer][MM] Add PluggableLayer for RelPosAttention (#33753) · 77e6dcbb
Shanshan Shen authored Mar 04, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
77e6dcbb

03 Mar, 2026 3 commits

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

[Docs][Model Runner V2] Add Design Docs (#35819) · 4f85bae9
Woosuk Kwon authored Mar 02, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
4f85bae9
[Model] Add support for nvidia/llama-nemotron-rerank-vl-1b-v2 (#35735) · c8b678e5
Jakub Zakrzewski authored Mar 03, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
c8b678e5