Commits · 43aa3892314f8336f83a9fbe614899ddcf0e1df8 · OpenDAS / vllm_cscc

09 Mar, 2026 3 commits

[Dependency] Remove default ray dependency (#36170) · 384425f8

Wentao Ye authored Mar 08, 2026

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

384425f8

Allow `markdownlint` to run locally (#36398) · a0f44bb6
Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a0f44bb6
[XPU][Doc] update xpu document about triton dependency/conflict issue. (#36301) · fde4771b
Kunshang Ji authored Mar 09, 2026
```
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
```
fde4771b

07 Mar, 2026 3 commits
- [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891) · 379689d5
  Wei Zhao authored Mar 07, 2026
  
  379689d5
- Adding support to Sarvam's MoE models (#33942) · 85f50eb4
  rahul-sarvam authored Mar 08, 2026
```
Signed-off-by: rahul-sarvam <140298821+rahul-sarvam@users.noreply.github.com>
```
  85f50eb4
- [V0 Deprecation] Remove unused swap_space parameter (#36216) · 00b814ba
  lif authored Mar 07, 2026
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: mcelrath
```
  00b814ba
06 Mar, 2026 4 commits

[docs][torch.compile] Add fusions.md — kernel/operator fusion reference page (#35538) · ce8546a1

Copilot authored Mar 06, 2026

Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: ProExpertProg <luka.govedic@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

ce8546a1

[ROCm][CI] Fix tool use test stability - disable skinny GEMM, prefix caching,... · 807d6803

Andreas Karatzas authored Mar 06, 2026


[ROCm][CI] Fix tool use test stability - disable skinny GEMM, prefix caching, eliminate batch variance (#35553)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>

807d6803

docs: fix wrong cc in int8.md (#36209) · e68de8ad
Xiang Shi authored Mar 06, 2026
```
Signed-off-by: Xiang Shi <realkevin@tutanota.com>
```
e68de8ad
Reenable features for ROCm attention backends (#36185) · c5362c73
Rohan Potdar authored Mar 05, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
c5362c73

05 Mar, 2026 8 commits
- [Model] Add support for OLMo Hybrid (#32550) · a911f4dd
  Yanhong Li authored Mar 05, 2026
  
  a911f4dd
- [Bugfix][CI] fix typos (#34934) · 6a895197
  Jiayi Yan authored Mar 06, 2026
```
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6a895197
- [ROCm] Refactor ROCm attention backend selection logic (#35246) · 8c760b6a
  Sage Moore authored Mar 05, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  8c760b6a
- [Docs] Only build docs if `documentation` or `ready` labels are present (#36135) · 8df52335
  Harry Mellor authored Mar 05, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8df52335
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
- [Docs] add Dynamo/aibrix integration and kubeai/aks link (#32767) · 7493c51c
  Paco Xu authored Mar 05, 2026
```
Signed-off-by: Paco Xu <paco.xu@daocloud.io>
```
  7493c51c
- [Docs] Update docs to include mm processor + encoder benchmarks (#34083) · ac773bbe
  Reagan Lee authored Mar 05, 2026
```
Signed-off-by: Reagan <reaganjlee@gmail.com>
```
  ac773bbe
- [Doc] Add Parallel Draft Models (#35973) · d106bf39
  zihaoanllm authored Mar 05, 2026
```
Signed-off-by: <zihaoan2@amd.com>
Signed-off-by: zihaoanllm <zihaoan2@amd.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d106bf39
04 Mar, 2026 13 commits

[Docs] Document security risks of GPT-OSS Python tool (#35139) · 636ee223
Russell Bryant authored Mar 04, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
636ee223

[Docs] Clarify structured outputs configuration for Qwen3 reasoning mode (#32441) · 138d891d

Davina Zaman authored Mar 04, 2026

Signed-off-by: Davina Zaman <davzaman@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

138d891d

docs: update CPU Docker images to reference Docker Hub instead of AWS ECR (#34882) · 32224f56

Maxime Grenu authored Mar 04, 2026

Signed-off-by: Maxime Grenu <69890511+cluster2600@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

32224f56

docs: add version requirement note for --profiler-config flag (#32454) · f3dc292e
Abhishek Mathukiya authored Mar 04, 2026
```
Signed-off-by: abhishkh <mathukiya.a@northeastern.edu>
```
f3dc292e

[Docs] Add RunPod GPU deployment guide for vLLM (#34531) · 138c5fa1

Chen authored Mar 04, 2026

Signed-off-by: lisperz <zhuchen200245@163.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

138c5fa1

[Docs] Upgrade dynamic LoRA warning to admonition block (#35218) · 2f2c1d73
Russell Bryant authored Mar 04, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
2f2c1d73
[Docs] Update design/multiprocessing.md (#30677) · fd3bfe74
Michael Yao authored Mar 05, 2026
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
fd3bfe74
docs(cpu): Clarify pre-built wheels requirement for CPU Python-only build (#35090) · d25c1ec3
Sage authored Mar 04, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
d25c1ec3
[Doc] Add MTP docs and update speculative decoding guidance (#35197) · 7cc6058a
Xing Liu authored Mar 05, 2026
```
Signed-off-by: liuxing <945764858@qq.com>
```
7cc6058a
fix(docs): use static rdzv backend in multi-node troubleshooting script (#34784) · 28028dff
Manrique Vargas authored Mar 04, 2026
```
Signed-off-by: machov <mv1742@nyu.edu>
```
28028dff

[Doc] Fix GPU Worker count in Process Count Summary (#36000) · e86221de

simone-dotolo authored Mar 04, 2026

Signed-off-by: simone-dotolo <simonedotolo@libero.it>
Signed-off-by: simone-dotolo <84937474+simone-dotolo@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

e86221de

[model] support FireRedASR2 (#35727) · c1d96340

AllenDou authored Mar 04, 2026


Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

c1d96340

[PluggableLayer][MM] Add PluggableLayer for RelPosAttention (#33753) · 77e6dcbb
Shanshan Shen authored Mar 04, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
77e6dcbb

03 Mar, 2026 3 commits

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

[Docs][Model Runner V2] Add Design Docs (#35819) · 4f85bae9
Woosuk Kwon authored Mar 02, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
4f85bae9
[Model] Add support for nvidia/llama-nemotron-rerank-vl-1b-v2 (#35735) · c8b678e5
Jakub Zakrzewski authored Mar 03, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
c8b678e5

01 Mar, 2026 1 commit

[Attention] FA4 integration (#32974) · 8b5014d3

Lucas Wilkinson authored Mar 01, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

8b5014d3

28 Feb, 2026 5 commits
- add io_process_plugin for sparse embedding (#34214) · 8e75d885
  Augusto Yao authored Feb 28, 2026
```
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
Signed-off-by: Augusto Yao <augusto.yjh@antgroup.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  8e75d885
- [Benchmark] Improve UX of sweep scripts (#35600) · 4292e3b8
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4292e3b8
- [Benchmark] Rename SLA Finder to Workload Explorer (#35586) · 24d6ea8a
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  24d6ea8a
- [Bugfix] Fixes for SLA finder (#35537) · fd68cd13
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fd68cd13
- [ROCm] Add `stablelm` Head Size 80 To Supported Head Sizes For ROCM_ATTN (#35527) · 0edf101d
  Micah Williamson authored Feb 27, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  0edf101d