Commits · b0651021e5c042e0893929e1b80cf367c6611708 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "270a5da495d24e947a71e2fa0c56635f4fad2dc3"

04 Mar, 2026 13 commits

[Docs] Document security risks of GPT-OSS Python tool (#35139) · 636ee223
Russell Bryant authored Mar 04, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
636ee223

[Docs] Clarify structured outputs configuration for Qwen3 reasoning mode (#32441) · 138d891d

Davina Zaman authored Mar 04, 2026

Signed-off-by: Davina Zaman <davzaman@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

138d891d

docs: update CPU Docker images to reference Docker Hub instead of AWS ECR (#34882) · 32224f56

Maxime Grenu authored Mar 04, 2026

Signed-off-by: Maxime Grenu <69890511+cluster2600@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

32224f56

docs: add version requirement note for --profiler-config flag (#32454) · f3dc292e
Abhishek Mathukiya authored Mar 04, 2026
```
Signed-off-by: abhishkh <mathukiya.a@northeastern.edu>
```
f3dc292e

[Docs] Add RunPod GPU deployment guide for vLLM (#34531) · 138c5fa1

Chen authored Mar 04, 2026

Signed-off-by: lisperz <zhuchen200245@163.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

138c5fa1

[Docs] Upgrade dynamic LoRA warning to admonition block (#35218) · 2f2c1d73
Russell Bryant authored Mar 04, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
2f2c1d73
[Docs] Update design/multiprocessing.md (#30677) · fd3bfe74
Michael Yao authored Mar 05, 2026
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
fd3bfe74
docs(cpu): Clarify pre-built wheels requirement for CPU Python-only build (#35090) · d25c1ec3
Sage authored Mar 04, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
d25c1ec3
[Doc] Add MTP docs and update speculative decoding guidance (#35197) · 7cc6058a
Xing Liu authored Mar 05, 2026
```
Signed-off-by: liuxing <945764858@qq.com>
```
7cc6058a
fix(docs): use static rdzv backend in multi-node troubleshooting script (#34784) · 28028dff
Manrique Vargas authored Mar 04, 2026
```
Signed-off-by: machov <mv1742@nyu.edu>
```
28028dff

[Doc] Fix GPU Worker count in Process Count Summary (#36000) · e86221de

simone-dotolo authored Mar 04, 2026

Signed-off-by: simone-dotolo <simonedotolo@libero.it>
Signed-off-by: simone-dotolo <84937474+simone-dotolo@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

e86221de

[model] support FireRedASR2 (#35727) · c1d96340

AllenDou authored Mar 04, 2026


Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

c1d96340

[PluggableLayer][MM] Add PluggableLayer for RelPosAttention (#33753) · 77e6dcbb
Shanshan Shen authored Mar 04, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
77e6dcbb

03 Mar, 2026 3 commits

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

[Docs][Model Runner V2] Add Design Docs (#35819) · 4f85bae9
Woosuk Kwon authored Mar 02, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
4f85bae9
[Model] Add support for nvidia/llama-nemotron-rerank-vl-1b-v2 (#35735) · c8b678e5
Jakub Zakrzewski authored Mar 03, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
c8b678e5

01 Mar, 2026 1 commit

[Attention] FA4 integration (#32974) · 8b5014d3

Lucas Wilkinson authored Mar 01, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

8b5014d3

28 Feb, 2026 5 commits
- add io_process_plugin for sparse embedding (#34214) · 8e75d885
  Augusto Yao authored Feb 28, 2026
```
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
Signed-off-by: Augusto Yao <augusto.yjh@antgroup.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  8e75d885
- [Benchmark] Improve UX of sweep scripts (#35600) · 4292e3b8
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4292e3b8
- [Benchmark] Rename SLA Finder to Workload Explorer (#35586) · 24d6ea8a
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  24d6ea8a
- [Bugfix] Fixes for SLA finder (#35537) · fd68cd13
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fd68cd13
- [ROCm] Add `stablelm` Head Size 80 To Supported Head Sizes For ROCM_ATTN (#35527) · 0edf101d
  Micah Williamson authored Feb 27, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  0edf101d
27 Feb, 2026 5 commits

[ROCm] Enabling encoder and encoder-decoder on ROCm and AITER unified backends (#35334) · 9fa6c68f
Gregory Shtrasberg authored Feb 27, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
9fa6c68f

[Doc] Fix link to Llama chat template for usability (#35525) · b602e4f2

Martin Hickey authored Feb 27, 2026

Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

b602e4f2

[Model] Add huggingface skt/A.X-K1 model (#32407) · 905d76b5

fort726 authored Feb 28, 2026

Signed-off-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Signed-off-by: fort726 <38447663+fort726@users.noreply.github.com>
Co-authored-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

905d76b5

Add @BoyuanFeng to CODEOWNERS (#35317) · 5de98abc
Boyuan Feng authored Feb 27, 2026
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
5de98abc
[Bug] Fix outdated links in source code (#35314) · 062b7896
Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
062b7896

26 Feb, 2026 5 commits

[WideEP] Remove pplx all2all backend (#33724) · eb19955c

Tyler Michael Smith authored Feb 26, 2026


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

eb19955c

[Model] Add nvidia/llama-nemotron-embed-vl-1b-v2 multimodal embedding model (#35297) · 111d8690
Jakub Zakrzewski authored Feb 26, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
111d8690
[Model] Ring 2.5 (#35102) · ab87f852
Jiangyun Zhu authored Feb 26, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
ab87f852
[Benchmark] Simplify SLA scan (#35306) · d3a51da9
Cyrus Leung authored Feb 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d3a51da9

[Bugfix] Fix CUDA compatibility path setting for both datacenter and consumer NVIDIA GPUs (#33992) · 160424a9

Seungmin Kim authored Feb 26, 2026

Signed-off-by: Seungmin Kim <8457324+ehfd@users.noreply.github.com>
Signed-off-by: Andrew Mello <19512127+88plug@users.noreply.github.com>
Co-authored-by: 88plug <19512127+88plug@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

160424a9

25 Feb, 2026 6 commits

Doc link typo (#35281) · 709eadbb

Joao Gante authored Feb 25, 2026


Signed-off-by: Joao Gante <joaofranciscocardosogante@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

709eadbb

[Doc] Suggest "--managed-python" flag when installing python using uv (#33069) · 80e60a61
Yanwen Lin authored Feb 25, 2026
```
Signed-off-by: Yanwen Lin <lyw1124278064@gmail.com>
```
80e60a61

[DOC][BugFix] Specfiy build dependency installation (#34513) · 26e722f9

jonoillar authored Feb 25, 2026


Signed-off-by: Jon OILLARBURU <jon.oillarburu@multiversecomputing.com>
Co-authored-by: Jon OILLARBURU <jon.oillarburu@multiversecomputing.com>

26e722f9

[Docs]Fix documentation formatting in architecture overview (#34679) · 2c619e5e

lichuang authored Feb 25, 2026

Signed-off-by: codedump <lichuang1982@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2c619e5e

docs: document committer proposal process in governance (#35225) · 8a685be8
Simon Mo authored Feb 24, 2026
```
Signed-off-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
8a685be8
Remove requirement to use `--hf-overrides` for `DeepseekVLV2ForCausalLM` (#35203) · f7967577
Harry Mellor authored Feb 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
f7967577

24 Feb, 2026 1 commit
- [MM] Allow audio chunking for offline LLM (#34628) · f91808ae
  Nicolò Lucchesi authored Feb 24, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f91808ae
23 Feb, 2026 1 commit

[Metrics] Add Prometheus counters for Model FLOPs Utilization (MFU) (#30950) · 5cc7c445

Mark McLoughlin authored Feb 23, 2026



Export the existing Model FLOPs Utilization (MFU) metrics via Prometheus.

`--enable-mfu-metrics` is required for these to be exposed.
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>

5cc7c445