Commits · c1d963403c4f09cc0d5a25573c45d7405cd09abb · OpenDAS / vllm_cscc

04 Mar, 2026 2 commits

[model] support FireRedASR2 (#35727) · c1d96340

AllenDou authored Mar 04, 2026


Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

c1d96340

[PluggableLayer][MM] Add PluggableLayer for RelPosAttention (#33753) · 77e6dcbb
Shanshan Shen authored Mar 04, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
77e6dcbb

03 Mar, 2026 3 commits

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

[Docs][Model Runner V2] Add Design Docs (#35819) · 4f85bae9
Woosuk Kwon authored Mar 02, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
4f85bae9
[Model] Add support for nvidia/llama-nemotron-rerank-vl-1b-v2 (#35735) · c8b678e5
Jakub Zakrzewski authored Mar 03, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
c8b678e5

01 Mar, 2026 1 commit

[Attention] FA4 integration (#32974) · 8b5014d3

Lucas Wilkinson authored Mar 01, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

8b5014d3

28 Feb, 2026 5 commits
- add io_process_plugin for sparse embedding (#34214) · 8e75d885
  Augusto Yao authored Feb 28, 2026
```
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
Signed-off-by: Augusto Yao <augusto.yjh@antgroup.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  8e75d885
- [Benchmark] Improve UX of sweep scripts (#35600) · 4292e3b8
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4292e3b8
- [Benchmark] Rename SLA Finder to Workload Explorer (#35586) · 24d6ea8a
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  24d6ea8a
- [Bugfix] Fixes for SLA finder (#35537) · fd68cd13
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fd68cd13
- [ROCm] Add `stablelm` Head Size 80 To Supported Head Sizes For ROCM_ATTN (#35527) · 0edf101d
  Micah Williamson authored Feb 27, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  0edf101d
27 Feb, 2026 5 commits

[ROCm] Enabling encoder and encoder-decoder on ROCm and AITER unified backends (#35334) · 9fa6c68f
Gregory Shtrasberg authored Feb 27, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
9fa6c68f

[Doc] Fix link to Llama chat template for usability (#35525) · b602e4f2

Martin Hickey authored Feb 27, 2026

Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

b602e4f2

[Model] Add huggingface skt/A.X-K1 model (#32407) · 905d76b5

fort726 authored Feb 28, 2026

Signed-off-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Signed-off-by: fort726 <38447663+fort726@users.noreply.github.com>
Co-authored-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

905d76b5

Add @BoyuanFeng to CODEOWNERS (#35317) · 5de98abc
Boyuan Feng authored Feb 27, 2026
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
5de98abc
[Bug] Fix outdated links in source code (#35314) · 062b7896
Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
062b7896

26 Feb, 2026 5 commits

[WideEP] Remove pplx all2all backend (#33724) · eb19955c

Tyler Michael Smith authored Feb 26, 2026


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

eb19955c

[Model] Add nvidia/llama-nemotron-embed-vl-1b-v2 multimodal embedding model (#35297) · 111d8690
Jakub Zakrzewski authored Feb 26, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
111d8690
[Model] Ring 2.5 (#35102) · ab87f852
Jiangyun Zhu authored Feb 26, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
ab87f852
[Benchmark] Simplify SLA scan (#35306) · d3a51da9
Cyrus Leung authored Feb 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d3a51da9

[Bugfix] Fix CUDA compatibility path setting for both datacenter and consumer NVIDIA GPUs (#33992) · 160424a9

Seungmin Kim authored Feb 26, 2026

Signed-off-by: Seungmin Kim <8457324+ehfd@users.noreply.github.com>
Signed-off-by: Andrew Mello <19512127+88plug@users.noreply.github.com>
Co-authored-by: 88plug <19512127+88plug@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

160424a9

25 Feb, 2026 6 commits

Doc link typo (#35281) · 709eadbb

Joao Gante authored Feb 25, 2026


Signed-off-by: Joao Gante <joaofranciscocardosogante@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

709eadbb

[Doc] Suggest "--managed-python" flag when installing python using uv (#33069) · 80e60a61
Yanwen Lin authored Feb 25, 2026
```
Signed-off-by: Yanwen Lin <lyw1124278064@gmail.com>
```
80e60a61

[DOC][BugFix] Specfiy build dependency installation (#34513) · 26e722f9

jonoillar authored Feb 25, 2026


Signed-off-by: Jon OILLARBURU <jon.oillarburu@multiversecomputing.com>
Co-authored-by: Jon OILLARBURU <jon.oillarburu@multiversecomputing.com>

26e722f9

[Docs]Fix documentation formatting in architecture overview (#34679) · 2c619e5e

lichuang authored Feb 25, 2026

Signed-off-by: codedump <lichuang1982@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2c619e5e

docs: document committer proposal process in governance (#35225) · 8a685be8
Simon Mo authored Feb 24, 2026
```
Signed-off-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
8a685be8
Remove requirement to use `--hf-overrides` for `DeepseekVLV2ForCausalLM` (#35203) · f7967577
Harry Mellor authored Feb 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
f7967577

24 Feb, 2026 1 commit
- [MM] Allow audio chunking for offline LLM (#34628) · f91808ae
  Nicolò Lucchesi authored Feb 24, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f91808ae
23 Feb, 2026 2 commits

[Metrics] Add Prometheus counters for Model FLOPs Utilization (MFU) (#30950) · 5cc7c445

Mark McLoughlin authored Feb 23, 2026



Export the existing Model FLOPs Utilization (MFU) metrics via Prometheus.

`--enable-mfu-metrics` is required for these to be exposed.
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>

5cc7c445

[Refactor] Simplify dummy data generation (#35025) · 987506bc
Cyrus Leung authored Feb 23, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
987506bc

22 Feb, 2026 1 commit

[New Model] Add ColModernVBERT (#34558) · 970861ac

Athrael Soju authored Feb 22, 2026


Signed-off-by: Athrael Soju <athrael.soju@gmail.com>
Signed-off-by: athrael-soju <athrael-soju@users.noreply.github.com>

970861ac

21 Feb, 2026 4 commits

[Doc] Fix example of eagle3 (#34960) · bebfe55b

petrpechman authored Feb 21, 2026


Signed-off-by: Petr Pechman <petr.pechman@firma.seznam.cz>
Co-authored-by: Petr Pechman <petr.pechman@firma.seznam.cz>

bebfe55b

[PD] Change kv_load_failure_policy Default from "recompute" to "fail" (#34896) · ab6f3487
Nicolò Lucchesi authored Feb 21, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
ab6f3487
[ROCm] Enable bitsandbytes quantization support on ROCm (#34688) · 8dc8a99b
BADAOUI Abdennacer authored Feb 21, 2026
```
Signed-off-by: badaoui <abdennacerbadaoui0@gmail.com>
```
8dc8a99b

[Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) +... · 5719a4e4

Kata Coder authored Feb 21, 2026


[Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) + NewModel: nvidia/nemotron-colembed (#34574)
Signed-off-by: craftsangjae <craftsangjae@gmail.com>

5719a4e4

18 Feb, 2026 2 commits
- [Docs] Clean up speculators docs (#34065) · 64ac1395
  Kyle Sayers authored Feb 18, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  64ac1395
- [Renderer] Deprecate code paths for old input processing (#34775) · a766b303
  Cyrus Leung authored Feb 18, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a766b303
17 Feb, 2026 1 commit
- [Bugfix][MTP][Sparse MLA] Allow sparse MLA with MTP to run with FULL cudagraphs (#34457) · dc5fa77a
  Matthew Bonanni authored Feb 17, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  dc5fa77a
16 Feb, 2026 2 commits
- Bump `lm-eval` version for Transformers v5 compatibility (#33994) · a21cedf4
  Harry Mellor authored Feb 16, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a21cedf4
- [Doc] Add Mistral-7b-v0.3 model to the batch invariance validated model (#34584) · 56530210
  Parth Bansal authored Feb 16, 2026
```
Signed-off-by: Parth Bansal <parthbansal127@gmail.com>
```
  56530210