Commits · 0b53bec60b9b41c9e16cefa2db367afb6a60628d · OpenDAS / vllm_cscc

"components/backends/vllm/deploy/agg.yaml" did not exist on "5bf23d54f3e46a15ff5000773a32d8829befa919"

27 Jan, 2026 4 commits

Fix IndexError with encoder-decoder models when using Custom Paged Attention (#33112) · c568581f
Strahinja Stamenkovic authored Jan 27, 2026
```
Signed-off-by: sstamenk <strahinja.stamenkovic@amd.com>
```
c568581f

fix: preserve native tool call ID in multi-turn tool calling (#32768) · 2d705343

wangln19 authored Jan 27, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <2037008807@qq.com>

2d705343

[MoE Refactor] Integrate Naive Prepare Finalize into MK (#32567) · 5a93b916

Robert Shaw authored Jan 26, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: amirkl94 <203507526+amirkl94@users.noreply.github.com>

5a93b916

[Model Runner V2] Remove UvaBufferPool for cpu->gpu copy (#33055) · 6d86fde0

Woosuk Kwon authored Jan 26, 2026


Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Nick Hill <nhill@redhat.com>

6d86fde0

26 Jan, 2026 27 commits

[Bugfix][TPU] Return a Default fp8 MoE Backend (#32908) · 510ed1e8

XiongfeiWei authored Jan 26, 2026


Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

510ed1e8

[Bugfix][MXFP4] Call `trtllm_fp4_block_scale_moe` with kwargs (#33104) · 8caffd92
Pengchao Wang authored Jan 26, 2026
```
Signed-off-by: Pengchao Wang <wpc@fb.com>
```
8caffd92
[fix] CPUDNNLGEMMHandler pointer baked into inductor artifact (#32913) · 58a05b0c
dolpm authored Jan 26, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
58a05b0c

[Logging] add `--disable-access-log-for-endpoints` CLI option (#30011) · 6ee7f18f

Jared Wen authored Jan 27, 2026



Add a new CLI option --disable-access-log-for-endpoints to suppress
uvicorn access logs for specified endpoints (e.g., /health, /metrics, /ping).

This addresses the need to reduce log noise in production environments
where health check endpoints are frequently polled by load balancers or
monitoring systems, generating excessive log entries that obscure
meaningful request logs.

Fixes #29982
Signed-off-by: JaredforReal <w13431838023@gmail.com>

6ee7f18f

[Refactor] Remove unused `_moe_permute` function (#33108) · 8f987883
Wentao Ye authored Jan 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
8f987883

[Bugfix] Fix Dtypes for Pynccl Wrapper (#33030) · 43a013c3

Robert Shaw authored Jan 26, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

43a013c3

[Model] Bump transformers version for test registry (#33100) · c25dbee4
Cyrus Leung authored Jan 27, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
c25dbee4
[Bugfix] Fix Voxtral streaming slot_mapping (#33073) · 19ab0f7c
Nicolò Lucchesi authored Jan 26, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
19ab0f7c

[FIX] Always support TP > 4 for FP4 Gemm (#31099) · 67fe677c

danielafrimi authored Jan 26, 2026


Signed-off-by: dafrimi <dafrimi@nvidia.com>
Co-authored-by: root <root@gpu-51.slurm-workers-slurm.slurm.svc.cluster.local>

67fe677c

Remove unused logic in `models/mistral.py` (#33095) · d56afd45
Andy Lo authored Jan 26, 2026
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
d56afd45
[ROCm][Bugfix] Fix ptpc scale load issue for fused shared expert path in deepseek mtp (#33018) · be6931ee
Pleaplusone authored Jan 26, 2026
```
Signed-off-by: ganyi <ygan@amd.com>
```
be6931ee
[Bugfix] Fix Can't instantiate abstract class DeepseekV32IndexerBackend (#33052) · 9ef3b718
Chauncey authored Jan 26, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
9ef3b718

[GLM-OCR] GLM-OCR with MTP Support (#33005) · bb17e8f1

Yuxuan Zhang authored Jan 26, 2026


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

bb17e8f1

[Chore] Update type annotation of `input_ids` in model forward (#33063) · dcd80206
Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
dcd80206

[Performance] Tune Mamba selective scan kernel for B200 (#32873) · f4a0921c

danisereb authored Jan 26, 2026


Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

f4a0921c

[Feature] Add LoRA support for Gemma3 vision components (#32764) · 208c5625
VihaanThat authored Jan 26, 2026

208c5625
[Misc] HF Hub LoRA Resolver (#20320) · 9ac818a5
Alex Brooks authored Jan 26, 2026
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
9ac818a5
[Model] Use mm_position to compute mrope positions for Qwen3-Omni (#33010) · 6ca2c91b
Itay Etelis authored Jan 26, 2026
```
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
```
6ca2c91b

[lora/moe] Improve fused MoE‑LoRA kernel indexing and memory access (#32770) · e33192b2

cwazai authored Jan 26, 2026


Signed-off-by: 陈建华 <1647430658@qq.com>
Signed-off-by: Yanwen Lin <lyw1124278064@gmail.com>
Signed-off-by: kimheesu <wlskaka4@gmail.com>
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: ganyi <ygan@amd.com>
Signed-off-by: whx-sjtu <2952154980@qq.com>
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: Ifta Khairul Alam Adil <ikaadil007@gmail.com>
Signed-off-by: Ifta khairul Alam Adil <25082512+ikaadil@users.noreply.gith...

e33192b2

[Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955) · 11b55687
Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
11b55687

Set splitk=1 for fused-moe-lora expand kernel (#32882) · ee484b3f

Danielle Robinson authored Jan 25, 2026


Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

ee484b3f

[Model Runner V2] Add LoRAState to consolidate lora logic (#33062) · a9b53dd4
Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
a9b53dd4

[StepVL] support close img patch (#32923) · 105d1045

ltd0924 authored Jan 26, 2026


Signed-off-by: luotingdan <luotingdan@stepfun.com>
Signed-off-by: ltd0924 <32387785+ltd0924@users.noreply.github.com>
Co-authored-by: luotingdan <luotingdan@stepfun.com>

105d1045

[CI] Fix MHA attention test failure (AttributeError when model_config is None... · 566cdb6c

Lucas Wilkinson authored Jan 25, 2026


[CI] Fix MHA attention test failure (AttributeError when model_config is None in ViT attention backend) (#33033)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

566cdb6c

[Model Runner V2] Minor simplification for finish_requests (#33048) · 2f0d3ba7
Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
2f0d3ba7
[Model Runner V2] Fix slot_mapping after #25954 (#33046) · edf927bc
Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
```
edf927bc
[Bugfix][VLM] Fix transformers backend embed_multimodal for Qwen2.5-VL profiling (#32969) · 22aeb430
Andreas Karatzas authored Jan 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
22aeb430

25 Jan, 2026 4 commits

[Model] Use mm_position to compute mrope positions for Qwen2.5-Omni (#32772) · a698e8e7
Itay Etelis authored Jan 25, 2026
```
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
```
a698e8e7
[BugFix] Add env variable to control PDL in LoRA (#32836) · 73b24346
Jee Jee Li authored Jan 25, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
73b24346

[Bugfix] fix encoder cache hang in Qwen3VL (#32684) · 7e67df55

JJJYmmm authored Jan 25, 2026


Signed-off-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

7e67df55

[Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
fcb9df99

24 Jan, 2026 5 commits

[Feature] add session based streaming input support to v1 (#28973) · 91601ff4

Joshua Deng authored Jan 24, 2026


Signed-off-by: Joshua Deng <joshuakdeng@gmail.com>
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

91601ff4

Using max_loras + 1 to construct grid in fused_moe_lora (#32277) · d4dbb7af
yugong333 authored Jan 24, 2026
```
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
```
d4dbb7af
[MLA] Fuse cat and qaunt for fp8 kv-cache (#32950) · da5e7b12
Lucas Wilkinson authored Jan 24, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
da5e7b12

[Bugfix]: resolve torch.compile cache conflict between mm_encoder_tp_modes (#32842) · 1209b784

Hiroken. authored Jan 24, 2026


Signed-off-by: Hongjian Zhang <zhanghongjian@xiaohongshu.com>
Signed-off-by: Xingran Wang <wangxingran123456@outlook.com>
Co-authored-by: Xingran Wang <wangxingran123456@outlook.com>

1209b784

[EncoderCacheManager] Remove unnecessary copy (#32800) · 5fa0f6ef
Lukas Geiger authored Jan 24, 2026
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
5fa0f6ef