Commits · ae59e10f090599db1e3b2395f11d16a9335fba40 · OpenDAS / vllm_cscc

28 Jan, 2026 2 commits
- 修复vit attn的导入问题，以及w4a16的gptq的接口问题 · ae59e10f
  zhuwenwen authored Jan 28, 2026
  
  ae59e10f
- 修复了awq的shape的bug，以及兼容了lmslim注册导入的的情况 · 2d8b3257
  zhuwenwen authored Jan 28, 2026
  
  2d8b3257
27 Jan, 2026 10 commits

Roger Wang authored Jan 26, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: wanglinian <wanglinian@stu.pku.edu.cn>
Co-authored-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b539f988

[code clean] remove duplicate code (#33135) · b781eeaa
Ning Xie authored Jan 27, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
b781eeaa
[Frontend] Cleanup serving engine (#33103) · e0b005d9
Cyrus Leung authored Jan 27, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
e0b005d9
[torch.compile] Stop assuming 32 bit indexing (#33113) · 3b8f0fe5
Richard Zou authored Jan 26, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
3b8f0fe5
[Frontend] Reduce mixin usage in serving pooling (#33101) · c831911b
Cyrus Leung authored Jan 27, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
c831911b
[Perf] avoid duplicate mem_get_info() call in get_current_memory_usage (#33064) · 157caf51
Paco Xu authored Jan 27, 2026
```
Signed-off-by: Paco Xu <paco.xu@daocloud.io>
```
157caf51
Fix IndexError with encoder-decoder models when using Custom Paged Attention (#33112) · c568581f
Strahinja Stamenkovic authored Jan 27, 2026
```
Signed-off-by: sstamenk <strahinja.stamenkovic@amd.com>
```
c568581f

fix: preserve native tool call ID in multi-turn tool calling (#32768) · 2d705343

wangln19 authored Jan 27, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <2037008807@qq.com>

2d705343

[MoE Refactor] Integrate Naive Prepare Finalize into MK (#32567) · 5a93b916

Robert Shaw authored Jan 26, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: amirkl94 <203507526+amirkl94@users.noreply.github.com>

5a93b916

[Model Runner V2] Remove UvaBufferPool for cpu->gpu copy (#33055) · 6d86fde0

Woosuk Kwon authored Jan 26, 2026


Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Nick Hill <nhill@redhat.com>

6d86fde0

26 Jan, 2026 28 commits

[Bugfix][TPU] Return a Default fp8 MoE Backend (#32908) · 510ed1e8

XiongfeiWei authored Jan 26, 2026


Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

510ed1e8

[Bugfix][MXFP4] Call `trtllm_fp4_block_scale_moe` with kwargs (#33104) · 8caffd92
Pengchao Wang authored Jan 26, 2026
```
Signed-off-by: Pengchao Wang <wpc@fb.com>
```
8caffd92
[fix] CPUDNNLGEMMHandler pointer baked into inductor artifact (#32913) · 58a05b0c
dolpm authored Jan 26, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
58a05b0c

[Logging] add `--disable-access-log-for-endpoints` CLI option (#30011) · 6ee7f18f

Jared Wen authored Jan 27, 2026



Add a new CLI option --disable-access-log-for-endpoints to suppress
uvicorn access logs for specified endpoints (e.g., /health, /metrics, /ping).

This addresses the need to reduce log noise in production environments
where health check endpoints are frequently polled by load balancers or
monitoring systems, generating excessive log entries that obscure
meaningful request logs.

Fixes #29982
Signed-off-by: JaredforReal <w13431838023@gmail.com>

6ee7f18f

[Refactor] Remove unused `_moe_permute` function (#33108) · 8f987883
Wentao Ye authored Jan 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
8f987883

[Bugfix] Fix Dtypes for Pynccl Wrapper (#33030) · cf1167e5

Robert Shaw authored Jan 26, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
(cherry picked from commit 43a013c3)

cf1167e5

[Bugfix] Fix Dtypes for Pynccl Wrapper (#33030) · 43a013c3

Robert Shaw authored Jan 26, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

43a013c3

[Model] Bump transformers version for test registry (#33100) · c25dbee4
Cyrus Leung authored Jan 27, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
c25dbee4
[Bugfix] Fix Voxtral streaming slot_mapping (#33073) · 19ab0f7c
Nicolò Lucchesi authored Jan 26, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
19ab0f7c

[FIX] Always support TP > 4 for FP4 Gemm (#31099) · 67fe677c

danielafrimi authored Jan 26, 2026


Signed-off-by: dafrimi <dafrimi@nvidia.com>
Co-authored-by: root <root@gpu-51.slurm-workers-slurm.slurm.svc.cluster.local>

67fe677c

Remove unused logic in `models/mistral.py` (#33095) · d56afd45
Andy Lo authored Jan 26, 2026
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
d56afd45
[ROCm][Bugfix] Fix ptpc scale load issue for fused shared expert path in deepseek mtp (#33018) · be6931ee
Pleaplusone authored Jan 26, 2026
```
Signed-off-by: ganyi <ygan@amd.com>
```
be6931ee
[Bugfix] Fix Can't instantiate abstract class DeepseekV32IndexerBackend (#33052) · 9ef3b718
Chauncey authored Jan 26, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
9ef3b718

[GLM-OCR] GLM-OCR with MTP Support (#33005) · bb17e8f1

Yuxuan Zhang authored Jan 26, 2026


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

bb17e8f1

[Chore] Update type annotation of `input_ids` in model forward (#33063) · dcd80206
Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
dcd80206

[Performance] Tune Mamba selective scan kernel for B200 (#32873) · f4a0921c

danisereb authored Jan 26, 2026


Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

f4a0921c

[Feature] Add LoRA support for Gemma3 vision components (#32764) · 208c5625
VihaanThat authored Jan 26, 2026

208c5625
[Misc] HF Hub LoRA Resolver (#20320) · 9ac818a5
Alex Brooks authored Jan 26, 2026
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
9ac818a5
[Model] Use mm_position to compute mrope positions for Qwen3-Omni (#33010) · 6ca2c91b
Itay Etelis authored Jan 26, 2026
```
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
```
6ca2c91b

[lora/moe] Improve fused MoE‑LoRA kernel indexing and memory access (#32770) · e33192b2

cwazai authored Jan 26, 2026


Signed-off-by: 陈建华 <1647430658@qq.com>
Signed-off-by: Yanwen Lin <lyw1124278064@gmail.com>
Signed-off-by: kimheesu <wlskaka4@gmail.com>
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: ganyi <ygan@amd.com>
Signed-off-by: whx-sjtu <2952154980@qq.com>
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: Ifta Khairul Alam Adil <ikaadil007@gmail.com>
Signed-off-by: Ifta khairul Alam Adil <25082512+ikaadil@users.noreply.gith...

e33192b2

[Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955) · 11b55687
Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
11b55687

Set splitk=1 for fused-moe-lora expand kernel (#32882) · ee484b3f

Danielle Robinson authored Jan 25, 2026


Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

ee484b3f

[Model Runner V2] Add LoRAState to consolidate lora logic (#33062) · a9b53dd4
Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
a9b53dd4

[StepVL] support close img patch (#32923) · 105d1045

ltd0924 authored Jan 26, 2026


Signed-off-by: luotingdan <luotingdan@stepfun.com>
Signed-off-by: ltd0924 <32387785+ltd0924@users.noreply.github.com>
Co-authored-by: luotingdan <luotingdan@stepfun.com>

105d1045

[CI] Fix MHA attention test failure (AttributeError when model_config is None... · 566cdb6c

Lucas Wilkinson authored Jan 25, 2026


[CI] Fix MHA attention test failure (AttributeError when model_config is None in ViT attention backend) (#33033)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

566cdb6c

[Model Runner V2] Minor simplification for finish_requests (#33048) · 2f0d3ba7
Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
2f0d3ba7
[Model Runner V2] Fix slot_mapping after #25954 (#33046) · edf927bc
Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
```
edf927bc
[Bugfix][VLM] Fix transformers backend embed_multimodal for Qwen2.5-VL profiling (#32969) · 22aeb430
Andreas Karatzas authored Jan 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
22aeb430