Commits · 4197168ea5877de51dc8aede9388c9be9ecc76ac · OpenDAS / vllm_cscc

28 Jan, 2026 15 commits

[ez] Remove checks for torch version <= 2.8 (#33209) · 4197168e
Angela Yi authored Jan 28, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
4197168e
Use aiter triton fused_add_rmsnorm_pad for gpt-oss (#30976) · 59bcc5b6
Rohan Potdar authored Jan 28, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
59bcc5b6

[Feature] Fully support for async scheduling + PP, 30.8% E2E throughput... · 3e440786

Wentao Ye authored Jan 28, 2026


[Feature] Fully support for async scheduling + PP, 30.8% E2E throughput improvement, 31.8% TPOT improvement (#32618)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

3e440786

[lora/moe] Avoid extra intermediate buffer & Python slicing in expand phase... · f210f0b7

cwazai authored Jan 29, 2026


[lora/moe] Avoid extra intermediate buffer & Python slicing in expand phase when split_k == 1 (#32774)
Signed-off-by: 陈建华 <1647430658@qq.com>

f210f0b7

[Quantization][Deprecation] Remove Marlin 24 (#32688) · af9b69f9

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

af9b69f9

[Misc] Provide a DeepSeek ReasoningParser with thinking enabled by default (#33221) · 8e5e40da
Chauncey authored Jan 28, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
8e5e40da
Revert "Enable Cross layers KV cache layout at NIXL Connector (#30207)" (#33241) · 2e8de867
Or Ozeri authored Jan 28, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
```
2e8de867

[Quantization][Deprecation] Remove BitBlas (#32683) · 247d1a32

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

247d1a32

[CI] Enable mypy import following for `vllm/compilation` (#33199) · f1acbd68
Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
f1acbd68
[ROCm] Enabling forward_includes_kv_cache on ROCm MHA backends (#33106) · 22ad6495
Gregory Shtrasberg authored Jan 28, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
22ad6495

Adds FunAudioChat multimodal audio model support (#2) (#33058) · 36d450e3

ramos authored Jan 28, 2026


Signed-off-by: ramos <49182011+nemoramo@users.noreply.github.com>
Signed-off-by: mayufeng <mayufeng@example.com>
Co-authored-by: mayufeng <mayufeng@example.com>

36d450e3

[Bugfix] Lazy import NgramProposer in GPU model runner (#32821) · a2b877df
22quinn authored Jan 27, 2026
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
a2b877df
Don't use `min_pixels`/`max_pixels` from Qwen2VL's processor (#33208) · 35fb0b86
Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
35fb0b86
Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2eb673a0

[Model Runner V2] Use a different stream for grammar bitmask h2d copy (#33059) · 46ec6d71

Woosuk Kwon authored Jan 27, 2026


Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Nick Hill <nhill@redhat.com>

46ec6d71

27 Jan, 2026 25 commits

[torch.compile] Speed up MOE handling in forward_context (#33184) · d9aa39a3
Richard Zou authored Jan 27, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
d9aa39a3
[Perf] Optimize dcp allocate tensor (#33102) · 3a6d5cbe
Wentao Ye authored Jan 27, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
3a6d5cbe
[Bugfix] Fix display error (inconsistent with context) (#33020) · f5d7049c
linhaifeng authored Jan 28, 2026
```
Signed-off-by: linhaifeng <1371675203@qq.com>
```
f5d7049c
[Attention] Use `has_flashinfer` helper (#33177) · 1cbccb6d
Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
1cbccb6d

feature: support eagle3 for HunyuanVL & Hunyuan (#33035) · bd92089d

Iris authored Jan 28, 2026


Signed-off-by: irisliu10 <601012173@qq.com>
Signed-off-by: Iris <38269816+irisliu10@users.noreply.github.com>

bd92089d

Support compress-tensors with nvfp4 or fp8 weights and modelopt with nvfp4... · 66e601ef

IriKa authored Jan 28, 2026


Support compress-tensors with nvfp4 or fp8 weights and modelopt with nvfp4 weights on Turing (#33076)
Signed-off-by: IriKa Qiu <qiujie.jq@gmail.com>

66e601ef

[BugFix] Fix P/D with non-MoE DP (#33037) · 0cd259b2
Nick Hill authored Jan 27, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
0cd259b2

Support heterogeneous NemotronHPuzzle model (#32549) · 83fb2d09

danielafrimi authored Jan 27, 2026



Signed-off-by: <dafrimi@nvidia.com>
Signed-off-by: Daniel Afrimi <dafrimi@nvidia.com>
Signed-off-by: root <dafrimi@nvidia.com>

83fb2d09

[LoRA][Spec Decode] Support LoRA for Nemotron-H MTP models (#32265) · f3a5ee70

danisereb authored Jan 27, 2026


Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

f3a5ee70

[Frontend] Cleanup api server (#33158) · 7cbbca9a

wang.yuqi authored Jan 27, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>

7cbbca9a

[Metrics][MFU] Fix UnembedMetrics FLOP overcounting for prefill (#33045) (#33045) · 5ec44056

omkhalil authored Jan 27, 2026

Fix UnembedMetrics to correctly count FLOPs for the unembedding (LM head) layer.

The bug: UnembedMetrics used total_num_tokens() which counts all tokens in the
batch for projection flops, vocab projections are run on just the last token for the
autoregressive use case.
Co-authored-by: Omar Mohamed Khalil <omarkhalil@meta.com>

5ec44056

[Bugfix] Fix DeepseekV32 `AssertionError: num_kv_heads == 1` (#33090) · 492a7983
Nicolò Lucchesi authored Jan 27, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
492a7983
[5/N][Attention] Finish eliminating `vllm/attention` folder (#32064) · a608b4c6
Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
a608b4c6
[Bugfix] Disable CG for Whisper+FA2 (#33164) · 1f3a2c29
Nicolò Lucchesi authored Jan 27, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
1f3a2c29

[Metrics] [KVConnector] Add Offloading Connector metrics (#27942) · 7227d061

omerpaz95 authored Jan 27, 2026



Added queries and hits metrics for the Offloading Connector.

Also added timing metrics for store and load operations, which take the
average time it takes to load/store, per-token.

The metrics are available from Prometheus and from the StatLogger.
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Co-authored-by: Omer Paz <Omer.Paz@ibm.com>

7227d061

Fix weight mapping test for Transfomers v5 (#33162) · 14385c80
Harry Mellor authored Jan 27, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
14385c80

[Frontend] Frontend will only attach supported tasks corresponding entrypoints. (#33139) · 76139d08

wang.yuqi authored Jan 27, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

76139d08

[AMD][QWEN3-NEXT] FP8 Tunings (#32042) · da8d0c44
Lifan Shen authored Jan 27, 2026
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
da8d0c44

[Models] Kimi-K2.5 (#33131) · b539f988

Roger Wang authored Jan 26, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: wanglinian <wanglinian@stu.pku.edu.cn>
Co-authored-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b539f988

[code clean] remove duplicate code (#33135) · b781eeaa
Ning Xie authored Jan 27, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
b781eeaa
[Frontend] Cleanup serving engine (#33103) · e0b005d9
Cyrus Leung authored Jan 27, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
e0b005d9
[torch.compile] Stop assuming 32 bit indexing (#33113) · 3b8f0fe5
Richard Zou authored Jan 26, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
3b8f0fe5
[Frontend] Reduce mixin usage in serving pooling (#33101) · c831911b
Cyrus Leung authored Jan 27, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
c831911b
[Perf] avoid duplicate mem_get_info() call in get_current_memory_usage (#33064) · 157caf51
Paco Xu authored Jan 27, 2026
```
Signed-off-by: Paco Xu <paco.xu@daocloud.io>
```
157caf51
Fix IndexError with encoder-decoder models when using Custom Paged Attention (#33112) · c568581f
Strahinja Stamenkovic authored Jan 27, 2026
```
Signed-off-by: sstamenk <strahinja.stamenkovic@amd.com>
```
c568581f