Commits · 0885aa25646d55d270b6a518d36861de2bec90d1 · OpenDAS / vllm_cscc

18 Apr, 2026 1 commit
- [feature][Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity #38479 · 0885aa25
  wanglong3 authored Apr 18, 2026
  
  0885aa25
16 Apr, 2026 1 commit
- [BUGFIX]修复deepgemm算子导致的GLM5 W8A8精度问题。 · 6efaf21a
  chenhw5 authored Apr 14, 2026
  
  6efaf21a
02 Mar, 2026 1 commit
- [Model] GLM adaptation · afe3ea1e
  zhuwenwen authored Mar 02, 2026
  
  afe3ea1e
16 Feb, 2026 2 commits
- Fix sampler.cu cub · 8ecffc73
  Rayyyyy authored Feb 16, 2026
  
  8ecffc73
- Add qwen3_5 · 843c1822
  Rayyyyy authored Feb 16, 2026
  
  843c1822
05 Feb, 2026 1 commit
- sync v0.15.1(tests) · 78c1f9e5
  zhuwenwen authored Feb 05, 2026
  
  78c1f9e5
04 Feb, 2026 1 commit
- [BugFix][Spec Decoding] Fix negative accepted tokens metric crash (#33729) · 1892993b
  Nick Hill authored Feb 03, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  1892993b
03 Feb, 2026 1 commit
- [torch.compile] Speed up MOE handling in forward_context (#33184) · 611b1875
  Richard Zou authored Jan 27, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
(cherry picked from commit d9aa39a3)
```
  611b1875
02 Feb, 2026 6 commits

[Fix] prefix cache hit rate == 0 bug with gpt-oss style models (#33524) · f0d00586
Yifan Qiao authored Feb 01, 2026
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
(cherry picked from commit a01ef3fa)
```
f0d00586

[Nightly CI] Remove CT Model (#33530) · 94cbe0a3

Robert Shaw authored Feb 01, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
(cherry picked from commit 318b1207)

94cbe0a3

[Models] Step-3.5-Flash (#33523) · 8b45c58f

csy0225 authored Feb 02, 2026


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: i-zhangmingming <i-zhangmingming@stepfun.com>
Co-authored-by: xiewuxun <xiewuxun@stepfun.com>
Co-authored-by: zetaohong <i-hongzetao@stepfun.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
(cherry picked from commit c3b40dc3)

8b45c58f

[fix][torch.compile] Fix cold-start compilation time increase by adding kv... · 29152683

Luka Govedič authored Jan 31, 2026


[fix][torch.compile] Fix cold-start compilation time increase by adding kv cache update to splitting ops (#33441)
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Richard Zou <zou3519@gmail.com>
(cherry picked from commit 15f40b20)

29152683

[Bugfix][ROCm] Fixing the skinny gemm dispatch logic from #32831 (#33366) · 5f45b0b7
Gregory Shtrasberg authored Jan 30, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
(cherry picked from commit 31aedfe7)
```
5f45b0b7

[Bugfix] Fix Qwen3-VL-Reranker load. (#33298) · 1ed963d4

wang.yuqi authored Jan 29, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
(cherry picked from commit abb34ac4)

1ed963d4

28 Jan, 2026 3 commits

Revert "Enable Cross layers KV cache layout at NIXL Connector (#30207)" (#33241) · fe18ce4d

Or Ozeri authored Jan 28, 2026


Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
(cherry picked from commit 2e8de867)

fe18ce4d

[Models] Kimi-K2.5 (#33131) · 5042815a

Roger Wang authored Jan 26, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: wanglinian <wanglinian@stu.pku.edu.cn>
Co-authored-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
(cherry picked from commit b539f988)

5042815a

[CI] Fix AssertionError: MCP tool call not found in output_messages (#33093) · afb390ab
Chauncey authored Jan 26, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
(cherry picked from commit a2393ed4)
```
afb390ab

27 Jan, 2026 4 commits

[Models] Kimi-K2.5 (#33131) · b539f988

Roger Wang authored Jan 26, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: wanglinian <wanglinian@stu.pku.edu.cn>
Co-authored-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b539f988

[CI][Pooling] Stabilize ModernBERT test (#32909) · 6c006457
Andreas Karatzas authored Jan 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
6c006457

fix: preserve native tool call ID in multi-turn tool calling (#32768) · 2d705343

wangln19 authored Jan 27, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <2037008807@qq.com>

2d705343

[MoE Refactor] Integrate Naive Prepare Finalize into MK (#32567) · 5a93b916

Robert Shaw authored Jan 26, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: amirkl94 <203507526+amirkl94@users.noreply.github.com>

5a93b916

26 Jan, 2026 8 commits

[Logging] add `--disable-access-log-for-endpoints` CLI option (#30011) · 6ee7f18f

Jared Wen authored Jan 27, 2026



Add a new CLI option --disable-access-log-for-endpoints to suppress
uvicorn access logs for specified endpoints (e.g., /health, /metrics, /ping).

This addresses the need to reduce log noise in production environments
where health check endpoints are frequently polled by load balancers or
monitoring systems, generating excessive log entries that obscure
meaningful request logs.

Fixes #29982
Signed-off-by: JaredforReal <w13431838023@gmail.com>

6ee7f18f

[Model] Bump transformers version for test registry (#33100) · c25dbee4
Cyrus Leung authored Jan 27, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
c25dbee4
[CI] Fix AssertionError: MCP tool call not found in output_messages (#33093) · a2393ed4
Chauncey authored Jan 26, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
a2393ed4

[GLM-OCR] GLM-OCR with MTP Support (#33005) · bb17e8f1

Yuxuan Zhang authored Jan 26, 2026


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

bb17e8f1

[Chore] Update type annotation of `input_ids` in model forward (#33063) · dcd80206
Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
dcd80206
[Misc] HF Hub LoRA Resolver (#20320) · 9ac818a5
Alex Brooks authored Jan 26, 2026
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
9ac818a5
[Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955) · 11b55687
Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
11b55687

[Tests] Remove Duplicates (#33032) · 254db42e

Robert Shaw authored Jan 26, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

254db42e

25 Jan, 2026 2 commits

[Bugfix] fix encoder cache hang in Qwen3VL (#32684) · 7e67df55

JJJYmmm authored Jan 25, 2026


Signed-off-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

7e67df55

[Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
fcb9df99

24 Jan, 2026 5 commits

[Feature] add session based streaming input support to v1 (#28973) · 91601ff4

Joshua Deng authored Jan 24, 2026


Signed-off-by: Joshua Deng <joshuakdeng@gmail.com>
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

91601ff4

[Tests] Replace flaky sleep with polling in test_background_cancel (#32986) · cd775bdb
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
cd775bdb
[Tests] Standardize RNG seed utility across test files (#32982) · 0ccecf88
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
0ccecf88
[Tests] Clarify pytest skip reasons with actionable context (#32981) · 0b9a735e
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
0b9a735e

[Performance] Split FlashAttn attention and cache update (#25954) · a28b94e6

ElizaWszola authored Jan 24, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a28b94e6

23 Jan, 2026 4 commits
- [fix] add VLLM_OBJECT_STORAGE_SHM_BUFFER_NAME to compile factors (#32912) · 0118cdcc
  dolpm authored Jan 23, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  0118cdcc
- [Refactor] Rename `gptq_marlin` to `marlin` to match MoE (#32952) · 4561f139
  Michael Goin authored Jan 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4561f139
- [cudagraphs] Refactor cudagraph capture loop (#32946) · 3a414595
  Lucas Wilkinson authored Jan 23, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3a414595
- [V1][Hybrid] Mamba Prefix Caching with align mode (#30877) · 5206e5e2
  Harry Huang authored Jan 24, 2026
```
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  5206e5e2