Commits · e54ee3ea33bb8554eb6fa2eedb7007ae101197cf · OpenDAS / vllm_cscc

30 Dec, 2025 3 commits

[Core] Deduplicate generate/encode logic in `AsyncLLM` (#31510) · e54ee3ea
Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
e54ee3ea

fix: update kimi k2 tool parser logic (#31207) · 358bfd31

wangln19 authored Dec 30, 2025

Signed-off-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Signed-off-by: Wang Linian <wanglinian@stu.pku.edu.cn>
Co-authored-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

358bfd31

[Prefix Cache] Include lora_name in BlockStored event for deterministic... · 39512aba

Sage authored Dec 30, 2025


[Prefix Cache] Include lora_name in BlockStored event for deterministic KV-cache reconstruction (#27577)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
Co-authored-by: Sage <80211083+sagiahrac@users.noreply.github.com>

39512aba

29 Dec, 2025 10 commits

[CI]Test Group 'NixlConnector PD accuracy tests' is fixed (#31460) · 0f35429a
qli88 authored Dec 29, 2025
```
Signed-off-by: qli88 <qiang.li2@amd.com>
```
0f35429a

[Bugfix][ROCm] Fix Static Quant Issue (#31502) · 56f51625

Robert Shaw authored Dec 29, 2025


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

56f51625

[MoE Refactor][12/N] Marlin Fp8 MoE Pure Function (#31499) · 9152a30d
Robert Shaw authored Dec 29, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
9152a30d
[Core] Enable async scheduling by default (#27614) · c2ff33cc
Nick Hill authored Dec 29, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
c2ff33cc
implements register kv caches in lmcache connector (#31397) · b12cb383
chunxiaozheng authored Dec 30, 2025
```
Signed-off-by: idellzheng <idellzheng@tencent.com>
```
b12cb383
Optimize QKNorm for MiniMax-M2/M2.1 (#31493) · 5bc66411
Roger Young authored Dec 30, 2025
```
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
5bc66411

[Feature] Add offline FastAPI documentation support for air-gapped environments (#30184) · b3a2bdf1

RickyChen / 陳昭儒 authored Dec 30, 2025

Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

b3a2bdf1

Replace `nn.ConvNd` with vLLM's `ConvNdLayer` for Transformers modeling backend (#31498) · e37e7349
Harry Mellor authored Dec 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
e37e7349
[Bugfix] Preserve tool call id/type/name in streaming finish chunk (#31438) · 9c884faa
amittell authored Dec 29, 2025
```
Signed-off-by: amittell <mittell@me.com>
Signed-off-by: Alex Mittell <mittell@me.com>
```
9c884faa

[Bugfix][Frontend] Fix Jina reranker multimodal input compatibility (#31445) · bf73a3e4

twj authored Dec 29, 2025

Signed-off-by: tianwenjing <tianwenjing@jfgenius.com>
Signed-off-by: twj <151701930+twjww@users.noreply.github.com>
Co-authored-by: tianwenjing <tianwenjing@jfgenius.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

bf73a3e4

28 Dec, 2025 4 commits
- Add Fused MoE Triton kernels for GLM-4.5-Air, GLM-4.5v, GLM-4.6v on 2x RTX Pro 6000 (#31407) · b9793e6a
  Mamy Ratsimbazafy authored Dec 28, 2025
```
Signed-off-by: Mamy Ratsimbazafy <mamy_github@numforge.co>
```
  b9793e6a
- [Model] Add tuned triton fused_moe configs for Qwen3Moe on B200 (#31448) · 0b6b7010
  Jzz1943 authored Dec 29, 2025
```
Signed-off-by: Zhongze Jiang <jiangzhongze.jzz@ant-intl.com>
```
  0b6b7010
- [BugFix] Re-fix async multimodal cpu tensor race condition (#31373) · 094fcce2
  Nick Hill authored Dec 28, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: njhill <nickhill123@gmail.com>
```
  094fcce2
- [BugFix] register quant scale tensors as buffer (#31395) · 62def07d
  Boyuan Feng authored Dec 27, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  62def07d
27 Dec, 2025 4 commits

[MoE Refactor][10/N] Cleanup Fp8 Process Weights After Loading (#31169) · 727c41f3
Robert Shaw authored Dec 27, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
727c41f3
[BugFix] Fix cache issue in compilation_config (#31376) · 2f12cd32
Boyuan Feng authored Dec 27, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
2f12cd32

Fix/get raw stream patch #30905 (#30912) · 8711b216

baonudesifeizhai authored Dec 26, 2025

Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

8711b216

[Core][Hybrid allocator + connector] Support hybrid allocator + kv cache connector (#30166) · 52bf0665
Yifan Qiao authored Dec 26, 2025
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: KuntaiDu <kuntai@uchicago.edu>
```
52bf0665

26 Dec, 2025 7 commits

CustomOp: Unify aiter impl into GroupedTopk (#31221) · 87f1b8ca
Xinyu Chen authored Dec 27, 2025
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
87f1b8ca

[Mistral common] Ensure all functions are imported from the top & only use public methods (#31138) · 48e74497

Patrick von Platen authored Dec 26, 2025

Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

48e74497

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1

Jee Jee Li authored Dec 26, 2025


Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>

ce1eafd1

[Misc] Fix Qwen2-MoE shared_expert_gate (#31339) · c3666f56
Jee Jee Li authored Dec 26, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
c3666f56
Support LoRA and GPTQModel for PLaMo 2/3 (#31322) · 9ee05cbe
Shinichi Hemmi authored Dec 26, 2025
```
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
```
9ee05cbe
[benchmark] use model card root instead of id (#31329) · 3b8f31b3
Ning Xie authored Dec 26, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
3b8f31b3

Feature/isaac 0.1 (#28367) · b7165d53

oscardev256 authored Dec 25, 2025


Signed-off-by: oscardev256 <42308241+oscardev256@users.noreply.github.com>
Signed-off-by: Oscar Gonzalez <ogonzal6@alumni.jh.edu>
Signed-off-by: Yang <lymailforjob@gmail.com>
Co-authored-by: Yang <lymailforjob@gmail.com>

b7165d53

25 Dec, 2025 5 commits
- [BugFix] Fix async scheduling + reasoning with struct output (#31332) · 81786c87
  Nick Hill authored Dec 25, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  81786c87
- [Hybrid] Mamba2 prefix cache blocks freeing for running requests (#28047) · f1531d9f
  Stan Wozniak authored Dec 25, 2025
```
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  f1531d9f
- [Model][Ernie4.5-VL] Support video metadata for timestamp rendering (#31274) · 2d6001f4
  SongHe authored Dec 25, 2025
```
Signed-off-by: dengsonghe <dengsonghe@baidu.com>
Co-authored-by: dengsonghe <dengsonghe@baidu.com>
```
  2d6001f4
- use the same stream for cuda graph catpure and replay for NCCL (#29207) · 030fc449
  Amir Samani authored Dec 25, 2025
```
Signed-off-by: Amir Samani <asamani@nvidia.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  030fc449
- [Frontend] add FunctionGemma tool parser support (#31218) · ba25a659
  Mark Gatere authored Dec 25, 2025
```
Signed-off-by: gateremark <gateremg@gmail.com>
```
  ba25a659
24 Dec, 2025 7 commits
- [Perf] Add skip_clone to SamplingParams for internal request handling (#31041) · bc5ef333
  Michael Goin authored Dec 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bc5ef333
- [Chore][1/2] Drop `v0.14` deprecations (#31285) · 09dc7c69
  Cyrus Leung authored Dec 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dc7c69
- [Bugfix] Remove dead `block_quant_to_tensor_quant` function (#31294) · 506eb0f4
  ゆり authored Dec 25, 2025
```
Co-authored-by: yurekami <yurekami@users.noreply.github.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  506eb0f4
- [cli] complete vllm cli help message (#31226) · 5d930896
  Ning Xie authored Dec 24, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  5d930896
- [Bugfix][Hardware][AMD] Fix FP8 dtype in silu_mul quantization (#31179) · 66c98874
  Kevin McKay authored Dec 24, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  66c98874
- [Chore] Remove unused `noqa`s (#31263) · aa3868ec
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aa3868ec
- [Bugfix] Fix `max_model_len="auto"` handling (#31260) · 7adeb4bf
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7adeb4bf