Commits · a332b84578cdc0706e040f6a765954c8a289904f · OpenDAS / vllm_cscc

01 Oct, 2025 3 commits

[CI] Only capture a single CUDA graph size in CI by default (#25951) · a332b845
Harry Mellor authored Oct 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a332b845

Update to Transformers `v4.56.2` (#24638) · 2a69ab48

Harry Mellor authored Oct 01, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

2a69ab48

[Model] MTP fallback to eager for DeepSeek v32 (#25982) · 001e50c9
Lucia Fang authored Sep 30, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
001e50c9

30 Sep, 2025 10 commits

[gpt-oss] use vLLM instead of openai types for streaming (#25186) · 5db1870b

Andrew Xia authored Sep 30, 2025


Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>

5db1870b

Add explicit pooling classes for the Transformers backend (#25322) · a388252a

Harry Mellor authored Sep 30, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a388252a

[V1] [P/D] Add Support for KV Load Failure Recovery (#19330) · 9a9f48df
David Ben-David authored Oct 01, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
9a9f48df
[Doc] Improve MM Pooling model documentation (#25966) · 2f652e6c
Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
2f652e6c

[CI] Move applicable tests to CPU (#24080) · bc546f76

Reza Barazesh authored Sep 30, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

bc546f76

[NIXL] Add support for MLA caches with different latent dim (#25902) · 80608ba5

Nicolò Lucchesi authored Sep 30, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

80608ba5

[Model] Move `vision_feature_select_strategy` into `resolve_visual_encoder_outputs` (#25938) · d7e34b42
Cyrus Leung authored Sep 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d7e34b42

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

[Bugfix]: Clean up chunked prefill logging when using whisper (#25075) · e23cacda
Simon Danielsson authored Sep 30, 2025
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
```
e23cacda
Test Prompt Embeds/LoRA compatibility and Enable LoRA Support for OPT Models (#25717) · 78a47f87
Andrew Sansom authored Sep 29, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
78a47f87

29 Sep, 2025 6 commits
- [V0 Deprecation] Remove `vllm.worker` and update according imports (#25901) · 6a113d9a
  Aaron Pham authored Sep 29, 2025
  
  6a113d9a
- [BugFix][torch.compile] KV scale calculation issues with FP8 quantization (#25513) · c42ff4f4
  Adrian Abeyta authored Sep 29, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
  c42ff4f4
- [Model] Remove MotifForCausalLM (#25866) · e61eb5e0
  Jee Jee Li authored Sep 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  e61eb5e0
- [Bugfix][Speculative Decoding] Fix Eagle3 quantization config issue (#25883) · 145ac733
  Rahul Tuli authored Sep 29, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  145ac733
- [Nixl][P/D] Add cuda2cpu support (HD->DH transfer) (#24690) · d0d138bc
  Chenxi Yang authored Sep 29, 2025
```
Signed-off-by: Chenxi Yang <cxyang@fb.com>
Co-authored-by: Chenxi Yang <cxyang@fb.com>
```
  d0d138bc
- [XPU]Fix xpu spec decoding UTs, avoid using cuda graph (#25847) · 143844fa
  Kunshang Ji authored Sep 29, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  143844fa
28 Sep, 2025 1 commit
- Update GLM-4.5 Doc transformers version (#25830) · b1ded114
  Yuxuan Zhang authored Sep 28, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  b1ded114
27 Sep, 2025 8 commits

[Core] GC Debug callback (#24829) · c216119d

Jialin Ouyang authored Sep 27, 2025


Signed-off-by: Jialin Ouyang <jialino@meta.com>
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Co-authored-by: Jialin Ouyang <jialino@meta.com>

c216119d

Fix GPTQ model loading in Transformers backend (#25770) · ec152c87

Harry Mellor authored Sep 27, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

ec152c87

Add filtering for chat template kwargs (#25794) · 7977e502

Russell Bryant authored Sep 27, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

7977e502

[CI/Build] Reorganize root-level V1 tests (#25767) · cd87bfbf
Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
cd87bfbf
[CI/Build] Consolidate model loader tests and requirements (#25765) · d346ec69
Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d346ec69

[Multimodal][Speculative Decoding]Eagle Eagle3 mm support, enablement on qwen2.5vl (#22872) · f1d53d15

WeiQing Chen authored Sep 27, 2025


Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>

f1d53d15

Add option to restrict media domains (#25783) · 3958b96b

Russell Bryant authored Sep 26, 2025


Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>

3958b96b

[Spec decode] automatically disable mm for text-only draft models (#25667) · 6f5c0931
Jonas M. Kübler authored Sep 27, 2025
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
6f5c0931

26 Sep, 2025 12 commits

Kernel-override Determinism [1/n] (#25603) · dc48ba0c
Bram Wasti authored Sep 26, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
dc48ba0c
[spec decode] Consolidate speculative decode method name for MTP (#25232) · c70ac4b8
qizixi authored Sep 26, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
```
c70ac4b8

[V1] address post issues related to #20059 (part 1) (#23046) · f075693d

fhl2000 authored Sep 27, 2025


Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

f075693d

[CI] Add E2E Blackwell Quantized MoE Test (#25723) · f708bd49
Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
f708bd49

[Bugfix] Improve GLM4 MoE Reasoning Parser's is_reasoning_end Condition (#25355) · 11aafd98

Frank Wang authored Sep 26, 2025

Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Signed-off-by: Frank Wang <41319051+frankwang28@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

11aafd98

[Misc] fix unique_filepath (#25732) · 56aafa8c

Jiangyun Zhu authored Sep 27, 2025


Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

56aafa8c

[ray][metrics] Replace ':' with '_' for OpenTelemetry compatibility in Ray (#25439) · 8d52f2b3

Seiji Eicher authored Sep 26, 2025

Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Signed-off-by: Seiji Eicher <58963096+eicherseiji@users.noreply.github.com>
Co-authored-by: Rui Qiao <161574667+ruisearch42@users.noreply.github.com>

8d52f2b3

[CI/Build] Fix some V1 tests not being run (#25569) · db1e42f6
Cyrus Leung authored Sep 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
db1e42f6
[CI/Build] Split up Distributed Tests (#25572) · bc9d7b55
Cyrus Leung authored Sep 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
bc9d7b55

[Bugfix] Properly abort pooling request. (#25734) · fe6b19c3

wang.yuqi authored Sep 26, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

fe6b19c3

[CI] Fix test_shared_storage_connector_hashes (#25748) · 2827b3f4
Chauncey authored Sep 26, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
2827b3f4

[Model] Mamba2 varlen refactor (#21467) · 2b6b1d78

Chih-Chieh Yang authored Sep 26, 2025


Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
Co-authored-by: RishiAstra <40644327+RishiAstra@users.noreply.github.com>

2b6b1d78