Commits · 9ae6b242e8304d9ee202aec08ebc8bf69d2d2557 · OpenDAS / vllm_cscc

"lib/llm/src/vscode:/vscode.git/clone" did not exist on "4f99451bb01b765e3cc8572d867c194dd0e5845c"

01 Oct, 2025 10 commits

[BugFix] Fix default kv-cache-dtype default for DeepseekV3.2 (#25988) · e4beabd2
Lucas Wilkinson authored Oct 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
e4beabd2
[MM] Add text-only mode for Qwen3-VL (#26000) · a1825fe6
Roger Wang authored Sep 30, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
a1825fe6
[Model] MTP fallback to eager for DeepSeek v32 (#25982) · bab9231b
Lucia Fang authored Sep 30, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
bab9231b
[spec decode] Consolidate speculative decode method name for MTP (#25232) · c214d699
qizixi authored Sep 26, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
```
c214d699
[bugfix][deepseek] fix flashmla kernel selection (#25956) · 83f3c9be
youkaichao authored Oct 01, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
83f3c9be

[NIXL] Add support for MLA caches with different latent dim (#25902) · d0b178ce

Nicolò Lucchesi authored Sep 30, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

d0b178ce

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · b3230e1a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

b3230e1a

[BugFix] Fix DP/EP hang (#25906) · 03df0fb5

Lucas Wilkinson authored Sep 30, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

03df0fb5

[Bug] Fix Weight Loading for Block FP8 Cutlass SM90 (#25909) · 9471879b

Wentao Ye authored Sep 29, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

9471879b

[Bugfix] Fallback ViT attn backend to SDPA for blackwell (#25851) · ab5b6459
Roger Wang authored Sep 28, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
ab5b6459

29 Sep, 2025 2 commits

[P/D] NIXL Updates (#25844) · 8ce5d319

Robert Shaw authored Sep 29, 2025


Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

8ce5d319

[Bugfix] fix Qwen3VLMoe load when pp > 1 (#25838) · 09c2cbc0

JJJYmmm authored Sep 29, 2025


Signed-off-by: liuye.hj <liuye.hj@alibaba-inc.com>
Co-authored-by: liuye.hj <liuye.hj@alibaba-inc.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

09c2cbc0

28 Sep, 2025 10 commits

[VLM] Update Qwen3-VL max_num_video_tokens calculation for configurable video profiling (#25557) · 4c347044

Isotr0py authored Sep 28, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Signed-off-by: simon-mo <simon.mo@hey.com>

4c347044

[Bugfix] Fix Qwen3-VL regression from #24982 (#25814) · 19e7ab73
Roger Wang authored Sep 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
19e7ab73
[MM] Optimize memory profiling for scattered multimodal embeddings (#25810) · 6de3d431
Roger Wang authored Sep 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
6de3d431
[Bugfix][NIXL] Fix Async Scheduler timeout issue (#25808) · b14773bd
Nicolò Lucchesi authored Sep 27, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
b14773bd
[Bugfix][WideEP] Apply TP Attn + EP MoE fix to other models (#24982) · 26a7a33b
Tyler Michael Smith authored Sep 27, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
26a7a33b
[Bugfix] Allow Only SDPA Backend for ViT on B200 for Qwen3-VL (#25788) · c2fa2d4d
Wentao Ye authored Sep 26, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
c2fa2d4d

Add option to restrict media domains (#25783) · 32335c8b

Russell Bryant authored Sep 26, 2025


Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

32335c8b

Add filtering for chat template kwargs (#25794) · 04c2b269

Russell Bryant authored Sep 27, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: simon-mo <simon.mo@hey.com>

04c2b269

Validate API tokens in constant time (#25781) · ee10d7e6

Russell Bryant authored Sep 27, 2025


Signed-off-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

ee10d7e6

Reduce the Cuda Graph memory footprint when running with DBO (#25779) · bb79c4da
Sage Moore authored Sep 26, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
bb79c4da

26 Sep, 2025 18 commits

Eagle3 that supports the Minicpm3 model (#24243) · 33f6aaf9

阿丹(adan) authored Sep 27, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: liudan <adan@minicpm.com>
Co-authored-by: liudan <liudan@qq.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>

33f6aaf9

[Misc] fix unique_filepath (#25732) · 56aafa8c

Jiangyun Zhu authored Sep 27, 2025


Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

56aafa8c

[ray][metrics] Replace ':' with '_' for OpenTelemetry compatibility in Ray (#25439) · 8d52f2b3

Seiji Eicher authored Sep 26, 2025

Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Signed-off-by: Seiji Eicher <58963096+eicherseiji@users.noreply.github.com>
Co-authored-by: Rui Qiao <161574667+ruisearch42@users.noreply.github.com>

8d52f2b3

[BugFix] Fix using `dbo_decode_token_threshold` always (and ignoring... · 984d1849

Lucas Wilkinson authored Sep 26, 2025


[BugFix] Fix using `dbo_decode_token_threshold` always (and ignoring `dbo_prefill_token_threshold`) (#25622)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

984d1849

[Quantization] Add field to skip unquantized modules for GPTQ config (#25455) · d4d98998
Isotr0py authored Sep 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
d4d98998

[Bugfix] Properly abort pooling request. (#25734) · fe6b19c3

wang.yuqi authored Sep 26, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

fe6b19c3

[Model] Mamba2 varlen refactor (#21467) · 2b6b1d78

Chih-Chieh Yang authored Sep 26, 2025


Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
Co-authored-by: RishiAstra <40644327+RishiAstra@users.noreply.github.com>

2b6b1d78

Support LongCat-Flash-Chat tool call (#24083) · b03b1b97
Xu Wenqing authored Sep 26, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
b03b1b97

[Bugfix] Fix Shared Expert/Zero expert code in FusedMoE.process_chunk (#25698) · dfb9af20

Sage Moore authored Sep 26, 2025


Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

dfb9af20

[misc] refactor speculative config (#25657) · 19f76ee6
yyzxw authored Sep 26, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
```
19f76ee6
Remove cuda hard-code in compute_causal_conv1d_metadata (#25555) · dd70437a
Icey authored Sep 26, 2025
```
Signed-off-by: Icey <1790571317@qq.com>
```
dd70437a

[Qwen3-Next][GDN] fixes cuda graph capturing bug in GDN metadata and a stride... · 99b3a504

Tao He authored Sep 26, 2025


[Qwen3-Next][GDN] fixes cuda graph capturing bug in GDN metadata and a stride bug in causal_conv_1d. (#25743)
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>

99b3a504

[Harware][AMD][Model] Triton MoE tuning configs for GLM-4.5 for MI300X (#25703) · 52621c8f
xaguilar-amd authored Sep 26, 2025
```
Signed-off-by: xaguilar <Xavier.AguilarFruto@amd.com>
```
52621c8f
perf: Avoid copying inputs_embeds tensors to GPU unless prompt_embeds is enabled (#25739) · d48f4d6d
Andrew Sansom authored Sep 26, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
d48f4d6d

fix: revert cast to cpu in `MsgpackEncoder._encode_tensor` to avoid hidden... · e84e0735

Andrew Sansom authored Sep 26, 2025


fix: revert cast to cpu in `MsgpackEncoder._encode_tensor` to avoid hidden performance regressions (#25738)
Signed-off-by: Andrew Sansom <andrew@protopia.ai>

e84e0735

[CI/Build] fix doc build warning: Failed to get 'name: description' pair (#25733) · 3edf87d2
yitingdc authored Sep 26, 2025
```
Signed-off-by: yiting.jiang <yiting.jiang@daocloud.io>
```
3edf87d2

EVS Support (Video tokens pruning) (#22980) · 392edee3

Eugene Khvedchenya authored Sep 26, 2025


Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Eugene Khvedchenya <ekhvedchenya@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

392edee3

[Misc] Remove unnecessary memoryviews in shm_broadcast.py (#25721) · 983056e4
Nick Hill authored Sep 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
983056e4