Commits · 3ae082c373a864ec421d7e9118906f3b7add2bf5 · OpenDAS / vllm_cscc

22 Oct, 2025 10 commits

[Chore] Separate out optional dependency checks from vllm.utils (#27207) · 3ae082c3

dongbo910220 authored Oct 22, 2025

Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3ae082c3

[Core] Handle MoE LoRA edge cases (#27335) · abf3db40
Jee Jee Li authored Oct 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
abf3db40
Bugfix - pass 'max_num_tokens_padded' into 'moe_lora_align_block_size' (#27311) · 8e4ca4d1
gnovack authored Oct 22, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
8e4ca4d1
[Log] Add Warning for `LLM(data_parallel_size=k)` single-process DP Usage (#27282) · 1a0f4def
Wentao Ye authored Oct 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1a0f4def
[Bugfix][CPU] Disable dual stream execution for experts on CPU (#27320) · 843af7f7
Li, Jiang authored Oct 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
843af7f7

[Frontend][3/N] Improve all pooling task | Support binary embedding response (#27066) · 1f633b86

wang.yuqi authored Oct 22, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1f633b86

fixed reasoning streaming with tool_choice="required" (#24108) · a4c29e6e

ExtReMLapin authored Oct 22, 2025

Signed-off-by: CNE Pierre FICHEPOIL <pierre-1.fichepoil@gendarmerie.interieur.gouv.fr>
Signed-off-by: ExtReMLapin <3909752+ExtReMLapin@users.noreply.github.com>
Co-authored-by: CNE Pierre FICHEPOIL <pierre-1.fichepoil@gendarmerie.interieur.gouv.fr>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

a4c29e6e

[1/N][Platform] Cleanup useless function (#26982) · f6027b28
wangxiyuan authored Oct 22, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
f6027b28
[torch.compile] Enable silu_mul_fp8_quant fusion without custom ops enabled (#27146) · ab3e8004
Jiangyun Zhu authored Oct 22, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
ab3e8004
[Benchmark] Add plot utility for parameter sweep (#27168) · ceacedc1
Cyrus Leung authored Oct 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
ceacedc1

21 Oct, 2025 25 commits

[Deepseek v3.2] Remove extra logics in indexer (#26465) · 09a7e6f6

Lain authored Oct 21, 2025


Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Signed-off-by: Lain <siyuanf@nvidia.com>
Co-authored-by: Daniel Campora <961215+dcampora@users.noreply.github.com>

09a7e6f6

[P/D] KVConnector for decode benchmarking (#25986) · 6c2eef5a

Tyler Michael Smith authored Oct 21, 2025


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>

6c2eef5a

[Bugfix] skip cuda graph for drafter when running with eager (#26821) · 19748806
Benjamin Chislett authored Oct 21, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
19748806

Updated xgrammar backend to not deny supported string formats (#27253) · 4a8a567e

ExtReMLapin authored Oct 22, 2025

4a8a567e

[Performance] Dual stream execution of "shared_experts" and "selected_experts"... · 344a0017

Alexander Matveev authored Oct 21, 2025


[Performance] Dual stream execution of "shared_experts" and "selected_experts" inside FusedMoE (#26440)
Signed-off-by: Alexander Matveev <amatveev@redhat.com>

344a0017

[Bugfix] fixes the decoding metadata of dense mla's fp8 kvcache. (#27144) · 250fb1b8

Tao He authored Oct 22, 2025


Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>

250fb1b8

[V0 Deprecation] Remove V0 executors (#27142) · 647214f3
Nick Hill authored Oct 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
647214f3
[Bugfix][P/D] Reduce num_threads used by nixl ucx backend (#27196) · ddeec11b
David Whyte-Gray authored Oct 21, 2025
```
Signed-off-by: David Whyte-Gray <40244437+dagrayvid@users.noreply.github.com>
```
ddeec11b
[Feature] Batch Invariant for R1 TP 8 on Blackwell (#27229) · 86ed7702
Wentao Ye authored Oct 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
86ed7702
[ROCM] Enable CompressedTensorsWNA16 (#27187) · ba09652d
JartX authored Oct 21, 2025
```
Signed-off-by: JartX <sagformas@epdcenter.es>
```
ba09652d
[Chore] Separate out NCCL utilities from vllm.utils (#27197) · 6c728f77
dongbo910220 authored Oct 21, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
6c728f77
[Deepseek v3.2] Optimize top_k_per_row (#26763) · 80e94529
Daniel Cámpora authored Oct 21, 2025
```
Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
```
80e94529
[MM][Core] Decouple ViT backend from LM backend (#27061) · c3a2c6ac
Roger Wang authored Oct 21, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
c3a2c6ac
[Nixl] Minor refactor to handshake related metadata (#26410) · 72f431e7
Nicolò Lucchesi authored Oct 21, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
72f431e7
[Fix][Spec Decode] Fix llama4 draft loading with different quantization (#27136) · be444507
Zebing Lin authored Oct 21, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
be444507
[Bugfix] Fix broken MTP weight loading for FP8 KV Scales (#27227) · f381cf23
Benjamin Chislett authored Oct 21, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
f381cf23

[Bugfix] Fix gpt-oss w4a8 DP/EP on B200 (#26729) · 5ff5d94e

Varun Sundar Rabindranath authored Oct 21, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

5ff5d94e

[ModelOpt] Load w13/w2_input_scale for all experts, nvfp4 (#26135) · f95da13c

Shu Wang authored Oct 21, 2025


Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

f95da13c

[BugFix] GPT-OSS Attention DP + MoE TP weight loading issue (#24032) · aef368aa
Po-Han Huang (NVIDIA) authored Oct 21, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
aef368aa

[Feature][Kernel]FusedMoE LoRA (#21229) · 5f6cbf60

Chen Wu authored Oct 21, 2025


Signed-off-by: wuchen <cntryroa@gmail.com>
Signed-off-by: banjuede <lmklhc@163.com>
Signed-off-by: Chen Wu <cntryroa@gmail.com>
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: wuchen <wuchen@zetyun.com>
Co-authored-by: Nathan Van Gheem <vangheem@gmail.com>
Co-authored-by: banjuede <lmklhc@163.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>

5f6cbf60

[Frontend] Enforce tokenize=False when applying chat template (#27205) · 3ada34f9
Russell Bryant authored Oct 20, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
3ada34f9
create is_in_the_same_node on cpu (#26832) · 0eb8f2b8
Lunwen He authored Oct 20, 2025
```
Co-authored-by: Lunwen He <lunwenh@meta.com>
```
0eb8f2b8
[cpu] Dispatch un-quantized linear to oneDNN/ACL by default for AArch64 (#27183) · 163965d1
Fadi Arafeh authored Oct 21, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Michael Yang <Michael.Yang@arm.com>
```
163965d1
[V0 Deprecation] Remove V0 metrics code (#27215) · a03cf9bc
Nick Hill authored Oct 20, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
a03cf9bc
[Quantization] Automatically infer AWQ `modules_to_not_convert` field (#26909) · 352c0c8a
Isotr0py authored Oct 21, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
352c0c8a

20 Oct, 2025 5 commits

[Feature][Quantization] auto_round support for mixed bits quantization (#23812) · 87778d5f

Heng Guo authored Oct 21, 2025

Signed-off-by: n1ck-guo <heng.guo@intel.com>
Signed-off-by: Heng Guo <heng.guo@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

87778d5f

[Kernel][Model] Tune fused_moe Triton configs for Qwen3-30B A3/A3B on H100 (FP8/BF16) (#26268) · 4d0f2661
shivampr authored Oct 20, 2025
```
Signed-off-by: Shivam <shivampr.dev@gmail.com>
```
4d0f2661

Nemotron Nano V2 VL + EVS Video Support (#27107) · e93ff6c8

Eugene Khvedchenya authored Oct 20, 2025


Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Natan Bagrov <nbagrov@nvidia.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Natan Bagrov <nbagrov@nvidia.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

e93ff6c8

[Kernel] Accelerate solve_tril with TMA (#26746) · 9fce7bee
Jiangyun Zhu authored Oct 20, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
9fce7bee

[LoRA] LoRA cuda graph specialization (#25914) · b63f2143

Andy Lo authored Oct 20, 2025


Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

b63f2143