Commits · 502640c3f944f8b9702989bd45f8add970b67ea0 · OpenDAS / vllm_cscc

02 Oct, 2025 12 commits

[Perf] Fix and reapply move apply w8a8 block fp8 linear to class (#25696) · 502640c3

ElizaWszola authored Oct 02, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: ElizaWszola <elizaw.9289@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

502640c3

[Mamba][KVCacheManager] Simplify kv cache manage logic for mamba + MTP (#25119) · 3d5f1c86
Chen Zhang authored Oct 02, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
3d5f1c86

EAGLE 3: Fix preamble so that measured speedup over Eagle 1 becomes 32%... · 1cab2f9c

Ekagra Ranjan authored Oct 02, 2025


EAGLE 3: Fix preamble so that measured speedup over Eagle 1 becomes 32% instead of 5% on MTBench (#25916)
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>

1cab2f9c

[Deepseek v3.2] Support indexer prefill chunking (#25999) · 1e50f1be
Chen Zhang authored Oct 02, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
1e50f1be
[Small] Prevent bypassing media domain restriction via HTTP redirects (#26035) · ad87ba92
Chenheli Hua authored Oct 02, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
ad87ba92

[BugFix] Fix FI accuracy issue when used for MLA prefill (#26063) · decf7f79

Lucas Wilkinson authored Oct 02, 2025

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

decf7f79

[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm... · d00d6529

Cyrus Leung authored Oct 03, 2025


[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm serve` command (#25967)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

d00d6529

[Qwen][ROCm] Flash Attention Rotary Embeddings (#24642) · 5e4a8223
vllmellm authored Oct 02, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
5e4a8223
[Model] Use `merge_by_field_config` for MM models (D-F) (#26076) · cc253b73
Cyrus Leung authored Oct 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
cc253b73
[Model] Use `merge_by_field_config` for MM models (A-C) (#26073) · 7d6fb905
Cyrus Leung authored Oct 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
7d6fb905
[Misc] Make handling of SamplingParams clearer in n>1 case (#26032) · 169313b9
Nick Hill authored Oct 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
169313b9
[ROCm][Bugfix] Add missing parameter to ROCm backend (#26029) · 0b018d8b
Gregory Shtrasberg authored Oct 01, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
0b018d8b

01 Oct, 2025 15 commits
- Support RL online quantization with torchao (#23014) · c3124680
  Jerry Zhang authored Oct 01, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  c3124680
- [BugFix] ChunkedLocalAttention is currently not CG compatible (#26034) · 4134312b
  Lucas Wilkinson authored Oct 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  4134312b
- [Bug] Fix Negative Cuda Memory Usage (#25683) · da554f93
  Wentao Ye authored Oct 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  da554f93
- Fix test_mamba_ssm_ssd.py due to missing _query_start_loc_to_chunk_indices_offsets (#25995) · c36f0aa3
  Huamin Li authored Oct 01, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  c36f0aa3
- [Bugfix] Apply same sampling parameters for both `n=1` and `n>1` (#26005) · 3b7c20a6
  Kenichi Maehashi authored Oct 01, 2025
```
Signed-off-by: Kenichi Maehashi <maehashi@preferred.jp>
```
  3b7c20a6
- [Benchmark] Finish documented v0.11.0 deprecation of --endpoint-type (#26007) · f9e71481
  Nathan Scott authored Oct 01, 2025
```
Signed-off-by: Nathan Scott <nathans@redhat.com>
```
  f9e71481
- [MISC] Fix misleading batch_size_capture_list when cuda_graph_sizes < 4 (#25829) · 2518230d
  billishyahao authored Oct 01, 2025
```
Signed-off-by: billishyahao <bill.he@amd.com>
Co-authored-by: Luka Govedic <ProExpertProg@users.noreply.github.com>
```
  2518230d
- [Misc] Factor out common `_apply_feature_select_strategy` (#26003) · 1405f0c7
  Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1405f0c7
- [BugFix][MM] Fix Nonetype error when video is cache in qwen2.5-omni-thinker (#26004) · 84d57342
  Wenlong Wang authored Oct 01, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  84d57342
- [Misc]allow disable pynccl (#25421) · f48b6a03
  Lucia Fang authored Sep 30, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  f48b6a03
- Update to Transformers `v4.56.2` (#24638) · 2a69ab48
  Harry Mellor authored Oct 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2a69ab48
- [BugFix] Fix default kv-cache-dtype default for DeepseekV3.2 (#25988) · 8d7da92f
  Lucas Wilkinson authored Oct 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  8d7da92f
- [MM] Add text-only mode for Qwen3-VL (#26000) · 66bca9b8
  Roger Wang authored Sep 30, 2025
  
  66bca9b8
- [Log] Optimize Log for FP8MOE (#25709) · 12449488
  Wentao Ye authored Sep 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  12449488
- [Model] MTP fallback to eager for DeepSeek v32 (#25982) · 001e50c9
  Lucia Fang authored Sep 30, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  001e50c9
30 Sep, 2025 13 commits
- [gpt-oss] use vLLM instead of openai types for streaming (#25186) · 5db1870b
  Andrew Xia authored Sep 30, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  5db1870b
- Add explicit pooling classes for the Transformers backend (#25322) · a388252a
  Harry Mellor authored Sep 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a388252a
- [V1] [P/D] Add Support for KV Load Failure Recovery (#19330) · 9a9f48df
  David Ben-David authored Oct 01, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  9a9f48df
- [Llama4] [multimodal] Fix misplaced dtype cast of `cos_sin_cache` in... · 43b752c3
  cjackal authored Oct 01, 2025
```
[Llama4] [multimodal] Fix misplaced dtype cast of `cos_sin_cache` in `Llama4VisionRotaryEmbedding` (#25889)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  43b752c3
- OffloadingConnector: Fix GPU block tracking bug (#25856) · cfd302db
  Or Ozeri authored Sep 30, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  cfd302db
- [Bug] Fix AttributeError: 'QKVParallelLinear' object has no attribute 'orig_dtype' (#25958) · e6a226ef
  Wentao Ye authored Sep 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e6a226ef
- [bugfix][deepseek] fix flashmla kernel selection (#25956) · a2e6fa7e
  youkaichao authored Oct 01, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  a2e6fa7e
- [Bugfix] Token type and position embeddings fail to be applied to `inputs_embeds` (#25922) · 9f1c4eca
  Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9f1c4eca
- [Bugfix] Fix accuracy issue of TRTLLM FP8 MOE and improve logging (#25895) · ef283548
  Pavani Majety authored Sep 30, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  ef283548
- [Bugfix][Model] Fix inference for Hunyuan dense models (#25354) · f4db5e6d
  Anion authored Sep 30, 2025
```
Signed-off-by: anion <1005128408@qq.com>
Signed-off-by: Anion <123177548+Anionex@users.noreply.github.com>
```
  f4db5e6d
- [Kernel][Moe Configs] Add more tuned triton configs for ExpertsInt8 and FP8 (#25858) · 35fe398c
  Asaf Joseph Gardin authored Sep 30, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  35fe398c
- [Fix] Improve CPU backend compatibility for RISC-V (#25816) · bb6d4304
  ihb2032 authored Sep 30, 2025
```
Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn>
Signed-off-by: ihb2032 <1355790728@qq.com>
```
  bb6d4304
- [NIXL] Add support for MLA caches with different latent dim (#25902) · 80608ba5
  Nicolò Lucchesi authored Sep 30, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  80608ba5