Commits · 58d4c705a88adc3187591b4b2e651eae3b190061 · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "37efc63b644b2f4e3b08bf7ff198dd8cd4c3f354"

17 Sep, 2025 7 commits
- [Core] Get num_encoder_tokens from scheduler config (#24989) · 58d4c705
  Russell Bryant authored Sep 16, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  58d4c705
- [misc] fix typo in value error (#24995) · ea3de5ef
  Prashant Gupta authored Sep 16, 2025
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
```
  ea3de5ef
- [UX] Remove "quantization is not fully optimized yet" log (#25012) · 67532a1a
  Michael Goin authored Sep 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67532a1a
- [UX] Enforce valid choices for envs like VLLM_ATTENTION_BACKEND, etc (#24761) · dd83a157
  Michael Goin authored Sep 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  dd83a157
- [Benchmarks] Add MMVU video dataset support and clean up deprecated datasets (#24719) · 5a411ef6
  Isotr0py authored Sep 17, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  5a411ef6
- [Core] Use `CpuGpuBuffer` for block table tensors (#24795) · eeb135eb
  Nick Hill authored Sep 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  eeb135eb
- [FP8] Extend per-token-group quantization support to QuantFP8 (#24342) · cef32104
  Tahsin Tunan authored Sep 17, 2025
```
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
```
  cef32104
16 Sep, 2025 25 commits

[CI][Bugfix] Fix failing Blackwell test (#24993) · d119fc86

Matthew Bonanni authored Sep 16, 2025


Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

d119fc86

[Perf] Reuse workspace for FP8+FP4 Marlin MoE (#20500) · dbebb7f8

Michael Goin authored Sep 16, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dbebb7f8

fp8 kv cache support fix for torch.compile (#22758) · 3053a22b

Aleksandr Malyshev authored Sep 16, 2025

Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>

3053a22b

[gpt-oss][1][bugfix] fix streaming final output (#24466) · 86daa875
Andrew Xia authored Sep 16, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
86daa875
[gpt-oss][1b] streaming add item id, content id (#24788) · f4d6eb95
Andrew Xia authored Sep 16, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
f4d6eb95
Directly get max encoder len from VLLM config in V1 (#24866) · cd1f885b
Sugar authored Sep 17, 2025
```
Signed-off-by: Sugar-zsg <952242923@qq.com>
```
cd1f885b
[Misc] Add removed encoder-decoder models to previously supported models list (#24961) · d593cf28
Isotr0py authored Sep 17, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
d593cf28
[Bugfix] Fix unable to run encoder model when disable_hybrid_kv_cache_manager is true (#24571) · faa7a5da
lianyibo authored Sep 17, 2025
```
Signed-off-by: lianyibo <lianyibo1@kunlunit.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
faa7a5da

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693) · 56793995

Sage Moore authored Sep 16, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

56793995

[Core][MultiModalHasher] Don't convert memoryviews to bytes during hashing (#24925) · 08369289
Lukas Geiger authored Sep 16, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
08369289
[Model] Clean up and simplify Mamba2 Metadata Usage in both V0 and V1 (#24331) · 73cfb3c5
Chih-Chieh Yang authored Sep 16, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
73cfb3c5
Move `SpeculativeConfig` from `config/__init__.py` to `config/speculative.py` (#24904) · 0faf3cc3
Harry Mellor authored Sep 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
0faf3cc3

[Feat][EPLB] A novel static EPLB placement strategy for MoE models. (#23745) · 7ea5c73a

Chen Bruce authored Sep 16, 2025


Signed-off-by: bruceszchen <bruceszchen@tencent.com>
Signed-off-by: Chen Bruce <bruceszchen@tencent.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Chen Bruce <cszwwdz@vip.qq.com>
Co-authored-by: lemon412 <lemon412@foxmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

7ea5c73a

[Mamba] Support TP>1 with quantization for mamba2 mixer in case `n_groups % tp_size == 0` (#24593) · 27fcfe7b

tomeras91 authored Sep 16, 2025

Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
Signed-off-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

27fcfe7b

[Bugfix] remove duplicate tokens streamed in required tool choice streaming (#23312) · 68dbde5d
Cheng Kuan Yong Jason authored Sep 16, 2025
```
Signed-off-by: Jason Cheng <jasoncky96@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
68dbde5d
[benchmark] Add triton version in the moe tuned config (#24769) · 04ad0dc2
Jee Jee Li authored Sep 16, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
04ad0dc2
[QWEN NEXT] Fused MoE kernels Optimization configs (#24924) · 238c4c17
Saman A. Pour authored Sep 15, 2025
```
Signed-off-by: Saman Keon <samanamp@outlook.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
238c4c17
[Bug] [Spec Dec]: Fix kv_cache dtype mismatch for Eagle3 drafter on FP8 target (#24505) · 8c546102
vllmellm authored Sep 16, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
8c546102
[Bugfix] Fix sequence parallelism bug when enable pipeline parallelism (#24021) · 17871983
cascade authored Sep 15, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
17871983
Remove V0 Encoder-Decoder Support (#24907) · 759ef49b
Woosuk Kwon authored Sep 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
759ef49b
[XPU] Fix circular import error. (#24927) · 5206ab20
Kunshang Ji authored Sep 16, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
5206ab20
[Metrics] Hide deprecated metrics with gpu_ prefix (#24245) · 2942970d
Mark McLoughlin authored Sep 16, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
2942970d
[Bug] Fix `is_flashmla_supported` Check Error (#24774) · b42566f4
Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
b42566f4
[ROCm][Bugfix] Fix the case where there's bias (#24895) · 2891603e
Gregory Shtrasberg authored Sep 15, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
2891603e
[Deprecation] Remove DeepGEMM Old Symbol Wrapper (#24902) · de2cc3d8
Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
de2cc3d8

15 Sep, 2025 8 commits
- [Compile] Fix noop_elimination pass and add tests for noop_elimination (#24880) · 5bcc153d
  Jiangyun Zhu authored Sep 16, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  5bcc153d
- [ci] fix wheel names for arm wheels (#24898) · fd2f1054
  Simon Mo authored Sep 15, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  fd2f1054
- [Performance] Remove redundant clone() calls in cutlass_mla (#24891) · aae725af
  Alexander Matveev authored Sep 15, 2025
  
  aae725af
- [gpt-oss][1a] create_responses stream outputs BaseModel type, api server is SSE still (#24759) · 73df49ef
  Andrew Xia authored Sep 15, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  73df49ef
- [gpt-oss] Add IncompleteDetails to ResponsesRepsonse (#24561) · 25aba2b6
  Andrew Xia authored Sep 15, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  25aba2b6
- Update num_tokens_across_dp to use nccl instead of gloo (#24105) · 49bfc538
  Sage Moore authored Sep 15, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  49bfc538
- [Transform] Deterministic Hadacore Transforms (#24106) · a0b26701
  Kyle Sayers authored Sep 15, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  a0b26701
- Move `MultiModalConfig` from `config/__init__.py` to `config/multimodal.py` (#24659) · c4afdb69
  Harry Mellor authored Sep 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c4afdb69