Commits · ca2d1925ef5ad309061c2d5dd9a1e409c5ca28ee · OpenDAS / vllm_cscc

17 Sep, 2025 14 commits

[Rocm] [quantization] Fix quark ptpc moe and add test case (#24649) · ca2d1925
haoyangli-amd authored Sep 17, 2025
```
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
Co-authored-by: Haoyang Li <haoyang.li@amd.com>
```
ca2d1925

[Model] Support Qwen3-VL Model Series (#24727) · 0f7acdd7

Roger Wang authored Sep 16, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huang Jie <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: 松灵 <26085463+wulipc@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

0f7acdd7

[V0 Deprecation] Remove MQLLMEngine (#25019) · 5801e497

Woosuk Kwon authored Sep 16, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>

5801e497

[Core] Get num_encoder_tokens from scheduler config (#24989) · 58d4c705
Russell Bryant authored Sep 16, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
58d4c705
[misc] fix typo in value error (#24995) · ea3de5ef
Prashant Gupta authored Sep 16, 2025
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
```
ea3de5ef
[UX] Remove "quantization is not fully optimized yet" log (#25012) · 67532a1a
Michael Goin authored Sep 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
67532a1a
[Docs] fix invalid doc link (#25017) · 5672ba90
yyzxw authored Sep 17, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
```
5672ba90
[UX] Enforce valid choices for envs like VLLM_ATTENTION_BACKEND, etc (#24761) · dd83a157
Michael Goin authored Sep 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
dd83a157
[Benchmarks] Add MMVU video dataset support and clean up deprecated datasets (#24719) · 5a411ef6
Isotr0py authored Sep 17, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
5a411ef6
[Core] Use `CpuGpuBuffer` for block table tensors (#24795) · eeb135eb
Nick Hill authored Sep 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
eeb135eb
[Doc] Add --force-overwrite option to generate_cmake_presets.py (#24375) · 3059b9cc
elvischenv authored Sep 17, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
3059b9cc

Removes source compilation of nixl dependency (#24874) · 64ad5518

Benjamin Bartels authored Sep 17, 2025

Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Daniele <36171005+dtrifiro@users.noreply.github.com>

64ad5518

[FP8] Extend per-token-group quantization support to QuantFP8 (#24342) · cef32104

Tahsin Tunan authored Sep 17, 2025

Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

cef32104

[CI] GPT-OSS GPQA eval test for Blackwell (#24920) · 493b10f8

Michael Goin authored Sep 16, 2025

Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

493b10f8

16 Sep, 2025 26 commits
- [CI][Bugfix] Fix failing Blackwell test (#24993) · d119fc86
  Matthew Bonanni authored Sep 16, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  d119fc86
- [Perf] Reuse workspace for FP8+FP4 Marlin MoE (#20500) · dbebb7f8
  Michael Goin authored Sep 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  dbebb7f8
- fp8 kv cache support fix for torch.compile (#22758) · 3053a22b
  Aleksandr Malyshev authored Sep 16, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>
```
  3053a22b
- Use kwargs for long lists of `EngineCoreRequest` arguments in tests and fix extra kwargs (#24987) · 02d4b854
  Andrew Sansom authored Sep 16, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  02d4b854
- [gpt-oss][1][bugfix] fix streaming final output (#24466) · 86daa875
  Andrew Xia authored Sep 16, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  86daa875
- [ROCm] Add dependencies for ROCm (#24900) · dcf2f3ec
  Concurrensee authored Sep 16, 2025
```
Signed-off-by: Yida Wu <yida.wu@amd.com>
```
  dcf2f3ec
- [MISC] Add code owners of vllm/v1 to vllm/v1/core (#24928) · 218454b9
  Chen Zhang authored Sep 16, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  218454b9
- [gpt-oss][1b] streaming add item id, content id (#24788) · f4d6eb95
  Andrew Xia authored Sep 16, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  f4d6eb95
- Directly get max encoder len from VLLM config in V1 (#24866) · cd1f885b
  Sugar authored Sep 17, 2025
```
Signed-off-by: Sugar-zsg <952242923@qq.com>
```
  cd1f885b
- [Misc] Add removed encoder-decoder models to previously supported models list (#24961) · d593cf28
  Isotr0py authored Sep 17, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d593cf28
- [Bugfix] Fix unable to run encoder model when disable_hybrid_kv_cache_manager is true (#24571) · faa7a5da
  lianyibo authored Sep 17, 2025
```
Signed-off-by: lianyibo <lianyibo1@kunlunit.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  faa7a5da
- [Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693) · 56793995
  Sage Moore authored Sep 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  56793995
- [Core][MultiModalHasher] Don't convert memoryviews to bytes during hashing (#24925) · 08369289
  Lukas Geiger authored Sep 16, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  08369289
- [Model] Clean up and simplify Mamba2 Metadata Usage in both V0 and V1 (#24331) · 73cfb3c5
  Chih-Chieh Yang authored Sep 16, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
  73cfb3c5
- [CI] Add Decode Context Parallelism (DCP) test to CI (#24487) · 4e5affea
  Ming Yang authored Sep 16, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  4e5affea
- (doc): set cmake c++ compatible standard when building on MacOS CPU. (#23483) · e4f0b4cd
  TeeKen Lau authored Sep 16, 2025
```
Signed-off-by: teekenl <teekenlau@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e4f0b4cd
- feat: Add Grafana and Perces monitoring dashboards for vLLM (#23498) · de3e53a7
  liangwen12year authored Sep 16, 2025
  
  de3e53a7
- [Docs] move benchmarks README to contributing guides (#24820) · 85e0df13
  Ye (Charlotte) Qi authored Sep 16, 2025
  
  85e0df13
- Move `SpeculativeConfig` from `config/__init__.py` to `config/speculative.py` (#24904) · 0faf3cc3
  Harry Mellor authored Sep 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0faf3cc3
- [Feat][EPLB] A novel static EPLB placement strategy for MoE models. (#23745) · 7ea5c73a
  Chen Bruce authored Sep 16, 2025
```
Signed-off-by: bruceszchen <bruceszchen@tencent.com>
Signed-off-by: Chen Bruce <bruceszchen@tencent.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Chen Bruce <cszwwdz@vip.qq.com>
Co-authored-by: lemon412 <lemon412@foxmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7ea5c73a
- [Mamba] Support TP>1 with quantization for mamba2 mixer in case `n_groups % tp_size == 0` (#24593) · 27fcfe7b
  tomeras91 authored Sep 16, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
Signed-off-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  27fcfe7b
- [Bugfix] remove duplicate tokens streamed in required tool choice streaming (#23312) · 68dbde5d
  Cheng Kuan Yong Jason authored Sep 16, 2025
```
Signed-off-by: Jason Cheng <jasoncky96@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  68dbde5d
- [benchmark] Add triton version in the moe tuned config (#24769) · 04ad0dc2
  Jee Jee Li authored Sep 16, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  04ad0dc2
- [QWEN NEXT] Fused MoE kernels Optimization configs (#24924) · 238c4c17
  Saman A. Pour authored Sep 15, 2025
```
Signed-off-by: Saman Keon <samanamp@outlook.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  238c4c17
- [Bug] [Spec Dec]: Fix kv_cache dtype mismatch for Eagle3 drafter on FP8 target (#24505) · 8c546102
  vllmellm authored Sep 16, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  8c546102
- [Bugfix] Fix sequence parallelism bug when enable pipeline parallelism (#24021) · 17871983
  cascade authored Sep 15, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  17871983