Commits · 21da73343ad35f756e053ba4155dafb05229b0c5 · OpenDAS / vllm_cscc

18 Sep, 2025 12 commits
- [Misc] Clean up flags in `vllm bench serve` (#25138) · 21da7334
  Roger Wang authored Sep 18, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  21da7334
- [Bugfix][Mamba] - Fix Conv State Kernel FP32 Support (#24883) · 66072b36
  Asaf Joseph Gardin authored Sep 18, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  66072b36
- [Frontend] Support setting logprobs to -1 (#25031) · cc935fdd
  Chauncey authored Sep 18, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  cc935fdd
- [Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89
  Aaron Pham authored Sep 18, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  29283e89
- Add 'path' option to ImagePrompt data_format (#25081) · aa3f105c
  Gerard Finol authored Sep 18, 2025
```
Signed-off-by: Gerard Finol <gerard.finol@urv.cat>
```
  aa3f105c
- [Spec Decode] Efficient padded speculation (#24539) · b7433ca1
  Benjamin Chislett authored Sep 18, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  b7433ca1
- [V0 Deprecation] Remove more V0 tests (#25117) · 5c65a72b
  Woosuk Kwon authored Sep 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  5c65a72b
- Mark prompt logprobs as incompatible with prompt embeds at API level (#25077) · bec060fd
  Andrew Sansom authored Sep 17, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  bec060fd
- [V0 Deprecation] Skip PP test (#25128) · 7fb2a5be
  Woosuk Kwon authored Sep 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7fb2a5be
- [V0 Deprecation] Remove misc V0 tests (#25118) · 6c036615
  Woosuk Kwon authored Sep 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6c036615
- [V0 Deprecation] Remove V0 Tracing & Metrics tests (#25115) · 2fc24e94
  Woosuk Kwon authored Sep 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2fc24e94
- [V0 Deprecation] Remove V0 Engine tests (#25114) · 2c3c1bd0
  Woosuk Kwon authored Sep 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2c3c1bd0
17 Sep, 2025 18 commits

[Kernel] Delegate construction of FusedMoEQuantConfig to FusedMoEMethodBase subclasses (#22537) · 5963b98b
bnellnm authored Sep 17, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
5963b98b

[Bugfix] Fix accuracy issue for silu_mul + nvfp4 quant fusion kernel (#24833) · e6585ddb

elvischenv authored Sep 18, 2025


Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

e6585ddb

[V1] Logits processor docs (#22919) · 7ae98875

afeldman-nm authored Sep 17, 2025

Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Signed-off-by: afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>
Co-authored-by: Joseph Marinier <Joseph.Marinier@gmail.com>

7ae98875

[CI Bugfix] Fix failing test_model_load_with_params tests due to tokenizer refactor (#25086) · e3db5ebb
Michael Goin authored Sep 17, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
e3db5ebb
[V0 Deprecation] Remove V0 tests in test_sequence.py (#25088) · 9d442b7c
Woosuk Kwon authored Sep 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
9d442b7c
[CI] Revert back prepare_prompts and check_answers (#25087) · eb68c2dc
Woosuk Kwon authored Sep 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
eb68c2dc
[V0 Deprecation] Remove V0 Core tests (#25082) · 4b946d69
Woosuk Kwon authored Sep 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
4b946d69
[CI Bugfix] Fix failing test_invalid_env (#25078) · 087c6ffc
Michael Goin authored Sep 17, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
087c6ffc

Add RADIO Vision Encoder Support to vLLM (#24595) · 252ada55

danielafrimi authored Sep 17, 2025


Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: root <root@cw-dfw-h100-001-305-026.cm.cluster>

252ada55

[Misc] Avoid use of deprecated `AutoModelForVision2Seq` (#25065) · e120533d
Cyrus Leung authored Sep 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
e120533d
[Frontend] Support returning all prompt logprobs (#24956) · 544fe76b
Chauncey authored Sep 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
544fe76b
[Core] Remove tokenizer group in vLLM (#24078) · 6c47f6bf
Zhuohan Li authored Sep 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
6c47f6bf
[Rocm] [quantization] Fix quark ptpc moe and add test case (#24649) · ca2d1925
haoyangli-amd authored Sep 17, 2025
```
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
Co-authored-by: Haoyang Li <haoyang.li@amd.com>
```
ca2d1925

[Model] Support Qwen3-VL Model Series (#24727) · 0f7acdd7

Roger Wang authored Sep 16, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huang Jie <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: 松灵 <26085463+wulipc@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

0f7acdd7

[V0 Deprecation] Remove MQLLMEngine (#25019) · 5801e497

Woosuk Kwon authored Sep 16, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>

5801e497

[Core] Use `CpuGpuBuffer` for block table tensors (#24795) · eeb135eb
Nick Hill authored Sep 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
eeb135eb

[FP8] Extend per-token-group quantization support to QuantFP8 (#24342) · cef32104

Tahsin Tunan authored Sep 17, 2025

Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

cef32104

[CI] GPT-OSS GPQA eval test for Blackwell (#24920) · 493b10f8

Michael Goin authored Sep 16, 2025

Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

493b10f8

16 Sep, 2025 10 commits

Use kwargs for long lists of `EngineCoreRequest` arguments in tests and fix extra kwargs (#24987) · 02d4b854
Andrew Sansom authored Sep 16, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
02d4b854
[gpt-oss][1][bugfix] fix streaming final output (#24466) · 86daa875
Andrew Xia authored Sep 16, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
86daa875
[gpt-oss][1b] streaming add item id, content id (#24788) · f4d6eb95
Andrew Xia authored Sep 16, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
f4d6eb95

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693) · 56793995

Sage Moore authored Sep 16, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

56793995

[CI] Add Decode Context Parallelism (DCP) test to CI (#24487) · 4e5affea
Ming Yang authored Sep 16, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
4e5affea

[Feat][EPLB] A novel static EPLB placement strategy for MoE models. (#23745) · 7ea5c73a

Chen Bruce authored Sep 16, 2025


Signed-off-by: bruceszchen <bruceszchen@tencent.com>
Signed-off-by: Chen Bruce <bruceszchen@tencent.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Chen Bruce <cszwwdz@vip.qq.com>
Co-authored-by: lemon412 <lemon412@foxmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

7ea5c73a

[Bugfix] Fix sequence parallelism bug when enable pipeline parallelism (#24021) · 17871983
cascade authored Sep 15, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
17871983
Remove V0 Encoder-Decoder Support (#24907) · 759ef49b
Woosuk Kwon authored Sep 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
759ef49b
[Metrics] Hide deprecated metrics with gpu_ prefix (#24245) · 2942970d
Mark McLoughlin authored Sep 16, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
2942970d
[CI] Small Accuracy Eval Test for Deepseek Model (#24259) · 3c96e7b8
Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
3c96e7b8