Commits · 185d8ed44f382fc2b066e4d2eabd3c1b5fcbd8db · OpenDAS / vllm_cscc

07 Oct, 2025 8 commits
- [responsesAPI][bugfix] serialize harmony messages (#26185) · 185d8ed4
  Andrew Xia authored Oct 07, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  185d8ed4
- [Deprecation] Deprecate `LLM.set_tokenizer` (#26333) · d9836d45
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d9836d45
- [Model] Define merge_by_field_config MM interface (U-Z) (#26261) · 5f7e8a91
  Ayush Satyam authored Oct 07, 2025
```
Signed-off-by: Ayush Satyam <ayushsatyam146@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5f7e8a91
- [BUG] Fix file parsing for load_format runai_streamer_sharded (#26324) · 4dbdf4a2
  ahao-anyscale authored Oct 06, 2025
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  4dbdf4a2
- [UX] Support nested dicts in hf_overrides (#25727) · c6873c4e
  Michael Goin authored Oct 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c6873c4e
- [Core] Simplify the Dp padding/should ubatch coordination logic (#25768) · 2111b464
  Sage Moore authored Oct 06, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  2111b464
- [Docs][DBO] Add initial doc that describes the DBO implementation (#26024) · c50901f3
  Sage Moore authored Oct 06, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  c50901f3
- [Misc] Define EP kernel arch list in Dockerfile (#25635) · 8229280a
  Simon Mo authored Oct 06, 2025
```
Signed-off-by: Simon Mo <simon.mo@hey.com>
```
  8229280a
06 Oct, 2025 31 commits

[Perf] Add decode full-graph support to FlashInfer-MLA backend (#26313) · f77df946
Benjamin Chislett authored Oct 06, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
f77df946
[ROCm] Split AITER unified attention into its own backend (#25507) · f231e5bc
Gregory Shtrasberg authored Oct 06, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
f231e5bc
[Bugfix] Allow skipping MoE in NVFP4 (fix for MTP) (#25987) · 2161efe9
Benjamin Chislett authored Oct 06, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
2161efe9

[BugFix] Pad input buffers in _dummy_run (#26209) · f23b4c04

Varun Sundar Rabindranath authored Oct 06, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

f23b4c04

[Docs] Fix broken table in moe_kernel_features doc (#26314) · 93540958

Varun Sundar Rabindranath authored Oct 06, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

93540958

[Benchmark] Enable MM Embedding benchmarks (#26310) · 44b9af5b
Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
44b9af5b

[Bugfix] Fix gemma3 with transformers backend (#23178) · 7cd95dc8

Raushan Turganbay authored Oct 06, 2025

Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Raushan Turganbay <raushan@huggingface.co>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

7cd95dc8

Add bias handling to CPUFusedMOE kernel (#26289) · c02058c2

Crefeda Rodrigues authored Oct 06, 2025


Signed-off-by: Crefeda Rodrigues <crefeda.rodrigues@arm.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Crefeda Rodrigues <65665931+cfRod@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Sharif Inamdar <Sharif.Inamdar@arm.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

c02058c2

[Bugfix][Spec Decode] Fix wrong valid_mask for padded speculation when chunked... · b2ea5ba6

7mile authored Oct 07, 2025


[Bugfix][Spec Decode] Fix wrong valid_mask for padded speculation when chunked prefill occurs (#26231)
Signed-off-by: seven-mile <i@7li.moe>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>

b2ea5ba6

[Misc] auto_tune: kill specific vllm process (#26304) · 824a3f40
Karan Goel authored Oct 06, 2025
```
Signed-off-by: Karan Goel <karangoel@google.com>
```
824a3f40
Support llama3 eagle3 head with llama4 verifier (#25961) · 05f6846e
Rahul Tuli authored Oct 06, 2025
```
Signed-off-by: rahul-tuli <rtuli@redhat.com>
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
05f6846e

[CI Bugfix] Make sure TRTLLM attention is available in test_blackwell_moe (#26188) · 20db99cc

Michael Goin authored Oct 06, 2025

Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

20db99cc

[Tests] conftest: Extending VllmRunner and HfRunner to accept token_ids as input (#26295) · 6431be80

Yannick Schnider authored Oct 06, 2025

Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
Signed-off-by: Yannick Schnider <Yannick.Schnider1@ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

6431be80

[Attention] Remove unused reorder_batch method (#24463) · 4727a8af
Matthew Bonanni authored Oct 06, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
4727a8af

[Model] EVS support for nano_nemotron_vl (#26269) · b8f603ce

tomeras91 authored Oct 06, 2025

Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
Signed-off-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>

b8f603ce

Fix `DotsOCR` tensor type (#26281) · fc679696
Chatcharin Sangbutsarakum authored Oct 06, 2025
```
Signed-off-by: what_in_the_nim <chatcharinsang@gmail.com>
```
fc679696

[Bugfix] Fix mrope in Transformers Backend (#26087) · ab5e7d93

Raushan Turganbay authored Oct 06, 2025

Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

ab5e7d93

Support expert parallel load balancing in Transformers backend (#26287) · 0340f455
Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
0340f455
[Model] Use `merge_by_field_config` for MM models (Llava family) (#26280) · 19a00eb2
Cyrus Leung authored Oct 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
19a00eb2
[Frontend] Consolidate tokenizer init code (#26276) · 391612e7
Cyrus Leung authored Oct 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
391612e7
[Doc] add KAITO to integrations (#25521) · 77c95f72
abhisheksheth28 authored Oct 06, 2025
```
Signed-off-by: "Abhishek Sheth" <absheth@microsoft.com>
```
77c95f72

[Docs] Edit HF Inference Endpoints documentation (#26275) · 59f30d04

Aritra Roy Gosthipaty authored Oct 06, 2025


Signed-off-by: Aritra Roy Gosthipaty <aritra.born2fly@gmail.com>
Signed-off-by: ariG23498 <aritra.born2fly@gmail.com>

59f30d04

[Misc] Clean up unnecessary E501 ignore (#26274) · 43c146ca
Roger Wang authored Oct 06, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
43c146ca
[Benchmarking] Add disable_shuffle option for dataset loading (#26258) · 7c2ec0fe
Yasmin Moslem authored Oct 06, 2025
```
Signed-off-by: Yasmin Moslem <48152713+ymoslem@users.noreply.github.com>
```
7c2ec0fe

Bump actions/stale from 10.0.0 to 10.1.0 (#26272) · 039b6bad

dependabot[bot] authored Oct 06, 2025


Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

039b6bad

Fix per file ruff ignores related to line length (#26262) · 6c046382
Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
6c046382
[CI][gpt-oss] Enable python tool tests in CI (#24315) · 91ac7f76
wuhang authored Oct 06, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
91ac7f76
[MISC] Add heheda12345 to CODEOWNERS of vllm/config/cache.py (#26270) · 4be7d7c1
Chen Zhang authored Oct 05, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
4be7d7c1
[Doc] Edited minor typo (#26266) · 59b47764
orangeng authored Oct 05, 2025
```
Signed-off-by: Orange Ng <ngquanhao@outlook.com>
```
59b47764
[V1] [Hybrid] Some additional clean-up in Mamba2 prefix caching (#26222) · 778f5541
Thomas Parnell authored Oct 06, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
778f5541
[CI] Add comment about the single cudagraph capture size that is used (#26252) · d3c84297
Thomas Parnell authored Oct 06, 2025

d3c84297

05 Oct, 2025 1 commit
- [DOC] Update production-stack.md (#26177) · f509a208
  Elieser Pereira authored Oct 05, 2025
```
Signed-off-by: Elieser Pereira <elieser.pereiraa@gmail.com>
```
  f509a208