Commits · 824a3f403f8cbb5b7984d33ca4741f67928c1d61 · OpenDAS / vllm_cscc · GitLab

06 Oct, 2025 22 commits
- [Misc] auto_tune: kill specific vllm process (#26304) · 824a3f40
  Karan Goel authored Oct 06, 2025
```
Signed-off-by: Karan Goel <karangoel@google.com>
```
  824a3f40
- Support llama3 eagle3 head with llama4 verifier (#25961) · 05f6846e
  Rahul Tuli authored Oct 06, 2025
```
Signed-off-by: rahul-tuli <rtuli@redhat.com>
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  05f6846e
- [CI Bugfix] Make sure TRTLLM attention is available in test_blackwell_moe (#26188) · 20db99cc
  Michael Goin authored Oct 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  20db99cc
- [Tests] conftest: Extending VllmRunner and HfRunner to accept token_ids as input (#26295) · 6431be80
  Yannick Schnider authored Oct 06, 2025
```
Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
Signed-off-by: Yannick Schnider <Yannick.Schnider1@ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  6431be80
- [Attention] Remove unused reorder_batch method (#24463) · 4727a8af
  Matthew Bonanni authored Oct 06, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  4727a8af
- [Model] EVS support for nano_nemotron_vl (#26269) · b8f603ce
  tomeras91 authored Oct 06, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
Signed-off-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
```
  b8f603ce
- Fix `DotsOCR` tensor type (#26281) · fc679696
  Chatcharin Sangbutsarakum authored Oct 06, 2025
```
Signed-off-by: what_in_the_nim <chatcharinsang@gmail.com>
```
  fc679696
- [Bugfix] Fix mrope in Transformers Backend (#26087) · ab5e7d93
  Raushan Turganbay authored Oct 06, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ab5e7d93
- Support expert parallel load balancing in Transformers backend (#26287) · 0340f455
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0340f455
- [Model] Use `merge_by_field_config` for MM models (Llava family) (#26280) · 19a00eb2
  Cyrus Leung authored Oct 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  19a00eb2
- [Frontend] Consolidate tokenizer init code (#26276) · 391612e7
  Cyrus Leung authored Oct 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  391612e7
- [Doc] add KAITO to integrations (#25521) · 77c95f72
  abhisheksheth28 authored Oct 06, 2025
```
Signed-off-by: "Abhishek Sheth" <absheth@microsoft.com>
```
  77c95f72
- [Docs] Edit HF Inference Endpoints documentation (#26275) · 59f30d04
  Aritra Roy Gosthipaty authored Oct 06, 2025
```
Signed-off-by: Aritra Roy Gosthipaty <aritra.born2fly@gmail.com>
Signed-off-by: ariG23498 <aritra.born2fly@gmail.com>
```
  59f30d04
- [Misc] Clean up unnecessary E501 ignore (#26274) · 43c146ca
  Roger Wang authored Oct 06, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  43c146ca
- [Benchmarking] Add disable_shuffle option for dataset loading (#26258) · 7c2ec0fe
  Yasmin Moslem authored Oct 06, 2025
```
Signed-off-by: Yasmin Moslem <48152713+ymoslem@users.noreply.github.com>
```
  7c2ec0fe
- Bump actions/stale from 10.0.0 to 10.1.0 (#26272) · 039b6bad
  dependabot[bot] authored Oct 06, 2025
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
  039b6bad
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
- [CI][gpt-oss] Enable python tool tests in CI (#24315) · 91ac7f76
  wuhang authored Oct 06, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  91ac7f76
- [MISC] Add heheda12345 to CODEOWNERS of vllm/config/cache.py (#26270) · 4be7d7c1
  Chen Zhang authored Oct 05, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  4be7d7c1
- [Doc] Edited minor typo (#26266) · 59b47764
  orangeng authored Oct 05, 2025
```
Signed-off-by: Orange Ng <ngquanhao@outlook.com>
```
  59b47764
- [V1] [Hybrid] Some additional clean-up in Mamba2 prefix caching (#26222) · 778f5541
  Thomas Parnell authored Oct 06, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  778f5541
- [CI] Add comment about the single cudagraph capture size that is used (#26252) · d3c84297
  Thomas Parnell authored Oct 06, 2025
  
  d3c84297
05 Oct, 2025 18 commits
- [DOC] Update production-stack.md (#26177) · f509a208
  Elieser Pereira authored Oct 05, 2025
```
Signed-off-by: Elieser Pereira <elieser.pereiraa@gmail.com>
```
  f509a208
- [CI] Add Blackwell LM Eval Small Models test to nightly (#26052) · 60bc25e7
  Michael Goin authored Oct 05, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  60bc25e7
- Fix per file ruff ignores related to simplification (#26259) · b893d661
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b893d661
- [NVIDIA] flashinfer TRTLLM attention prefill token limit (#25998) · 6b6e9877
  Jason Li authored Oct 05, 2025
```
Signed-off-by: jasonlizhengjian <jason.li@centml.ai>
Signed-off-by: jasonlizhengjian <jasonlizhengjian@gmail.com>
```
  6b6e9877
- [CI] fix mamba kernel test (#26250) · 9c3c21c5
  Jiangyun Zhu authored Oct 06, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  9c3c21c5
- Update `ruff` pre-commit hooks version (#26255) · 512b8aff
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  512b8aff
- Fix per file ruff ignores related to typing (#26254) · 1c0c6820
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1c0c6820
- fix(tests): Resolve late binding of loop variable in assert message lambda (#26249) · 5f317530
  ihb2032 authored Oct 06, 2025
```
Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn>
Signed-off-by: ihb2032 <1355790728@qq.com
```
  5f317530
- Remove all cases of `fmt: on/off` (#26253) · 557b2e96
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  557b2e96
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
- [Platform][Kernel] platform-specific kernel loading (#25823) · 17edd8a8
  Hank_ authored Oct 05, 2025
```
Signed-off-by: Hank <hcc.mayday@gmail.com>
```
  17edd8a8
- [Bugfix][Hardware][RISC-V] Limit supported dtypes to float32 to avoid scheduler segfault (#26228) · 3303cfb4
  ihb2032 authored Oct 05, 2025
```
Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn>
Signed-off-by: ihb2032 <1355790728@qq.com>
```
  3303cfb4
- [Bugfix] Always apply MM processor even when no MM items are passed (#26240) · b7e8e4e6
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b7e8e4e6
- [Bugfix]: Assertion error when using FlashInfer backend (#25933) · 432e1cbc
  Simon Danielsson authored Oct 05, 2025
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  432e1cbc
- [Perf][Easy] Early stop in request_block_hasher (#26112) · 201c971e
  Jialin Ouyang authored Oct 05, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  201c971e
- Add documentation for granite 4 tool calling (#26175) · e0986ea0
  Maximilien de Bayser authored Oct 05, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  e0986ea0
- [Bugfix] Allow `--skip-tokenizer-init` with `echo and return_token_ids` (#26238) · a964e5e6
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a964e5e6