Commits · ab5e7d93f41fefd11aec7977b1a7d294897c26be · OpenDAS / vllm_cscc · GitLab

06 Oct, 2025 9 commits
- [Bugfix] Fix mrope in Transformers Backend (#26087) · ab5e7d93
  Raushan Turganbay authored Oct 06, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ab5e7d93
- Support expert parallel load balancing in Transformers backend (#26287) · 0340f455
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0340f455
- [Model] Use `merge_by_field_config` for MM models (Llava family) (#26280) · 19a00eb2
  Cyrus Leung authored Oct 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  19a00eb2
- [Frontend] Consolidate tokenizer init code (#26276) · 391612e7
  Cyrus Leung authored Oct 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  391612e7
- [Misc] Clean up unnecessary E501 ignore (#26274) · 43c146ca
  Roger Wang authored Oct 06, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  43c146ca
- [Benchmarking] Add disable_shuffle option for dataset loading (#26258) · 7c2ec0fe
  Yasmin Moslem authored Oct 06, 2025
```
Signed-off-by: Yasmin Moslem <48152713+ymoslem@users.noreply.github.com>
```
  7c2ec0fe
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
- [CI][gpt-oss] Enable python tool tests in CI (#24315) · 91ac7f76
  wuhang authored Oct 06, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  91ac7f76
- [V1] [Hybrid] Some additional clean-up in Mamba2 prefix caching (#26222) · 778f5541
  Thomas Parnell authored Oct 06, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  778f5541
05 Oct, 2025 14 commits
- Fix per file ruff ignores related to simplification (#26259) · b893d661
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b893d661
- [NVIDIA] flashinfer TRTLLM attention prefill token limit (#25998) · 6b6e9877
  Jason Li authored Oct 05, 2025
```
Signed-off-by: jasonlizhengjian <jason.li@centml.ai>
Signed-off-by: jasonlizhengjian <jasonlizhengjian@gmail.com>
```
  6b6e9877
- Fix per file ruff ignores related to typing (#26254) · 1c0c6820
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1c0c6820
- Remove all cases of `fmt: on/off` (#26253) · 557b2e96
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  557b2e96
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
- [Platform][Kernel] platform-specific kernel loading (#25823) · 17edd8a8
  Hank_ authored Oct 05, 2025
```
Signed-off-by: Hank <hcc.mayday@gmail.com>
```
  17edd8a8
- [Bugfix][Hardware][RISC-V] Limit supported dtypes to float32 to avoid scheduler segfault (#26228) · 3303cfb4
  ihb2032 authored Oct 05, 2025
```
Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn>
Signed-off-by: ihb2032 <1355790728@qq.com>
```
  3303cfb4
- [Bugfix] Always apply MM processor even when no MM items are passed (#26240) · b7e8e4e6
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b7e8e4e6
- [Bugfix]: Assertion error when using FlashInfer backend (#25933) · 432e1cbc
  Simon Danielsson authored Oct 05, 2025
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  432e1cbc
- [Perf][Easy] Early stop in request_block_hasher (#26112) · 201c971e
  Jialin Ouyang authored Oct 05, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  201c971e
- [Bugfix] Allow `--skip-tokenizer-init` with `echo and return_token_ids` (#26238) · a964e5e6
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a964e5e6
- [Easy] Add str repr for IterationStats (#26232) · 78c1d5bf
  22quinn authored Oct 04, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  78c1d5bf
- [Model] Use `merge_by_field_config` for MM models (H-L) (#26230) · 59a85c36
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  59a85c36
04 Oct, 2025 17 commits
- [Renderer] Clean up renderer code (#26216) · 119f0063
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  119f0063
- [Frontend] Cache chat template kwargs resolution (#26227) · a42d2df7
  Isotr0py authored Oct 04, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a42d2df7
- [CPU] Refine batch reorder of CPU attention backend (#26096) · 5c057e06
  Li, Jiang authored Oct 04, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  5c057e06
- [V1] [Hybrid] Remove code to override default CUDA graph configuration (#26226) · ed3aeb25
  Thomas Parnell authored Oct 04, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  ed3aeb25
- Fix tensor device and dtype placement in Qwen2VL model (#26219) · 86ee9491
  yuafng authored Oct 04, 2025
```
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Yuanfeng Li <yuanfengli@meta.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  86ee9491
- [Model] CLIP Embedding Support (#26010) · 4570535e
  Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4570535e
- [Bugfix] Fix `_reqs_to_process` leak on abort (#26012) · 2a6dc67e
  Nicolò Lucchesi authored Oct 04, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  2a6dc67e
- [Core] Enable decode of context length equal to max model length (#26168) · f05fea1f
  Yannick Schnider authored Oct 04, 2025
```
Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
```
  f05fea1f
- Add Olmo 3 reasoning parser (#26054) · d0df145c
  Luca Soldaini authored Oct 04, 2025
```
Signed-off-by: Luca Soldaini <luca@soldaini.net>
```
  d0df145c
- Revert "Add batch invariant kernel override for FlashInfer backend [2/n]" (#26220) · 1838cd48
  Cyrus Leung authored Oct 04, 2025
  
  1838cd48
- [CI Failure] fix_test_auto_prefix_cache_support (#26053) · 7d6b0338
  Huamin Li authored Oct 04, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  7d6b0338
- [Misc] Remove unused `executor.apply_model` (#26215) · 7c2e91c4
  Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7c2e91c4
- [Misc] Require `merge_by_field_config` argument (#26214) · 736fbf4c
  Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  736fbf4c
- [Model] Support nested structures for TensorSchema (#26212) · 44ea8513
  Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44ea8513
- Support expert parallel in Transformers backend (#26162) · d3d649ef
  Harry Mellor authored Oct 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d3d649ef
- [V1] [Hybrid] Mamba2 Automatic Prefix Caching (#25752) · ea507c3a
  Stan Wozniak authored Oct 04, 2025
```
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  ea507c3a
- [cpu][perf] Accelerate unquantized-linear for AArch64 through oneDNN/ACL and... · 9705fba7
  Fadi Arafeh authored Oct 04, 2025
```
[cpu][perf] Accelerate unquantized-linear for AArch64 through oneDNN/ACL and weight prepack (#25948)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  9705fba7