Commits · 922979bfcc461cf0069789728f4afdf1284265fb · OpenDAS / vllm_cscc · GitLab

22 Sep, 2025 17 commits
- [DP] support torchrun external launcher with Data Parallelism (#24899) · 922979bf
  Lucia Fang authored Sep 22, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  922979bf
- [CI Failure] Fix fp8 kv cache on <SM90 (#25396) · 239ef0c1
  Michael Goin authored Sep 22, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  239ef0c1
- [Compiler] Disable Inductor standalone compile by default (#25391) · 1d7f95b8
  ElizaWszola authored Sep 22, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  1d7f95b8
- [CLI env var] Add VLLM_FLASH_ATTN_MAX_NUM_SPLITS_FOR_CUDA_GRAPH in env variables (#25274) · cfbee3d0
  Daisy-Ma-coder authored Sep 22, 2025
```
Signed-off-by: qqma <qqma@amazon.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: qqma <qqma@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  cfbee3d0
- [EPLB] Reduce EPLB Inference Overhead (#24573) · 06a41334
  Bowen Wang authored Sep 22, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  06a41334
- [V1][Attention] Split triton_attn in triton-only and rocm specific backends (#24648) · 175811e3
  Burkhard Ringlein authored Sep 22, 2025
```
Signed-off-by: Burkhard Ringlein <ngl@zurich.ibm.com>
```
  175811e3
- [Bugfix] Fix several issues with p2p xPyD in GET type (#23993) · c10101a3
  Csrayz authored Sep 22, 2025
```
Signed-off-by: Csrayz <jover@cmbchina.com>
Signed-off-by: ivyilike <pww123@cmbchina.com>
Co-authored-by: ivyilike <pww123@cmbchina.com>
```
  c10101a3
- [Kernel] MI-300X triton moe configs (#23445) · ac243886
  Sara-KS authored Sep 22, 2025
```
Signed-off-by: Sara Kokkila Schumacher <saraks@ibm.com>
```
  ac243886
- Make `mypy` behave like a proper pre-commit hook (#25313) · 3d2c56b7
  Harry Mellor authored Sep 22, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  3d2c56b7
- [Misc] Remove unused encoder-decoder error strings (#25374) · 417a164a
  Cyrus Leung authored Sep 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  417a164a
- refactor: abstract graph mode support into platform interface (#25161) · b6f01bd9
  Yizhou authored Sep 22, 2025
```
Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>
```
  b6f01bd9
- [TPU] Deprecate `xm.mark_step` in favor of ``torch_xla.sync` (#25254) · 4cf71cc8
  Nicolò Lucchesi authored Sep 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  4cf71cc8
- Enable Eagle3 speculative decoding for GPT-OSS model (#25246) · 21467f9a
  Eldar Kurtić authored Sep 22, 2025
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
```
  21467f9a
- [V0 Deprecation] Remove `MultiModalPlaceholderMap` (#25366) · f92d9526
  Cyrus Leung authored Sep 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f92d9526
- [V0 Deprecation] Remove V0-only methods in multi-modal registry (#25362) · 6d0b827c
  Cyrus Leung authored Sep 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6d0b827c
- [Bugfix] Fix hermes tool parser handling of non-string argument types (#22002) · 0eecb316
  WeiQing Chen authored Sep 22, 2025
```
Signed-off-by: wangzi <3220100013@zju.edu.cn>
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  0eecb316
- [Model] Support Dots OCR (#24645) · 7b57a433
  Roger Wang authored Sep 21, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: yinz-aizip <yinz@aizip.ai>
```
  7b57a433
21 Sep, 2025 18 commits
- Remove V0 attention backends (#25351) · bc6e542d
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bc6e542d
- [Perf] Further optimization for Qwen3-VL `fast_pos_embed_interpolate` (#25347) · af7dfb0d
  Isotr0py authored Sep 22, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  af7dfb0d
- [V0 Deprecation] Remove V0 sampling metadata (#25345) · 1c3ffdbe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  1c3ffdbe
- feat: Enable engine-level arguments with speculators models (#25250) · c438b295
  Rahul Tuli authored Sep 21, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  c438b295
- [V0 Deprecation] Remove async_output_proc, preemption mode, delay factor (#25334) · 0ff8ebb2
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0ff8ebb2
- [V0 Deprecation] Remove V0 Sequence class & Sampler (#25332) · 26e673fe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  26e673fe
- [Optimization] Cache chat template result when processor fails to be loaded (#25341) · 65a5910c
  Cyrus Leung authored Sep 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  65a5910c
- [Bugfix] Typos in error message for missing model config file (#25339) · 9aea7373
  Simon Danielsson authored Sep 21, 2025
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
```
  9aea7373
- [MM][Perf] Minor Optimization on Qwen3-VL `fast_pos_embed_interpolate` (#25337) · 30d08911
  Roger Wang authored Sep 21, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  30d08911
- [V1] Add sliding window support to Flex Attention backend (#24089) · cf56cf78
  Isotr0py authored Sep 21, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cf56cf78
- [V0 Deprecation] Remove V0 MP executor (#25329) · 7ed82d19
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7ed82d19
- [V0 Deprecation] Remove from_seq_group methods (#25330) · 12dbd834
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  12dbd834
- [Multi Modal][Performance] Fused Q,K's apply_rope in more models (#25005) · 035fd2bd
  Wenlong Wang authored Sep 20, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  035fd2bd
- [V0 Deprecation] Remove V0 model runner base & simplify worker base (#25328) · 1cd885bd
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1cd885bd
- [V0 Deprecation] Remove V0 core (#25321) · c99db8c8
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c99db8c8
- [Chore] Remove unused sampler in models (#25324) · 572ddf83
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  572ddf83
- [V0 Deprecation] Remove V0 Output Processor (#25320) · 86647d1c
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  86647d1c
- [V0 Deprecation] Remove LLMEngine (#25033) · 52c2a8d4
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  52c2a8d4
20 Sep, 2025 5 commits
- [Docs] Fix warnings in vllm/profiler and vllm/transformers_utils (#25220) · 367a480b
  Michael Yao authored Sep 21, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  367a480b
- [Core] Enable sharded state loader for V1 engine and enhance test coverage (#25308) · d88918e4
  lirong authored Sep 20, 2025
```
Signed-off-by: pengdrumli <pengdrumli@tencent.com>
```
  d88918e4
- [Model] Cleanup InternViT's data parallel implementation (#25306) · 3c713a97
  Isotr0py authored Sep 20, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3c713a97
- Generate _ModelInfo properties file when loading to improve loading speed (#23558) · bf8b26ca
  Manoel Marques authored Sep 20, 2025
```
Signed-off-by: Manoel Marques <manoel.marques@ibm.com>
Signed-off-by: Manoel Marques <manoelmrqs@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  bf8b26ca
- [Docs] Fix warnings in mkdocs build (continued) (#25042) · 032d661d
  Wenlong Wang authored Sep 20, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  032d661d