Commits · 6afc0ffaf61b49599dec25c30b28596a390ad2d9 · OpenDAS / vllm_cscc · GitLab

29 Nov, 2025 11 commits
- [Model Runner V2] Add sample/ directory and reorganize files (#29719) · 6afc0ffa
  Woosuk Kwon authored Nov 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6afc0ffa
- [LoRA] Cleanup LoRA unused code (#29611) · 39e63dec
  Jee Jee Li authored Nov 29, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  39e63dec
- [Model Runner V2] Don't use UVA buffer for prefill_len (#29713) · 4a80ad0a
  Woosuk Kwon authored Nov 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4a80ad0a
- Add gpu memory wait before test_async_tp (#28893) · 4b17ce68
  Angela Yi authored Nov 28, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  4b17ce68
- [BugFix] Fix DBO failing with TypeError: 'NoneType' object is not iterable (#29698) · e23f665d
  Lucas Wilkinson authored Nov 28, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  e23f665d
- [Model Runner V2] Refactor prefill token preparation (#29712) · ca1b1e72
  Woosuk Kwon authored Nov 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ca1b1e72
- [Frontend] Perform offline path replacement to `tokenizer` (#29706) · 762a4a6c
  Tsukasa OI authored Nov 29, 2025
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
  762a4a6c
- [Bugfix] Fix wrong mock attribute (#29704) · b2c50eda
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b2c50eda
- [Model Runner V2] Support penalties using bin counts (#29703) · 1dcafb3d
  Woosuk Kwon authored Nov 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1dcafb3d
- [ROCm][Bugfix] Patch for the `Multi-Modal Processor Test` group (#29702) · ea3370b4
  Andreas Karatzas authored Nov 28, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  ea3370b4
- [Bugfix] Fix O(n²) multimodal string prompt processing (#29667) · c625d7b1
  Mert Unsal authored Nov 28, 2025
```
Signed-off-by: mertunsall <mertunsal1905@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  c625d7b1
28 Nov, 2025 29 commits
- [compile] Include `enable_sleep_mode` into caching factors. (#29696) · 6173682b
  Zhengxu Chen authored Nov 28, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  6173682b
- bugfix: correct attn output with base 2 or e (#28840) · 9726e645
  Augusto Yao authored Nov 29, 2025
```
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
```
  9726e645
- Revert "[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971)" (#29697) · 3fd1fb0b
  Huamin Li authored Nov 28, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  3fd1fb0b
- [Bugfix] fix dots.llm1.inst (#29687) · a51f4186
  Jiangyun Zhu authored Nov 29, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  a51f4186
- [Misc] Remove redundant `ClassRegistry` (#29681) · 7675ba30
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  7675ba30
- [CI/Build]: make it possible to build with a free-threaded interpreter (#29241) · 7c1ed458
  Ralf Gommers authored Nov 29, 2025
```
Signed-off-by: Ralf Gommers <ralf.gommers@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  7c1ed458
- [Perf] Optimize EAGLE prepare_inputs_padded with triton kernels (#28597) · 1986de13
  Benjamin Chislett authored Nov 28, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  1986de13
- [Frontend] Remap -O to -cc commandline flag (#29557) · 3461e7ef
  Yanan Cao authored Nov 28, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  3461e7ef
- Remove `all_special_tokens_extended` from tokenizer code (#29686) · fecae12c
  Harry Mellor authored Nov 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fecae12c
- [Chore] Rename `Processor` to `InputProcessor` (#29682) · 8d9338fa
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8d9338fa
- [CI/Build] Rework CPU multimodal processor test (#29684) · d40c8540
  Isotr0py authored Nov 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d40c8540
- [Docs] Add CLI reference doc for `vllm bench sweep plot_pareto` (#29689) · 43329556
  Harry Mellor authored Nov 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  43329556
- [Chore]: Reorganize model repo operating functions in `transformers_utils` (#29680) · f946a8d7
  Isotr0py authored Nov 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  f946a8d7
- [V0 deprecation] Clean up legacy paged attention helper functions (#28043) · 6f9d81d0
  Isotr0py authored Nov 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6f9d81d0
- [Doc]: fixing typos in multiple files. (#29685) · fae69430
  Didier Durand authored Nov 28, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  fae69430
- add add_truncate_prompt_tokens in repr for PoolingParams (#29683) · 3bcbb30c
  果冻虾仁 authored Nov 29, 2025
  
  3bcbb30c
- [mypy] Enable type checking for more directories (#29674) · 9e6bcda3
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9e6bcda3
- Guard FlashInfer sampler using the same check as FlashInfer attention backend (#29415) · 9eec282c
  Harry Mellor authored Nov 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  9eec282c
- [Misc] Remove `yapf` directives (#29675) · 0808eb81
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0808eb81
- Remove upstream fa checks (#29471) · 460d8bbf
  Mingyuan Ma authored Nov 28, 2025
```
Signed-off-by: mingyuanm <mingyuanm@nvidia.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  460d8bbf
- [CPU] Update torch 2.9.1 for CPU backend (#29664) · e2f56c30
  Li, Jiang authored Nov 28, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e2f56c30
- Revert "Supress verbose logs from model_hosting_container_standards (… (#29335) · f8151b66
  HappyAmazonian authored Nov 28, 2025
```
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  f8151b66
- [Optimization] Early return for `_apply_matches` and `_iter_placeholders` (#29668) · 1168768a
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1168768a
- [BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542) · 8e7a8916
  Nick Hill authored Nov 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8e7a8916
- [mypy] Pass type checking for `vllm/utils` and `vllm/v1/pool` (#29666) · 953d9c82
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  953d9c82
- [Misc] Remove redundant attention var constants (#29650) · 33b06a6f
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  33b06a6f
- [Docs] Add SPLADE and Ultravox models to supported models documentation (#29659) · 5c2b5cb4
  Wilson Wu authored Nov 28, 2025
```
Signed-off-by: Wilson Wu <iwilsonwu@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  5c2b5cb4
- [Rocm] Set VLLM_ROCM_USE_AITER_FUSION_SHARED_EXPERTS default is disabled (#28985) · 3cb32e5d
  杰兮 authored Nov 28, 2025
```
Signed-off-by: zhyajie <yajizhan@amd.com>
Co-authored-by: zhyajie <yajizhan@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  3cb32e5d
- [Doc] Reorganize benchmark docs (#29658) · ccbdf51b
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ccbdf51b