Commits · 8e7a891602eb49d5e520e082148b1f021f9f801e · OpenDAS / vllm_cscc · GitLab

28 Nov, 2025 13 commits
- [BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542) · 8e7a8916
  Nick Hill authored Nov 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8e7a8916
- [mypy] Pass type checking for `vllm/utils` and `vllm/v1/pool` (#29666) · 953d9c82
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  953d9c82
- [Misc] Remove redundant attention var constants (#29650) · 33b06a6f
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  33b06a6f
- [Rocm] Set VLLM_ROCM_USE_AITER_FUSION_SHARED_EXPERTS default is disabled (#28985) · 3cb32e5d
  杰兮 authored Nov 28, 2025
```
Signed-off-by: zhyajie <yajizhan@amd.com>
Co-authored-by: zhyajie <yajizhan@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  3cb32e5d
- Fix parameter order in GPT-OSS weight loading function for non-MXFP4 weights (#29506) · 5f5521bd
  Filipp Fisin authored Nov 28, 2025
```
Signed-off-by: Filipp Fisin <48059208+qGentry@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  5f5521bd
- [BUGFIX] MistralTokenizer._call__ adds an invalid EOS token (#29607) · b2c1d294
  Julien Denize authored Nov 28, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  b2c1d294
- [Doc] Improve abnormal information string (#29655) · cc0f2a0e
  maang-h authored Nov 28, 2025
```
Signed-off-by: maang <maang_h@163.com>
```
  cc0f2a0e
- [Feature][Bench] Add pareto visualization (#29477) · 48059895
  rongfu.leng authored Nov 28, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  48059895
- Revert "[CPU]Update CPU PyTorch to 2.9.0 (#29589)" (#29647) · b34e8775
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b34e8775
- Improve enable chunked_prefill & prefix_caching logic. (#26623) · f4b76056
  wang.yuqi authored Nov 28, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  f4b76056
- [Multimodal][Speculative Decoding]Eagle3 mm support, enablement on qwen3vl (#29594) · 37b15e97
  EanWang211123 authored Nov 28, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: EanWang211123 <wangyiheng@sangfor.com.cn>
Co-authored-by: Louie Tsai <louie.tsai@intel.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  37b15e97
- [BugFix] Fix ValueError in NewRequestData repr methods (#29392) · c7ba1f6b
  maang-h authored Nov 28, 2025
```
Signed-off-by: maang <maang_h@163.com>
```
  c7ba1f6b
- [LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971) · 745a3bae
  Xin Yang authored Nov 27, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  745a3bae
27 Nov, 2025 27 commits
- [BugFix] Fix new nightly failures (#29578) · be493e0b
  Lucas Wilkinson authored Nov 27, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  be493e0b
- [Model Runner V2][BugFix] Keep reference to GPU tensors in AsyncOutput (#29623) · ae0ce1be
  Woosuk Kwon authored Nov 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ae0ce1be
- [BugFix] Fix `plan` API Mismatch when using latest FlashInfer (#29426) · a5345bf4
  Andrii Skliar authored Nov 27, 2025
```
Signed-off-by: Andrii Skliar <askliar@askliar-mlt.client.nvidia.com>
Co-authored-by: Andrii Skliar <askliar@askliar-mlt.client.nvidia.com>
```
  a5345bf4
- [Bugfix][MM encoder] Fix ViT attention backend resolving for Turing GPU (#29614) · 38658ec6
  Isotr0py authored Nov 28, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  38658ec6
- [Deprecation] Advance deprecation status (#29617) · a24ea541
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a24ea541
- [Misc] Remove unused code from `protocol.py` (#29616) · ea228b44
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ea228b44
- add skip_reading_prefix_cache in repr for PoolingParams (#29620) · d45269b3
  果冻虾仁 authored Nov 28, 2025
  
  d45269b3
- [Bugfix] Fix doc build on main (#29619) · ee9841da
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ee9841da
- [BugFix] Optional tokenizer argument when loading GGUF models (#29582) · 0840abdd
  Injae Ryou authored Nov 28, 2025
```
Signed-off-by: Injae Ryou <injaeryou@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  0840abdd
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
- [bugfix] avoid NIXL_ERR_REMOTE_DISCONNECT in nixl_connector when Prefill dies (#28120) · cd007a53
  Mathis Felardos authored Nov 27, 2025
```
Signed-off-by: Mathis Felardos <mathis@mistral.ai>
```
  cd007a53
- [Doc]: fixing typos in diverse files (#29492) · 66d3d542
  Didier Durand authored Nov 27, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  66d3d542
- [LoRA] Continue optimizing MoE LoRA weight loading (#29322) · 2f5f9acd
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2f5f9acd
- [Bugfix] Fix HunyuanVL XD-RoPE (#29593) · cf348c8d
  Roger Wang authored Nov 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored by: grider-transwithai <grider@transwith.ai>
```
  cf348c8d
- [Bugfix] Fix pre-commit (#29601) · e6d4f3c2
  Cyrus Leung authored Nov 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e6d4f3c2
- [Docs] Improve `priority` parameter documentation (#29572) · 51906c8c
  maang-h authored Nov 27, 2025
```
Signed-off-by: maang <maang_h@163.com>
Signed-off-by: maang-h <55082429+maang-h@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  51906c8c
- [Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e
  Morrison Turnansky authored Nov 27, 2025
```
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0838b52e
- [Bugfix] Update Ultravox compatibility (#29588) · 00d3310d
  Cyrus Leung authored Nov 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  00d3310d
- [Model Runner V2] Implement multi-step Eagle with CUDA graph (#29559) · da3222f3
  Woosuk Kwon authored Nov 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  da3222f3
- Fix tpu-inference platform path (#29554) · 3ecabd06
  Johnny Yang authored Nov 26, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  3ecabd06
- [Bugfix] Fix getting device for MoE LoRA (#29475) · c069086b
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c069086b
- [Model Runner V2] Refactor CudaGraphManager (#29583) · 11ea5ec1
  Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  11ea5ec1
- [Model Runner V2] Minor cleanup for build_attn_metadata (#29576) · ee80aee1
  Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ee80aee1
- [Model Runner V2] Minor code cleanup (#29570) · 0aeb698b
  Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0aeb698b
- [Bugfix] fix IMA issue in certain cases of the moe marlin kernel (#28619) · a67dec7c
  Jinzhen Lin authored Nov 27, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  a67dec7c
- [Attention][Async] Eliminate `seq_lens_cpu` in FlashAttention metadata... · 77740191
  Matthew Bonanni authored Nov 26, 2025
```
[Attention][Async] Eliminate `seq_lens_cpu` in FlashAttention metadata building with DCP > 1 (#29449)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77740191
- [Bugfix] Make compressed-tensors MoEs respect ignored layers (#28878) · df01eda4
  HDCharles authored Nov 26, 2025
```
Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
```
  df01eda4