Commits · 0840abdd242bbc7d0c42f0bfa73fec94a44e921b · OpenDAS / vllm_cscc · GitLab

27 Nov, 2025 27 commits
- [BugFix] Optional tokenizer argument when loading GGUF models (#29582) · 0840abdd
  Injae Ryou authored Nov 28, 2025
```
Signed-off-by: Injae Ryou <injaeryou@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  0840abdd
- Update Transformers pin in CI to 4.57.3 (#29418) · e1f26233
  Harry Mellor authored Nov 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e1f26233
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
- [bugfix] avoid NIXL_ERR_REMOTE_DISCONNECT in nixl_connector when Prefill dies (#28120) · cd007a53
  Mathis Felardos authored Nov 27, 2025
```
Signed-off-by: Mathis Felardos <mathis@mistral.ai>
```
  cd007a53
- [Doc]: fixing typos in diverse files (#29492) · 66d3d542
  Didier Durand authored Nov 27, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  66d3d542
- [CI/Build] Skip ray tests on ROCm (#29556) · bab438ff
  Ryan Rock authored Nov 27, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  bab438ff
- [CI/Build][Bugfix] Fix auto label issues for CPU (#29610) · 882851dc
  Li, Jiang authored Nov 27, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  882851dc
- [LoRA] Continue optimizing MoE LoRA weight loading (#29322) · 2f5f9acd
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2f5f9acd
- [Bugfix] Fix HunyuanVL XD-RoPE (#29593) · cf348c8d
  Roger Wang authored Nov 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored by: grider-transwithai <grider@transwith.ai>
```
  cf348c8d
- [CI] Auto label CPU related issues (#29602) · a5abd1d3
  Li, Jiang authored Nov 27, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a5abd1d3
- [Bugfix] Fix pre-commit (#29601) · e6d4f3c2
  Cyrus Leung authored Nov 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e6d4f3c2
- [Docs] Improve `priority` parameter documentation (#29572) · 51906c8c
  maang-h authored Nov 27, 2025
```
Signed-off-by: maang <maang_h@163.com>
Signed-off-by: maang-h <55082429+maang-h@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  51906c8c
- [Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e
  Morrison Turnansky authored Nov 27, 2025
```
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0838b52e
- [Bugfix] Update Ultravox compatibility (#29588) · 00d3310d
  Cyrus Leung authored Nov 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  00d3310d
- [Model Runner V2] Implement multi-step Eagle with CUDA graph (#29559) · da3222f3
  Woosuk Kwon authored Nov 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  da3222f3
- [ROCm][CI] Fix test_cpu_offloading for ROCm (#29548) · 43c57925
  Micah Williamson authored Nov 27, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  43c57925
- Fix tpu-inference platform path (#29554) · 3ecabd06
  Johnny Yang authored Nov 26, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  3ecabd06
- [Bugfix] Fix getting device for MoE LoRA (#29475) · c069086b
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c069086b
- [Model Runner V2] Refactor CudaGraphManager (#29583) · 11ea5ec1
  Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  11ea5ec1
- [cpu][fix] Fix Arm CI tests (#29552) · ecb19523
  Fadi Arafeh authored Nov 27, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  ecb19523
- [DOC] Add vLLM Bangkok Meetup info (#29561) · da8e1a1b
  TJian authored Nov 27, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  da8e1a1b
- [Model Runner V2] Minor cleanup for build_attn_metadata (#29576) · ee80aee1
  Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ee80aee1
- [Model Runner V2] Minor code cleanup (#29570) · 0aeb698b
  Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0aeb698b
- add xpu supported model and model id for cpu (#29380) · 9bb33c89
  Louie Tsai authored Nov 26, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
```
  9bb33c89
- [Bugfix] fix IMA issue in certain cases of the moe marlin kernel (#28619) · a67dec7c
  Jinzhen Lin authored Nov 27, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  a67dec7c
- [Attention][Async] Eliminate `seq_lens_cpu` in FlashAttention metadata... · 77740191
  Matthew Bonanni authored Nov 26, 2025
```
[Attention][Async] Eliminate `seq_lens_cpu` in FlashAttention metadata building with DCP > 1 (#29449)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77740191
- [Bugfix] Make compressed-tensors MoEs respect ignored layers (#28878) · df01eda4
  HDCharles authored Nov 26, 2025
```
Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
```
  df01eda4
26 Nov, 2025 13 commits
- [TPU] add tpu_inference (#27277) · ba1fcd84
  Johnny Yang authored Nov 26, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  ba1fcd84
- [Core] Refactor padding logic and pad for CUDA graphs before attention metadata building (#28579) · 56539cdd
  Lucas Wilkinson authored Nov 26, 2025
  
  56539cdd
- [Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
  Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  430dd4d9
- [CI/Build] allow user modify pplx and deepep ref by ENV or command line (#29131) · c4c0354e
  Alec authored Nov 26, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  c4c0354e
- [refactor] CTConfig methods to static/class methods (#28870) · e6031295
  HDCharles authored Nov 26, 2025
```
Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e6031295
- [Perf] Optimize batch invariant BMM, 18.1% Throughput improvement, 10.7% TTFT improvement (#29345) · 0b0aa874
  Wentao Ye authored Nov 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0b0aa874
- Revert "[Bugfix] Fix GPT-OSS AR+NORM fusion (#28841)" (#29483) · 70d5953f
  Huamin Li authored Nov 26, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  70d5953f
- Optimize the wording of the document and unify the terminology and th… (#29491) · 3650a74e
  yxt authored Nov 26, 2025
  
  3650a74e
- Fix TeleChatForCausalLM not register issue (#29473) · bb706d60
  Yejing Lai authored Nov 26, 2025
```
Signed-off-by: Lai, Yejing <yejing.lai@intel.com>
```
  bb706d60
- [Bugfix] Fix handling of image embeds in models (#29480) · e30859df
  Cyrus Leung authored Nov 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e30859df
- [Misc] Allow LM only loading for Pixtral (#29451) · 452a7c9f
  Roger Wang authored Nov 26, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  452a7c9f
- [Performance][MLA][ROCm] Remove redundant D2D copy in deepseek (#27457) · d9d342d2
  Pleaplusone authored Nov 26, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  d9d342d2
- [Kernel] Use pre-allocated output buffer for triton kernel fused_experts (#29219) · 53d7f1f6
  Xin Yang authored Nov 25, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  53d7f1f6