Commits · 51906c8c559f1d7c23efa667fcb3b7ed79f7fa25 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "7b165eb401d09abcf4164a2da9f2265387d05420"

27 Nov, 2025 12 commits

[Docs] Improve `priority` parameter documentation (#29572) · 51906c8c

maang-h authored Nov 27, 2025


Signed-off-by: maang <maang_h@163.com>
Signed-off-by: maang-h <55082429+maang-h@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

51906c8c

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e

Morrison Turnansky authored Nov 27, 2025


Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

0838b52e

[Bugfix] Update Ultravox compatibility (#29588) · 00d3310d
Cyrus Leung authored Nov 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
00d3310d
[Model Runner V2] Implement multi-step Eagle with CUDA graph (#29559) · da3222f3
Woosuk Kwon authored Nov 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
da3222f3
Fix tpu-inference platform path (#29554) · 3ecabd06
Johnny Yang authored Nov 26, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
3ecabd06
[Bugfix] Fix getting device for MoE LoRA (#29475) · c069086b
Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
c069086b
[Model Runner V2] Refactor CudaGraphManager (#29583) · 11ea5ec1
Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
11ea5ec1
[Model Runner V2] Minor cleanup for build_attn_metadata (#29576) · ee80aee1
Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
ee80aee1
[Model Runner V2] Minor code cleanup (#29570) · 0aeb698b
Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
0aeb698b

[Bugfix] fix IMA issue in certain cases of the moe marlin kernel (#28619) · a67dec7c

Jinzhen Lin authored Nov 27, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

a67dec7c

[Attention][Async] Eliminate `seq_lens_cpu` in FlashAttention metadata... · 77740191

Matthew Bonanni authored Nov 26, 2025


[Attention][Async] Eliminate `seq_lens_cpu` in FlashAttention metadata building with DCP > 1 (#29449)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>

77740191

[Bugfix] Make compressed-tensors MoEs respect ignored layers (#28878) · df01eda4
HDCharles authored Nov 26, 2025
```
Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
```
df01eda4

26 Nov, 2025 15 commits
- [TPU] add tpu_inference (#27277) · ba1fcd84
  Johnny Yang authored Nov 26, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  ba1fcd84
- [Core] Refactor padding logic and pad for CUDA graphs before attention metadata building (#28579) · 56539cdd
  Lucas Wilkinson authored Nov 26, 2025
  
  56539cdd
- [Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
  Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  430dd4d9
- [refactor] CTConfig methods to static/class methods (#28870) · e6031295
  HDCharles authored Nov 26, 2025
```
Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e6031295
- [Perf] Optimize batch invariant BMM, 18.1% Throughput improvement, 10.7% TTFT improvement (#29345) · 0b0aa874
  Wentao Ye authored Nov 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0b0aa874
- Revert "[Bugfix] Fix GPT-OSS AR+NORM fusion (#28841)" (#29483) · 70d5953f
  Huamin Li authored Nov 26, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  70d5953f
- Fix TeleChatForCausalLM not register issue (#29473) · bb706d60
  Yejing Lai authored Nov 26, 2025
```
Signed-off-by: Lai, Yejing <yejing.lai@intel.com>
```
  bb706d60
- [Bugfix] Fix handling of image embeds in models (#29480) · e30859df
  Cyrus Leung authored Nov 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e30859df
- [Misc] Allow LM only loading for Pixtral (#29451) · 452a7c9f
  Roger Wang authored Nov 26, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  452a7c9f
- [Performance][MLA][ROCm] Remove redundant D2D copy in deepseek (#27457) · d9d342d2
  Pleaplusone authored Nov 26, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  d9d342d2
- [Kernel] Use pre-allocated output buffer for triton kernel fused_experts (#29219) · 53d7f1f6
  Xin Yang authored Nov 25, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  53d7f1f6
- [UX] Suppress gloo log spam (#29250) · 8d6a89df
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8d6a89df
- [Misc] Add backup hash algorithm for FIPS constrained environments (#28795) · 56531b79
  George D. Torres authored Nov 25, 2025
```
Signed-off-by: George D. Torres <gdavtor@gmail.com>
Signed-off-by: George D. Torres <41129492+geodavic@users.noreply.github.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  56531b79
- dummy run corner case (#29433) · 12866af7
  Xieyang Xu authored Nov 25, 2025
  
  12866af7
- fix assertion for single world use case (uni) (#29429) · d8819c88
  Lucia Fang authored Nov 25, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  d8819c88
25 Nov, 2025 13 commits
- [BugFix] Fix initialization of draft model. (#29319) · de75b0bb
  Andrey Khalyavin authored Nov 26, 2025
```
Signed-off-by: Andrey Khalyavin <halyavin@yandex-team.ru>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  de75b0bb
- Change warning logs to debug for unimplemented MXFP4 Linear/Attention (#29441) · 7df02897
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  7df02897
- [caching] Add enable_prompt_embeds and cpu_offload_gb to compile hashes. (#29435) · 0abc7948
  Zhengxu Chen authored Nov 25, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  0abc7948
- [Core] Support logprobs with spec decode + async scheduling (#29223) · 4e57c658
  Nick Hill authored Nov 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4e57c658
- [Compile] Refactor. Move PostGradPassManager out of Compilation config (#29340) · e7d77627
  Ilya Markov authored Nov 25, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  e7d77627
- [responsesAPI][2] parse ResponseFunctionToolCallOutputItem (#29383) · b07555d2
  Andrew Xia authored Nov 25, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  b07555d2
- Fix RoPE related failures in Transformers nightly tests (#29333) · 0353d2e1
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0353d2e1
- Scheduled removal of `override_pooler_config` and `disable_log_requests` (#29402) · a1f26768
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  a1f26768
- [Hybrid Allocator] Support KV cache groups with different block_size (#29143) · 48ddb02b
  Yifan Qiao authored Nov 25, 2025
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  48ddb02b
- [Kernel] Add NVFP4 MoE CUTLASS support for SM120 (#29242) · e5020986
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  e5020986
- [UX] Put CUDA attention backend selection log into one line (#29337) · dbc3d999
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  dbc3d999
- [Feature]: Improve GGUF loading from HuggingFace user experience like repo_id:quant_type (#29137) · 794029f0
  Injae Ryou authored Nov 25, 2025
```
Signed-off-by: Injae Ryou <injaeryou@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  794029f0
- Revert back to torch.equal over torch.allclose from #28819 (#29086) · 0231ce83
  Eldar Kurtić authored Nov 25, 2025
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
```
  0231ce83