Commits · ba1fcd84a7f1dc907c17bf4ba4fab6762a9f33a1 · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "ff6c1da4e6ab8d020b41c23166c7b482c047c81a"

26 Nov, 2025 15 commits
- [TPU] add tpu_inference (#27277) · ba1fcd84
  Johnny Yang authored Nov 26, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  ba1fcd84
- [Core] Refactor padding logic and pad for CUDA graphs before attention metadata building (#28579) · 56539cdd
  Lucas Wilkinson authored Nov 26, 2025
  
  56539cdd
- [Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
  Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  430dd4d9
- [refactor] CTConfig methods to static/class methods (#28870) · e6031295
  HDCharles authored Nov 26, 2025
```
Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e6031295
- [Perf] Optimize batch invariant BMM, 18.1% Throughput improvement, 10.7% TTFT improvement (#29345) · 0b0aa874
  Wentao Ye authored Nov 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0b0aa874
- Revert "[Bugfix] Fix GPT-OSS AR+NORM fusion (#28841)" (#29483) · 70d5953f
  Huamin Li authored Nov 26, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  70d5953f
- Fix TeleChatForCausalLM not register issue (#29473) · bb706d60
  Yejing Lai authored Nov 26, 2025
```
Signed-off-by: Lai, Yejing <yejing.lai@intel.com>
```
  bb706d60
- [Bugfix] Fix handling of image embeds in models (#29480) · e30859df
  Cyrus Leung authored Nov 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e30859df
- [Misc] Allow LM only loading for Pixtral (#29451) · 452a7c9f
  Roger Wang authored Nov 26, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  452a7c9f
- [Performance][MLA][ROCm] Remove redundant D2D copy in deepseek (#27457) · d9d342d2
  Pleaplusone authored Nov 26, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  d9d342d2
- [Kernel] Use pre-allocated output buffer for triton kernel fused_experts (#29219) · 53d7f1f6
  Xin Yang authored Nov 25, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  53d7f1f6
- [UX] Suppress gloo log spam (#29250) · 8d6a89df
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8d6a89df
- [Misc] Add backup hash algorithm for FIPS constrained environments (#28795) · 56531b79
  George D. Torres authored Nov 25, 2025
```
Signed-off-by: George D. Torres <gdavtor@gmail.com>
Signed-off-by: George D. Torres <41129492+geodavic@users.noreply.github.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  56531b79
- dummy run corner case (#29433) · 12866af7
  Xieyang Xu authored Nov 25, 2025
  
  12866af7
- fix assertion for single world use case (uni) (#29429) · d8819c88
  Lucia Fang authored Nov 25, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  d8819c88
25 Nov, 2025 25 commits
- [BugFix] Fix initialization of draft model. (#29319) · de75b0bb
  Andrey Khalyavin authored Nov 26, 2025
```
Signed-off-by: Andrey Khalyavin <halyavin@yandex-team.ru>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  de75b0bb
- Change warning logs to debug for unimplemented MXFP4 Linear/Attention (#29441) · 7df02897
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  7df02897
- [caching] Add enable_prompt_embeds and cpu_offload_gb to compile hashes. (#29435) · 0abc7948
  Zhengxu Chen authored Nov 25, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  0abc7948
- [Core] Support logprobs with spec decode + async scheduling (#29223) · 4e57c658
  Nick Hill authored Nov 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4e57c658
- [Compile] Refactor. Move PostGradPassManager out of Compilation config (#29340) · e7d77627
  Ilya Markov authored Nov 25, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  e7d77627
- [responsesAPI][2] parse ResponseFunctionToolCallOutputItem (#29383) · b07555d2
  Andrew Xia authored Nov 25, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  b07555d2
- Fix RoPE related failures in Transformers nightly tests (#29333) · 0353d2e1
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0353d2e1
- Scheduled removal of `override_pooler_config` and `disable_log_requests` (#29402) · a1f26768
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  a1f26768
- [Hybrid Allocator] Support KV cache groups with different block_size (#29143) · 48ddb02b
  Yifan Qiao authored Nov 25, 2025
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  48ddb02b
- [Kernel] Add NVFP4 MoE CUTLASS support for SM120 (#29242) · e5020986
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  e5020986
- [UX] Put CUDA attention backend selection log into one line (#29337) · dbc3d999
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  dbc3d999
- [Feature]: Improve GGUF loading from HuggingFace user experience like repo_id:quant_type (#29137) · 794029f0
  Injae Ryou authored Nov 25, 2025
```
Signed-off-by: Injae Ryou <injaeryou@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  794029f0
- Revert back to torch.equal over torch.allclose from #28819 (#29086) · 0231ce83
  Eldar Kurtić authored Nov 25, 2025
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
```
  0231ce83
- [Bugfix] Fix logic for choosing default prefix caching setting (#29393) · 516c3f78
  Thomas Parnell authored Nov 25, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  516c3f78
- Scheduled removal of `CompilationConfig.use_inductor` (#29323) · 51fc9e01
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  51fc9e01
- [Bugfix] Fix overallocation in MM profiling (#29386) · c2c661af
  Roger Wang authored Nov 25, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  c2c661af
- [Core] Generalize Encoder-Decoder `seq_lens` computation to avoid Whisper... · 798e87db
  Nicolò Lucchesi authored Nov 25, 2025
```
[Core] Generalize Encoder-Decoder `seq_lens` computation to avoid Whisper hardcoded logic   (#29268)
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  798e87db
- [Misc] Suppress log outputs when constructing the default vllm config. (#29291) · de688994
  wang.yuqi authored Nov 25, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  de688994
- [Frontend] Respect Chat Completion parallel_tool_calls param (#26233) · e1dd706c
  Ben Browning authored Nov 25, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  e1dd706c
- [responsesAPI] refactor construct_input_messages (#29359) · a685b47c
  Andrew Xia authored Nov 25, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  a685b47c
- [BugFix] bad_words filtering ineffective when n > 1 (#29313) · 32c40b95
  Avishek Goswami authored Nov 25, 2025
```
Signed-off-by: GOavi101 <1704178@kiit.ac.in>
```
  32c40b95
- [Misc] Streamline unique id generation (#29375) · db290610
  Nick Hill authored Nov 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  db290610
- [Bugfix] If chunked_prefill is disabled, end the scheduling early. (#28911) · 67fc16cd
  wang.yuqi authored Nov 25, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  67fc16cd
- [Bugfix] Fix GPT-OSS AR+NORM fusion (#28841) · 6330f947
  elvischenv authored Nov 25, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  6330f947
- [ROCm][CI] Fix test_cudagraph_mode failure in AMD CI (#29367) · ef1f7030
  Micah Williamson authored Nov 25, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  ef1f7030