Commits · 7a6c8c3fa150957d154ea729490d38dc6f023229 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "7243e02aa1c6e01ab1d2a50aa7e27ebc9b2c6719"

19 Oct, 2025 6 commits
- [Chore] Separate out `vllm.utils.network_utils` (#27164) · 7a6c8c3f
  iAmir97 authored Oct 19, 2025
```
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
```
  7a6c8c3f
- output type conversion fix (#27159) · 221bf725
  Jianyu Huang authored Oct 19, 2025
  
  221bf725
- [Benchmark] Convenience script for multiple parameter combinations (#27085) · b3aba04e
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b3aba04e
- [Chore] Separate out hashing utilities from vllm.utils (#27151) · 8a297115
  dongbo910220 authored Oct 19, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  8a297115
- [BugFix] Fix lazy imports involving outlines_core (#27158) · 191eed0b
  22quinn authored Oct 18, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  191eed0b
- [Minor] Remove unused env variable (#27161) · fb860670
  Woosuk Kwon authored Oct 18, 2025
  
  fb860670
18 Oct, 2025 15 commits

[V1][Metrics][Plugin] Add plugin support for custom `StatLoggerBase` implementations (#22456) · 83e760c5
Tova Movshovitz authored Oct 19, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
```
83e760c5

[BugFix] Disable fp8 kv-cache by default for DeepSeek V3.2 (#27121) · c2bba690

Lucas Wilkinson authored Oct 18, 2025

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c2bba690

[BugFix] fix graph partition signature (#27139) · e133d6d2
Boyuan Feng authored Oct 18, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
e133d6d2
[Chore] Separate out profiling utilities from vllm.utils (#27150) · a1946c9f
dongbo910220 authored Oct 19, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
a1946c9f
[Minor] Add some clarifying comments to recent changes (#27130) · 3b450752
Nick Hill authored Oct 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
3b450752
Fix incorrect string formatting in barrier timeout exceptions (#27149) · 168e578e
Yongtao Huang authored Oct 19, 2025
```
Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com>
```
168e578e
[Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
6ac5e06f
[Models][QwenVL] Remove unnecessary `.contiguous()` calls (#27106) · 5c2acb27
Lukas Geiger authored Oct 18, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
5c2acb27
[Misc] Refactor `get_kv_cache_spec` into `AttentionLayerBase` (#26587) · b26b70be
Nicolò Lucchesi authored Oct 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
b26b70be
[fix][cpu] fix prefill attention in CPU attention backend (#27035) · ab4be40f
Fadi Arafeh authored Oct 18, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
ab4be40f
[Feature] Batch Invariant: Support DeepGEMM and Blackwell (#27127) · 245e4f2c
Wentao Ye authored Oct 18, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
245e4f2c

[Chore] Separate out `vllm.utils.mem_utils` (#27143) · 1d165d6d

iAmir97 authored Oct 18, 2025

Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

1d165d6d

[Misc] Rev DeepEP (#27122) · 30a33b92

Varun Sundar Rabindranath authored Oct 18, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

30a33b92

[GPT-OSS] Structure_Tag support for gpt-oss tool-call in cot (#25515) · 7c572544

Hanchenli authored Oct 17, 2025


Signed-off-by: Hanchenli <lihanc2002@gmail.com>
Signed-off-by: Hanchenli <61769611+Hanchenli@users.noreply.github.com>
Signed-off-by: Wei Wei <wwei6@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Wei Wei <wwei6@meta.com>
Co-authored-by: Wei Wei <weiweinpu@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

7c572544

[Perf] Add H100 fused MoE config (#25398) · c981f0ea
ZiTian Zhao authored Oct 18, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
c981f0ea

17 Oct, 2025 19 commits
- [BugFix][Core] Fix error when enable async-scheduling in multi-node env (#25887) · 6367bde7
  Lehua Ding authored Oct 18, 2025
```
Signed-off-by: Lehua Ding <lehuading@tencent.com>
Signed-off-by: Lehua Ding <lehuading@qq.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  6367bde7
- [V1][Spec Decode] Fix greedy temperature detection after sampler refactor (#27077) · acedc74b
  Pradyun92 authored Oct 17, 2025
```
Signed-off-by: Pradyun Ramadorai <pradyunr@amazon.com>
Co-authored-by: Pradyun Ramadorai <pradyunr@amazon.com>
```
  acedc74b
- [Minor] Remove unnecessary error message (#27115) · d29483b5
  Zhuohan Li authored Oct 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  d29483b5
- [Bugfix] Use PIECEWISE cudagraphs on Blackwell if max_model_len > 131072 (#27114) · 950cf9e5
  Michael Goin authored Oct 17, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  950cf9e5
- [Chore] Remove unused `PolyNorm` layer (#27110) · 3125d799
  Isotr0py authored Oct 18, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3125d799
- [Bugfix] [AITER] [ROCm] Fix Quark MoE Quant Config and AITER Fused MoE quant type logic (#27029) · e33ee23e
  vllmellm authored Oct 18, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  e33ee23e
- [ROCM] MoE fp4 CK kernel (#26545) · 0925b28a
  Aleksandr Malyshev authored Oct 17, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
  0925b28a
- [bugfix] Qwen3-VL fix video incorrect timestamp calculations while do_sample_frames=True (#27104) · 4c91a28e
  燃 authored Oct 18, 2025
```
Co-authored-by: 松灵 <wpf272043@alibaba-inc.com>
```
  4c91a28e
- [Data-parallel] Allow DP>1 for world_size > num_gpus on node (8) (#26367) · b038d9c4
  Patrick von Platen authored Oct 17, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
```
  b038d9c4
- [torch.compile] Enable attention and allreduce fusion without custom ops enabled (#24604) · bd7157a0
  Luka Govedič authored Oct 17, 2025
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  bd7157a0
- Fix incorrect docstring for stop_profile() method (#27101) · be429d0c
  Yongtao Huang authored Oct 17, 2025
```
Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com>
```
  be429d0c
- [Harware][AMD][Model] Triton MoE tuning configs for GLM-4.5 for MI350 and MI355 (#25586) · c253745e
  Reima Karhila (AMD) authored Oct 17, 2025
```
Signed-off-by: Reima Karhila <reima.karhila@amd.com>
Signed-off-by: xaguilar <Xavier.AguilarFruto@amd.com>
Co-authored-by: xaguilar <Xavier.AguilarFruto@amd.com>
```
  c253745e
- [Model]Improve Qwen3VLMoeForConditionalGeneration packed_modules_mapping (#27096) · daec4d26
  Jee Jee Li authored Oct 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  daec4d26
- [Docs] Replace `rst` style double-backtick with `md` single-backtick (#27091) · 6c9fdbf7
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c9fdbf7
- [VLM][Refactor] Remove useless func `get_input_positions` in `MRotaryEmbedding` (#27088) · e20eba75
  Mengqing Cao authored Oct 17, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  e20eba75
- [Kernel][Performance] Fuse float cast and renormalize to topk softmax kernel (#26717) · 75c7ad99
  zhrrr authored Oct 17, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
```
  75c7ad99
- [Model] Add support for LightOnOCR (#26916) · 3aeb19a3
  Said Taghadouini authored Oct 17, 2025
```
Signed-off-by: Said Taghadouini <taghadouinisaid@gmail.com>
Signed-off-by: Said Taghadouini <84044788+staghado@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  3aeb19a3
- [Model] Always use Transformers backend for PaliGemma and Gemma3-MM (#26715) · 8c017b34
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8c017b34
- [Kernel] Lazy import FlashInfer (#26977) · fec2b341
  Jee Jee Li authored Oct 17, 2025
  
  fec2b341