Commits · 80e94529845d78284047e52f6253889c534bce13 · OpenDAS / vllm_cscc

"examples/custom_backend/hello_world/README.md" did not exist on "4498a77d0b9748878f2ca15470add0f3c56917eb"

21 Oct, 2025 14 commits

[Deepseek v3.2] Optimize top_k_per_row (#26763) · 80e94529
Daniel Cámpora authored Oct 21, 2025
```
Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
```
80e94529
[MM][Core] Decouple ViT backend from LM backend (#27061) · c3a2c6ac
Roger Wang authored Oct 21, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
c3a2c6ac
[Nixl] Minor refactor to handshake related metadata (#26410) · 72f431e7
Nicolò Lucchesi authored Oct 21, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
72f431e7
[Fix][Spec Decode] Fix llama4 draft loading with different quantization (#27136) · be444507
Zebing Lin authored Oct 21, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
be444507
[Bugfix] Fix broken MTP weight loading for FP8 KV Scales (#27227) · f381cf23
Benjamin Chislett authored Oct 21, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
f381cf23

[Bugfix] Fix gpt-oss w4a8 DP/EP on B200 (#26729) · 5ff5d94e

Varun Sundar Rabindranath authored Oct 21, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

5ff5d94e

[ModelOpt] Load w13/w2_input_scale for all experts, nvfp4 (#26135) · f95da13c

Shu Wang authored Oct 21, 2025


Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

f95da13c

[BugFix] GPT-OSS Attention DP + MoE TP weight loading issue (#24032) · aef368aa
Po-Han Huang (NVIDIA) authored Oct 21, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
aef368aa

[Feature][Kernel]FusedMoE LoRA (#21229) · 5f6cbf60

Chen Wu authored Oct 21, 2025


Signed-off-by: wuchen <cntryroa@gmail.com>
Signed-off-by: banjuede <lmklhc@163.com>
Signed-off-by: Chen Wu <cntryroa@gmail.com>
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: wuchen <wuchen@zetyun.com>
Co-authored-by: Nathan Van Gheem <vangheem@gmail.com>
Co-authored-by: banjuede <lmklhc@163.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>

5f6cbf60

[Frontend] Enforce tokenize=False when applying chat template (#27205) · 3ada34f9
Russell Bryant authored Oct 20, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
3ada34f9
create is_in_the_same_node on cpu (#26832) · 0eb8f2b8
Lunwen He authored Oct 20, 2025
```
Co-authored-by: Lunwen He <lunwenh@meta.com>
```
0eb8f2b8
[cpu] Dispatch un-quantized linear to oneDNN/ACL by default for AArch64 (#27183) · 163965d1
Fadi Arafeh authored Oct 21, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Michael Yang <Michael.Yang@arm.com>
```
163965d1
[V0 Deprecation] Remove V0 metrics code (#27215) · a03cf9bc
Nick Hill authored Oct 20, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
a03cf9bc
[Quantization] Automatically infer AWQ `modules_to_not_convert` field (#26909) · 352c0c8a
Isotr0py authored Oct 21, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
352c0c8a

20 Oct, 2025 6 commits

[Feature][Quantization] auto_round support for mixed bits quantization (#23812) · 87778d5f

Heng Guo authored Oct 21, 2025

Signed-off-by: n1ck-guo <heng.guo@intel.com>
Signed-off-by: Heng Guo <heng.guo@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

87778d5f

[Kernel][Model] Tune fused_moe Triton configs for Qwen3-30B A3/A3B on H100 (FP8/BF16) (#26268) · 4d0f2661
shivampr authored Oct 20, 2025
```
Signed-off-by: Shivam <shivampr.dev@gmail.com>
```
4d0f2661

Nemotron Nano V2 VL + EVS Video Support (#27107) · e93ff6c8

Eugene Khvedchenya authored Oct 20, 2025


Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Natan Bagrov <nbagrov@nvidia.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Natan Bagrov <nbagrov@nvidia.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

e93ff6c8

[Kernel] Accelerate solve_tril with TMA (#26746) · 9fce7bee
Jiangyun Zhu authored Oct 20, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
9fce7bee

[LoRA] LoRA cuda graph specialization (#25914) · b63f2143

Andy Lo authored Oct 20, 2025


Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

b63f2143

[Model][VLM] Support Bee-8B Model (#27012) · f32bf758

Yi Zhang authored Oct 20, 2025


Signed-off-by: uyzhang <yi.zhang.4096@gmail.com>
Signed-off-by: Yi Zhang <zhangyi970819@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

f32bf758

19 Oct, 2025 9 commits
- Fix typo in ValueError message: use `kv_role` instead of `kv_disagg_role` (#27166) · 8a81d776
  Yongtao Huang authored Oct 20, 2025
```
Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com>
```
  8a81d776
- [Bugfix] Fix error with penalties when speculative decoding and structural... · f6fdacd8
  Sergei Skvortsov authored Oct 19, 2025
```
[Bugfix] Fix error with penalties when speculative decoding and structural output are enabled (#26586)
Signed-off-by: southfreebird <yvorott@gmail.com>
```
  f6fdacd8
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
- [Chore] Separate out `vllm.utils.network_utils` (#27164) · 7a6c8c3f
  iAmir97 authored Oct 19, 2025
```
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
```
  7a6c8c3f
- output type conversion fix (#27159) · 221bf725
  Jianyu Huang authored Oct 19, 2025
  
  221bf725
- [Benchmark] Convenience script for multiple parameter combinations (#27085) · b3aba04e
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b3aba04e
- [Chore] Separate out hashing utilities from vllm.utils (#27151) · 8a297115
  dongbo910220 authored Oct 19, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  8a297115
- [BugFix] Fix lazy imports involving outlines_core (#27158) · 191eed0b
  22quinn authored Oct 18, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  191eed0b
- [Minor] Remove unused env variable (#27161) · fb860670
  Woosuk Kwon authored Oct 18, 2025
  
  fb860670
18 Oct, 2025 11 commits
- [V1][Metrics][Plugin] Add plugin support for custom `StatLoggerBase` implementations (#22456) · 83e760c5
  Tova Movshovitz authored Oct 19, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
```
  83e760c5
- [BugFix] Disable fp8 kv-cache by default for DeepSeek V3.2 (#27121) · c2bba690
  Lucas Wilkinson authored Oct 18, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c2bba690
- [BugFix] fix graph partition signature (#27139) · e133d6d2
  Boyuan Feng authored Oct 18, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  e133d6d2
- [Chore] Separate out profiling utilities from vllm.utils (#27150) · a1946c9f
  dongbo910220 authored Oct 19, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  a1946c9f
- [Minor] Add some clarifying comments to recent changes (#27130) · 3b450752
  Nick Hill authored Oct 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  3b450752
- Fix incorrect string formatting in barrier timeout exceptions (#27149) · 168e578e
  Yongtao Huang authored Oct 19, 2025
```
Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com>
```
  168e578e
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
- [Models][QwenVL] Remove unnecessary `.contiguous()` calls (#27106) · 5c2acb27
  Lukas Geiger authored Oct 18, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  5c2acb27
- [Misc] Refactor `get_kv_cache_spec` into `AttentionLayerBase` (#26587) · b26b70be
  Nicolò Lucchesi authored Oct 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  b26b70be
- [fix][cpu] fix prefill attention in CPU attention backend (#27035) · ab4be40f
  Fadi Arafeh authored Oct 18, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  ab4be40f
- [Feature] Batch Invariant: Support DeepGEMM and Blackwell (#27127) · 245e4f2c
  Wentao Ye authored Oct 18, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  245e4f2c