Commits · f95da13c3da5e5ff74e5f5f1da109c5e1cae0886 · OpenDAS / vllm_cscc

21 Oct, 2025 10 commits

[ModelOpt] Load w13/w2_input_scale for all experts, nvfp4 (#26135) · f95da13c

Shu Wang authored Oct 21, 2025


Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

f95da13c

[BugFix] GPT-OSS Attention DP + MoE TP weight loading issue (#24032) · aef368aa
Po-Han Huang (NVIDIA) authored Oct 21, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
aef368aa

[Feature][Kernel]FusedMoE LoRA (#21229) · 5f6cbf60

Chen Wu authored Oct 21, 2025


Signed-off-by: wuchen <cntryroa@gmail.com>
Signed-off-by: banjuede <lmklhc@163.com>
Signed-off-by: Chen Wu <cntryroa@gmail.com>
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: wuchen <wuchen@zetyun.com>
Co-authored-by: Nathan Van Gheem <vangheem@gmail.com>
Co-authored-by: banjuede <lmklhc@163.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>

5f6cbf60

[Frontend] Enforce tokenize=False when applying chat template (#27205) · 3ada34f9
Russell Bryant authored Oct 20, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
3ada34f9
create is_in_the_same_node on cpu (#26832) · 0eb8f2b8
Lunwen He authored Oct 20, 2025
```
Co-authored-by: Lunwen He <lunwenh@meta.com>
```
0eb8f2b8
[cpu] Dispatch un-quantized linear to oneDNN/ACL by default for AArch64 (#27183) · 163965d1
Fadi Arafeh authored Oct 21, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Michael Yang <Michael.Yang@arm.com>
```
163965d1
[V0 Deprecation] Remove V0 metrics code (#27215) · a03cf9bc
Nick Hill authored Oct 20, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
a03cf9bc
[Quantization] Automatically infer AWQ `modules_to_not_convert` field (#26909) · 352c0c8a
Isotr0py authored Oct 21, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
352c0c8a

[ez] add uv lock to gitignore (#27212) · bfe0b4bd

Andrew Xia authored Oct 20, 2025


Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>

bfe0b4bd

[ROCm] enable some tests in entrypoints test groups on AMD (#26725) · 58fbbcb2
Concurrensee authored Oct 20, 2025
```
Signed-off-by: Yida <yida.wu@amd.com>
```
58fbbcb2

20 Oct, 2025 8 commits

[Feature][Quantization] auto_round support for mixed bits quantization (#23812) · 87778d5f

Heng Guo authored Oct 21, 2025

Signed-off-by: n1ck-guo <heng.guo@intel.com>
Signed-off-by: Heng Guo <heng.guo@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

87778d5f

[Bugfix][CI] Fix `Distributed Tests (4 GPUs)` async_sched+ray test (#27195) · f9e7ad54
Nicolò Lucchesi authored Oct 20, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
f9e7ad54
[Kernel][Model] Tune fused_moe Triton configs for Qwen3-30B A3/A3B on H100 (FP8/BF16) (#26268) · 4d0f2661
shivampr authored Oct 20, 2025
```
Signed-off-by: Shivam <shivampr.dev@gmail.com>
```
4d0f2661

Nemotron Nano V2 VL + EVS Video Support (#27107) · e93ff6c8

Eugene Khvedchenya authored Oct 20, 2025


Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Natan Bagrov <nbagrov@nvidia.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Natan Bagrov <nbagrov@nvidia.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

e93ff6c8

AArch64 CPU Docker pipeline (#26931) · 1c691f4a
ioana ghiban authored Oct 20, 2025

1c691f4a
[Kernel] Accelerate solve_tril with TMA (#26746) · 9fce7bee
Jiangyun Zhu authored Oct 20, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
9fce7bee

[LoRA] LoRA cuda graph specialization (#25914) · b63f2143

Andy Lo authored Oct 20, 2025


Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

b63f2143

[Model][VLM] Support Bee-8B Model (#27012) · f32bf758

Yi Zhang authored Oct 20, 2025


Signed-off-by: uyzhang <yi.zhang.4096@gmail.com>
Signed-off-by: Yi Zhang <zhangyi970819@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

f32bf758

19 Oct, 2025 9 commits
- Fix typo in ValueError message: use `kv_role` instead of `kv_disagg_role` (#27166) · 8a81d776
  Yongtao Huang authored Oct 20, 2025
```
Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com>
```
  8a81d776
- [Bugfix] Fix error with penalties when speculative decoding and structural... · f6fdacd8
  Sergei Skvortsov authored Oct 19, 2025
```
[Bugfix] Fix error with penalties when speculative decoding and structural output are enabled (#26586)
Signed-off-by: southfreebird <yvorott@gmail.com>
```
  f6fdacd8
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
- [Chore] Separate out `vllm.utils.network_utils` (#27164) · 7a6c8c3f
  iAmir97 authored Oct 19, 2025
```
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
```
  7a6c8c3f
- output type conversion fix (#27159) · 221bf725
  Jianyu Huang authored Oct 19, 2025
  
  221bf725
- [Benchmark] Convenience script for multiple parameter combinations (#27085) · b3aba04e
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b3aba04e
- [Chore] Separate out hashing utilities from vllm.utils (#27151) · 8a297115
  dongbo910220 authored Oct 19, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  8a297115
- [BugFix] Fix lazy imports involving outlines_core (#27158) · 191eed0b
  22quinn authored Oct 18, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  191eed0b
- [Minor] Remove unused env variable (#27161) · fb860670
  Woosuk Kwon authored Oct 18, 2025
  
  fb860670
18 Oct, 2025 13 commits
- [V1][Metrics][Plugin] Add plugin support for custom `StatLoggerBase` implementations (#22456) · 83e760c5
  Tova Movshovitz authored Oct 19, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
```
  83e760c5
- [BugFix] Disable fp8 kv-cache by default for DeepSeek V3.2 (#27121) · c2bba690
  Lucas Wilkinson authored Oct 18, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c2bba690
- [BugFix] fix graph partition signature (#27139) · e133d6d2
  Boyuan Feng authored Oct 18, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  e133d6d2
- [Chore] Separate out profiling utilities from vllm.utils (#27150) · a1946c9f
  dongbo910220 authored Oct 19, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  a1946c9f
- [BugFix] Fix failing gemma-3-1b-it test:... · 9f020f4f
  Lucas Wilkinson authored Oct 18, 2025
```
[BugFix] Fix failing gemma-3-1b-it test: `test_lm_eval_accuracy_v1_engine[google/gemma-3-1b-it]` (#27111)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  9f020f4f
- [Minor] Add some clarifying comments to recent changes (#27130) · 3b450752
  Nick Hill authored Oct 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  3b450752
- Fix incorrect string formatting in barrier timeout exceptions (#27149) · 168e578e
  Yongtao Huang authored Oct 19, 2025
```
Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com>
```
  168e578e
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
- [Models][QwenVL] Remove unnecessary `.contiguous()` calls (#27106) · 5c2acb27
  Lukas Geiger authored Oct 18, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  5c2acb27
- [Misc] Refactor `get_kv_cache_spec` into `AttentionLayerBase` (#26587) · b26b70be
  Nicolò Lucchesi authored Oct 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  b26b70be
- [fix][cpu] fix prefill attention in CPU attention backend (#27035) · ab4be40f
  Fadi Arafeh authored Oct 18, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  ab4be40f
- [Feature] Batch Invariant: Support DeepGEMM and Blackwell (#27127) · 245e4f2c
  Wentao Ye authored Oct 18, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  245e4f2c
- [Chore] Separate out `vllm.utils.mem_utils` (#27143) · 1d165d6d
  iAmir97 authored Oct 18, 2025
```
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  1d165d6d