Commits · e93ff6c8b92b7e7d067f535b52ac7c6304e6b316 · OpenDAS / vllm_cscc

"components/backends/sglang/deploy/agg_logging.yaml" did not exist on "5bf23d54f3e46a15ff5000773a32d8829befa919"

20 Oct, 2025 3 commits

Nemotron Nano V2 VL + EVS Video Support (#27107) · e93ff6c8

Eugene Khvedchenya authored Oct 20, 2025


Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Natan Bagrov <nbagrov@nvidia.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Natan Bagrov <nbagrov@nvidia.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

e93ff6c8

[Kernel] Accelerate solve_tril with TMA (#26746) · 9fce7bee
Jiangyun Zhu authored Oct 20, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
9fce7bee

[Model][VLM] Support Bee-8B Model (#27012) · f32bf758

Yi Zhang authored Oct 20, 2025


Signed-off-by: uyzhang <yi.zhang.4096@gmail.com>
Signed-off-by: Yi Zhang <zhangyi970819@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

f32bf758

19 Oct, 2025 2 commits
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
- output type conversion fix (#27159) · 221bf725
  Jianyu Huang authored Oct 19, 2025
  
  221bf725
18 Oct, 2025 7 commits
- [BugFix] Disable fp8 kv-cache by default for DeepSeek V3.2 (#27121) · c2bba690
  Lucas Wilkinson authored Oct 18, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c2bba690
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
- [Models][QwenVL] Remove unnecessary `.contiguous()` calls (#27106) · 5c2acb27
  Lukas Geiger authored Oct 18, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  5c2acb27
- [Misc] Refactor `get_kv_cache_spec` into `AttentionLayerBase` (#26587) · b26b70be
  Nicolò Lucchesi authored Oct 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  b26b70be
- [Feature] Batch Invariant: Support DeepGEMM and Blackwell (#27127) · 245e4f2c
  Wentao Ye authored Oct 18, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  245e4f2c
- [Misc] Rev DeepEP (#27122) · 30a33b92
  Varun Sundar Rabindranath authored Oct 18, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  30a33b92
- [Perf] Add H100 fused MoE config (#25398) · c981f0ea
  ZiTian Zhao authored Oct 18, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  c981f0ea
17 Oct, 2025 17 commits
- [Minor] Remove unnecessary error message (#27115) · d29483b5
  Zhuohan Li authored Oct 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  d29483b5
- [Chore] Remove unused `PolyNorm` layer (#27110) · 3125d799
  Isotr0py authored Oct 18, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3125d799
- [Bugfix] [AITER] [ROCm] Fix Quark MoE Quant Config and AITER Fused MoE quant type logic (#27029) · e33ee23e
  vllmellm authored Oct 18, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  e33ee23e
- [ROCM] MoE fp4 CK kernel (#26545) · 0925b28a
  Aleksandr Malyshev authored Oct 17, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
  0925b28a
- [bugfix] Qwen3-VL fix video incorrect timestamp calculations while do_sample_frames=True (#27104) · 4c91a28e
  燃 authored Oct 18, 2025
```
Co-authored-by: 松灵 <wpf272043@alibaba-inc.com>
```
  4c91a28e
- [torch.compile] Enable attention and allreduce fusion without custom ops enabled (#24604) · bd7157a0
  Luka Govedič authored Oct 17, 2025
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  bd7157a0
- [Harware][AMD][Model] Triton MoE tuning configs for GLM-4.5 for MI350 and MI355 (#25586) · c253745e
  Reima Karhila (AMD) authored Oct 17, 2025
```
Signed-off-by: Reima Karhila <reima.karhila@amd.com>
Signed-off-by: xaguilar <Xavier.AguilarFruto@amd.com>
Co-authored-by: xaguilar <Xavier.AguilarFruto@amd.com>
```
  c253745e
- [Model]Improve Qwen3VLMoeForConditionalGeneration packed_modules_mapping (#27096) · daec4d26
  Jee Jee Li authored Oct 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  daec4d26
- [Docs] Replace `rst` style double-backtick with `md` single-backtick (#27091) · 6c9fdbf7
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c9fdbf7
- [VLM][Refactor] Remove useless func `get_input_positions` in `MRotaryEmbedding` (#27088) · e20eba75
  Mengqing Cao authored Oct 17, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  e20eba75
- [Kernel][Performance] Fuse float cast and renormalize to topk softmax kernel (#26717) · 75c7ad99
  zhrrr authored Oct 17, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
```
  75c7ad99
- [Model] Add support for LightOnOCR (#26916) · 3aeb19a3
  Said Taghadouini authored Oct 17, 2025
```
Signed-off-by: Said Taghadouini <taghadouinisaid@gmail.com>
Signed-off-by: Said Taghadouini <84044788+staghado@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  3aeb19a3
- [Model] Always use Transformers backend for PaliGemma and Gemma3-MM (#26715) · 8c017b34
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8c017b34
- [Bugfix][Qwen] fixes the weights dtype in qwen3_next: it is actually a bfloat16 (#27030) · bde9e227
  Tao He authored Oct 17, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  bde9e227
- disable graph partition in custom op (#26952) · 08405609
  Boyuan Feng authored Oct 16, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Boyuan Feng <fby.1994@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  08405609
- Remove unused imports (#26972) · 4d055ef4
  Lukas Geiger authored Oct 17, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  4d055ef4
- [Chore] Separate out `vllm.utils.importlib` (#27022) · 4d4d6bad
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4d4d6bad
16 Oct, 2025 11 commits
- [NVIDIA] [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel (#26714) · 41d30719
  jiahanc authored Oct 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  41d30719
- Refactor Transformers backend to use mixins (#26906) · fb5e10d3
  Harry Mellor authored Oct 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb5e10d3
- [small][batch invariance] Rename the env and internal flags to simplify usage (#26855) · b2f78cba
  Bram Wasti authored Oct 16, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  b2f78cba
- [Feature] Migrate DeepGEMM API from `get_m_alignment_for_contiguous_layout` to... · b3dda72c
  Wentao Ye authored Oct 16, 2025
```
[Feature] Migrate DeepGEMM API from `get_m_alignment_for_contiguous_layout` to `get_mk_alignment_for_contiguous_layout` (#26935)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  b3dda72c
- [GPTOSS][DP/EP][Marlin] Enable GPTOSS Batched DP/EP using Marlin kernels (#25997) · fb0571b0
  Varun Sundar Rabindranath authored Oct 16, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fb0571b0
- [Compressed Tensors] Always clone output for compile robustness (#26849) · a5464dcf
  Kyle Sayers authored Oct 16, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  a5464dcf
- Fix Qwen2.5 VL image grid docstring (#27033) · 7bb736d0
  ZiTian Zhao authored Oct 17, 2025
```
Signed-off-by: zitian zhao <zitian.zhao@tencentmusic.com>
```
  7bb736d0
- [Model] Fix Qwen3VL mm mapping (#27027) · 9f4e3090
  Jee Jee Li authored Oct 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9f4e3090
- [Bugfix] Correct LayerNorm epsilon parameter in modernbert.py (#27008) · dcbb3f18
  bogdanm authored Oct 16, 2025
```
Signed-off-by: bogdanm <152898065+bogdan01m@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  dcbb3f18
- [MISC] fix import violations for re and triton modules (#26654) · 00417f4e
  Sungjae Lee authored Oct 16, 2025
```
Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Co-authored-by: Mengqing Cao <cmq0113@163.com>
```
  00417f4e
- [Model][Bugfix] fix ernie45 vl run failed from shared experts optimization (#26885) · e5192879
  CSWYF3634076 authored Oct 16, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  e5192879