Commits · fa7e254a7f3ea7b28f1c5908c83ac57275d3c090 · OpenDAS / vllm_cscc · GitLab

30 Sep, 2025 9 commits

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

[Bugfix]: Clean up chunked prefill logging when using whisper (#25075) · e23cacda
Simon Danielsson authored Sep 30, 2025
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
```
e23cacda
[Model][Bugfix] Fix MiDashengLM audio encoder mask by removing incorrect `logical_not` (#25925) · 2e1b8bc2
zhoukz authored Sep 30, 2025
```
Signed-off-by: zhoukz <me@zhoukz.com>
```
2e1b8bc2
[BugFix] Pass config_format via try_get_generation_config (#25912) · e47433b3
acisseJZhong authored Sep 29, 2025

e47433b3
[BugFix] Fix DP/EP hang (#25906) · 23194d83
Lucas Wilkinson authored Sep 30, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
23194d83
Move`VllmConfig` from `config/__init__.py` to `config/vllm.py` (#25271) · 61aedb5f
Harry Mellor authored Sep 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
61aedb5f
[Benchmark] Support benchmark throughput for external launcher DP (#25913) · d3bd1711
Zhuohan Li authored Sep 29, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
d3bd1711

[Bug] Fix Weight Loading for Block FP8 Cutlass SM90 (#25909) · 89e4050a

Wentao Ye authored Sep 29, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

89e4050a

Test Prompt Embeds/LoRA compatibility and Enable LoRA Support for OPT Models (#25717) · 78a47f87
Andrew Sansom authored Sep 29, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
78a47f87

29 Sep, 2025 23 commits
- [V0 Deprecation] Remove `vllm.worker` and update according imports (#25901) · 6a113d9a
  Aaron Pham authored Sep 29, 2025
  
  6a113d9a
- [NIXL] Increase default KV block eviction timeout on P (#25897) · 2e4fe48c
  Nicolò Lucchesi authored Sep 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  2e4fe48c
- [Doc] Polish example for torchrun dp (#25899) · 8eb0a1d9
  Zhuohan Li authored Sep 29, 2025
  
  8eb0a1d9
- [Kernel] Chunk-aligned mamba2 (#24683) · fea3e476
  Thomas Parnell authored Sep 29, 2025
  
  fea3e476
- [Bugfix][ROCm] Fixing trying to import non-existent symbols from libnccl.so (#25605) · 61a34316
  Gregory Shtrasberg authored Sep 29, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  61a34316
- [Doc] Add documentation for vLLM continuous benchmarking and profiling (#25819) · 9bedac96
  Naman Lalit authored Sep 29, 2025
```
Signed-off-by: Naman Lalit <nl2688@nyu.edu>
```
  9bedac96
- [BugFix][torch.compile] KV scale calculation issues with FP8 quantization (#25513) · c42ff4f4
  Adrian Abeyta authored Sep 29, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
  c42ff4f4
- [Bugfix] Use correct key "ignore" for config.json non-quantized layers (#25706) · d5ab2851
  Lee Nau authored Sep 29, 2025
```
Signed-off-by: Lee Nau <lnau@nvidia.com>
```
  d5ab2851
- [Model] Remove MotifForCausalLM (#25866) · e61eb5e0
  Jee Jee Li authored Sep 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  e61eb5e0
- [CI/Build] Include Transformers backend test in nightly transformers test (#25885) · 0899ba5b
  Isotr0py authored Sep 30, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  0899ba5b
- [Bugfix][Speculative Decoding] Fix Eagle3 quantization config issue (#25883) · 145ac733
  Rahul Tuli authored Sep 29, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  145ac733
- [Nixl][P/D] Add cuda2cpu support (HD->DH transfer) (#24690) · d0d138bc
  Chenxi Yang authored Sep 29, 2025
```
Signed-off-by: Chenxi Yang <cxyang@fb.com>
Co-authored-by: Chenxi Yang <cxyang@fb.com>
```
  d0d138bc
- [torch.compile] serialize cudagraph_mode as its enum name instead of value (#25868) · 43227236
  Jiangyun Zhu authored Sep 29, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  43227236
- [Model][Bugfix] Fix issues in MiDashengLM implementation for quantized models (#25854) · 8616300a
  zhoukz authored Sep 29, 2025
```
Signed-off-by: zhoukz <me@zhoukz.com>
```
  8616300a
- [Bugfix] Fix requirements paths in install instructions (#25827) · edbaadd9
  Yingjun Mou authored Sep 29, 2025
```
Signed-off-by: yingjun-mou <renzomou@gmail.com>
```
  edbaadd9
- update to latest deepgemm for dsv3.2 (#25871) · 9360d34f
  youkaichao authored Sep 29, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  9360d34f
- [Misc] Remove more `get_input_embeddings_v0` (#25857) · 1b67b046
  Cyrus Leung authored Sep 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1b67b046
- [V0 Deprecation][Models] Remove all V0 condition for mm embeddings merge (#25331) · bd51f78e
  Isotr0py authored Sep 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  bd51f78e
- [Bugfix] Fallback ViT attn backend to SDPA for blackwell (#25851) · 65ecb4f1
  Roger Wang authored Sep 28, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  65ecb4f1
- [XPU]Fix xpu spec decoding UTs, avoid using cuda graph (#25847) · 143844fa
  Kunshang Ji authored Sep 29, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  143844fa
- Add Phi4FlashForCausalLM to _PREVIOUSLY_SUPPORTED_MODELS (#25832) · 219cfbe7
  Thomas Parnell authored Sep 29, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  219cfbe7
- [P/D] NIXL Updates (#25844) · 9b44a7d9
  Robert Shaw authored Sep 29, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  9b44a7d9
- [Misc] fix tests failure by using current_platform (#25825) · a3ae45a3
  Juechen Liu authored Sep 28, 2025
```
Signed-off-by: Juechen Liu <jueliu@meta.com>
```
  a3ae45a3
28 Sep, 2025 7 commits
- Remove redundant cudagraph dispatcher warning (#25841) · 0307428d
  Michael Goin authored Sep 28, 2025
  
  0307428d
- [Bugfix] fix Qwen3VLMoe load when pp > 1 (#25838) · 471997ad
  JJJYmmm authored Sep 29, 2025
```
Signed-off-by: liuye.hj <liuye.hj@alibaba-inc.com>
Co-authored-by: liuye.hj <liuye.hj@alibaba-inc.com>
```
  471997ad
- Update GLM-4.5 Doc transformers version (#25830) · b1ded114
  Yuxuan Zhang authored Sep 28, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  b1ded114
- Fix random dataset mismatched token length with config. (#24937) · f4e4088c
  weiliang authored Sep 28, 2025
```
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  f4e4088c
- [VLM] Update Qwen3-VL max_num_video_tokens calculation for configurable video profiling (#25557) · 0efd540d
  Isotr0py authored Sep 28, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  0efd540d
- [Bugfix] Fix Qwen3-VL regression from #24982 (#25814) · 61447540
  Roger Wang authored Sep 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  61447540
- [MM] Optimize memory profiling for scattered multimodal embeddings (#25810) · 69311446
  Roger Wang authored Sep 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  69311446
27 Sep, 2025 1 commit
- [Bugfix][NIXL] Fix Async Scheduler timeout issue (#25808) · da63274d
  Nicolò Lucchesi authored Sep 27, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  da63274d