Commits · c42ff4f4fdc4a4d48ccef18b8067995f6c19e6ec · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "7bc904d708489f12209c88f5f19a04a13a10d30d"

29 Sep, 2025 17 commits

[BugFix][torch.compile] KV scale calculation issues with FP8 quantization (#25513) · c42ff4f4
Adrian Abeyta authored Sep 29, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
c42ff4f4
[Bugfix] Use correct key "ignore" for config.json non-quantized layers (#25706) · d5ab2851
Lee Nau authored Sep 29, 2025
```
Signed-off-by: Lee Nau <lnau@nvidia.com>
```
d5ab2851
[Model] Remove MotifForCausalLM (#25866) · e61eb5e0
Jee Jee Li authored Sep 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
e61eb5e0
[CI/Build] Include Transformers backend test in nightly transformers test (#25885) · 0899ba5b
Isotr0py authored Sep 30, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
0899ba5b
[Bugfix][Speculative Decoding] Fix Eagle3 quantization config issue (#25883) · 145ac733
Rahul Tuli authored Sep 29, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
145ac733
[Nixl][P/D] Add cuda2cpu support (HD->DH transfer) (#24690) · d0d138bc
Chenxi Yang authored Sep 29, 2025
```
Signed-off-by: Chenxi Yang <cxyang@fb.com>
Co-authored-by: Chenxi Yang <cxyang@fb.com>
```
d0d138bc
[torch.compile] serialize cudagraph_mode as its enum name instead of value (#25868) · 43227236
Jiangyun Zhu authored Sep 29, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
43227236
[Model][Bugfix] Fix issues in MiDashengLM implementation for quantized models (#25854) · 8616300a
zhoukz authored Sep 29, 2025
```
Signed-off-by: zhoukz <me@zhoukz.com>
```
8616300a
[Bugfix] Fix requirements paths in install instructions (#25827) · edbaadd9
Yingjun Mou authored Sep 29, 2025
```
Signed-off-by: yingjun-mou <renzomou@gmail.com>
```
edbaadd9
update to latest deepgemm for dsv3.2 (#25871) · 9360d34f
youkaichao authored Sep 29, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
9360d34f
[Misc] Remove more `get_input_embeddings_v0` (#25857) · 1b67b046
Cyrus Leung authored Sep 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
1b67b046
[V0 Deprecation][Models] Remove all V0 condition for mm embeddings merge (#25331) · bd51f78e
Isotr0py authored Sep 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
bd51f78e
[Bugfix] Fallback ViT attn backend to SDPA for blackwell (#25851) · 65ecb4f1
Roger Wang authored Sep 28, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
65ecb4f1
[XPU]Fix xpu spec decoding UTs, avoid using cuda graph (#25847) · 143844fa
Kunshang Ji authored Sep 29, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
143844fa
Add Phi4FlashForCausalLM to _PREVIOUSLY_SUPPORTED_MODELS (#25832) · 219cfbe7
Thomas Parnell authored Sep 29, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
219cfbe7

Robert Shaw authored Sep 29, 2025


Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

9b44a7d9

[Misc] fix tests failure by using current_platform (#25825) · a3ae45a3
Juechen Liu authored Sep 28, 2025
```
Signed-off-by: Juechen Liu <jueliu@meta.com>
```
a3ae45a3

28 Sep, 2025 7 commits
- Remove redundant cudagraph dispatcher warning (#25841) · 0307428d
  Michael Goin authored Sep 28, 2025
  
  0307428d
- [Bugfix] fix Qwen3VLMoe load when pp > 1 (#25838) · 471997ad
  JJJYmmm authored Sep 29, 2025
```
Signed-off-by: liuye.hj <liuye.hj@alibaba-inc.com>
Co-authored-by: liuye.hj <liuye.hj@alibaba-inc.com>
```
  471997ad
- Update GLM-4.5 Doc transformers version (#25830) · b1ded114
  Yuxuan Zhang authored Sep 28, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  b1ded114
- Fix random dataset mismatched token length with config. (#24937) · f4e4088c
  weiliang authored Sep 28, 2025
```
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  f4e4088c
- [VLM] Update Qwen3-VL max_num_video_tokens calculation for configurable video profiling (#25557) · 0efd540d
  Isotr0py authored Sep 28, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  0efd540d
- [Bugfix] Fix Qwen3-VL regression from #24982 (#25814) · 61447540
  Roger Wang authored Sep 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  61447540
- [MM] Optimize memory profiling for scattered multimodal embeddings (#25810) · 69311446
  Roger Wang authored Sep 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  69311446
27 Sep, 2025 16 commits
- [Bugfix][NIXL] Fix Async Scheduler timeout issue (#25808) · da63274d
  Nicolò Lucchesi authored Sep 27, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  da63274d
- [Core] GC Debug callback (#24829) · c216119d
  Jialin Ouyang authored Sep 27, 2025
```
Signed-off-by: Jialin Ouyang <jialino@meta.com>
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Co-authored-by: Jialin Ouyang <jialino@meta.com>
```
  c216119d
- [Bug]: Set LD_LIBRARY_PATH to include the 'standard' CUDA location (#25766) · 5546acb4
  Clayton Coleman authored Sep 27, 2025
```
Signed-off-by: Clayton Coleman <smarterclayton@gmail.com>
```
  5546acb4
- [torch.compile]: Add VLLM_DEBUG_DUMP_PATH environment variable (#25651) · c0ec8183
  Jiangyun Zhu authored Sep 28, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  c0ec8183
- [Core] Refactor self.model() to call a helper for subclassing. (#25084) · b65e56ba
  Patrick C. Toulme authored Sep 27, 2025
```
Signed-off-by: Patrick Toulme <ptoulme@meta.com>
Signed-off-by: Patrick Toulme <pctoulme+1@gmail.com>
```
  b65e56ba
- [env] default nixl side port conflicts with kv-event zmq port (#25056) · 49996cd5
  Peter Pan authored Sep 27, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  49996cd5
- [docs] transcriptions API audio upload (#25446) · ecb37e27
  yyzxw authored Sep 27, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
```
  ecb37e27
- [Bugfix][WideEP] Apply TP Attn + EP MoE fix to other models (#24982) · a5354b3e
  Tyler Michael Smith authored Sep 27, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  a5354b3e
- [Bugfix] Fix triton import precommit failure (#25803) · f9df8b4a
  Tyler Michael Smith authored Sep 27, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  f9df8b4a
- Fix GPTQ model loading in Transformers backend (#25770) · ec152c87
  Harry Mellor authored Sep 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ec152c87
- Add filtering for chat template kwargs (#25794) · 7977e502
  Russell Bryant authored Sep 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  7977e502
- Validate API tokens in constant time (#25781) · 3f5d902d
  Russell Bryant authored Sep 27, 2025
```
Signed-off-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: rentianyue-jk <rentianyue-jk@360shuke.com>
```
  3f5d902d
- [Bugfix] Merge MM embeddings by index instead of token IDs (#16229) · 27d7638b
  Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  27d7638b
- [Bugfix] Add missing `image_size` for phi4_multimodal (#25796) · 17617398
  Xiaohan Zou authored Sep 27, 2025
  
  17617398
- [Misc] Update openai client example file for multimodal (#25795) · 23b8ee67
  Roger Wang authored Sep 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  23b8ee67
- [Misc] Fix codeowners override for v1 sample and attention (#25037) · 39391520
  22quinn authored Sep 27, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  39391520