Commits · 965bc71b0445d7010bd40b3808d423d49ee68e58 · OpenDAS / vllm_cscc · GitLab

25 Jul, 2025 7 commits
- Integrate TensorSchema with shape validation for Phi3VImagePixelInputs (#21232) · 965bc71b
  Benji Beck authored Jul 24, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  965bc71b
- [DP] Support api-server-count > 0 in hybrid DP LB mode (#21510) · 9c8b2c2a
  Nick Hill authored Jul 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9c8b2c2a
- [Bugfix] DeepGemm utils : Fix hardcoded type-cast (#21517) · 2212cd6c
  Varun Sundar Rabindranath authored Jul 25, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  2212cd6c
- [Kernel] adding fused_moe configs for upcoming granite4 (#21332) · ce3a9b13
  Burkhard Ringlein authored Jul 25, 2025
```
Signed-off-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  ce3a9b13
- Fix GLM-4 PP Missing Layer When using with PP. (#21531) · 2ce90e5b
  Yuxuan Zhang authored Jul 25, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  2ce90e5b
- [Bug] Fix DeepGemm Init Error (#21554) · 633f6e80
  Wentao Ye authored Jul 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  633f6e80
- [Frontend] `run-batch` supports V1 (#21541) · 34ddcf9f
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34ddcf9f
24 Jul, 2025 26 commits
- [MoE] More balanced expert sharding (#21497) · fe56180c
  Woosuk Kwon authored Jul 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  fe56180c
- update flashinfer to v0.2.9rc1 (#21485) · 2dd72d23
  weiliang authored Jul 25, 2025
```
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
```
  2dd72d23
- [P/D] Support CPU Transfer in NixlConnector (#18293) · 60662849
  Juncheng Gu authored Jul 24, 2025
```
Signed-off-by: Juncheng Gu <juncgu@gmail.com>
Signed-off-by: Richard Liu <ricliu@google.com>
Co-authored-by: Richard Liu <39319471+richardsliu@users.noreply.github.com>
Co-authored-by: Richard Liu <ricliu@google.com>
```
  60662849
- [P/D] Move FakeNixlWrapper to test dir (#21328) · 1e9ea8e6
  Rui Qiao authored Jul 24, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  1e9ea8e6
- [XPU] Conditionally import CUDA-specific passes to avoid import errors on xpu platform (#21036) · d9f9a3fd
  Chaojun Zhang authored Jul 24, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  d9f9a3fd
- Update flashinfer CUTLASS MoE Kernel (#21408) · 1b25f1fe
  Shu Wang authored Jul 24, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  1b25f1fe
- [Model] Officially support Emu3 with Transformers backend (#21319) · 13abd0ea
  Harry Mellor authored Jul 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  13abd0ea
- [Attention] Optimize FlashInfer MetadataBuilder Build call (#21137) · 61b8cea3
  Lucas Wilkinson authored Jul 24, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  61b8cea3
- [Feat] Allow custom naming of vLLM processes (#21445) · 6da00785
  Chauncey authored Jul 24, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  6da00785
- [Misc] Improve comment for DPEngineCoreActor._set_cuda_visible_devices() (#21501) · 73e3949d
  Rui Qiao authored Jul 24, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  73e3949d
- Replace `--expand-tools-even-if-tool-choice-none` with... · 6eca337c
  Shintarou Okada authored Jul 24, 2025
```
Replace `--expand-tools-even-if-tool-choice-none` with `--exclude-tools-when-tool-choice-none` for v0.10.0 (#20544)
Signed-off-by: okada <kokuzen@gmail.com>
Signed-off-by: okada shintarou <okada@preferred.jp>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6eca337c
- remove GLM-4.5 quantization wrong Code (#21435) · 85bda9e7
  Yuxuan Zhang authored Jul 24, 2025
  
  85bda9e7
- [Core] Support model loader plugins (#21067) · 610852a4
  22quinn authored Jul 24, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  610852a4
- [Misc] Fix duplicate FusedMoEConfig debug messages (#21455) · f0f4de8f
  Nick Hill authored Jul 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  f0f4de8f
- [v1][Core] Clean up usages of `SpecializedManager` (#21407) · fc5f756d
  Zhou Fang authored Jul 24, 2025
```
Signed-off-by: Zhou Fang <fang.github@gmail.com>
```
  fc5f756d
- [TPU][Bugfix] fix moe layer (#21340) · e74bfc70
  Chengji Yao authored Jul 24, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  e74bfc70
- Deduplicate Transformers backend code using inheritance (#21461) · dde295a9
  Harry Mellor authored Jul 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  dde295a9
- Add think chunk (#21333) · 6d8d0a24
  Julien Denize authored Jul 24, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  6d8d0a24
- [BugFix] Set CUDA_VISIBLE_DEVICES before spawning the subprocesses (#21211) · 11ef7a61
  Yinghai Lu authored Jul 23, 2025
```
Signed-off-by: Yinghai Lu <yinghai@thinkingmachines.ai>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
```
  11ef7a61
- Dump input metadata on crash for async scheduling (#21258) · dc2f159f
  Woosuk Kwon authored Jul 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  dc2f159f
- [DP] Internal Load Balancing Per Node [`one-pod-per-node`] (#21238) · d5b981f8
  Robert Shaw authored Jul 23, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  d5b981f8
- [BugFix] Fix KVConnector TP worker aggregation (#21473) · eec69420
  Nick Hill authored Jul 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  eec69420
- [BugFix]: Batch generation from prompt_embeds fails for long prompts (#21390) · fd48d99f
  KazusatoOoko authored Jul 23, 2025
```
Signed-off-by: KazusatoOko <kazusto.oko@sakana.ai>
Co-authored-by: KazusatoOko <kazusto.oko@sakana.ai>
```
  fd48d99f
- [Frontend] Set MAX_AUDIO_CLIP_FILESIZE_MB via env var instead of hardcoding (#21374) · 63d92abb
  deven-labovitch authored Jul 23, 2025
```
Signed-off-by: Deven Labovitch <deven@videa.ai>
```
  63d92abb
- feat(gguf_loader): accept HF repo paths & URLs for GGUF (#20793) · 11599b0e
  Hardik Gupta authored Jul 23, 2025
```
Signed-off-by: Hardik <hardikgupta1999@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  11599b0e
- [Core] Freeze gc during cuda graph capture to speed up init (#21146) · f3137cdd
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: Codex <codex@openai.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f3137cdd
23 Jul, 2025 7 commits
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
- [V1] Fix local chunked attention always disabled (#21419) · 78c13e30
  Yong Hoon Shin authored Jul 23, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  78c13e30
- [Core] Add `reload_weights` RPC method (#20096) · 5c9b807b
  22quinn authored Jul 23, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  5c9b807b
- Add test case for compiling multiple graphs (#21044) · 4ac7713e
  Yong Hoon Shin authored Jul 23, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  4ac7713e
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
- [Bugfix][Qwen][DCA] fixes bug in dual-chunk-flash-attn backend for qwen 1m models. (#21364) · 7c734ee0
  Tao He authored Jul 23, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  7c734ee0
- [V1] Check all pooling tasks during profiling (#21299) · f59ec35b
  Cyrus Leung authored Jul 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f59ec35b