Commits · 610852a42327836eb804c1a893fcb9bb6d52c29c · OpenDAS / vllm_cscc · GitLab

24 Jul, 2025 19 commits
- [Core] Support model loader plugins (#21067) · 610852a4
  22quinn authored Jul 24, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  610852a4
- [Misc] Fix duplicate FusedMoEConfig debug messages (#21455) · f0f4de8f
  Nick Hill authored Jul 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  f0f4de8f
- [v1][Core] Clean up usages of `SpecializedManager` (#21407) · fc5f756d
  Zhou Fang authored Jul 24, 2025
```
Signed-off-by: Zhou Fang <fang.github@gmail.com>
```
  fc5f756d
- [TPU][Bugfix] fix moe layer (#21340) · e74bfc70
  Chengji Yao authored Jul 24, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  e74bfc70
- [Bugfix][ROCm] Fix for warp_size uses on host (#21205) · 90eeea8f
  Gregory Shtrasberg authored Jul 24, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  90eeea8f
- Deduplicate Transformers backend code using inheritance (#21461) · dde295a9
  Harry Mellor authored Jul 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  dde295a9
- Add think chunk (#21333) · 6d8d0a24
  Julien Denize authored Jul 24, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  6d8d0a24
- [BugFix] Set CUDA_VISIBLE_DEVICES before spawning the subprocesses (#21211) · 11ef7a61
  Yinghai Lu authored Jul 23, 2025
```
Signed-off-by: Yinghai Lu <yinghai@thinkingmachines.ai>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
```
  11ef7a61
- Dump input metadata on crash for async scheduling (#21258) · dc2f159f
  Woosuk Kwon authored Jul 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  dc2f159f
- [DP] Internal Load Balancing Per Node [`one-pod-per-node`] (#21238) · d5b981f8
  Robert Shaw authored Jul 23, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  d5b981f8
- [BugFix] Fix KVConnector TP worker aggregation (#21473) · eec69420
  Nick Hill authored Jul 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  eec69420
- [BugFix]: Batch generation from prompt_embeds fails for long prompts (#21390) · fd48d99f
  KazusatoOoko authored Jul 23, 2025
```
Signed-off-by: KazusatoOko <kazusto.oko@sakana.ai>
Co-authored-by: KazusatoOko <kazusto.oko@sakana.ai>
```
  fd48d99f
- [Bugfix] Fix example disagg_example_p2p_nccl_xpyd.sh zombie process (#21437) · f8c15c4e
  WeiQing Chen authored Jul 24, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
```
  f8c15c4e
- [Bugfix] Fix casing warning (#21468) · aa08a954
  Matthew Bonanni authored Jul 23, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  aa08a954
- [XPU][UT] increase intel xpu CI test scope (#21492) · 13e4ee1d
  Liangliang Ma authored Jul 24, 2025
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
```
  13e4ee1d
- [Misc] Add dummy maverick test to CI (#21324) · 772ce5af
  Ming Yang authored Jul 23, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  772ce5af
- [Frontend] Set MAX_AUDIO_CLIP_FILESIZE_MB via env var instead of hardcoding (#21374) · 63d92abb
  deven-labovitch authored Jul 23, 2025
```
Signed-off-by: Deven Labovitch <deven@videa.ai>
```
  63d92abb
- feat(gguf_loader): accept HF repo paths & URLs for GGUF (#20793) · 11599b0e
  Hardik Gupta authored Jul 23, 2025
```
Signed-off-by: Hardik <hardikgupta1999@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  11599b0e
- [Core] Freeze gc during cuda graph capture to speed up init (#21146) · f3137cdd
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: Codex <codex@openai.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f3137cdd
23 Jul, 2025 21 commits
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
- [V1] Fix local chunked attention always disabled (#21419) · 78c13e30
  Yong Hoon Shin authored Jul 23, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  78c13e30
- [Core] Add `reload_weights` RPC method (#20096) · 5c9b807b
  22quinn authored Jul 23, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  5c9b807b
- [TPU][TEST] Fix the downloading issue in TPU v1 test 11. (#21418) · 14bf19e3
  QiliangCui authored Jul 23, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  14bf19e3
- Add test case for compiling multiple graphs (#21044) · 4ac7713e
  Yong Hoon Shin authored Jul 23, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  4ac7713e
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
- [Tests] Add tests for headless internal DP LB (#21450) · 316b1bf7
  Nick Hill authored Jul 23, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  316b1bf7
- [Bugfix][Qwen][DCA] fixes bug in dual-chunk-flash-attn backend for qwen 1m models. (#21364) · 7c734ee0
  Tao He authored Jul 23, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  7c734ee0
- [V1] Check all pooling tasks during profiling (#21299) · f59ec35b
  Cyrus Leung authored Jul 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f59ec35b
- [Model] add Hunyuan V1 Dense Model support. (#21368) · 2671334d
  Asher authored Jul 23, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  2671334d
- [Docs] Clean up v1/metrics.md (#21449) · 2cc5016a
  Michael Yao authored Jul 23, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  2cc5016a
- [Misc] fixed nvfp4_moe test failures due to invalid kwargs (#21246) · 6929f8b4
  Yang Chen authored Jul 23, 2025
```
Signed-off-by: Yang Chen <yangche@fb.com>
```
  6929f8b4
- Mamba V2 Test not Asserting Failures. (#21379) · 32ec9e2f
  Yu Chin Fabian Lim authored Jul 23, 2025
```
Signed-off-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
```
  32ec9e2f
- [Sampler] Introduce logprobs mode for logging (#21398) · accac829
  Lu Fang authored Jul 23, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  accac829
- [Docs] Fix bullets and grammars in tool_calling.md (#21440) · 23637dcd
  Michael Yao authored Jul 23, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  23637dcd
- Fixed typo in profiling logs (#21441) · 6364af92
  Sergio Paniego Blanco authored Jul 23, 2025
  
  6364af92
- [Bugfix] ensure tool_choice is popped when `tool_choice:null` is passed in json payload (#19679) · 7aaa2bd5
  Guillaume Calmettes authored Jul 23, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  7aaa2bd5
- add clear messages for deprecated models (#21424) · 2f5c14de
  youkaichao authored Jul 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  2f5c14de
- [Cleanup] Only log MoE DP setup warning if DP is enabled (#21315) · f002e9a8
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f002e9a8
- [Core] Add basic unit test for maybe_evict_cached_block (#21400) · a1f3610f
  Jialin Ouyang authored Jul 23, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  a1f3610f
- [Bugfix] Fix nightly transformers CI failure (#21427) · 4ecedd18
  Isotr0py authored Jul 23, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  4ecedd18