Commits · dde295a9342fa2b1a3f6c4886706694a53f7b97d · OpenDAS / vllm_cscc

24 Jul, 2025 14 commits

Deduplicate Transformers backend code using inheritance (#21461) · dde295a9
Harry Mellor authored Jul 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
dde295a9
Add think chunk (#21333) · 6d8d0a24
Julien Denize authored Jul 24, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
6d8d0a24

[BugFix] Set CUDA_VISIBLE_DEVICES before spawning the subprocesses (#21211) · 11ef7a61

Yinghai Lu authored Jul 23, 2025


Signed-off-by: Yinghai Lu <yinghai@thinkingmachines.ai>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>

11ef7a61

Dump input metadata on crash for async scheduling (#21258) · dc2f159f
Woosuk Kwon authored Jul 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
dc2f159f

[DP] Internal Load Balancing Per Node [`one-pod-per-node`] (#21238) · d5b981f8

Robert Shaw authored Jul 23, 2025


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

d5b981f8

[BugFix] Fix KVConnector TP worker aggregation (#21473) · eec69420
Nick Hill authored Jul 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
eec69420
[BugFix]: Batch generation from prompt_embeds fails for long prompts (#21390) · fd48d99f
KazusatoOoko authored Jul 23, 2025
```
Signed-off-by: KazusatoOko <kazusto.oko@sakana.ai>
Co-authored-by: KazusatoOko <kazusto.oko@sakana.ai>
```
fd48d99f
[Bugfix] Fix example disagg_example_p2p_nccl_xpyd.sh zombie process (#21437) · f8c15c4e
WeiQing Chen authored Jul 24, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
```
f8c15c4e
[Bugfix] Fix casing warning (#21468) · aa08a954
Matthew Bonanni authored Jul 23, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
aa08a954
[XPU][UT] increase intel xpu CI test scope (#21492) · 13e4ee1d
Liangliang Ma authored Jul 24, 2025
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
```
13e4ee1d

[Misc] Add dummy maverick test to CI (#21324) · 772ce5af

Ming Yang authored Jul 23, 2025


Signed-off-by: Ming Yang <minos.future@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

772ce5af

[Frontend] Set MAX_AUDIO_CLIP_FILESIZE_MB via env var instead of hardcoding (#21374) · 63d92abb
deven-labovitch authored Jul 23, 2025
```
Signed-off-by: Deven Labovitch <deven@videa.ai>
```
63d92abb

feat(gguf_loader): accept HF repo paths & URLs for GGUF (#20793) · 11599b0e

Hardik Gupta authored Jul 23, 2025


Signed-off-by: Hardik <hardikgupta1999@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

11599b0e

[Core] Freeze gc during cuda graph capture to speed up init (#21146) · f3137cdd
Michael Goin authored Jul 23, 2025
```
Signed-off-by: Codex <codex@openai.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
f3137cdd

23 Jul, 2025 26 commits
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
- [V1] Fix local chunked attention always disabled (#21419) · 78c13e30
  Yong Hoon Shin authored Jul 23, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  78c13e30
- [Core] Add `reload_weights` RPC method (#20096) · 5c9b807b
  22quinn authored Jul 23, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  5c9b807b
- [TPU][TEST] Fix the downloading issue in TPU v1 test 11. (#21418) · 14bf19e3
  QiliangCui authored Jul 23, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  14bf19e3
- Add test case for compiling multiple graphs (#21044) · 4ac7713e
  Yong Hoon Shin authored Jul 23, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  4ac7713e
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
- [Tests] Add tests for headless internal DP LB (#21450) · 316b1bf7
  Nick Hill authored Jul 23, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  316b1bf7
- [Bugfix][Qwen][DCA] fixes bug in dual-chunk-flash-attn backend for qwen 1m models. (#21364) · 7c734ee0
  Tao He authored Jul 23, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  7c734ee0
- [V1] Check all pooling tasks during profiling (#21299) · f59ec35b
  Cyrus Leung authored Jul 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f59ec35b
- [Model] add Hunyuan V1 Dense Model support. (#21368) · 2671334d
  Asher authored Jul 23, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  2671334d
- [Docs] Clean up v1/metrics.md (#21449) · 2cc5016a
  Michael Yao authored Jul 23, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  2cc5016a
- [Misc] fixed nvfp4_moe test failures due to invalid kwargs (#21246) · 6929f8b4
  Yang Chen authored Jul 23, 2025
```
Signed-off-by: Yang Chen <yangche@fb.com>
```
  6929f8b4
- Mamba V2 Test not Asserting Failures. (#21379) · 32ec9e2f
  Yu Chin Fabian Lim authored Jul 23, 2025
```
Signed-off-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
```
  32ec9e2f
- [Sampler] Introduce logprobs mode for logging (#21398) · accac829
  Lu Fang authored Jul 23, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  accac829
- [Docs] Fix bullets and grammars in tool_calling.md (#21440) · 23637dcd
  Michael Yao authored Jul 23, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  23637dcd
- Fixed typo in profiling logs (#21441) · 6364af92
  Sergio Paniego Blanco authored Jul 23, 2025
  
  6364af92
- [Bugfix] ensure tool_choice is popped when `tool_choice:null` is passed in json payload (#19679) · 7aaa2bd5
  Guillaume Calmettes authored Jul 23, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  7aaa2bd5
- add clear messages for deprecated models (#21424) · 2f5c14de
  youkaichao authored Jul 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  2f5c14de
- [Cleanup] Only log MoE DP setup warning if DP is enabled (#21315) · f002e9a8
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f002e9a8
- [Core] Add basic unit test for maybe_evict_cached_block (#21400) · a1f3610f
  Jialin Ouyang authored Jul 23, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  a1f3610f
- [Bugfix] Fix nightly transformers CI failure (#21427) · 4ecedd18
  Isotr0py authored Jul 23, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  4ecedd18
- Changing "amdproduction" allocation. (#21409) · 107111a8
  Alexei-V-Ivanov-AMD authored Jul 22, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  107111a8
- [Bugfix][CUDA] fixes CUDA FP8 kv cache dtype supported (#21420) · 2dec7c1a
  elvischenv authored Jul 23, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  2dec7c1a
- [BUGFIX] deepseek-v2-lite failed due to fused_qkv_a_proj name update (#21414) · 08d2bd78
  Chendi.Xue authored Jul 22, 2025
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  08d2bd78
- [BugFix] Update python to python3 calls for image; fix prefix & input calculations. (#21391) · 4f76a05f
  ericehanley authored Jul 22, 2025
```
Signed-off-by: Eric Hanley <ericehanley@google.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  4f76a05f
- Simplify weight loading in Transformers backend (#21382) · f154bb9f
  Harry Mellor authored Jul 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f154bb9f