Commits · 610852a42327836eb804c1a893fcb9bb6d52c29c · OpenDAS / vllm_cscc

"requirements-test.in" did not exist on "711a000255eac3e034f0b73aa5cc62b45201a571"

24 Jul, 2025 14 commits

[Core] Support model loader plugins (#21067) · 610852a4
22quinn authored Jul 24, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
610852a4
[Misc] Fix duplicate FusedMoEConfig debug messages (#21455) · f0f4de8f
Nick Hill authored Jul 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
f0f4de8f
[v1][Core] Clean up usages of `SpecializedManager` (#21407) · fc5f756d
Zhou Fang authored Jul 24, 2025
```
Signed-off-by: Zhou Fang <fang.github@gmail.com>
```
fc5f756d

[TPU][Bugfix] fix moe layer (#21340) · e74bfc70

Chengji Yao authored Jul 24, 2025


Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

e74bfc70

Deduplicate Transformers backend code using inheritance (#21461) · dde295a9
Harry Mellor authored Jul 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
dde295a9
Add think chunk (#21333) · 6d8d0a24
Julien Denize authored Jul 24, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
6d8d0a24

[BugFix] Set CUDA_VISIBLE_DEVICES before spawning the subprocesses (#21211) · 11ef7a61

Yinghai Lu authored Jul 23, 2025


Signed-off-by: Yinghai Lu <yinghai@thinkingmachines.ai>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>

11ef7a61

Dump input metadata on crash for async scheduling (#21258) · dc2f159f
Woosuk Kwon authored Jul 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
dc2f159f

[DP] Internal Load Balancing Per Node [`one-pod-per-node`] (#21238) · d5b981f8

Robert Shaw authored Jul 23, 2025


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

d5b981f8

[BugFix] Fix KVConnector TP worker aggregation (#21473) · eec69420
Nick Hill authored Jul 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
eec69420
[BugFix]: Batch generation from prompt_embeds fails for long prompts (#21390) · fd48d99f
KazusatoOoko authored Jul 23, 2025
```
Signed-off-by: KazusatoOko <kazusto.oko@sakana.ai>
Co-authored-by: KazusatoOko <kazusto.oko@sakana.ai>
```
fd48d99f
[Frontend] Set MAX_AUDIO_CLIP_FILESIZE_MB via env var instead of hardcoding (#21374) · 63d92abb
deven-labovitch authored Jul 23, 2025
```
Signed-off-by: Deven Labovitch <deven@videa.ai>
```
63d92abb

feat(gguf_loader): accept HF repo paths & URLs for GGUF (#20793) · 11599b0e

Hardik Gupta authored Jul 23, 2025


Signed-off-by: Hardik <hardikgupta1999@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

11599b0e

[Core] Freeze gc during cuda graph capture to speed up init (#21146) · f3137cdd
Michael Goin authored Jul 23, 2025
```
Signed-off-by: Codex <codex@openai.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
f3137cdd

23 Jul, 2025 17 commits
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
- [V1] Fix local chunked attention always disabled (#21419) · 78c13e30
  Yong Hoon Shin authored Jul 23, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  78c13e30
- [Core] Add `reload_weights` RPC method (#20096) · 5c9b807b
  22quinn authored Jul 23, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  5c9b807b
- Add test case for compiling multiple graphs (#21044) · 4ac7713e
  Yong Hoon Shin authored Jul 23, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  4ac7713e
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
- [Bugfix][Qwen][DCA] fixes bug in dual-chunk-flash-attn backend for qwen 1m models. (#21364) · 7c734ee0
  Tao He authored Jul 23, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  7c734ee0
- [V1] Check all pooling tasks during profiling (#21299) · f59ec35b
  Cyrus Leung authored Jul 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f59ec35b
- [Model] add Hunyuan V1 Dense Model support. (#21368) · 2671334d
  Asher authored Jul 23, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  2671334d
- [Sampler] Introduce logprobs mode for logging (#21398) · accac829
  Lu Fang authored Jul 23, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  accac829
- Fixed typo in profiling logs (#21441) · 6364af92
  Sergio Paniego Blanco authored Jul 23, 2025
  
  6364af92
- [Bugfix] ensure tool_choice is popped when `tool_choice:null` is passed in json payload (#19679) · 7aaa2bd5
  Guillaume Calmettes authored Jul 23, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  7aaa2bd5
- add clear messages for deprecated models (#21424) · 2f5c14de
  youkaichao authored Jul 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  2f5c14de
- [Cleanup] Only log MoE DP setup warning if DP is enabled (#21315) · f002e9a8
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f002e9a8
- [Bugfix] Fix nightly transformers CI failure (#21427) · 4ecedd18
  Isotr0py authored Jul 23, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  4ecedd18
- [Bugfix][CUDA] fixes CUDA FP8 kv cache dtype supported (#21420) · 2dec7c1a
  elvischenv authored Jul 23, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  2dec7c1a
- [BUGFIX] deepseek-v2-lite failed due to fused_qkv_a_proj name update (#21414) · 08d2bd78
  Chendi.Xue authored Jul 22, 2025
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  08d2bd78
- Simplify weight loading in Transformers backend (#21382) · f154bb9f
  Harry Mellor authored Jul 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f154bb9f
22 Jul, 2025 9 commits
- [BugFix] Fix ray import error mem cleanup bug (#21381) · b77c7d32
  Joe Runde authored Jul 22, 2025
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  b77c7d32
- [Misc] Copy HF_TOKEN env var to Ray workers (#21406) · 35bc8bd5
  Rui Qiao authored Jul 22, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  35bc8bd5
- [Model] Add Qwen3CoderToolParser (#21396) · 4594fc3b
  Yiheng Xu authored Jul 22, 2025
```
Signed-off-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: simon-mo <xmo@berkeley.edu>
```
  4594fc3b
- Fix Flashinfer Allreduce+Norm enable disable calculation based on... · ae268b63
  Xin Li authored Jul 22, 2025
```
Fix Flashinfer Allreduce+Norm enable disable calculation based on `fi_allreduce_fusion_max_token_num` (#21325)
Signed-off-by: XIn Li <xinli@nvidia.com>
```
  ae268b63
- [Bugfix] Decode Tokenized IDs to Strings for `hf_processor` in `llm.chat()`... · 2226d5bd
  Aritra Roy Gosthipaty authored Jul 22, 2025
```
[Bugfix] Decode Tokenized IDs to Strings for `hf_processor` in `llm.chat()` with `model_impl=transformers` (#21353)
Signed-off-by: ariG23498 <aritra.born2fly@gmail.com>
```
  2226d5bd
- Add tokenization_kwargs to encode for embedding model truncation (#21033) · 44554a00
  Wang Yijun authored Jul 22, 2025
  
  44554a00
- [feat] Enable mm caching for transformers backend (#21358) · f38ee34a
  Raushan Turganbay authored Jul 22, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  f38ee34a
- Adds parallel model weight loading for runai_streamer (#21330) · b194557a
  Benjamin Bartels authored Jul 22, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b194557a
- [Perf] Cuda Kernel for Per Token Group Quant (#21083) · 774d0c01
  Wentao Ye authored Jul 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  774d0c01