Commits · 2c7fa47161ba513817a80e165c86a66760c06ebb · OpenDAS / vllm_cscc

14 Jul, 2025 4 commits
- Fix: Add missing EOFError handling in CLI complete command (#20896) · 2c7fa471
  Reid authored Jul 14, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  2c7fa471
- Removing redundant python version check (#20888) · 88fc8a97
  Daniel song authored Jul 14, 2025
```
Signed-off-by: Dannyso05 <dansong1177@gmail.com>
```
  88fc8a97
- [Prefix Cache] Add reproducible prefix-cache block hashing using SHA-256 + CBOR (64bit) (#20511) · 66f6fbd3
  Maroon Ayoub authored Jul 14, 2025
```
Signed-off-by: Maroon Ayoub <maroon.ayoub@ibm.com>
```
  66f6fbd3
- [Core] Add `update_config` RPC method (#20095) · 8632e831
  22quinn authored Jul 13, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  8632e831
13 Jul, 2025 10 commits
- [V1] Hybrid allocator without prefix caching (#20661) · 4bbfc36b
  nopperl authored Jul 14, 2025
```
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
```
  4bbfc36b
- [V1] [ROCm] [AITER] Upgrade AITER to commit `916bf3c` and bugfix APIs (#20880) · 80d38b8a
  TJian authored Jul 13, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  80d38b8a
- [Bugfix] fix define of RerankDocument (#20877) · 211b6a61
  Liuchenlong authored Jul 13, 2025
```
Signed-off-by: liuchenlong <liuchenlong@xiaohongshu.com>
Co-authored-by: liuchenlong <liuchenlong@xiaohongshu.com>
```
  211b6a61
- [Bugfix] Fix: add patch_rope_scaling after hf override (#20857) · 247102f0
  Wang Siyuan authored Jul 13, 2025
```
Signed-off-by: Wang Siyuan <wsy0227@sjtu.edu.cn>
Signed-off-by: Wang Siyuan <sywang0227@gmail.com>
```
  247102f0
- Support for LlamaForSequenceClassification (#20807) · bd4c1e6f
  Minkyu Kim authored Jul 13, 2025
```
Signed-off-by: thechaos16 <thechaos16@gmail.com>
```
  bd4c1e6f
- Renable google/gemma-3-1b-it accuracy test. (#20866) · 99b4f080
  QiliangCui authored Jul 12, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  99b4f080
- [Core] Support multiple tasks per model (#20771) · 020f58ab
  Nicolò Lucchesi authored Jul 13, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  020f58ab
- [Refactor] Change the way of import triton (#20774) · c1acd6d7
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c1acd6d7
- [Bugfix] Fix a couple PPLX+CUTLASS MoE bugs (#20825) · 3b3b778d
  ElizaWszola authored Jul 13, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  3b3b778d
- [Perf] Use Triton instead of Torch for DeepGEMM Per Token Group Quant (#20841) · 42d440c2
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  42d440c2
12 Jul, 2025 23 commits
- [Sched] Enhance the logic to remove stopped requests from queues (#20739) · f45a3328
  Woosuk Kwon authored Jul 12, 2025
  
  f45a3328
- [Bugfix] Restrict Machete to only run on Hopper (#20830) · 6e2c176e
  Michael Goin authored Jul 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6e2c176e
- [docs] convert supported configs to table (#20858) · a86754a1
  Reid authored Jul 12, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  a86754a1
- [Bugfix] Fix Tensor Parallelism Padding Consistency in Granite Models (#20843) · c2a2f19a
  Alex Brooks authored Jul 12, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  c2a2f19a
- [Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) · 2c11a738
  Congcong Chen authored Jul 12, 2025
```
Signed-off-by: Congcong Chen <congcongchen@microsoft.com>
```
  2c11a738
- Revert "Use NVCC --compress-mode to reduce binary size by 30% #20694" (#20853) · b639327a
  Michael Goin authored Jul 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b639327a
- Enable ModelOpt Llama4 fp8 checkpoint deployment (#20419) · 4afe687a
  Zhiyu authored Jul 11, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  4afe687a
- Remove extra tensor on CPU (#20693) · 5de8d9f1
  Maximilien de Bayser authored Jul 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  5de8d9f1
- [cold start time] add envs.VLLM_COMPILE_DEPYF to guard decompile (#20790) · c1c8ca57
  Boyuan Feng authored Jul 11, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c1c8ca57
- [Bugfix] Fix torch.compile x LoRA for PyTorch 2.8 (#20823) · a3a5a47e
  Richard Zou authored Jul 12, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  a3a5a47e
- [Docs] Update basic.md (#20846) · fb25e956
  Lucia Fang authored Jul 12, 2025
  
  fb25e956
- [Bug] Fix DeepGemm for EP low latency case (#20833) · 0d4891cd
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0d4891cd
- [Misc] Respect `no_use_tqdm_on_load` flag while capturing CUDA graph (#20834) · f56d2996
  lkchen authored Jul 11, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  f56d2996
- [Bugfix] Replace unavailable video url in multimodal test (#20854) · 147afb44
  Isotr0py authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  147afb44
- [Frontend] Abstract prompt and SpeechToTextConfig for transcriptions models (#20637) · 3c7d942d
  Nicolò Lucchesi authored Jul 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3c7d942d
- [Bugfix] : Fix typo - logger.warn_once -> logger.warning_once (#20852) · 890323dc
  Varun Sundar Rabindranath authored Jul 12, 2025
  
  890323dc
- [CI/Build] Ensure compatability with Transformers v4.53 (#20541) · 01cae377
  Isotr0py authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  01cae377
- [Bugfix] Fix tensor parallel issue in Qwen3 reranker weight loading (#20682) · 11c01986
  yurhett authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  11c01986
- [Bugfix] Lazy import fused_experts in BitsAndBytesMoEMethod to avoid break... · b1235c3e
  Li, Jiang authored Jul 12, 2025
```
[Bugfix] Lazy import fused_experts in BitsAndBytesMoEMethod to avoid break not-cuda-alike devices  (#20822)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  b1235c3e
- [Misc] Restrict deep_gemm's log output (#20827) · 44d02f54
  Jee Jee Li authored Jul 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  44d02f54
- Add pynccl all-gatherv and reducescatterv (#20154) · a8593237
  Trevor Morris authored Jul 11, 2025
```
Signed-off-by: Trevor Morris <tmorris@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  a8593237
- Integration SM100 FlashInfer fused allreduce RMSNorm (#20691) · fc0f41d1
  Ilya Markov authored Jul 12, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  fc0f41d1
- [CI Bug] Fix Async Engine, Inputs, Utils, Worker Test: 'State' object has no... · 7b828e30
  Wentao Ye authored Jul 11, 2025
```
[CI Bug] Fix Async Engine, Inputs, Utils, Worker Test: 'State' object has no attribute 'enable_server_load_tracking' (#20845)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7b828e30
11 Jul, 2025 3 commits

Update kimi-k2 tool calling docs, enable unit tests (#20821) · 5f0af36a

bigmoyan authored Jul 12, 2025


Signed-off-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>

5f0af36a

[Bugfix] Fix OOM in language generation test (#20814) · 0d21b266

Isotr0py authored Jul 12, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

0d21b266

[Docs] Data Parallel deployment documentation (#20768) · 9907fc44
Nick Hill authored Jul 11, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
9907fc44