Commits · 697ef765ee91d1a47b49ae7e43951cfd116b6052 · OpenDAS / vllm_cscc

"lib/bindings/kvbm/src/block_manager.rs" did not exist on "80256acf1533f672f01d25215cb133206355d29c"

14 Jul, 2025 6 commits
- [Refactor][V1] Move outlines utils for V1 imports (#20878) · 697ef765
  Aaron Pham authored Jul 14, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  697ef765
- [Quantization] add BNB for MixtralForCausalLM (#20893) · a99b9f7d
  Jee Jee Li authored Jul 14, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a99b9f7d
- Fix: Add missing EOFError handling in CLI complete command (#20896) · 2c7fa471
  Reid authored Jul 14, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  2c7fa471
- Removing redundant python version check (#20888) · 88fc8a97
  Daniel song authored Jul 14, 2025
```
Signed-off-by: Dannyso05 <dansong1177@gmail.com>
```
  88fc8a97
- [Prefix Cache] Add reproducible prefix-cache block hashing using SHA-256 + CBOR (64bit) (#20511) · 66f6fbd3
  Maroon Ayoub authored Jul 14, 2025
```
Signed-off-by: Maroon Ayoub <maroon.ayoub@ibm.com>
```
  66f6fbd3
- [Core] Add `update_config` RPC method (#20095) · 8632e831
  22quinn authored Jul 13, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  8632e831
13 Jul, 2025 9 commits
- [V1] Hybrid allocator without prefix caching (#20661) · 4bbfc36b
  nopperl authored Jul 14, 2025
```
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
```
  4bbfc36b
- [V1] [ROCm] [AITER] Upgrade AITER to commit `916bf3c` and bugfix APIs (#20880) · 80d38b8a
  TJian authored Jul 13, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  80d38b8a
- [Bugfix] fix define of RerankDocument (#20877) · 211b6a61
  Liuchenlong authored Jul 13, 2025
```
Signed-off-by: liuchenlong <liuchenlong@xiaohongshu.com>
Co-authored-by: liuchenlong <liuchenlong@xiaohongshu.com>
```
  211b6a61
- [Bugfix] Fix: add patch_rope_scaling after hf override (#20857) · 247102f0
  Wang Siyuan authored Jul 13, 2025
```
Signed-off-by: Wang Siyuan <wsy0227@sjtu.edu.cn>
Signed-off-by: Wang Siyuan <sywang0227@gmail.com>
```
  247102f0
- Support for LlamaForSequenceClassification (#20807) · bd4c1e6f
  Minkyu Kim authored Jul 13, 2025
```
Signed-off-by: thechaos16 <thechaos16@gmail.com>
```
  bd4c1e6f
- [Core] Support multiple tasks per model (#20771) · 020f58ab
  Nicolò Lucchesi authored Jul 13, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  020f58ab
- [Refactor] Change the way of import triton (#20774) · c1acd6d7
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c1acd6d7
- [Bugfix] Fix a couple PPLX+CUTLASS MoE bugs (#20825) · 3b3b778d
  ElizaWszola authored Jul 13, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  3b3b778d
- [Perf] Use Triton instead of Torch for DeepGEMM Per Token Group Quant (#20841) · 42d440c2
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  42d440c2
12 Jul, 2025 19 commits
- [Sched] Enhance the logic to remove stopped requests from queues (#20739) · f45a3328
  Woosuk Kwon authored Jul 12, 2025
  
  f45a3328
- [Bugfix] Restrict Machete to only run on Hopper (#20830) · 6e2c176e
  Michael Goin authored Jul 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6e2c176e
- [Bugfix] Fix Tensor Parallelism Padding Consistency in Granite Models (#20843) · c2a2f19a
  Alex Brooks authored Jul 12, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  c2a2f19a
- [Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) · 2c11a738
  Congcong Chen authored Jul 12, 2025
```
Signed-off-by: Congcong Chen <congcongchen@microsoft.com>
```
  2c11a738
- Enable ModelOpt Llama4 fp8 checkpoint deployment (#20419) · 4afe687a
  Zhiyu authored Jul 11, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  4afe687a
- Remove extra tensor on CPU (#20693) · 5de8d9f1
  Maximilien de Bayser authored Jul 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  5de8d9f1
- [cold start time] add envs.VLLM_COMPILE_DEPYF to guard decompile (#20790) · c1c8ca57
  Boyuan Feng authored Jul 11, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c1c8ca57
- [Bugfix] Fix torch.compile x LoRA for PyTorch 2.8 (#20823) · a3a5a47e
  Richard Zou authored Jul 12, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  a3a5a47e
- [Bug] Fix DeepGemm for EP low latency case (#20833) · 0d4891cd
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0d4891cd
- [Misc] Respect `no_use_tqdm_on_load` flag while capturing CUDA graph (#20834) · f56d2996
  lkchen authored Jul 11, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  f56d2996
- [Frontend] Abstract prompt and SpeechToTextConfig for transcriptions models (#20637) · 3c7d942d
  Nicolò Lucchesi authored Jul 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3c7d942d
- [Bugfix] : Fix typo - logger.warn_once -> logger.warning_once (#20852) · 890323dc
  Varun Sundar Rabindranath authored Jul 12, 2025
  
  890323dc
- [CI/Build] Ensure compatability with Transformers v4.53 (#20541) · 01cae377
  Isotr0py authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  01cae377
- [Bugfix] Fix tensor parallel issue in Qwen3 reranker weight loading (#20682) · 11c01986
  yurhett authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  11c01986
- [Bugfix] Lazy import fused_experts in BitsAndBytesMoEMethod to avoid break... · b1235c3e
  Li, Jiang authored Jul 12, 2025
```
[Bugfix] Lazy import fused_experts in BitsAndBytesMoEMethod to avoid break not-cuda-alike devices  (#20822)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  b1235c3e
- [Misc] Restrict deep_gemm's log output (#20827) · 44d02f54
  Jee Jee Li authored Jul 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  44d02f54
- Add pynccl all-gatherv and reducescatterv (#20154) · a8593237
  Trevor Morris authored Jul 11, 2025
```
Signed-off-by: Trevor Morris <tmorris@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  a8593237
- Integration SM100 FlashInfer fused allreduce RMSNorm (#20691) · fc0f41d1
  Ilya Markov authored Jul 12, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  fc0f41d1
- [CI Bug] Fix Async Engine, Inputs, Utils, Worker Test: 'State' object has no... · 7b828e30
  Wentao Ye authored Jul 11, 2025
```
[CI Bug] Fix Async Engine, Inputs, Utils, Worker Test: 'State' object has no attribute 'enable_server_load_tracking' (#20845)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7b828e30
11 Jul, 2025 6 commits
- [Misc] Add unit tests for MoE ModularKernel combinations + Profiling utility (#20449) · 53fa4573
  Varun Sundar Rabindranath authored Jul 11, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  53fa4573
- [Bugfix] Add missing field to TritonLanguagePlaceholder (#20812) · 66177189
  Li, Jiang authored Jul 11, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  66177189
- [Bugfix] Refactor `/invocations` to be task-agnostic (#20764) · cbd14ed5
  Cyrus Leung authored Jul 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbd14ed5
- [Core] Add Flashinfer TRTLLM Backend for Flashinfer decode path (SM100). (#19825) · 7bd4c37a
  Pavani Majety authored Jul 11, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: shuw <shuw@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7bd4c37a
- [Quantization][1/N] MoE support BNB-Inflight Quantization (#20061) · 8020e98c
  Jee Jee Li authored Jul 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8020e98c
- [Bugfix] Upgrade depyf to 0.19 and streamline custom pass logging (#20777) · 762be26a
  Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Signed-off-by: luka <lgovedic@redhat.com>
```
  762be26a