Commits · 3b3b778d4af545a30290275d3154bb0e514d2dcc · OpenDAS / vllm_cscc · GitLab

13 Jul, 2025 2 commits
- [Bugfix] Fix a couple PPLX+CUTLASS MoE bugs (#20825) · 3b3b778d
  ElizaWszola authored Jul 13, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  3b3b778d
- [Perf] Use Triton instead of Torch for DeepGEMM Per Token Group Quant (#20841) · 42d440c2
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  42d440c2
12 Jul, 2025 23 commits
- [Sched] Enhance the logic to remove stopped requests from queues (#20739) · f45a3328
  Woosuk Kwon authored Jul 12, 2025
  
  f45a3328
- [Bugfix] Restrict Machete to only run on Hopper (#20830) · 6e2c176e
  Michael Goin authored Jul 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6e2c176e
- [docs] convert supported configs to table (#20858) · a86754a1
  Reid authored Jul 12, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  a86754a1
- [Bugfix] Fix Tensor Parallelism Padding Consistency in Granite Models (#20843) · c2a2f19a
  Alex Brooks authored Jul 12, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  c2a2f19a
- [Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) · 2c11a738
  Congcong Chen authored Jul 12, 2025
```
Signed-off-by: Congcong Chen <congcongchen@microsoft.com>
```
  2c11a738
- Revert "Use NVCC --compress-mode to reduce binary size by 30% #20694" (#20853) · b639327a
  Michael Goin authored Jul 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b639327a
- Enable ModelOpt Llama4 fp8 checkpoint deployment (#20419) · 4afe687a
  Zhiyu authored Jul 11, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  4afe687a
- Remove extra tensor on CPU (#20693) · 5de8d9f1
  Maximilien de Bayser authored Jul 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  5de8d9f1
- [cold start time] add envs.VLLM_COMPILE_DEPYF to guard decompile (#20790) · c1c8ca57
  Boyuan Feng authored Jul 11, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c1c8ca57
- [Bugfix] Fix torch.compile x LoRA for PyTorch 2.8 (#20823) · a3a5a47e
  Richard Zou authored Jul 12, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  a3a5a47e
- [Docs] Update basic.md (#20846) · fb25e956
  Lucia Fang authored Jul 12, 2025
  
  fb25e956
- [Bug] Fix DeepGemm for EP low latency case (#20833) · 0d4891cd
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0d4891cd
- [Misc] Respect `no_use_tqdm_on_load` flag while capturing CUDA graph (#20834) · f56d2996
  lkchen authored Jul 11, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  f56d2996
- [Bugfix] Replace unavailable video url in multimodal test (#20854) · 147afb44
  Isotr0py authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  147afb44
- [Frontend] Abstract prompt and SpeechToTextConfig for transcriptions models (#20637) · 3c7d942d
  Nicolò Lucchesi authored Jul 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3c7d942d
- [Bugfix] : Fix typo - logger.warn_once -> logger.warning_once (#20852) · 890323dc
  Varun Sundar Rabindranath authored Jul 12, 2025
  
  890323dc
- [CI/Build] Ensure compatability with Transformers v4.53 (#20541) · 01cae377
  Isotr0py authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  01cae377
- [Bugfix] Fix tensor parallel issue in Qwen3 reranker weight loading (#20682) · 11c01986
  yurhett authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  11c01986
- [Bugfix] Lazy import fused_experts in BitsAndBytesMoEMethod to avoid break... · b1235c3e
  Li, Jiang authored Jul 12, 2025
```
[Bugfix] Lazy import fused_experts in BitsAndBytesMoEMethod to avoid break not-cuda-alike devices  (#20822)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  b1235c3e
- [Misc] Restrict deep_gemm's log output (#20827) · 44d02f54
  Jee Jee Li authored Jul 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  44d02f54
- Add pynccl all-gatherv and reducescatterv (#20154) · a8593237
  Trevor Morris authored Jul 11, 2025
```
Signed-off-by: Trevor Morris <tmorris@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  a8593237
- Integration SM100 FlashInfer fused allreduce RMSNorm (#20691) · fc0f41d1
  Ilya Markov authored Jul 12, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  fc0f41d1
- [CI Bug] Fix Async Engine, Inputs, Utils, Worker Test: 'State' object has no... · 7b828e30
  Wentao Ye authored Jul 11, 2025
```
[CI Bug] Fix Async Engine, Inputs, Utils, Worker Test: 'State' object has no attribute 'enable_server_load_tracking' (#20845)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7b828e30
11 Jul, 2025 15 commits
- Update kimi-k2 tool calling docs, enable unit tests (#20821) · 5f0af36a
  bigmoyan authored Jul 12, 2025
```
Signed-off-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>
```
  5f0af36a
- [Bugfix] Fix OOM in language generation test (#20814) · 0d21b266
  Isotr0py authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0d21b266
- [Docs] Data Parallel deployment documentation (#20768) · 9907fc44
  Nick Hill authored Jul 11, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9907fc44
- [Kernel] Basic tuned configs for NVFP4 CUTLASS dense GEMM (#20646) · d47661f0
  Michael Goin authored Jul 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d47661f0
- [Misc] Add unit tests for MoE ModularKernel combinations + Profiling utility (#20449) · 53fa4573
  Varun Sundar Rabindranath authored Jul 11, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  53fa4573
- [doc] fix ordered list issue (#20819) · 6fb16244
  Reid authored Jul 11, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  6fb16244
- [Bugfix] Add missing field to TritonLanguagePlaceholder (#20812) · 66177189
  Li, Jiang authored Jul 11, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  66177189
- Temporarily suspend google/gemma-3-1b-it. (#20722) · b4f0b5f9
  QiliangCui authored Jul 11, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  b4f0b5f9
- [Bugfix] Refactor `/invocations` to be task-agnostic (#20764) · cbd14ed5
  Cyrus Leung authored Jul 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbd14ed5
- [Core] Add Flashinfer TRTLLM Backend for Flashinfer decode path (SM100). (#19825) · 7bd4c37a
  Pavani Majety authored Jul 11, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: shuw <shuw@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7bd4c37a
- [Quantization][1/N] MoE support BNB-Inflight Quantization (#20061) · 8020e98c
  Jee Jee Li authored Jul 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8020e98c
- [Bugfix] Upgrade depyf to 0.19 and streamline custom pass logging (#20777) · 762be26a
  Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Signed-off-by: luka <lgovedic@redhat.com>
```
  762be26a
- [doc] fold long code block (#20795) · 6a9e6b2a
  Reid authored Jul 11, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  6a9e6b2a
- [V1] Enable Mamba2 layers other than MambaMixer2 in the v1 engine (#20660) · 5d09152f
  nopperl authored Jul 11, 2025
```
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
```
  5d09152f
- [Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830) · 31d5c179
  Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  31d5c179