Commits · 3c7d942da83385fd7ed656e85dc34455009893ce · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "91eea72330ef507c839596afc59f37732b045820"

12 Jul, 2025 9 commits
- [Frontend] Abstract prompt and SpeechToTextConfig for transcriptions models (#20637) · 3c7d942d
  Nicolò Lucchesi authored Jul 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3c7d942d
- [Bugfix] : Fix typo - logger.warn_once -> logger.warning_once (#20852) · 890323dc
  Varun Sundar Rabindranath authored Jul 12, 2025
  
  890323dc
- [CI/Build] Ensure compatability with Transformers v4.53 (#20541) · 01cae377
  Isotr0py authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  01cae377
- [Bugfix] Fix tensor parallel issue in Qwen3 reranker weight loading (#20682) · 11c01986
  yurhett authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  11c01986
- [Bugfix] Lazy import fused_experts in BitsAndBytesMoEMethod to avoid break... · b1235c3e
  Li, Jiang authored Jul 12, 2025
```
[Bugfix] Lazy import fused_experts in BitsAndBytesMoEMethod to avoid break not-cuda-alike devices  (#20822)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  b1235c3e
- [Misc] Restrict deep_gemm's log output (#20827) · 44d02f54
  Jee Jee Li authored Jul 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  44d02f54
- Add pynccl all-gatherv and reducescatterv (#20154) · a8593237
  Trevor Morris authored Jul 11, 2025
```
Signed-off-by: Trevor Morris <tmorris@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  a8593237
- Integration SM100 FlashInfer fused allreduce RMSNorm (#20691) · fc0f41d1
  Ilya Markov authored Jul 12, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  fc0f41d1
- [CI Bug] Fix Async Engine, Inputs, Utils, Worker Test: 'State' object has no... · 7b828e30
  Wentao Ye authored Jul 11, 2025
```
[CI Bug] Fix Async Engine, Inputs, Utils, Worker Test: 'State' object has no attribute 'enable_server_load_tracking' (#20845)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7b828e30
11 Jul, 2025 14 commits
- [Misc] Add unit tests for MoE ModularKernel combinations + Profiling utility (#20449) · 53fa4573
  Varun Sundar Rabindranath authored Jul 11, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  53fa4573
- [Bugfix] Add missing field to TritonLanguagePlaceholder (#20812) · 66177189
  Li, Jiang authored Jul 11, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  66177189
- [Bugfix] Refactor `/invocations` to be task-agnostic (#20764) · cbd14ed5
  Cyrus Leung authored Jul 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbd14ed5
- [Core] Add Flashinfer TRTLLM Backend for Flashinfer decode path (SM100). (#19825) · 7bd4c37a
  Pavani Majety authored Jul 11, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: shuw <shuw@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7bd4c37a
- [Quantization][1/N] MoE support BNB-Inflight Quantization (#20061) · 8020e98c
  Jee Jee Li authored Jul 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8020e98c
- [Bugfix] Upgrade depyf to 0.19 and streamline custom pass logging (#20777) · 762be26a
  Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Signed-off-by: luka <lgovedic@redhat.com>
```
  762be26a
- [V1] Enable Mamba2 layers other than MambaMixer2 in the v1 engine (#20660) · 5d09152f
  nopperl authored Jul 11, 2025
```
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
```
  5d09152f
- [Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830) · 31d5c179
  Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  31d5c179
- [XPU] XCCL support enabled in torch 2.8.0.dev nightly builds (#20705) · 35514b68
  Ratnam Parikh authored Jul 10, 2025
```
Signed-off-by: ratnampa <ratnam.parikh@intel.com>
```
  35514b68
- [Feature] Integrate SM100 DeepGEMM support (#20087) · e2de455c
  Wentao Ye authored Jul 10, 2025
  
  e2de455c
- [Attention] MLA - Flashinfer Ragged Prefill (#20034) · 5b032352
  Alexander Matveev authored Jul 10, 2025
  
  5b032352
- [Model] Support HF format of minimax (#20211) · 922f3164
  Michael Goin authored Jul 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  922f3164
- [fix]: disable cutlass block scaled group gemm for EP (#20781) · 5923ab95
  Duncan Moss authored Jul 10, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
```
  5923ab95
- Add kimi-k2 tool parser (#20789) · 0cf893ca
  bigmoyan authored Jul 11, 2025
```
Signed-off-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>
```
  0cf893ca
10 Jul, 2025 17 commits
- [Docs] Lazy import gguf (#20785) · b854321f
  Simon Mo authored Jul 10, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  b854321f
- [Misc] MoE ModularKernel : Introduce TopKWeightAndReduce (#20648) · f0c98cae
  Varun Sundar Rabindranath authored Jul 10, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  f0c98cae
- [KVConnector] Always call connector `clear_metadata()` at end of step (#20756) · 574ad60d
  Nick Hill authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: David Ben-David <sdavidbd@gmail.com>
```
  574ad60d
- [Bugfix] Fused MoE Modular Kernel chunking loop (#20392) · fdadb6f4
  Varun Sundar Rabindranath authored Jul 10, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fdadb6f4
- [Core] Add Support for Default Modality Specific LoRAs [generate / chat completions] (#19126) · 41060c6e
  Alex Brooks authored Jul 10, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  41060c6e
- [Bugfix] Remove assertion of expert_map being None (#20714) · 3de2ed76
  Ming Yang authored Jul 10, 2025
```
Signed-off-by: Ming Yang <yming@meta.com>
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3de2ed76
- [CI] Fix pre commit issue (#20782) · 299252ea
  Wentao Ye authored Jul 10, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  299252ea
- [V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975) · d6902ce7
  Nathan Hoos authored Jul 10, 2025
```
Signed-off-by: Nathan Hoos <thwackyy.y@gmail.com>
```
  d6902ce7
- [Bugfix] [CI] Fix Tensorizer LoRA test (#20760) · 5e53c89a
  Sanger Steel authored Jul 10, 2025
```
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
```
  5e53c89a
- [Model][VLM] Support JinaVL Reranker (#20260) · 4bed1677
  shineran96 authored Jul 11, 2025
```
Signed-off-by: shineran96 <shinewang96@gmail.com>
```
  4bed1677
- [Model] Add reason parser for Hunyuan A13B Model. (#20625) · b140416a
  Asher authored Jul 11, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  b140416a
- [ROCm][Regression] Remove tensor creation that harms performance on ROCm (#20741) · 5b8366b6
  Gregory Shtrasberg authored Jul 10, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  5b8366b6
- [Doc] Add engine args back in to the docs (#20674) · 3482fd7e
  Harry Mellor authored Jul 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3482fd7e
- [KVConnector] Aggregate finished requests on the scheduler (#19555) · cc876d0f
  Or Ozeri authored Jul 10, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  cc876d0f
- [TPU][Core]Make load weight exceed hbm error more instructive for customers (#20644) · fdfd409f
  Chenyaaang authored Jul 10, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  fdfd409f
- [BugFix] Fix `VllmConfig()` construction on all platforms (#20695) · ffbcc9e7
  Nick Hill authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ffbcc9e7
- [BugFix][CPU] Fix CPU worker dependency on cumem_allocator (#20696) · 59389c92
  Nick Hill authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  59389c92