Commits · b4f0b5f9aaa8b93a335c12b7f412f44f17d704e0 · OpenDAS / vllm_cscc · GitLab

11 Jul, 2025 15 commits
- Temporarily suspend google/gemma-3-1b-it. (#20722) · b4f0b5f9
  QiliangCui authored Jul 11, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  b4f0b5f9
- [Bugfix] Refactor `/invocations` to be task-agnostic (#20764) · cbd14ed5
  Cyrus Leung authored Jul 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbd14ed5
- [Core] Add Flashinfer TRTLLM Backend for Flashinfer decode path (SM100). (#19825) · 7bd4c37a
  Pavani Majety authored Jul 11, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: shuw <shuw@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7bd4c37a
- [Quantization][1/N] MoE support BNB-Inflight Quantization (#20061) · 8020e98c
  Jee Jee Li authored Jul 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8020e98c
- [Bugfix] Upgrade depyf to 0.19 and streamline custom pass logging (#20777) · 762be26a
  Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Signed-off-by: luka <lgovedic@redhat.com>
```
  762be26a
- [doc] fold long code block (#20795) · 6a9e6b2a
  Reid authored Jul 11, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  6a9e6b2a
- [V1] Enable Mamba2 layers other than MambaMixer2 in the v1 engine (#20660) · 5d09152f
  nopperl authored Jul 11, 2025
```
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
```
  5d09152f
- [Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830) · 31d5c179
  Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  31d5c179
- [XPU] XCCL support enabled in torch 2.8.0.dev nightly builds (#20705) · 35514b68
  Ratnam Parikh authored Jul 10, 2025
```
Signed-off-by: ratnampa <ratnam.parikh@intel.com>
```
  35514b68
- [Feature] Integrate SM100 DeepGEMM support (#20087) · e2de455c
  Wentao Ye authored Jul 10, 2025
  
  e2de455c
- [Attention] MLA - Flashinfer Ragged Prefill (#20034) · 5b032352
  Alexander Matveev authored Jul 10, 2025
  
  5b032352
- [Model] Support HF format of minimax (#20211) · 922f3164
  Michael Goin authored Jul 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  922f3164
- [fix]: disable cutlass block scaled group gemm for EP (#20781) · 5923ab95
  Duncan Moss authored Jul 10, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
```
  5923ab95
- Add kimi-k2 tool parser (#20789) · 0cf893ca
  bigmoyan authored Jul 11, 2025
```
Signed-off-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>
```
  0cf893ca
- [CI Bugfix] Specify same TORCH_CUDA_ARCH_LIST for flashinfer aot and install (#20772) · cf75cd20
  Michael Goin authored Jul 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cf75cd20
10 Jul, 2025 25 commits
- [Docs] Lazy import gguf (#20785) · b854321f
  Simon Mo authored Jul 10, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  b854321f
- [Bugfix][Benchmark] Make sure the output length > 0 when testing prefill workload. (#20786) · 5b6fe23d
  Kuntai Du authored Jul 10, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  5b6fe23d
- [Misc] MoE ModularKernel : Introduce TopKWeightAndReduce (#20648) · f0c98cae
  Varun Sundar Rabindranath authored Jul 10, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  f0c98cae
- [KVConnector] Always call connector `clear_metadata()` at end of step (#20756) · 574ad60d
  Nick Hill authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: David Ben-David <sdavidbd@gmail.com>
```
  574ad60d
- [Bugfix] Fused MoE Modular Kernel chunking loop (#20392) · fdadb6f4
  Varun Sundar Rabindranath authored Jul 10, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fdadb6f4
- [Core] Add Support for Default Modality Specific LoRAs [generate / chat completions] (#19126) · 41060c6e
  Alex Brooks authored Jul 10, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  41060c6e
- [Bugfix] Remove assertion of expert_map being None (#20714) · 3de2ed76
  Ming Yang authored Jul 10, 2025
```
Signed-off-by: Ming Yang <yming@meta.com>
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3de2ed76
- [CI] Fix pre commit issue (#20782) · 299252ea
  Wentao Ye authored Jul 10, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  299252ea
- [V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975) · d6902ce7
  Nathan Hoos authored Jul 10, 2025
```
Signed-off-by: Nathan Hoos <thwackyy.y@gmail.com>
```
  d6902ce7
- [Bugfix] [CI] Fix Tensorizer LoRA test (#20760) · 5e53c89a
  Sanger Steel authored Jul 10, 2025
```
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
```
  5e53c89a
- [Test] Remove docker build from test. (#20542) · c66e38ea
  QiliangCui authored Jul 10, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  c66e38ea
- Fix DeepSeek-R1-0528 chat template (#20717) · 25159536
  sfbemerk authored Jul 10, 2025
```
Signed-off-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
```
  25159536
- [Model][VLM] Support JinaVL Reranker (#20260) · 4bed1677
  shineran96 authored Jul 11, 2025
```
Signed-off-by: shineran96 <shinewang96@gmail.com>
```
  4bed1677
- [Model] Add reason parser for Hunyuan A13B Model. (#20625) · b140416a
  Asher authored Jul 11, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  b140416a
- [ROCm][Regression] Remove tensor creation that harms performance on ROCm (#20741) · 5b8366b6
  Gregory Shtrasberg authored Jul 10, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  5b8366b6
- [Hardware][CPU] Vllm int8 quantization enablement for ARM CPU (#14129) · c7753a98
  nishith-fujitsu authored Jul 10, 2025
```
Signed-off-by: nishith-fujitsu <nishith.jaiswal@fujitsu.com>
```
  c7753a98
- Update Dockerfile FlashInfer to v0.2.8rc1 (#20718) · 4b9a9435
  Michael Goin authored Jul 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4b9a9435
- [Doc] Add engine args back in to the docs (#20674) · 3482fd7e
  Harry Mellor authored Jul 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3482fd7e
- [Misc] Clean up mark to fork process in BNB tests (#20692) · 77f77a95
  Isotr0py authored Jul 10, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  77f77a95
- Normalize lm-eval command between baseline and correctness test (#18560) · 1a4f35e2
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1a4f35e2
- [CI Bugfix] Skip failing Tensorizer+LoRA test (#20724) · be1e128d
  Michael Goin authored Jul 10, 2025
  
  be1e128d
- [doc] fix ordered list (#20749) · 65393ee0
  Reid authored Jul 10, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  65393ee0
- [Bugfix][Build][Non-CUDA] Only referencing CMAKE_CUDA_COMPILER_VERSION on CUDA... · dc221ad7
  Gregory Shtrasberg authored Jul 10, 2025
```
[Bugfix][Build][Non-CUDA] Only referencing CMAKE_CUDA_COMPILER_VERSION on CUDA where it is defined (#20738)
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  dc221ad7
- [CI/Build] Fix Basic Models Test (#20728) · 7571a4a7
  Jee Jee Li authored Jul 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7571a4a7
- [Misc] loose new-model tagger conditions (#20747) · f67d986d
  Isotr0py authored Jul 10, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  f67d986d