Commits · 5e53c89a74ff98b7b0a9299f8854d17eb8142e9e · OpenDAS / vllm_cscc · GitLab

10 Jul, 2025 24 commits
- [Bugfix] [CI] Fix Tensorizer LoRA test (#20760) · 5e53c89a
  Sanger Steel authored Jul 10, 2025
```
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
```
  5e53c89a
- [Test] Remove docker build from test. (#20542) · c66e38ea
  QiliangCui authored Jul 10, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  c66e38ea
- Fix DeepSeek-R1-0528 chat template (#20717) · 25159536
  sfbemerk authored Jul 10, 2025
```
Signed-off-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
```
  25159536
- [Model][VLM] Support JinaVL Reranker (#20260) · 4bed1677
  shineran96 authored Jul 11, 2025
```
Signed-off-by: shineran96 <shinewang96@gmail.com>
```
  4bed1677
- [Model] Add reason parser for Hunyuan A13B Model. (#20625) · b140416a
  Asher authored Jul 11, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  b140416a
- [ROCm][Regression] Remove tensor creation that harms performance on ROCm (#20741) · 5b8366b6
  Gregory Shtrasberg authored Jul 10, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  5b8366b6
- [Hardware][CPU] Vllm int8 quantization enablement for ARM CPU (#14129) · c7753a98
  nishith-fujitsu authored Jul 10, 2025
```
Signed-off-by: nishith-fujitsu <nishith.jaiswal@fujitsu.com>
```
  c7753a98
- Update Dockerfile FlashInfer to v0.2.8rc1 (#20718) · 4b9a9435
  Michael Goin authored Jul 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4b9a9435
- [Doc] Add engine args back in to the docs (#20674) · 3482fd7e
  Harry Mellor authored Jul 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3482fd7e
- [Misc] Clean up mark to fork process in BNB tests (#20692) · 77f77a95
  Isotr0py authored Jul 10, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  77f77a95
- Normalize lm-eval command between baseline and correctness test (#18560) · 1a4f35e2
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1a4f35e2
- [CI Bugfix] Skip failing Tensorizer+LoRA test (#20724) · be1e128d
  Michael Goin authored Jul 10, 2025
  
  be1e128d
- [doc] fix ordered list (#20749) · 65393ee0
  Reid authored Jul 10, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  65393ee0
- [Bugfix][Build][Non-CUDA] Only referencing CMAKE_CUDA_COMPILER_VERSION on CUDA... · dc221ad7
  Gregory Shtrasberg authored Jul 10, 2025
```
[Bugfix][Build][Non-CUDA] Only referencing CMAKE_CUDA_COMPILER_VERSION on CUDA where it is defined (#20738)
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  dc221ad7
- [CI/Build] Fix Basic Models Test (#20728) · 7571a4a7
  Jee Jee Li authored Jul 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7571a4a7
- [Misc] loose new-model tagger conditions (#20747) · f67d986d
  Isotr0py authored Jul 10, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  f67d986d
- [KVConnector] Aggregate finished requests on the scheduler (#19555) · cc876d0f
  Or Ozeri authored Jul 10, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  cc876d0f
- [TPU][Core]Make load weight exceed hbm error more instructive for customers (#20644) · fdfd409f
  Chenyaaang authored Jul 10, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  fdfd409f
- [BugFix] Fix `VllmConfig()` construction on all platforms (#20695) · ffbcc9e7
  Nick Hill authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ffbcc9e7
- [BugFix][CPU] Fix CPU worker dependency on cumem_allocator (#20696) · 59389c92
  Nick Hill authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  59389c92
- [Frontend] Support Tool Calling with both `tool_choice='required'` and `$defs`. (#20629) · 8f2720de
  Chauncey authored Jul 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  8f2720de
- Correct PPMissingLayer handling in Deepseek-V2-Lite PP deployment (#20665) · ad6c2e1a
  Seiji Eicher authored Jul 09, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  ad6c2e1a
- Use NVCC `--compress-mode` to reduce binary size by 30% (#20694) · 49e8c7ea
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  49e8c7ea
- [Misc] DP : Add ExpertTokensMetadata (#20332) · 805d62ca
  Varun Sundar Rabindranath authored Jul 09, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>
```
  805d62ca
09 Jul, 2025 16 commits
- [CI/Build] Fix FlashInfer double build in Dockerfile (#20651) · b7d9e941
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b7d9e941
- [Misc] Simplify the prefix caching logic on draft tokens (#20701) · 7c12a765
  Woosuk Kwon authored Jul 09, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7c12a765
- [BugFix]: Properly set engine_id when using multi connector (#19487) · cd587c93
  Yiming authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: leiyiming <leiyiming@kingsoft.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  cd587c93
- [Feature][Quantization] MXFP4 support for MOE models (#17888) · 332d4cb1
  fxmarty-amd authored Jul 09, 2025
```
Signed-off-by: Felix Marty <felmarty@amd.com>
Signed-off-by: Bowen Bao <bowenbao@amd.com>
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>
```
  332d4cb1
- [Kernel] Add Conch backend for mixed-precision linear layer (#19818) · bf03ff35
  Jacob Manning authored Jul 09, 2025
```
Signed-off-by: Jacob Manning <jmanning+oss@stackav.com>
```
  bf03ff35
- [Kernel] Triton implementation of causal-conv1d for Mamba-based models (#18218) · 47043eb6
  Tuan, Hoang-Trong authored Jul 09, 2025
```
Signed-off-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  47043eb6
- Support Llama 4 for cutlass_moe_fp4 (#20453) · 31b96d1c
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  31b96d1c
- [CI/Build] Enlarge tolerance for a CPU multi-modal test (#20684) · e59ba9e1
  Li, Jiang authored Jul 10, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e59ba9e1
- Remove heading form installation `inc.md` file (#20697) · 403b4815
  Harry Mellor authored Jul 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  403b4815
- [Doc] Update CPU doc (#20676) · 138709f8
  Li, Jiang authored Jul 10, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  138709f8
- [Bench] Add NVFP4 GEMM benchmark script (#20578) · 0bbac1c1
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0bbac1c1
- [XPU][CI] enhance xpu test support (#20652) · a3e4e85e
  Liangliang Ma authored Jul 10, 2025
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
Co-authored-by: zhenwei-intel <zhenweiliu@habana.ai>
```
  a3e4e85e
- [TPU][Bugfix] fix test_pallas (#20666) · eb58f595
  Chengji Yao authored Jul 09, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  eb58f595
- [Bugfix] Fix handling of Tensorizer arguments for LoadConfig (#20643) · 4ac9c33f
  Sanger Steel authored Jul 09, 2025
```
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
```
  4ac9c33f
- [doc] update doc format (#20673) · efe73d05
  Reid authored Jul 09, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  efe73d05
- [Docs] Improve docs for RLHF co-location example (#20599) · 853487bc
  Ricardo Decal authored Jul 09, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  853487bc