Commits · ba81acbdc1eec643ba815a76628ae3e4b2263b76 · OpenDAS / vllm_cscc · GitLab

12 Aug, 2025 39 commits
- [Bugfix] Bump DeepGEMM Version to Fix SMXX Layout Issues (#22606) · ba81acbd
  Frank Wang authored Aug 12, 2025
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
```
  ba81acbd
- [Misc] parametrize 'dtype' in test_flash_mla (#22641) · 53c73028
  RUTHLESS-BOT authored Aug 13, 2025
```
Signed-off-by: RUTHLESS-BOT <wujiafeng@cmbchina.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  53c73028
- Fix torch version check for SM100 mxfp4 (#22535) · 6534d2fc
  zifeitong authored Aug 12, 2025
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  6534d2fc
- [CI][Nixl] Check kv cache layout during handshake (#22745) · 422f22e0
  Nicolò Lucchesi authored Aug 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  422f22e0
- [Kernel][AMD] Avoid D2H copy and cumsum kernel (#22683) · 6bd8ebf0
  Xiaozhu Meng authored Aug 12, 2025
```
Signed-off-by: Xiaozhu <mxz297@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  6bd8ebf0
- [Chore] Update CODEOWNERS to include @yewentao256 for CUDA kernels, attention... · dab4f9f7
  Wentao Ye authored Aug 12, 2025
```
[Chore] Update CODEOWNERS to include @yewentao256 for CUDA kernels, attention backends, quantization, and related tests (#22741)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  dab4f9f7
- Add more test scenario for tensor schema (#22733) · c42fe0b6
  TeeKen Lau authored Aug 13, 2025
```
Signed-off-by: teekenl <teekenlau@gmail.com>
```
  c42fe0b6
- Add: `SupportsEagle3` interface for explicit EAGLE3 support (#22642) · 5a4b4b37
  Rahul Tuli authored Aug 12, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  5a4b4b37
- [Benchmark] Fix terminal colors in benchmark_serving_multi_turn (python 3.12) (#22730) · e5d3d63c
  Daniel Serebrenik authored Aug 12, 2025
```
Signed-off-by: daniels <daniels@pliops.com>
```
  e5d3d63c
- [Bugfix][CI] Fix `test_remote_decode_lifecycle.py::test_short_prompt_lifecycle` (#22727) · 3d9d40ef
  Nicolò Lucchesi authored Aug 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3d9d40ef
- Fix Llama4 FlashInfer FP4 MoE issues (#22511) · 67c153b8
  Po-Han Huang (NVIDIA) authored Aug 12, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
  67c153b8
- [CI Failure] fix tests/entrypoints/openai/test_skip_tokenizer.py (#22708) · f7ad6a1e
  wang.yuqi authored Aug 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f7ad6a1e
- Officially support SmolLM3 using the Transformers backend (#22665) · 80bb1e8a
  Harry Mellor authored Aug 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  80bb1e8a
- [BugFix][Nixl][PD] Fix heterogenous TP (#22663) · d030b015
  Nicolò Lucchesi authored Aug 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  d030b015
- [Docs] Improve docs navigation (#22720) · 767e63b8
  Harry Mellor authored Aug 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  767e63b8
- [gpt-oss] Enable gpt-oss on ampere (#22714) · 007dd908
  Yongye Zhu authored Aug 12, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  007dd908
- [Misc] remove GH discussions link (#22722) · b8a9d0e4
  Jee Jee Li authored Aug 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b8a9d0e4
- [LMCache][Example] Align the PYTHONHASHSEED for prefillers and decoders for KV... · 50f2aae1
  zejunchen-zejun authored Aug 12, 2025
```
[LMCache][Example] Align the PYTHONHASHSEED for prefillers and decoders for KV chunks hashing (#21161)
Signed-off-by: zejunchen-zejun <zejun.chen@amd.com>
```
  50f2aae1
- [Bugfix] Mamba2 SSD varlen bug fix initstates decay, improve test, assert chunk pwr 2 (#21783) · 46ae7f66
  RishiAstra authored Aug 12, 2025
```
Signed-off-by: Rishi Astra <40644327+RishiAstra@users.noreply.github.com>
```
  46ae7f66
- Fix: AWQ Marlin get_quant_method does not recognize "modules_to_not_convert" (#21888) · 1ece7f30
  Jun-Howie authored Aug 12, 2025
```
Signed-off-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  1ece7f30
- [Bugfix] Fix erroneous randomly generated cases in bad word testing (#22170) · bc8372ef
  phantomlei authored Aug 12, 2025
```
Signed-off-by: phantomlei <phantomlei3@gmail.com>
```
  bc8372ef
- [V0] Correct CUDA Graph capture for encoder-decoder models (#22630) · 8d17fa63
  Sugar-zsg authored Aug 12, 2025
  
  8d17fa63
- [New Model] Support Command-A-Vision (#22660) · 9f909b89
  dongluw authored Aug 12, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  9f909b89
- [DOC] update v1_guide with INTEL HW (#22679) · 59f3b936
  Chendi.Xue authored Aug 12, 2025
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  59f3b936
- Move `SchedulerConfig` from `config/__init__.py` to `config/scheduler.py` (#22626) · 78077d54
  Harry Mellor authored Aug 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  78077d54
- [Bugfix] Fix ModernBert load & Enable sliding window attention for... · 6d729c43
  wang.yuqi authored Aug 12, 2025
```
[Bugfix] Fix ModernBert load & Enable sliding window attention for bidirectional attention. (#22637)
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  6d729c43
- [doc] Update x86 CPU-inference installation doc to reflect optionality of AVX512f (#22707) · 2f465795
  Sooraj S authored Aug 12, 2025
```
Signed-off-by: Sooraj S <94284954+sooraj-satheesh@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>
```
  2f465795
- [Doc] Added unmentioned required option "method" in the usage of EAGLE-3 based models (#21737) · 3a7e3bbd
  Hongsheng Liu authored Aug 12, 2025
```
Signed-off-by: Dilute-l <dilu2333@163.com>
Co-authored-by: Dilute-l <dilu2333@163.com>
```
  3a7e3bbd
- Fix passing `SpeculativeConfig` from the CLI (#22652) · 4fbd8bb5
  Harry Mellor authored Aug 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4fbd8bb5
- [gpt-oss] Small bug fixes for frontend (#22512) · ad344ef5
  Chen Zhang authored Aug 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  ad344ef5
- [gpt-oss] Fix mxfp4 support (#22700) · bbaf9e9c
  Chen Zhang authored Aug 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  bbaf9e9c
- Migrate MiniCPMVImageInputs to TensorSchema (#21939) · 46785034
  Benji Beck authored Aug 11, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  46785034
- [CI] Increase timeout for test_completion_with_image_embeds (#22670) · 93d06524
  Michael Goin authored Aug 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  93d06524
- [CI Failure] Use float32 for tests/entrypoints/openai/test_audio.py (#22686) · ea1292ad
  Michael Goin authored Aug 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  ea1292ad
- Upgrade FlashInfer to v0.2.11 (#22613) · dc5e4a65
  Po-Han Huang (NVIDIA) authored Aug 12, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  dc5e4a65
- Re-enable Xet on TPU tests now that `hf_xet` has been updated (#22666) · 839ab003
  Harry Mellor authored Aug 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  839ab003
- Enable 4bit bnb prequant MOE (#21548) · 9b94d6ec
  Andy Chen authored Aug 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9b94d6ec
- [gpt-oss] Add test for response API + harmony (but skipped) (#22554) · 1891a265
  Chen Zhang authored Aug 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  1891a265
- [gpt-oss] Support streaming in response API (#22431) · 95a935fc
  Chen Zhang authored Aug 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  95a935fc
11 Aug, 2025 1 commit
- Support more parallel styles in Transformers backend TP (#22651) · 458e74eb
  Harry Mellor authored Aug 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  458e74eb