Commits · d0a63015888f5d5ab33e369bfa5ede4c8e0faea7 · OpenDAS / vllm_cscc · GitLab

13 Aug, 2025 1 commit
- Fix Transformers backend tensor parallel for multimodal models (#22673) · d0a63015
  Harry Mellor authored Aug 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d0a63015
12 Aug, 2025 21 commits
- Fix torch version check for SM100 mxfp4 (#22535) · 6534d2fc
  zifeitong authored Aug 12, 2025
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  6534d2fc
- [CI][Nixl] Check kv cache layout during handshake (#22745) · 422f22e0
  Nicolò Lucchesi authored Aug 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  422f22e0
- [Kernel][AMD] Avoid D2H copy and cumsum kernel (#22683) · 6bd8ebf0
  Xiaozhu Meng authored Aug 12, 2025
```
Signed-off-by: Xiaozhu <mxz297@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  6bd8ebf0
- Add: `SupportsEagle3` interface for explicit EAGLE3 support (#22642) · 5a4b4b37
  Rahul Tuli authored Aug 12, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  5a4b4b37
- Fix Llama4 FlashInfer FP4 MoE issues (#22511) · 67c153b8
  Po-Han Huang (NVIDIA) authored Aug 12, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
  67c153b8
- [CI Failure] fix tests/entrypoints/openai/test_skip_tokenizer.py (#22708) · f7ad6a1e
  wang.yuqi authored Aug 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f7ad6a1e
- Officially support SmolLM3 using the Transformers backend (#22665) · 80bb1e8a
  Harry Mellor authored Aug 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  80bb1e8a
- [BugFix][Nixl][PD] Fix heterogenous TP (#22663) · d030b015
  Nicolò Lucchesi authored Aug 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  d030b015
- [gpt-oss] Enable gpt-oss on ampere (#22714) · 007dd908
  Yongye Zhu authored Aug 12, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  007dd908
- [Bugfix] Mamba2 SSD varlen bug fix initstates decay, improve test, assert chunk pwr 2 (#21783) · 46ae7f66
  RishiAstra authored Aug 12, 2025
```
Signed-off-by: Rishi Astra <40644327+RishiAstra@users.noreply.github.com>
```
  46ae7f66
- Fix: AWQ Marlin get_quant_method does not recognize "modules_to_not_convert" (#21888) · 1ece7f30
  Jun-Howie authored Aug 12, 2025
```
Signed-off-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  1ece7f30
- [V0] Correct CUDA Graph capture for encoder-decoder models (#22630) · 8d17fa63
  Sugar-zsg authored Aug 12, 2025
  
  8d17fa63
- [New Model] Support Command-A-Vision (#22660) · 9f909b89
  dongluw authored Aug 12, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  9f909b89
- Move `SchedulerConfig` from `config/__init__.py` to `config/scheduler.py` (#22626) · 78077d54
  Harry Mellor authored Aug 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  78077d54
- [Bugfix] Fix ModernBert load & Enable sliding window attention for... · 6d729c43
  wang.yuqi authored Aug 12, 2025
```
[Bugfix] Fix ModernBert load & Enable sliding window attention for bidirectional attention. (#22637)
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  6d729c43
- Fix passing `SpeculativeConfig` from the CLI (#22652) · 4fbd8bb5
  Harry Mellor authored Aug 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4fbd8bb5
- [gpt-oss] Small bug fixes for frontend (#22512) · ad344ef5
  Chen Zhang authored Aug 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  ad344ef5
- [gpt-oss] Fix mxfp4 support (#22700) · bbaf9e9c
  Chen Zhang authored Aug 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  bbaf9e9c
- Migrate MiniCPMVImageInputs to TensorSchema (#21939) · 46785034
  Benji Beck authored Aug 11, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  46785034
- Enable 4bit bnb prequant MOE (#21548) · 9b94d6ec
  Andy Chen authored Aug 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9b94d6ec
- [gpt-oss] Support streaming in response API (#22431) · 95a935fc
  Chen Zhang authored Aug 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  95a935fc
11 Aug, 2025 17 commits
- Support more parallel styles in Transformers backend TP (#22651) · 458e74eb
  Harry Mellor authored Aug 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  458e74eb
- [BugFix] [Spec Decode] Remove LlamaForCausalLMEagle3 to fix CI (#22611) · 807d21b8
  22quinn authored Aug 11, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  807d21b8
- [Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930) · 84cf78ac
  wang.yuqi authored Aug 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  84cf78ac
- fix: NIXL connector transfers partial block to pass full multi-modal context (#21074) · 16fb668b
  GuanLuo authored Aug 11, 2025
```
Signed-off-by: GuanLuo <gluo@nvidia.com>
```
  16fb668b
- [Feature] Add `VLLM_USE_DEEP_GEMM_E8M0` Env to Control E8M0 Scale (#21968) · f7dcce7a
  Wentao Ye authored Aug 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f7dcce7a
- [Misc] Further clean up some redundant config definitions (#22649) · 8e13d9fe
  Isotr0py authored Aug 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  8e13d9fe
- [Model] NemotronH Support (#22349) · 14a5d903
  danielafrimi authored Aug 11, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
```
  14a5d903
- [Misc] Move jsontree to utils (#22622) · 951b0382
  Cyrus Leung authored Aug 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  951b0382
- [Docs] Add comprehensive CLI reference for all large `vllm` subcommands (#22601) · bc1d02ac
  Harry Mellor authored Aug 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bc1d02ac
- [BUGFIX] KeyError 'layers.14.mlp.gate.g_idx' for Qwen3-MoE with GPTQ on ROCm (#22017) · 1e55dfa7
  JartX authored Aug 11, 2025
  
  1e55dfa7
- Support token_type_ids in V1 with less code changes (#21985) · 39052dbc
  Maximilien de Bayser authored Aug 11, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  39052dbc
- [ROCm][AITER] Support AITER Rope ops in RotaryEmbedding Module. (#22521) · 9c97a1c3
  vllmellm authored Aug 11, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  9c97a1c3
- [BugFix] Fix logits repetition penalty cuda check (#22592) · f919d4cb
  Eugene Cheah authored Aug 10, 2025
  
  f919d4cb
- [Misc][gpt-oss] guard import when triton kernel when not up to date (#22584) · afa5b7ca
  Zhewen Li authored Aug 10, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  afa5b7ca
- [BugFix] Fix KVConnectorOutput TPU breakage (#22598) · 5898b135
  Nick Hill authored Aug 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5898b135
- Migrate LlavaImageInputs to TensorSchema (#21770) · 06da44f0
  Benji Beck authored Aug 10, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  06da44f0
- Migrate LlavaNextVideoPixelInputs to TensorSchema (#21843) · a5549917
  Benji Beck authored Aug 10, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  a5549917
10 Aug, 2025 1 commit
- enable Docker-aware precompiled wheel setup (#22106) · d1af8b7b
  Doug Smith authored Aug 10, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  d1af8b7b