Commits · d0a63015888f5d5ab33e369bfa5ede4c8e0faea7 · OpenDAS / vllm_cscc

"examples/vscode:/vscode.git/clone" did not exist on "6b31c84affbcd2f672915ca2ef5bb39819566441"

13 Aug, 2025 1 commit
- Fix Transformers backend tensor parallel for multimodal models (#22673) · d0a63015
  Harry Mellor authored Aug 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d0a63015
12 Aug, 2025 13 commits
- Fix torch version check for SM100 mxfp4 (#22535) · 6534d2fc
  zifeitong authored Aug 12, 2025
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  6534d2fc
- Add: `SupportsEagle3` interface for explicit EAGLE3 support (#22642) · 5a4b4b37
  Rahul Tuli authored Aug 12, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  5a4b4b37
- Fix Llama4 FlashInfer FP4 MoE issues (#22511) · 67c153b8
  Po-Han Huang (NVIDIA) authored Aug 12, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
  67c153b8
- [CI Failure] fix tests/entrypoints/openai/test_skip_tokenizer.py (#22708) · f7ad6a1e
  wang.yuqi authored Aug 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f7ad6a1e
- Officially support SmolLM3 using the Transformers backend (#22665) · 80bb1e8a
  Harry Mellor authored Aug 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  80bb1e8a
- [gpt-oss] Enable gpt-oss on ampere (#22714) · 007dd908
  Yongye Zhu authored Aug 12, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  007dd908
- [Bugfix] Mamba2 SSD varlen bug fix initstates decay, improve test, assert chunk pwr 2 (#21783) · 46ae7f66
  RishiAstra authored Aug 12, 2025
```
Signed-off-by: Rishi Astra <40644327+RishiAstra@users.noreply.github.com>
```
  46ae7f66
- Fix: AWQ Marlin get_quant_method does not recognize "modules_to_not_convert" (#21888) · 1ece7f30
  Jun-Howie authored Aug 12, 2025
```
Signed-off-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  1ece7f30
- [New Model] Support Command-A-Vision (#22660) · 9f909b89
  dongluw authored Aug 12, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  9f909b89
- [Bugfix] Fix ModernBert load & Enable sliding window attention for... · 6d729c43
  wang.yuqi authored Aug 12, 2025
```
[Bugfix] Fix ModernBert load & Enable sliding window attention for bidirectional attention. (#22637)
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  6d729c43
- [gpt-oss] Fix mxfp4 support (#22700) · bbaf9e9c
  Chen Zhang authored Aug 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  bbaf9e9c
- Migrate MiniCPMVImageInputs to TensorSchema (#21939) · 46785034
  Benji Beck authored Aug 11, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  46785034
- Enable 4bit bnb prequant MOE (#21548) · 9b94d6ec
  Andy Chen authored Aug 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9b94d6ec
11 Aug, 2025 12 commits
- Support more parallel styles in Transformers backend TP (#22651) · 458e74eb
  Harry Mellor authored Aug 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  458e74eb
- [BugFix] [Spec Decode] Remove LlamaForCausalLMEagle3 to fix CI (#22611) · 807d21b8
  22quinn authored Aug 11, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  807d21b8
- [Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930) · 84cf78ac
  wang.yuqi authored Aug 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  84cf78ac
- [Feature] Add `VLLM_USE_DEEP_GEMM_E8M0` Env to Control E8M0 Scale (#21968) · f7dcce7a
  Wentao Ye authored Aug 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f7dcce7a
- [Model] NemotronH Support (#22349) · 14a5d903
  danielafrimi authored Aug 11, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
```
  14a5d903
- [Misc] Move jsontree to utils (#22622) · 951b0382
  Cyrus Leung authored Aug 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  951b0382
- [BUGFIX] KeyError 'layers.14.mlp.gate.g_idx' for Qwen3-MoE with GPTQ on ROCm (#22017) · 1e55dfa7
  JartX authored Aug 11, 2025
  
  1e55dfa7
- Support token_type_ids in V1 with less code changes (#21985) · 39052dbc
  Maximilien de Bayser authored Aug 11, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  39052dbc
- [ROCm][AITER] Support AITER Rope ops in RotaryEmbedding Module. (#22521) · 9c97a1c3
  vllmellm authored Aug 11, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  9c97a1c3
- [Misc][gpt-oss] guard import when triton kernel when not up to date (#22584) · afa5b7ca
  Zhewen Li authored Aug 10, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  afa5b7ca
- Migrate LlavaImageInputs to TensorSchema (#21770) · 06da44f0
  Benji Beck authored Aug 10, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  06da44f0
- Migrate LlavaNextVideoPixelInputs to TensorSchema (#21843) · a5549917
  Benji Beck authored Aug 10, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  a5549917
10 Aug, 2025 9 commits
- Remove redundant row_indices unsqueeze operation in MiniCPMO (#22528) · 8c50d62f
  ZiTian Zhao authored Aug 11, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  8c50d62f
- Migrate LlavaNextImageInputs to TensorSchema (#21774) · b4e29167
  Benji Beck authored Aug 10, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  b4e29167
- [Bugfix][Kernel] Support partial rotary embedding for MRoPE triton kernel (#22593) · b76753f0
  Isotr0py authored Aug 11, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  b76753f0
- [Docs] Fix warnings in docs build (#22588) · 00976db0
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  00976db0
- [Minor] Fix pre-commit error on main (#22579) · 7e8d6857
  Isotr0py authored Aug 10, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  7e8d6857
- Refactor sliding window configuration to Transformers best practice (#21927) · c4984839
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c4984839
- Improve fast_topk function with type hints and documentation (#22530) · 534c45b9
  ZiTian Zhao authored Aug 10, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  534c45b9
- [Config] add "qwen" as a native eagle3 target supported model (#22333) · 3d7363e6
  Le Chen authored Aug 10, 2025
```
Signed-off-by: lechen <lecself@163.com>
Signed-off-by: LeChen <lecself@163.com>
```
  3d7363e6
- [oss] Init gpt-oss bf16 support (#22508) · 0c5254b8
  Jee Jee Li authored Aug 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0c5254b8
09 Aug, 2025 5 commits

[FEAT] [Performance] Add triton mrope to replace the torch code path (#22375) · 42172ad1
TJian authored Aug 09, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
42172ad1

[Model] Gemma3n MM (#20495) · 5a16fa61

Nicolò Lucchesi authored Aug 09, 2025


Signed-off-by: ShriKode <shrikode@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: ShriKode <shrikode@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>

5a16fa61

GLM-4.5V with new class name at transformers (#22520) · a6022e6f

Yuxuan Zhang authored Aug 09, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a6022e6f

[TPU] Add support for online w8a8 quantization (#22425) · 9a0c5ded
Kyuyeun Kim authored Aug 08, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
9a0c5ded
Fix loading of quantized BigCode models (#22463) · 10a02535
Eldar Kurtić authored Aug 09, 2025
```
Signed-off-by: Eldar Kurtic <eldar@neuralmagic.com>
```
10a02535