Commits · 5bfe0dea7a3422f027ebb8fe36ce50ed5aa68d86 · OpenDAS / vllm_cscc

"lib/llm/src/entrypoint/input/grpc.rs" did not exist on "e3f1bd5d84e250ad4c0f925d207c40763133c31d"

19 Aug, 2025 5 commits

[bug fix] Fix llama4 spec decoding (#22691) · 5bfe0dea

qizixi authored Aug 19, 2025


Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

5bfe0dea

[Bugfix] Fix broken Minimax-01-VL model (#22116) · 31fd3265

Isotr0py authored Aug 19, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

31fd3265

Fix GLM-4.5V-FP8 numerical issue (#22949) · 4efd43e9

qizixi authored Aug 19, 2025


Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

4efd43e9

[Model] Support Pipeline Parallelism for moonshotai/Kimi-VL-A3B-Thinking-2506 (#23114) · fda9537c
Jiangyun Zhu authored Aug 19, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
fda9537c
Migrate InternVLImagePixelInputs (in nemotron_vl.py) to TensorSchema (#22023) · e75f3422
Benji Beck authored Aug 18, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
e75f3422

18 Aug, 2025 4 commits
- [Bugfix] Support compile for Transformers multimodal (#23095) · 0e3bb543
  Raushan Turganbay authored Aug 18, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  0e3bb543
- [Refactor] Get prompt updates earlier (#23097) · d3f71f12
  Cyrus Leung authored Aug 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d3f71f12
- [Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053) · 27e8d1ea
  Cyrus Leung authored Aug 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27e8d1ea
- [Bugfix] fix Qwen2.5-Omni processor output mapping (#23058) · 9f1c6422
  double7 authored Aug 18, 2025
```
Signed-off-by: double7 <33449816+DoubleVII@users.noreply.github.com>
Co-authored-by: 杨森 <yangsen.double7@bytedance.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  9f1c6422
17 Aug, 2025 4 commits
- [Misc] Remove dead return (#23061) · c55bc1db
  Woosuk Kwon authored Aug 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c55bc1db
- [Bugfix] should use stack instead of concat (#22972) · fe0411fc
  947132885 authored Aug 17, 2025
```
Signed-off-by: 947132885 <947132885@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  fe0411fc
- [Kernel] Add cuda kernel for gpt_oss activation (#22951) · 4d4061b6
  Jee Jee Li authored Aug 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4d4061b6
- [Refactor] Defer tensor data construction in MultiModalKwargs (#23030) · 5c32143b
  Cyrus Leung authored Aug 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5c32143b
16 Aug, 2025 3 commits
- [New Model]mBART model (#22883) · 829bbd78
  汪志鹏 authored Aug 16, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  829bbd78
- [Multimodal] Update Tensor schema test to cover arbitrary shape mm inputs (#22867) · cc826a20
  Isotr0py authored Aug 16, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cc826a20
- [Bugfix] Fix DeepSeek MTP (#22934) · fbd88728
  Benjamin Chislett authored Aug 15, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  fbd88728
15 Aug, 2025 5 commits
- [BugFix] Fix regression caused by mamba state dtype PR (#22998) · f5d412ba
  Thomas Parnell authored Aug 16, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  f5d412ba
- [Model] Granite-4 support loading quantized checkpoint (#22925) · 6cd69f51
  Chih-Chieh Yang authored Aug 15, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
  6cd69f51
- [V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928) · 75531a6c
  Thomas Parnell authored Aug 15, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  75531a6c
- Revert "[Kernel] Add cuda kernel for gpt_oss activation" (#22948) · f1f0d2fa
  Simon Mo authored Aug 14, 2025
  
  f1f0d2fa
- [Kernel] Add cuda kernel for gpt_oss activation (#22538) · 81f4b964
  Jee Jee Li authored Aug 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  81f4b964
14 Aug, 2025 2 commits
- [Model] Modify the gate implementation of glm4_moe (#22832) · 92ff41ab
  Jee Jee Li authored Aug 14, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  92ff41ab
- [Bugfix] Fix `PixtralHFImagePixelInputs` dynamic shape check (#22827) · 7c3a0741
  Isotr0py authored Aug 14, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  7c3a0741
13 Aug, 2025 11 commits
- [CI/Build] Update VLM common tests (#22841) · c9232d41
  Cyrus Leung authored Aug 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c9232d41
- [Bugfix] Fix MiniCPMV Image input inference failed (#22813) · 9bd9294f
  HWH authored Aug 14, 2025
```
Signed-off-by: HWH <67449739+jio-H@users.noreply.github.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  9bd9294f
- Fix GGUF loader for Qwen3 MoE. (#22785) · b159c0a6
  Gh0u1L5 authored Aug 13, 2025
```
Signed-off-by: Gh0u1L5 <Gh0u1L5@outlook.com>
```
  b159c0a6
- Remove unnecessary CUDA sync of qwen image and video preprocess (#22792) · 6772bb0f
  Yuanyuan Chen authored Aug 13, 2025
```
Signed-off-by: cyy <cyyever@outlook.com>
Signed-off-by: Yuanyuan Chen <cyyever@outlook.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  6772bb0f
- [Bugfix] Fix Nemotron VL image processing (#22739) · a01e0018
  Duc-Viet Hoang authored Aug 13, 2025
```
Co-authored-by: ducviet00-h2 <viet.d.hoang@h2corporation.jp>
```
  a01e0018
- [Model] Add missing prefix to glm4_1v (#22716) · 9e7e5baa
  Yuxuan Zhang authored Aug 13, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  9e7e5baa
- [Model] Add option to run Step3VisionEncoder in DP (#22697) · d16aa3da
  zzh142857 authored Aug 13, 2025
```
Signed-off-by: zzh142857 <chaorenzhaozhenghao@gmail.com>
```
  d16aa3da
- Force TRTLLM attention for gpt-oss on SM100 (#22678) · c6b92879
  Michael Goin authored Aug 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c6b92879
- Fix cuda illegal mem access with Llama4 TP8 + rms_norm custom op (#22701) · 4f0f844b
  Po-Han Huang (NVIDIA) authored Aug 13, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
  4f0f844b
- [Model] Decouple glm4v (#22751) · fde0b611
  Jee Jee Li authored Aug 13, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fde0b611
- Fix Transformers backend tensor parallel for multimodal models (#22673) · d0a63015
  Harry Mellor authored Aug 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d0a63015
12 Aug, 2025 6 commits
- Add: `SupportsEagle3` interface for explicit EAGLE3 support (#22642) · 5a4b4b37
  Rahul Tuli authored Aug 12, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  5a4b4b37
- [CI Failure] fix tests/entrypoints/openai/test_skip_tokenizer.py (#22708) · f7ad6a1e
  wang.yuqi authored Aug 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f7ad6a1e
- Officially support SmolLM3 using the Transformers backend (#22665) · 80bb1e8a
  Harry Mellor authored Aug 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  80bb1e8a
- [New Model] Support Command-A-Vision (#22660) · 9f909b89
  dongluw authored Aug 12, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  9f909b89
- [Bugfix] Fix ModernBert load & Enable sliding window attention for... · 6d729c43
  wang.yuqi authored Aug 12, 2025
```
[Bugfix] Fix ModernBert load & Enable sliding window attention for bidirectional attention. (#22637)
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  6d729c43
- Migrate MiniCPMVImageInputs to TensorSchema (#21939) · 46785034
  Benji Beck authored Aug 11, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  46785034