Commits · 61aa4b2901fa2a1376bcd781da253d83526e3090 · OpenDAS / vllm_cscc

07 Sep, 2025 1 commit

Migrate Qwen2 inputs to TensorSchema (#23475) · 37a6fa95

Benji Beck authored Sep 06, 2025


Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

37a6fa95

06 Sep, 2025 3 commits

[Multimodal] Improve max video embedding length estimation in V1 (#24312) · eddaafc1
Roger Wang authored Sep 06, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
eddaafc1
[New Model]: google/embeddinggemma-300m (#24318) · 6d6c6b05
wang.yuqi authored Sep 06, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
6d6c6b05

[Core] Allow disabling TP sharding for parallel Linear layer (#23024) · 53b19ccd

Isotr0py authored Sep 06, 2025

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

53b19ccd

05 Sep, 2025 1 commit
- [gpt-oss] tool parser supports for /chat/completions [1/n] (#22386) · c29fb540
  Aaron Pham authored Sep 04, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  c29fb540
04 Sep, 2025 6 commits

[LoRA]: Add lora support to qwen-2.5-omni (#24231) · c9f7081f
Yash Pratap Singh authored Sep 04, 2025

c9f7081f
[Model] Add pp support for hunyuan (#24212) · eafa8dcd
Jiangyun Zhu authored Sep 04, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
eafa8dcd
[Attention][Platform] Refactor MLA to support Custom Op (#23332) · 3efb9f4d
whx authored Sep 04, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
3efb9f4d

[Core][Model] Terratorch backend integration (#23513) · 51d5e9be

mgazz authored Sep 04, 2025


Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

51d5e9be

[Model] Add MiDashengLM model support (#23652) · e7fc7001

bingchen-mi authored Sep 04, 2025


Signed-off-by: chenbing8 <chenbing8@xiaomi.com>
Signed-off-by: bingchen-mi <chenbing8@xiaomi.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

e7fc7001

Migrate ultravox inputs to TensorSchema (#23503) · cb55ad86
Benji Beck authored Sep 03, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
cb55ad86

03 Sep, 2025 5 commits
- Migrate whisper inputs to TensorSchema (#23505) · 731a6940
  Benji Beck authored Sep 03, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  731a6940
- [Kernels] Overlap shared experts with send/recv (#23273) · e9b92dcd
  bnellnm authored Sep 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  e9b92dcd
- [V1] v1 engine + full CUDA graph support for PLaMo2 (#23998) · fa4311d8
  nopperl authored Sep 04, 2025
```
Signed-off-by: Hemmi Shinichi <shemmi@preferred.jp>
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
Co-authored-by: Hemmi Shinichi <shemmi@preferred.jp>
Co-authored-by: Thomas Parnell <tom.parnell@gmail.com>
```
  fa4311d8
- [BugFix] Fix routed_scaling_factor double mul for dots1 and glm4 MoE models (#24132) · 426cc862
  Yong Hoon Shin authored Sep 02, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  426cc862
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
02 Sep, 2025 10 commits
- [Bug] R1 Accuracy: Fix `routed_scaling_factor` Double Mul Issue (#24119) · 930a2414
  Wentao Ye authored Sep 02, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  930a2414
- Fix weights loading for Apertus (#24100) · 598bd74c
  nathan authored Sep 02, 2025
```
Signed-off-by: Nathan Ranchin <nranchin@student.ethz.ch>
```
  598bd74c
- [Model] Classification models support logit_bias / sigmoid_normalize (#24031) · e0653f6c
  wang.yuqi authored Sep 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  e0653f6c
- [BugFix] Fix EXAONE4 rotary embeddings (#23918) · 38ba061f
  Kyungmin Lee authored Sep 02, 2025
```
Signed-off-by: lkm2835 <lkm2835@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  38ba061f
- [Gemma3n] Fix audio batching (#24052) · 0a74e9d0
  Nicolò Lucchesi authored Sep 02, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  0a74e9d0
- [Model] Support dp on ViT on GLM-4.5V (#23168) · 2f0bab3f
  WeiQing Chen authored Sep 02, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
```
  2f0bab3f
- Migrate Interns1 inputs to TensorSchema (#23510) · 56d04089
  Benji Beck authored Sep 01, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  56d04089
- Migrate OvisImagePatchInputs to TensorSchema (#22024) · 1fa1d6a9
  Benji Beck authored Sep 01, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  1fa1d6a9
- [Bugfix] Fix the issue that Blip2ForConditionalGeneration' object has… (#24028) · 04d0c607
  damon authored Sep 02, 2025
```
Signed-off-by: Dazhi Jiang <dazhi_jiang@163.com>
```
  04d0c607
- [Doc]: fix typos in Python comments (#24042) · 0235103c
  Didier Durand authored Sep 02, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0235103c
01 Sep, 2025 7 commits

[Model] Support DP for ViT on Kimi-VL-A3B-Thinking-2506 (#23817) · a0e0efd6

WeiQing Chen authored Sep 02, 2025


Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

a0e0efd6

[Model]: support KeyeVL-1_5-8B (#23838) · 7c8271cd

Kwai-Keye authored Sep 01, 2025


Signed-off-by: wangruitao <wangruitao@kuaishou.com>
Co-authored-by: wangruitao <wangruitao@kuaishou.com>

7c8271cd

[Frontend] Gemma3n audio `transcriptions`/`translations` endpoint (#23735) · d46934b2
Nicolò Lucchesi authored Sep 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
d46934b2
[Doc]: fix typos in Python comments (#24026) · 10728495
Didier Durand authored Sep 01, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
10728495
Migrate Phi4 inputs to TensorSchema (#23471) · 437c3ce0
Benji Beck authored Aug 31, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
437c3ce0
[CI/Build] Improve Tensor Schema tests speed by avoid engine core initialization (#23357) · ff0e59d8
Isotr0py authored Sep 01, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
ff0e59d8

[BUGFIX] GPTQ quantization compatibility for Qwen3 MOE models (AutoGPTQ and... · 183a7096

JartX authored Sep 01, 2025


[BUGFIX] GPTQ quantization compatibility for Qwen3 MOE models (AutoGPTQ and AutoRound-GPTQ) (#23994)
Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

183a7096

30 Aug, 2025 4 commits

Add LoRA support for DeepSeek models (V2, V3, R1-0528) (#23971) · 379ea282

sadegh.shokatian authored Aug 30, 2025


Signed-off-by: sadeghja1070 <sadegh.ja1070@gmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

379ea282

[Model] Enable encoder DP for MiniCPM-V (#23948) · 3a6acad4

Jiangyun Zhu authored Aug 30, 2025


Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

3a6acad4

[V1] [Hybrid] Move MiniMaxLinearAttention into layers/mamba (#23831) · 4071c76c
Thomas Parnell authored Aug 30, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
4071c76c

Add routed_scaling_factor to MoE grouped topk (#23123) · 8fb85b7b

Xin Yang authored Aug 29, 2025


Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

8fb85b7b

29 Aug, 2025 3 commits
- Revert gemma3n fast prefill changes (#23897) · 8c3e1999
  Yong Hoon Shin authored Aug 29, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  8c3e1999
- [Models] Use in-place adds in Idefics2Vision (#23932) · 0a2f4c07
  Lukas Geiger authored Aug 29, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  0a2f4c07
- [MODEL] `Apertus` and `XIELU` (#23068) · 1cf3753b
  EduardDurech authored Aug 29, 2025
```
Signed-off-by: EduardDurech <39579228+EduardDurech@users.noreply.github.com>
Co-authored-by: AllenHaoHuang <allenhuangdd@gmail.com>
```
  1cf3753b