Commits · e93f4cc9e37484009f74e15d3111a1f335c532a5 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "de895f1697d22ea19a5a4d4ab3dc17037a3e9af3"

11 Sep, 2025 6 commits

Add the support for the qwen3 next model (a hybrid attention model). (#24526) · e93f4cc9
Tao He authored Sep 11, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
e93f4cc9

Remove redundant all gather + split (#23441) · d1336018

Chenxi Yang authored Sep 10, 2025


Co-authored-by: Chenxi Yang <cxyang@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

d1336018

[Model] New model support for Motif-1-Tiny (#23414) · 9bd831f5

TaehyunKim authored Sep 11, 2025


Signed-off-by: ca1207 <ca1207zzz@gmail.com>
Signed-off-by: TaehyunKim <73943231+ca1207@users.noreply.github.com>
Co-authored-by: WyldeCat <skan1543@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

9bd831f5

[Doc]: fixing doc typos (#24635) · e2b1f863
Didier Durand authored Sep 11, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
e2b1f863
[Ultravox] Fix Gemma instantiation, support quantization via --hf-overrides (#24131) · f17a6aa4
Peter Salas authored Sep 10, 2025
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
f17a6aa4

[Models][Quantization] Add quantization configuration update in Voxtral model (#24122) · 5931b7e5

Alexandre Marques authored Sep 10, 2025

Signed-off-by: Alexandre Marques <almarque@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

5931b7e5

10 Sep, 2025 10 commits
- [v1] Add Whisper model support (encoder-decoder) (#21088) · 37e8182b
  Russell Bryant authored Sep 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
```
  37e8182b
- [Bugfix] fix modelopt exclude_modules name mapping (#24178) · 08abfa78
  tomeras91 authored Sep 10, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  08abfa78
- [Docs] Fix warnings in `mkdocs build` (continued) (#24092) · ccee371e
  Hyogeun Oh (오효근) authored Sep 10, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  ccee371e
- [BugFix][Multi Modal] Fix TensorSchema shape mismatch in Molmo (#24559) · 4c04eef7
  Wenlong Wang authored Sep 10, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  4c04eef7
- [LoRA]: Add LoRA support to Mistral's Voxtral models (#24517) · 9e3c3a7d
  Yash Pratap Singh authored Sep 10, 2025
```
Signed-off-by: Yash Pratap Singh <yashsingh20001@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9e3c3a7d
- Feature/vit attention unification# 23880 (#23978) · 6cbd4190
  baonudesifeizhai authored Sep 10, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6cbd4190
- Support for NemotronH Nano VLM (#23644) · 72d30108
  danielafrimi authored Sep 10, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
```
  72d30108
- [Model] Limit CPU threads for image transformations in InternVL to reduce cpu contention. (#24519) · 267c80d3
  li-jinpeng authored Sep 10, 2025
```
Signed-off-by: li-jinpeng <3332126450@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  267c80d3
- [Core] Simplify and unify mm uuid handling & auto-generated mm hash overrides processing. (#24271) · 009d689b
  Chenheli Hua authored Sep 09, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  009d689b
- [BugFix][Spec Decode] Fix out-of-range index triggered by eagle3; re-enable... · 53b42f41
  Wenlong Wang authored Sep 09, 2025
```
[BugFix][Spec Decode] Fix out-of-range index triggered by eagle3; re-enable test for LlamaForCausalLMEagle3 (#24392)
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  53b42f41
09 Sep, 2025 5 commits
- [Bugfix] Fix hidden_size for multimodal classification model (#24501) · 9ad0688e
  Jee Jee Li authored Sep 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9ad0688e
- [Model] Systematic support for fp32 head, pooling models part (#23810) · 19332c04
  wang.yuqi authored Sep 09, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  19332c04
- [Performance][MM] Building the inverse permutation in O(n) time in... · e283976f
  WeiQing Chen authored Sep 09, 2025
```
[Performance][MM] Building the inverse permutation in O(n) time in Qwen2_5_VisionTransformer (#24443)
Signed-off-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
```
  e283976f
- [BugFix][Model] Fix Ernie4.5-VL hanging on long inputs (#24074) · b6fbc156
  CSWYF3634076 authored Sep 09, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  b6fbc156
- [Bugfix][Wide EP] Fix redundant work when using DeepEP, TP Attn, and EP MoE (#24134) · 955c6249
  Tyler Michael Smith authored Sep 08, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  955c6249
08 Sep, 2025 5 commits

[Model] Remove quantized mixtral (#24437) · 8d7f39b4
Jee Jee Li authored Sep 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
8d7f39b4
[Model] Enable BNB support for qwen2_5_omni_thinker (#24420) · 6f4a82f8
Jee Jee Li authored Sep 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
6f4a82f8

[Frontend] User-provided uuids for medias in chat. (RFC #22044) (#23449) · 01dfb5e9

Chenheli Hua authored Sep 08, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

01dfb5e9

[Model] Remove unnecessary CUDA sync of Qwen2VL image and video preprocess (#24334) · 60f0843e
Chatcharin Sangbutsarakum authored Sep 08, 2025
```
Signed-off-by: Win <chatcharinsang@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
60f0843e
[Model] Remove unnecessary CUDA sync of GLM-4.1V image and video preprocess (#24332) · 8a466026
Chatcharin Sangbutsarakum authored Sep 08, 2025
```
Signed-off-by: Win <chatcharinsang@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
8a466026

07 Sep, 2025 1 commit

Migrate Qwen2 inputs to TensorSchema (#23475) · 37a6fa95

Benji Beck authored Sep 06, 2025


Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

37a6fa95

06 Sep, 2025 3 commits

[Multimodal] Improve max video embedding length estimation in V1 (#24312) · eddaafc1
Roger Wang authored Sep 06, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
eddaafc1
[New Model]: google/embeddinggemma-300m (#24318) · 6d6c6b05
wang.yuqi authored Sep 06, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
6d6c6b05

[Core] Allow disabling TP sharding for parallel Linear layer (#23024) · 53b19ccd

Isotr0py authored Sep 06, 2025

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

53b19ccd

05 Sep, 2025 1 commit
- [gpt-oss] tool parser supports for /chat/completions [1/n] (#22386) · c29fb540
  Aaron Pham authored Sep 04, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  c29fb540
04 Sep, 2025 6 commits

[LoRA]: Add lora support to qwen-2.5-omni (#24231) · c9f7081f
Yash Pratap Singh authored Sep 04, 2025

c9f7081f
[Model] Add pp support for hunyuan (#24212) · eafa8dcd
Jiangyun Zhu authored Sep 04, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
eafa8dcd
[Attention][Platform] Refactor MLA to support Custom Op (#23332) · 3efb9f4d
whx authored Sep 04, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
3efb9f4d

[Core][Model] Terratorch backend integration (#23513) · 51d5e9be

mgazz authored Sep 04, 2025


Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

51d5e9be

[Model] Add MiDashengLM model support (#23652) · e7fc7001

bingchen-mi authored Sep 04, 2025


Signed-off-by: chenbing8 <chenbing8@xiaomi.com>
Signed-off-by: bingchen-mi <chenbing8@xiaomi.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

e7fc7001

Migrate ultravox inputs to TensorSchema (#23503) · cb55ad86
Benji Beck authored Sep 03, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
cb55ad86

03 Sep, 2025 3 commits

Migrate whisper inputs to TensorSchema (#23505) · 731a6940
Benji Beck authored Sep 03, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
731a6940
[Kernels] Overlap shared experts with send/recv (#23273) · e9b92dcd
bnellnm authored Sep 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
e9b92dcd

[V1] v1 engine + full CUDA graph support for PLaMo2 (#23998) · fa4311d8

nopperl authored Sep 04, 2025


Signed-off-by: Hemmi Shinichi <shemmi@preferred.jp>
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
Co-authored-by: Hemmi Shinichi <shemmi@preferred.jp>
Co-authored-by: Thomas Parnell <tom.parnell@gmail.com>

fa4311d8