Commits · 8d75f22e79656dddc975c73133fdccbbebc5c963 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "6e1100889e6a675d17ad82815acf8f02f1cc419e"

09 Dec, 2025 2 commits

[Model][Quantization] Fix / Add GGUF support for Qwen2 MoE models (#30307) · 73a484ca
Tsukasa OI authored Dec 10, 2025
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
73a484ca

[Bugfix] Qwen 3 VL Embedding loading (#30303) · 9c32df61

wang.yuqi authored Dec 09, 2025

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

9c32df61

08 Dec, 2025 4 commits

Add latent MoE support (#30203) · fcd5306f

shaharmor98 authored Dec 08, 2025


Signed-off-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

fcd5306f

[DeepSeek v3.2] Make top-k work for any logit values. (#27568) · 184076c3

Daniel Cámpora authored Dec 08, 2025


Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

184076c3

[Model][7/N] Improve all pooling task | Deprecation as_reward_model. Extract... · 9e77ffca

wang.yuqi authored Dec 08, 2025


[Model][7/N] Improve all pooling task | Deprecation as_reward_model. Extract hidden states prefer using new multi-vector retrieval API (#26686)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>

9e77ffca

[Perf] Remove sync point in vit torch sdpa attn backend (#30232) · bcb6f594
Dazhi Jiang authored Dec 08, 2025
```
Signed-off-by: Dazhi Jiang <dazhi_jiang@163.com>
```
bcb6f594

07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
06 Dec, 2025 3 commits
- [Model] Move `multimodal_cpu_fields` definition to field config (#30181) · 671427ef
  Cyrus Leung authored Dec 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  671427ef
- [Chore] Deprecate `SupportsMultiModal.merge_by_field_config` (#30170) · c46b932d
  Cyrus Leung authored Dec 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c46b932d
- [Model] Add support for transformer-based Ultravox v0.7 projector (#30089) · e858bc4d
  Peter Salas authored Dec 05, 2025
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
  e858bc4d
05 Dec, 2025 3 commits

[Bugfix][llama4_eagle] Fix missing 'lm_head' attribute (#29926) · 962d7038
Divakar Verma authored Dec 05, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
962d7038

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315) · 66e674cd

Matthew Bonanni authored Dec 05, 2025

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

66e674cd

[Frontend][Model] Add 'float16' to possible mamba cache dtype values, override... · 6038b1b0

amitz-nv authored Dec 05, 2025


[Frontend][Model] Add 'float16' to possible mamba cache dtype values, override mamba SSM cache dtype value for NemotronH (#29978)
Signed-off-by: amitz-nv <203509407+amitz-nv@users.noreply.github.com>

6038b1b0

04 Dec, 2025 8 commits
- Access `partial_rotary_factor` from `rope_parameters` (#29966) · e10c84e0
  Harry Mellor authored Dec 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e10c84e0
- support qwen3-vl handle requests with embeddings (#30037) · 6dcb07f6
  Tao Yun authored Dec 05, 2025
```
Signed-off-by: taoyun <1069423820@qq.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  6dcb07f6
- [Chore] Deprecate `merge_by_field_config` arg (#30035) · b286a311
  Cyrus Leung authored Dec 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b286a311
- Delete HF version of Phi 4 MM (#30049) · 9998ea5b
  Harry Mellor authored Dec 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9998ea5b
- [Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145) · 74c4d80c
  wang.yuqi authored Dec 04, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  74c4d80c
- [Misc] Move functions into `PoolingMetadata` (#30027) · 68eb5c8d
  Cyrus Leung authored Dec 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  68eb5c8d
- [ROCm] [Bugfix] `compute_attn_mask_seqlen` for qwen3 omni (#29974) · 3f1b0373
  TJian authored Dec 04, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  3f1b0373
- [Misc] Various cleanups for MM input processing (#29970) · 9ae2f603
  Cyrus Leung authored Dec 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9ae2f603
03 Dec, 2025 1 commit

[Bugfix] Fix incorrect `image_grid_thw` rank for HunyuanOCR from missing... · a21cd9ed

Isotr0py authored Dec 03, 2025


[Bugfix] Fix incorrect `image_grid_thw` rank for HunyuanOCR from missing `merge_by_field_config=True` (#29950)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a21cd9ed

02 Dec, 2025 14 commits

[Bugfix] Fix incorrect channel order for idefics3 in edge case (#29881) · 2f055ec1

Isotr0py authored Dec 03, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
(cherry picked from commit 0ec84221)

2f055ec1

[BUGFIX] llama_4_scaling wrongly passed to DeepseekAttention (#29908) · 9057fc2f
Julien Denize authored Dec 02, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
(cherry picked from commit 5e5646e2)
```
9057fc2f
[BUGFIX] llama_4_scaling wrongly passed to DeepseekAttention (#29908) · 5e5646e2
Julien Denize authored Dec 02, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
5e5646e2
Fix some more Transformers nightly tests (#29872) · 6fc5841d
Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
6fc5841d

[Bugfix] Fix DeepSeek R1 MTP weight loading (#29545) · 339e84ce

Matthew Bonanni authored Dec 02, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
(cherry picked from commit 51c57b51)

339e84ce

[Chore] Use `tokenizer.encode` and `tokenizer.decode` directly (#29851) · 34a8559b
Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
(cherry picked from commit 68ffbca7)
```
34a8559b
feat(model): Add BitsAndBytes quantization support for Qwen3-Omni-MoE (#29896) · a2b053dc
Navanit Dubey authored Dec 03, 2025
```
Signed-off-by: navanit-git <navanitdubey@gmail.com>
```
a2b053dc

[Bugfix] Fix incorrect channel order for idefics3 in edge case (#29881) · 0ec84221

Isotr0py authored Dec 03, 2025

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

0ec84221

[Bugfix] Fix DeepSeek R1 MTP weight loading (#29545) · 51c57b51

Matthew Bonanni authored Dec 02, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>

51c57b51

[Chore] Use `tokenizer.encode` and `tokenizer.decode` directly (#29851) · 68ffbca7
Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
68ffbca7

Add Mistral Large 3 and Ministral 3 (#29757) · d8c6210e

Julien Denize authored Dec 02, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Mickael Seznec <mickael@mistral.ai>

d8c6210e

Fix some Transformers nightly tests (#29802) · f5b0846b
Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
f5b0846b
[Chore] Move tokenizer initialization methods (#29793) · 653591d5
Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
653591d5
Add missing return in _check_vllm_model_embed_input_ids (#29834) · f441d36c
Johnny Yang authored Dec 01, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
f441d36c

01 Dec, 2025 1 commit
- [Frontend] add 'verbose_json' and 'timestamp' feature on Whisper Transcription/Translation (#24209) · 092bb73b
  sangbumlikeagod authored Dec 02, 2025
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
Signed-off-by: sangbumlikeagod <98077576+sangbumlikeagod@users.noreply.github.com>
```
  092bb73b
30 Nov, 2025 2 commits
- [Misc]Remove redundant hidden_size property in ModelConfig (#29749) · 21c26279
  Xingyu Liu authored Dec 01, 2025
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  21c26279
- [Core] Enable `inputs_embeds_size` separate from `hidden_size` (#29741) · 64bc09ba
  Cyrus Leung authored Nov 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64bc09ba