Commits · 7d6fb905d984e2ff1d4c7d68543e4c61e15dba98 · OpenDAS / vllm_cscc

02 Oct, 2025 1 commit
- [Model] Use `merge_by_field_config` for MM models (A-C) (#26073) · 7d6fb905
  Cyrus Leung authored Oct 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7d6fb905
01 Oct, 2025 7 commits
- Support RL online quantization with torchao (#23014) · c3124680
  Jerry Zhang authored Oct 01, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  c3124680
- [Misc] Factor out common `_apply_feature_select_strategy` (#26003) · 1405f0c7
  Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1405f0c7
- [BugFix][MM] Fix Nonetype error when video is cache in qwen2.5-omni-thinker (#26004) · 84d57342
  Wenlong Wang authored Oct 01, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  84d57342
- Update to Transformers `v4.56.2` (#24638) · 2a69ab48
  Harry Mellor authored Oct 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2a69ab48
- [BugFix] Fix default kv-cache-dtype default for DeepseekV3.2 (#25988) · 8d7da92f
  Lucas Wilkinson authored Oct 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  8d7da92f
- [MM] Add text-only mode for Qwen3-VL (#26000) · 66bca9b8
  Roger Wang authored Sep 30, 2025
  
  66bca9b8
- [Log] Optimize Log for FP8MOE (#25709) · 12449488
  Wentao Ye authored Sep 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  12449488
30 Sep, 2025 14 commits

Add explicit pooling classes for the Transformers backend (#25322) · a388252a

Harry Mellor authored Sep 30, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a388252a

[Llama4] [multimodal] Fix misplaced dtype cast of `cos_sin_cache` in... · 43b752c3

cjackal authored Oct 01, 2025


[Llama4] [multimodal] Fix misplaced dtype cast of `cos_sin_cache` in `Llama4VisionRotaryEmbedding` (#25889)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>

43b752c3

[Bug] Fix AttributeError: 'QKVParallelLinear' object has no attribute 'orig_dtype' (#25958) · e6a226ef
Wentao Ye authored Sep 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
e6a226ef
[Bugfix] Token type and position embeddings fail to be applied to `inputs_embeds` (#25922) · 9f1c4eca
Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
9f1c4eca
[Bugfix] Fix accuracy issue of TRTLLM FP8 MOE and improve logging (#25895) · ef283548
Pavani Majety authored Sep 30, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
ef283548

[Bugfix][Model] Fix inference for Hunyuan dense models (#25354) · f4db5e6d

Anion authored Sep 30, 2025


Signed-off-by: anion <1005128408@qq.com>
Signed-off-by: Anion <123177548+Anionex@users.noreply.github.com>

f4db5e6d

[Kernel][Moe Configs] Add more tuned triton configs for ExpertsInt8 and FP8 (#25858) · 35fe398c
Asaf Joseph Gardin authored Sep 30, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
35fe398c
[Model] Move `vision_feature_select_strategy` into `resolve_visual_encoder_outputs` (#25938) · d7e34b42
Cyrus Leung authored Sep 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d7e34b42
[Bugfix][Model]fix ernie45 moe gate&bias dtype to float32 (#25936) · ef6e0e71
CSWYF3634076 authored Sep 30, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
ef6e0e71

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>