Commits · 9e61b53db07831a97395d07cdac6ef798424cbbe · OpenDAS / vllm_cscc

20 Nov, 2025 1 commit
- test2除了qfeat全部改完 · 9e61b53d
  guanyu1 authored Nov 20, 2025
  
  9e61b53d
19 Nov, 2025 2 commits
- test2_强制修改为ALL · fe1ab618
  guanyu1 authored Nov 19, 2025
  
  fe1ab618
- test2-1119 · fda84b29
  guanyu1 authored Nov 19, 2025
  
  fda84b29
18 Nov, 2025 1 commit
- test2 · 3908ec24
  guanyu1 authored Nov 18, 2025
  
  3908ec24
15 Nov, 2025 1 commit
- hunyuan分类模型适配 · 70fdd8a2
  guanyu1 authored Nov 15, 2025
  
  70fdd8a2
31 Oct, 2025 2 commits
- update moe configs name · 28021d6e
  zhuwenwen authored Oct 31, 2025
  
  28021d6e
- 删除DPSK_FP16_QUICK · 1851782d
  zhuwenwen authored Oct 31, 2025
  
  1851782d
30 Oct, 2025 1 commit
- skip lmslim import when infer non quantized models · 8e22ded2
  zhuwenwen authored Oct 30, 2025
  
  8e22ded2
29 Oct, 2025 1 commit
- Revert "Add Qwen3-Omni moe thinker" · 58117664
  zhuwenwen authored Oct 29, 2025
```
This reverts commit e9cb2241.
```
  58117664
28 Oct, 2025 2 commits
- remove redundant fused_topk_bias · c16e075a
  zhuwenwen authored Oct 28, 2025
  
  c16e075a
- Add Qwen3-Omni moe thinker · e9cb2241
  zhuwenwen authored Oct 28, 2025
  
  e9cb2241
27 Oct, 2025 2 commits
- update num_expert_group · f007cd06
  zhuwenwen authored Oct 27, 2025
  
  f007cd06
- update scaling_alpha · b01011d2
  zhuwenwen authored Oct 27, 2025
  
  b01011d2
25 Oct, 2025 1 commit
- [Models] support HunYuanForCausalLM · f386ba88
  zhuwenwen authored Oct 25, 2025
  
  f386ba88
22 Oct, 2025 3 commits
- init is_quantization of load_column_parallel_weight (BasevLLMParameter) · a9c37628
  zhuwenwen authored Oct 22, 2025
  
  a9c37628
- init is_quantization of load_row_parallel_weight (BasevLLMParameter) · 3efb2e1c
  zhuwenwen authored Oct 22, 2025
  
  3efb2e1c
- remove redundant routed_scaling_factor · 39380c86
  zhuwenwen authored Oct 22, 2025
  
  39380c86
21 Oct, 2025 1 commit
- update qwen3_vl conv layout (ncdhw to ndhwc) · 6eb5b12c
  zhuwenwen authored Oct 21, 2025
  
  6eb5b12c
20 Oct, 2025 1 commit
- update the layout of load_column_parallel_weight and load_row_parallel_weight · f3731273
  zhuwenwen authored Oct 20, 2025
  
  f3731273
15 Oct, 2025 2 commits
- update the layout of weight_loader_v2 in ColumnParallelLinear and update the... · 33f37e9f
  zhuwenwen authored Oct 15, 2025
```
update the layout of weight_loader_v2 in ColumnParallelLinear and update the initialization of is_quantification
```
  33f37e9f
- update linear to matmul · e35a9e99
  zhuwenwen authored Oct 15, 2025
  
  e35a9e99
14 Oct, 2025 1 commit
- update linear apply · 7e5aa0c5
  zhuwenwen authored Oct 14, 2025
  
  7e5aa0c5
13 Oct, 2025 1 commit
- update moe_sum and moe_align · b35a518a
  zhuwenwen authored Oct 13, 2025
  
  b35a518a
12 Oct, 2025 3 commits
- add use_int4_w4a8 of fused_experts · 048f7316
  zhuwenwen authored Oct 12, 2025
  
  048f7316
- remove two_batch_overlap of moe and update use_mla · 11b94900
  zhuwenwen authored Oct 12, 2025
  
  11b94900
- update weight_loader_v2 layout of ColumnParallelLinear and MergedColumnParallelLinear · 6605af8e
  zhuwenwen authored Oct 12, 2025
  
  6605af8e
11 Oct, 2025 2 commits
- remove two_batch_overlap · 88443051
  zhuwenwen authored Oct 11, 2025
  
  88443051
- skip silu_mul_fp8_quant_deep_gemm_cuda and remove zero_overhead · 1bd3ae33
  zhuwenwen authored Oct 11, 2025
  
  1bd3ae33
02 Oct, 2025 1 commit
- [Deepseek v3.2] Support indexer prefill chunking (#25999) · c75c2e70
  Chen Zhang authored Oct 02, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  c75c2e70
01 Oct, 2025 5 commits

[BugFix] Fix default kv-cache-dtype default for DeepseekV3.2 (#25988) · e4beabd2
Lucas Wilkinson authored Oct 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
e4beabd2
[MM] Add text-only mode for Qwen3-VL (#26000) · a1825fe6
Roger Wang authored Sep 30, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
a1825fe6

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · b3230e1a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

b3230e1a

[Bug] Fix Weight Loading for Block FP8 Cutlass SM90 (#25909) · 9471879b

Wentao Ye authored Sep 29, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

9471879b

[Bugfix] Fallback ViT attn backend to SDPA for blackwell (#25851) · ab5b6459
Roger Wang authored Sep 28, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
ab5b6459

30 Sep, 2025 3 commits
- DeepSeek-R1-Channel-INT8调用rmsquant融合 · 9f087f8b
  zhuwenwen authored Sep 30, 2025
  
  9f087f8b
- [kernels] add rotary_embedding_deepseek_fuse · 1e911dbd
  zhuwenwen authored Sep 30, 2025
```
off rotary_embedding_deepseek_fuse
```
  1e911dbd
- feat: moe_align_block_size 更新lightop 接口,加入对ep的支持 · 63f1c793
  zhuwenwen authored Sep 30, 2025
  
  63f1c793
29 Sep, 2025 1 commit

[Bugfix] fix Qwen3VLMoe load when pp > 1 (#25838) · 09c2cbc0

JJJYmmm authored Sep 29, 2025


Signed-off-by: liuye.hj <liuye.hj@alibaba-inc.com>
Co-authored-by: liuye.hj <liuye.hj@alibaba-inc.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

09c2cbc0

28 Sep, 2025 2 commits

[VLM] Update Qwen3-VL max_num_video_tokens calculation for configurable video profiling (#25557) · 4c347044

Isotr0py authored Sep 28, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Signed-off-by: simon-mo <simon.mo@hey.com>

4c347044

[Bugfix] Fix Qwen3-VL regression from #24982 (#25814) · 19e7ab73
Roger Wang authored Sep 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
19e7ab73