Commits · b7b4e6393ed2a4d5a1e88c69c96aa7a86d13dccc · OpenDAS / vllm_cscc

05 Oct, 2025 1 commit
- fix rope acc error · b7b4e639
  zhuwenwen authored Oct 05, 2025
  
  b7b4e639
30 Sep, 2025 1 commit
- fix Z100L&K100 precision error · 9e5ec696
  zhuwenwen authored Sep 30, 2025
  
  9e5ec696
29 Sep, 2025 5 commits
- update moe_sum interface · 00bbf0bb
  zhuwenwen authored Sep 29, 2025
  
  00bbf0bb
- fix pp error and update min_block_size · 484fcfca
  zhuwenwen authored Sep 29, 2025
  
  484fcfca
- when v1 is set to block_size 16, switch to triton implementation · e470f6a1
  zhuwenwen authored Sep 29, 2025
  
  e470f6a1
- Revert "新增fp8—e5m2" · 3903e15e
  zhuwenwen authored Sep 29, 2025
```
This reverts commit d6ba8ed5.
```
  3903e15e
- 新增fp8—e5m2 · d6ba8ed5
  zhuwenwen authored Sep 29, 2025
  
  d6ba8ed5
26 Sep, 2025 12 commits
- Merge branch 'v0.9.2-dev' of http://10.16.6.30/dcutoolkit/deeplearing/vllm into v0.9.2-dev · 48114bb1
  zhuwenwen authored Sep 26, 2025
  
  48114bb1
- update cat kernel · e0fdf4e8
  zhuwenwen authored Sep 26, 2025
  
  e0fdf4e8
- off rotary_embedding_deepseek_fuse · dc675592
  zhuwenwen authored Sep 26, 2025
  
  dc675592
- Merge branch 'v0.9.2-dev-ep' into 'v0.9.2-dev' · f331f103
  zhuwenwen authored Sep 26, 2025
```
feat: moe_align_block_size 更新lightop 接口,加入对ep的支持

See merge request dcutoolkit/deeplearing/vllm!216
```
  f331f103
- feat: moe_align_block_size 更新lightop 接口,加入对ep的支持 · 0dcc2e60
  jujl1 authored Sep 26, 2025
  
  0dcc2e60
- Merge branch 'v0.9.2-dev' of http://10.16.6.30/dcutoolkit/deeplearing/vllm into v0.9.2-dev · aa4bc884
  zhuwenwen authored Sep 26, 2025
  
  aa4bc884
- update op · 92c6171e
  zhuwenwen authored Sep 26, 2025
  
  92c6171e
- Merge branch 'v0.9.2-dev-pdpp2' into 'v0.9.2-dev' · 8db3c41c
  zhuwenwen authored Sep 26, 2025
```
add PD P do pp

See merge request dcutoolkit/deeplearing/vllm!215
```
  8db3c41c
- add PD P do pp · ecd5815f
  xiabo authored Sep 26, 2025
  
  ecd5815f
- Merge branch 'v0.9.2-dev_pp_mtp' into 'v0.9.2-dev' · a857453f
  zhuwenwen authored Sep 26, 2025
```
[fix] pp+mtp bs 1 correctness

See merge request dcutoolkit/deeplearing/vllm!214
```
  a857453f
- VLLM_USE_LIGHTOP and VLLM_USE_OPT_CAT · c1ece8c6
  zhuwenwen authored Sep 26, 2025
```
add shared_output and routed_scaling_factor of CompressedTensorsW8A8Int8MoEMethod
```
  c1ece8c6
- [fix] pp+mtp bs 1 correctness · 22d6f9af
  lizhigong authored Sep 26, 2025
  
  22d6f9af
25 Sep, 2025 4 commits
- Merge branch '0.9.2+das.opt1.rc2.dtk25041-ds-w8a8-rmsquant-push' into 'v0.9.2-dev' · c7d0b817
  zhuwenwen authored Sep 25, 2025
```
DeepSeek-R1-Channel-INT8调用rmsquant融合。

See merge request dcutoolkit/deeplearing/vllm!213
```
  c7d0b817
- add shared_output and routed_scaling_factor of w4a8 · b33ff2d6
  zhuwenwen authored Sep 25, 2025
  
  b33ff2d6
- DeepSeek-R1-Channel-INT8调用rmsquant融合。 · a5043e83
  wujl5 authored Sep 25, 2025
  
  a5043e83
- [kernels] add fused_rms_norm_contiguous and rotary_embedding_deepseek_fuse · 49810c37
  zhuwenwen authored Sep 25, 2025
```
[kernels] update moe_align_block_size and moe_sum interface
```
  49810c37
24 Sep, 2025 4 commits
- Merge branch 'v0.9.2-dev_pp_mtp' into 'v0.9.2-dev' · ddf9d10c
  zhuwenwen authored Sep 24, 2025
```
fix scheduler issu in pp + mtp

See merge request dcutoolkit/deeplearing/vllm!212
```
  ddf9d10c
- update VLLM_USE_OPT_CAT · 4d97c5fc
  zhuwenwen authored Sep 24, 2025
  
  4d97c5fc
- [kernel] add lightop's moe_sum(mul+add) fusion operator for deepseek · 8d2cac26
  zhuwenwen authored Sep 24, 2025
```
[FIX] 修复mtp和VLLM_USE_TRITON_CAT不能一起开的bug
```
  8d2cac26
- fix scheduler issu in pp + mtp · 2cb921da
  lizhigong authored Sep 24, 2025
  
  2cb921da
23 Sep, 2025 6 commits
- add convert_vertical_slash_indexes and convert_vertical_slash_indexes_mergehead · 5086453d
  zhuwenwen authored Sep 23, 2025
  
  5086453d
- Merge remote-tracking branch 'origin/v0.9.2-dev-yql-kvfp8' into v0.9.2-dev · a0895c00
  zhuwenwen authored Sep 23, 2025
  
  a0895c00
- 修复kvcachefp8与cp/pc的冲突 · 8b7daa0d
  yangql authored Sep 23, 2025
  
  8b7daa0d
- 修复W4A8 PP8崩溃问题 · 4020670f
  zhuwenwen authored Sep 23, 2025
  
  4020670f
- Merge branch '092-dev_silu-mul-quant-push' into 'v0.9.2-dev' · 3320343d
  zhuwenwen authored Sep 23, 2025
```
deepseek-r1-w4a8 mlp/moe调用silu-mul-quant融合

See merge request dcutoolkit/deeplearing/vllm!209
```
  3320343d
- Merge branch 'v0.9.2-dev-pd' into 'v0.9.2-dev' · 440fc9db
  zhuwenwen authored Sep 23, 2025
```
修改P等待问题

See merge request dcutoolkit/deeplearing/vllm!210
```
  440fc9db
22 Sep, 2025 2 commits
- deepseek-r1-w4a8 mlp/moe调用silu-mul-quant融合 · 3964e019
  wujl5 authored Sep 22, 2025
  
  3964e019
- 修改P等待问题 · 560ffc4c
  xiabo authored Sep 22, 2025
  
  560ffc4c
17 Sep, 2025 2 commits
- Merge branch 'v0.9.2-dev_tbo' into 'v0.9.2-dev' · c0707728
  zhuwenwen authored Sep 17, 2025
```
fix the performance issue of tbo pd separation

See merge request dcutoolkit/deeplearing/vllm!208
```
  c0707728
- fix the performance issue of tbo pd separation · f8985b96
  lizhigong authored Sep 17, 2025
  
  f8985b96
16 Sep, 2025 3 commits
- Merge branch 'v0.9.2-dev-fth' into 'v0.9.2-dev' · 4a80b456
  zhuwenwen authored Sep 16, 2025
```
接入新的concat算子，包含decode和prefill，并根据size的不同进行选择

See merge request dcutoolkit/deeplearing/vllm!207
```
  4a80b456
- 接入新的concat算子，包含decode和prefill，并根据size的不同进行选择 · 2233e3d0
  王敏 authored Sep 16, 2025
  
  2233e3d0
- [fix]fix tests of engine · 0f8a9861
  zhuwenwen authored Sep 16, 2025
  
  0f8a9861