Commits · 3e6729e07131d8ca2ea12665a68813b4cd876982 · OpenDAS / vllm_cscc

18 Nov, 2025 1 commit
- deepseekv2-w4a8支持custom-rms-quant融合 · 3e6729e0
  wujl5 authored Nov 18, 2025
  
  3e6729e0
17 Nov, 2025 2 commits
- update VLLM_USE_LIGHTOP_FILL_MOE_ALIGN · 813f81fb
  zhuwenwen authored Nov 17, 2025
  
  813f81fb
- add VLLM_USE_LIGHTOP_FILL_MOE_ALIN · cff5c2d2
  zhuwenwen authored Nov 17, 2025
  
  cff5c2d2
12 Nov, 2025 1 commit
- update qwen3_moe of layernorm and activation · a014d6a5
  zhuwenwen authored Nov 12, 2025
  
  a014d6a5
11 Nov, 2025 1 commit
- Support blaslt w8a8 GEMM op. · 836dee3b
  wanglong3 authored Nov 11, 2025
  
  836dee3b
10 Nov, 2025 1 commit
- 解决w8a8 pp16开启marlin的oom问题 · 21f31cf6
  SAC_fanth authored Nov 10, 2025
  
  21f31cf6
07 Nov, 2025 2 commits
- remove redundant envs · d0485181
  zhuwenwen authored Nov 07, 2025
  
  d0485181
- replace triton_ of rms and act_and_mul · 0eaf8026
  zhuwenwen authored Nov 07, 2025
  
  0eaf8026
03 Nov, 2025 1 commit
- feat: w8a8_marlin 接入，通过-q slimquant_marlin开启，优化w4a8_marlin代码 · dd64aebf
  jujl1 authored Nov 01, 2025
  
  dd64aebf
31 Oct, 2025 3 commits
- remove moe jsons of awq · 17b375d6
  zhuwenwen authored Oct 31, 2025
  
  17b375d6
- update arch_name and arch_cu location · 0352a534
  zhuwenwen authored Oct 31, 2025
  
  0352a534
- update moe configs name · 96d4afdc
  zhuwenwen authored Oct 31, 2025
  
  96d4afdc
24 Oct, 2025 2 commits
- use _apply_rotary_emb_torch for z100l&k100 · 48d8707e
  zhuwenwen authored Oct 24, 2025
  
  48d8707e
- set USE_FUSED_RMS_QUANT=0 and USE_FUSED_SILU_MUL_QUANT=0 · 46dd30e7
  zhuwenwen authored Oct 24, 2025
```
add VLLM_USE_LIGHTOP_MOE_SUM_MUL_ADD
```
  46dd30e7
17 Oct, 2025 1 commit
- Set the default value of routed_scaling_factor to 1 · 9a505ffb
  zhuwenwen authored Oct 17, 2025
  
  9a505ffb
15 Oct, 2025 2 commits
- 修复awq 的mtp中的blockint8的问题 · 0cc9bc74
  yangql authored Oct 15, 2025
  
  0cc9bc74
- 删除DPSK_FP16_QUICK，以及增加awq和blockwiseint8的shared_output接口 · 50cb9270
  yangql authored Oct 15, 2025
  
  50cb9270
13 Oct, 2025 5 commits
- 去掉all2all ep相关代码 · 0b467604
  王敏 authored Oct 13, 2025
  
  0b467604
- update the envs for moe_sum and moe_align · 766663e6
  zhuwenwen authored Oct 13, 2025
  
  766663e6
- update moe_sum and moe_align · 1277ff09
  zhuwenwen authored Oct 13, 2025
  
  1277ff09
- optimize the implementation of moe_sum (lightop) · 7e68a7fe
  zhuwenwen authored Oct 13, 2025
  
  7e68a7fe
- optimize the implementation of moe_sum · 06a1bee2
  zhuwenwen authored Oct 13, 2025
  
  06a1bee2
11 Oct, 2025 1 commit
- change tbo about cudagrah · e42a922c
  maxiao1 authored Oct 11, 2025
  
  e42a922c
10 Oct, 2025 1 commit
- pd分离_tbo · 12291212
  maxiao1 authored Oct 06, 2025
  
  12291212
05 Oct, 2025 2 commits
- use opt rope · 8c0143db
  zhuwenwen authored Oct 05, 2025
  
  8c0143db
- fix rope acc error · b7b4e639
  zhuwenwen authored Oct 05, 2025
  
  b7b4e639
29 Sep, 2025 1 commit
- update moe_sum interface · 00bbf0bb
  zhuwenwen authored Sep 29, 2025
  
  00bbf0bb
26 Sep, 2025 4 commits
- off rotary_embedding_deepseek_fuse · dc675592
  zhuwenwen authored Sep 26, 2025
  
  dc675592
- feat: moe_align_block_size 更新lightop 接口,加入对ep的支持 · 0dcc2e60
  jujl1 authored Sep 26, 2025
  
  0dcc2e60
- update op · 92c6171e
  zhuwenwen authored Sep 26, 2025
  
  92c6171e
- VLLM_USE_LIGHTOP and VLLM_USE_OPT_CAT · c1ece8c6
  zhuwenwen authored Sep 26, 2025
```
add shared_output and routed_scaling_factor of CompressedTensorsW8A8Int8MoEMethod
```
  c1ece8c6
25 Sep, 2025 3 commits
- add shared_output and routed_scaling_factor of w4a8 · b33ff2d6
  zhuwenwen authored Sep 25, 2025
  
  b33ff2d6
- DeepSeek-R1-Channel-INT8调用rmsquant融合。 · a5043e83
  wujl5 authored Sep 25, 2025
  
  a5043e83
- [kernels] add fused_rms_norm_contiguous and rotary_embedding_deepseek_fuse · 49810c37
  zhuwenwen authored Sep 25, 2025
```
[kernels] update moe_align_block_size and moe_sum interface
```
  49810c37
24 Sep, 2025 2 commits
- update VLLM_USE_OPT_CAT · 4d97c5fc
  zhuwenwen authored Sep 24, 2025
  
  4d97c5fc
- [kernel] add lightop's moe_sum(mul+add) fusion operator for deepseek · 8d2cac26
  zhuwenwen authored Sep 24, 2025
```
[FIX] 修复mtp和VLLM_USE_TRITON_CAT不能一起开的bug
```
  8d2cac26
23 Sep, 2025 1 commit
- 修复W4A8 PP8崩溃问题 · 4020670f
  zhuwenwen authored Sep 23, 2025
  
  4020670f
22 Sep, 2025 1 commit
- deepseek-r1-w4a8 mlp/moe调用silu-mul-quant融合 · 3964e019
  wujl5 authored Sep 22, 2025
  
  3964e019
15 Sep, 2025 1 commit
- update moe_align_block_size · d251d4f3
  zhuwenwen authored Sep 15, 2025
  
  d251d4f3
14 Sep, 2025 1 commit
- deepseek-r1-w4a8使用rmsquant融合算子及横向融合 · fc443d52
  wujl5 authored Sep 14, 2025
  
  fc443d52