Commits · 0ff29dbfc7ead8e5d402fdbd4648989688e19ce4 · OpenDAS / vllm_cscc

05 Oct, 2025 2 commits
- use opt rope · 8c0143db
  zhuwenwen authored Oct 05, 2025
  
  8c0143db
- fix rope acc error · b7b4e639
  zhuwenwen authored Oct 05, 2025
  
  b7b4e639
30 Sep, 2025 2 commits
- 修复部分代码 · 46e26bf1
  王敏 authored Sep 30, 2025
  
  46e26bf1
- [feat]优化mori计算逻辑，支持cudagraph，按照bs*ep_size截断fused_moe的输入，共享专家不tp切分，去掉最后的allreduce · d2e57a90
  王敏 authored Sep 30, 2025
  
  d2e57a90
29 Sep, 2025 2 commits
- update moe_sum interface · 00bbf0bb
  zhuwenwen authored Sep 29, 2025
  
  00bbf0bb
- remove redundant shared_output · 50bed026
  zhuwenwen authored Sep 29, 2025
  
  50bed026
26 Sep, 2025 4 commits
- off rotary_embedding_deepseek_fuse · dc675592
  zhuwenwen authored Sep 26, 2025
  
  dc675592
- feat: moe_align_block_size 更新lightop 接口,加入对ep的支持 · 0dcc2e60
  jujl1 authored Sep 26, 2025
  
  0dcc2e60
- update op · 92c6171e
  zhuwenwen authored Sep 26, 2025
  
  92c6171e
- VLLM_USE_LIGHTOP and VLLM_USE_OPT_CAT · c1ece8c6
  zhuwenwen authored Sep 26, 2025
```
add shared_output and routed_scaling_factor of CompressedTensorsW8A8Int8MoEMethod
```
  c1ece8c6
25 Sep, 2025 3 commits
- add shared_output and routed_scaling_factor of w4a8 · b33ff2d6
  zhuwenwen authored Sep 25, 2025
  
  b33ff2d6
- DeepSeek-R1-Channel-INT8调用rmsquant融合。 · a5043e83
  wujl5 authored Sep 25, 2025
  
  a5043e83
- [kernels] add fused_rms_norm_contiguous and rotary_embedding_deepseek_fuse · 49810c37
  zhuwenwen authored Sep 25, 2025
```
[kernels] update moe_align_block_size and moe_sum interface
```
  49810c37
24 Sep, 2025 2 commits
- update VLLM_USE_OPT_CAT · 4d97c5fc
  zhuwenwen authored Sep 24, 2025
  
  4d97c5fc
- [kernel] add lightop's moe_sum(mul+add) fusion operator for deepseek · 8d2cac26
  zhuwenwen authored Sep 24, 2025
```
[FIX] 修复mtp和VLLM_USE_TRITON_CAT不能一起开的bug
```
  8d2cac26
23 Sep, 2025 2 commits
- 修复W4A8 PP8崩溃问题 · 4020670f
  zhuwenwen authored Sep 23, 2025
  
  4020670f
- Update w4a8_utils.py · 7904da3f
  zhuwenwen authored Sep 23, 2025
  
  7904da3f
22 Sep, 2025 1 commit
- deepseek-r1-w4a8 mlp/moe调用silu-mul-quant融合 · 3964e019
  wujl5 authored Sep 22, 2025
  
  3964e019
20 Sep, 2025 1 commit
- 增加w4a8marlin-ds的moe融合算子输入 · 26c82c27
  SAC_fanth authored Sep 20, 2025
  
  26c82c27
18 Sep, 2025 2 commits
- update fused_experts_impl_w4a8 · 29ee4475
  zhuwenwen authored Sep 18, 2025
  
  29ee4475
- [kernel] add VLLM_USE_DEEPSEEK_MOE_SUM_MUL_AND to use lightop's moe_sum fusion... · 0975d9e8
  zhuwenwen authored Sep 18, 2025
```
[kernel] add VLLM_USE_DEEPSEEK_MOE_SUM_MUL_AND to use lightop's moe_sum fusion operator for deepseek
```
  0975d9e8
17 Sep, 2025 1 commit
- merge 092-dev分支近期修改 · f9f1887d
  王敏 authored Sep 17, 2025
  
  f9f1887d
16 Sep, 2025 2 commits
- 修改mori最大输入token数 · 3c08fbc1
  王敏 authored Sep 16, 2025
  
  3c08fbc1
- 添加mori ep · 1a56d6cb
  王敏 authored Sep 16, 2025
  
  1a56d6cb
15 Sep, 2025 1 commit
- update moe_align_block_size · d251d4f3
  zhuwenwen authored Sep 15, 2025
  
  d251d4f3
14 Sep, 2025 1 commit
- deepseek-r1-w4a8使用rmsquant融合算子及横向融合 · fc443d52
  wujl5 authored Sep 14, 2025
  
  fc443d52
11 Sep, 2025 2 commits
- 新增dpsk-v3.1-awq的支持 · e5f51b79
  yangql authored Sep 11, 2025
  
  e5f51b79
- fix: w4a8 marlin 中 weight重排接入lightop算子 · 082d41a1
  jujl1 authored Sep 10, 2025
  
  082d41a1
10 Sep, 2025 2 commits
- 临时添加mori代码 · 3cb11400
  王敏 authored Sep 10, 2025
  
  3cb11400
- update flash-attn interface of apply_rotary_emb · 37707203
  zhuwenwen authored Sep 10, 2025
  
  37707203
09 Sep, 2025 1 commit
- fix: 优化w4a8 marlin 中 weight重排耗时 · ffab74dd
  jujl1 authored Sep 09, 2025
  
  ffab74dd
08 Sep, 2025 1 commit
- update op.moe_fused_gate · bc9aee38
  zhuwenwen authored Sep 08, 2025
  
  bc9aee38
07 Sep, 2025 2 commits
- add VLLM_USE_LIGHT_OP to optimize moe_align_block_size and moe_fused_gate · a54ab95d
  zhuwenwen authored Sep 07, 2025
  
  a54ab95d
- 临时添加cudagraph代码，目前还有问题 · fe70dcb2
  王敏 authored Sep 07, 2025
  
  fe70dcb2
06 Sep, 2025 3 commits
- feat: slimquant_w4a8量化加入ep_moe适配，修改ep_moe中调用接口为：self.quant_method.apply_ep() · 9c86df96
  jujl1 authored Sep 05, 2025
  
  9c86df96
- 修复all2all报维度不匹配问题 · 8f66f64b
  王敏 authored Sep 06, 2025
  
  8f66f64b
- 修复all2all报维度不匹配问题 · 578d3e97
  王敏 authored Sep 06, 2025
  
  578d3e97
04 Sep, 2025 2 commits
- 1.优化大EP，合入grouped gemm · d997afc4
  王敏 authored Sep 04, 2025
```
2.解决mtp >1 大EP推理all gather卡住问题
```
  d997afc4
- add glm-4.5-air-tp8 nn moe configs · 7a97637e
  zhuwenwen authored Sep 04, 2025
  
  7a97637e
03 Sep, 2025 1 commit
- [fix]fix tests of v1 and worker · a7668e46
  zhuwenwen authored Sep 03, 2025
  
  a7668e46