Commits · v0.9.2-dev_pp_zero · OpenDAS / vllm_cscc

25 Nov, 2025 1 commit
- add recive mtp tokenids and req_ids in pp rank 0 from pp rank 1 · 3344fbec
  lizhigong authored Nov 25, 2025
  
  3344fbec
24 Nov, 2025 1 commit
- 新增pp2零消耗调度分支 · a183111e
  lizhigong authored Nov 24, 2025
  
  a183111e
23 Nov, 2025 2 commits
- update VLLM_USE_CAT_MLA · 83c1f04a
  zhuwenwen authored Nov 23, 2025
  
  83c1f04a
- add VLLM_USE_CAT_MLA to use fused cat and mla · 4b00d1ba
  zhuwenwen authored Nov 23, 2025
  
  4b00d1ba
21 Nov, 2025 9 commits
- Merge branch '092dev_DS_add_silu_mul_quant_w8a8' into 'v0.9.2-dev' · be22412f
  zhuwenwen authored Nov 21, 2025
```
deepseek_v2_w8a8 增加 silu_mul_quant融合

See merge request dcutoolkit/deeplearing/vllm!265
```
  be22412f
- deepseek_v2_w8a8 增加 silu_mul_quant融合 · 216e414b
  wujl5 authored Nov 21, 2025
  
  216e414b
- add VLLM_USE_CUDA_GRAPH_SIZES(1) to use 1-24... (not only 1 2 4 8 16) · 2b47bce9
  zhuwenwen authored Nov 21, 2025
```
set VLLM_USE_LIGHTOP_FILL_MOE_ALIGN=1, VLLM_USE_OPT_ZEROS=1 and VLLM_USE_PP_SYNC=1
```
  2b47bce9
- Merge branch 'v0.9.2-dev-zero-mtp' into 'v0.9.2-dev' · ce755d66
  zhuwenwen authored Nov 21, 2025
```
feat: pp mtp加入零消耗调度，加入环境变量VLLM_USE_ZERO_MTP，默认打开

See merge request dcutoolkit/deeplearing/vllm!264
```
  ce755d66
- feat: pp mtp加入零消耗调度，加入环境变量VLLM_USE_ZERO_MTP，默认打开 · c50f084a
  jujl1 authored Nov 21, 2025
  
  c50f084a
- add VLLM_USE_CUDA_GRAPH_SIZES to use 1-18... (not only 1 2 4 8 16) · d126ce21
  zhuwenwen authored Nov 21, 2025
  
  d126ce21
- update Is_fuse_fill · 77fccdf4
  zhuwenwen authored Nov 21, 2025
  
  77fccdf4
- Merge branch 'v0.9.2-dev' of http://10.16.6.30/dcutoolkit/deeplearing/vllm into v0.9.2-dev · 5785324e
  zhuwenwen authored Nov 21, 2025
  
  5785324e
- update fill + moe align interface of lightop · e3d1dfdd
  zhuwenwen authored Nov 21, 2025
  
  e3d1dfdd
20 Nov, 2025 9 commits
- Merge branch 'v0.9.2-dev-pp-balance' into 'v0.9.2-dev' · 17d317cf
  zhuwenwen authored Nov 20, 2025
```
feat: pipeline_parallel新增pp域请求数均衡,VLLM_USE_PP_BALANCE控制，默认开启

See merge request dcutoolkit/deeplearing/vllm!262
```
  17d317cf
- feat: pipeline_parallel新增pp域请求数均衡,VLLM_USE_PP_BALANCE控制，默认开启 · 48cf947c
  jujl1 authored Oct 31, 2025
  
  48cf947c
- Merge branch 'v0.9.2-dev' of http://10.16.6.30/dcutoolkit/deeplearing/vllm into v0.9.2-dev · 971a47d2
  zhuwenwen authored Nov 20, 2025
  
  971a47d2
- 根据不同场景，更新默认调度和分离调度的选择 · 244b534f
  zhuwenwen authored Nov 20, 2025
  
  244b534f
- Merge branch '092dev_DS_v2_w4a8_silu_mul_quant_reabase' into 'v0.9.2-dev' · 74c6e218
  zhuwenwen authored Nov 20, 2025
```
deepseek_v2_w4a8模型forward_CRQ分支逻辑增加slilu_mul_quant融合

See merge request dcutoolkit/deeplearing/vllm!261
```
  74c6e218
- use schedule_split_pd (dpsk mtp + fullgraph) · dbbc0b2e
  zhuwenwen authored Nov 20, 2025
  
  dbbc0b2e
- USE_FUSED_SILU_MUL_QUANT默认改成开启 · 421850cb
  wujl5 authored Nov 20, 2025
  
  421850cb
- DS_v2_w4a8_CRQ增加slilu_mul_quant支持 · 075841f3
  wujl5 authored Nov 20, 2025
  
  075841f3
- MLA模块CRQ融合分支增加rms_cuda_opt · 8c646ebe
  wujl5 authored Nov 20, 2025
  
  8c646ebe
19 Nov, 2025 8 commits
- 修复pd分离开cp引起的校检问题 · 22a14b84
  zhuwenwen authored Nov 19, 2025
```
修改schedule_default和schedule_split_pd的选择
```
  22a14b84
- update m // 8 · ea2c27ab
  zhuwenwen authored Nov 19, 2025
  
  ea2c27ab
- update VLLM_USE_PD_SPLIT=0 · 90fc8f66
  zhuwenwen authored Nov 19, 2025
  
  90fc8f66
- set VLLM_USE_PD_SPLIT=0 (dpsk-v3) · d95a8fff
  zhuwenwen authored Nov 19, 2025
  
  d95a8fff
- Merge branch 'v0.9.2-dev' of http://10.16.6.30/dcutoolkit/deeplearing/vllm into v0.9.2-dev · ad74f612
  zhuwenwen authored Nov 19, 2025
  
  ad74f612
- add qwen3-30B tp2 tn moe json · 7270e6d9
  zhuwenwen authored Nov 19, 2025
  
  7270e6d9
- set VLLM_USE_LIGHTOP_FILL_MOE_ALIGN=0 · 46006aee
  zhuwenwen authored Nov 19, 2025
  
  46006aee
- Merge branch '1117_deepseek_reduce_fusenorm_quant_push_1' into 'v0.9.2-dev' · 65f4a174
  zhuwenwen authored Nov 19, 2025
```
deepseekv2-w4a8支持custom-rms-quant融合

See merge request dcutoolkit/deeplearing/vllm!259
```
  65f4a174
18 Nov, 2025 1 commit
- deepseekv2-w4a8支持custom-rms-quant融合 · 3e6729e0
  wujl5 authored Nov 18, 2025
  
  3e6729e0
17 Nov, 2025 5 commits
- update VLLM_USE_LIGHTOP_FILL_MOE_ALIGN · 813f81fb
  zhuwenwen authored Nov 17, 2025
  
  813f81fb
- set VLLM_USE_LIGHTOP_FILL_MOE_ALIN=0 for dpsk · 70f1c878
  zhuwenwen authored Nov 17, 2025
  
  70f1c878
- add VLLM_USE_LIGHTOP_FILL_MOE_ALIN · 904b87ba
  zhuwenwen authored Nov 17, 2025
  
  904b87ba
- add VLLM_USE_LIGHTOP_FILL_MOE_ALIN · cff5c2d2
  zhuwenwen authored Nov 17, 2025
  
  cff5c2d2
- update synchronize · ed53dfb0
  zhuwenwen authored Nov 17, 2025
  
  ed53dfb0
14 Nov, 2025 1 commit
- add VLLM_USE_PP_SYNC to use pp sync · a1e9e36f
  zhuwenwen authored Nov 14, 2025
  
  a1e9e36f
13 Nov, 2025 3 commits
- update qwen3 of rmsnorm · 8375370f
  zhuwenwen authored Nov 13, 2025
  
  8375370f
- Merge branch 'v0.9.2-dev-wm-1113' into 'v0.9.2-dev' · 8fc64935
  zhuwenwen authored Nov 13, 2025
```
[fix]解决DeepSeek-V3.2 mtp启动失败

See merge request dcutoolkit/deeplearing/vllm!253
```
  8fc64935
- [fix]解决moe_fused_gate编译错误，去掉mla中mtp部分的修改 · de8e0fa8
  王敏 authored Nov 13, 2025
  
  de8e0fa8