Commits · a6bed85bf1fbaa1735ab2100a86c2641b15eec57 · OpenDAS / vllm_cscc

27 Nov, 2025 9 commits
- fix: 修改attetion这里的import bug · 8cfbe041
  wujl5 authored Nov 27, 2025
  
  8cfbe041
- update reshape_and_cache_cuda import · b550cf96
  zhuwenwen authored Nov 27, 2025
  
  b550cf96
- fix: 修复融合moe.quant对其他模型的多余传参影响 · 4f11b099
  wujl5 authored Nov 27, 2025
  
  4f11b099
- 去掉宽松mtp中的隐式同步 · 03e822d1
  王敏 authored Nov 27, 2025
  
  03e822d1
- add VLLM_USE_TOPK_RENORM to use optimized topk_softmax + renormalize · 7ff04b72
  zhuwenwen authored Nov 27, 2025
  
  7ff04b72
- 增加VLLM_USE_OPT_RESHAPE_AND_CACHE 环境变量用来控制优化reshape and cache kernel · fe054987
  laibao authored Nov 27, 2025
  
  fe054987
- [fix]解决宽松mtp1报错 · deae0a22
  王敏 authored Nov 27, 2025
  
  deae0a22
- update VLLM_USE_FUSE_SILU_AND_MUL init value · afd18c9c
  zhuwenwen authored Nov 27, 2025
  
  afd18c9c
- 增加 VLLM_USE_FUSE_SILU_AND_MUL 环境变量，用来控制 fused MoE 里 silu+mul 的融合 kernel。 · a921f34c
  laibao authored Nov 27, 2025
  
  a921f34c
26 Nov, 2025 6 commits
- 更新 vllm/_custom_ops.py, vllm/model_executor/layers/quantization/utils/w8a8_utils.py · 2164aab4
  wanglong3 authored Nov 26, 2025
  
  2164aab4
- [feat]宽松mtp默认关掉 · b9bc84e2
  王敏 authored Nov 26, 2025
  
  b9bc84e2
- [feat]支持宽松mtp · 02b4ec43
  王敏 authored Nov 26, 2025
  
  02b4ec43
- [pref]: DS_v2_w8a8模型融掉moe.quant · 68972532
  wujl5 authored Nov 26, 2025
  
  68972532
- [fix]修复不开mtp精度异常问题 · a363d2c3
  zhuwenwen authored Nov 26, 2025
  
  a363d2c3
- set VLLM_USE_ZERO_MTP=0 · 7ff48a6c
  zhuwenwen authored Nov 26, 2025
  
  7ff48a6c
23 Nov, 2025 2 commits
- update VLLM_USE_CAT_MLA · 83c1f04a
  zhuwenwen authored Nov 23, 2025
  
  83c1f04a
- add VLLM_USE_CAT_MLA to use fused cat and mla · 4b00d1ba
  zhuwenwen authored Nov 23, 2025
  
  4b00d1ba
21 Nov, 2025 6 commits
- deepseek_v2_w8a8 增加 silu_mul_quant融合 · 216e414b
  wujl5 authored Nov 21, 2025
  
  216e414b
- add VLLM_USE_CUDA_GRAPH_SIZES(1) to use 1-24... (not only 1 2 4 8 16) · 2b47bce9
  zhuwenwen authored Nov 21, 2025
```
set VLLM_USE_LIGHTOP_FILL_MOE_ALIGN=1, VLLM_USE_OPT_ZEROS=1 and VLLM_USE_PP_SYNC=1
```
  2b47bce9
- feat: pp mtp加入零消耗调度，加入环境变量VLLM_USE_ZERO_MTP，默认打开 · c50f084a
  jujl1 authored Nov 21, 2025
  
  c50f084a
- add VLLM_USE_CUDA_GRAPH_SIZES to use 1-18... (not only 1 2 4 8 16) · d126ce21
  zhuwenwen authored Nov 21, 2025
  
  d126ce21
- update Is_fuse_fill · 77fccdf4
  zhuwenwen authored Nov 21, 2025
  
  77fccdf4
- update fill + moe align interface of lightop · e3d1dfdd
  zhuwenwen authored Nov 21, 2025
  
  e3d1dfdd
20 Nov, 2025 6 commits
- feat: pipeline_parallel新增pp域请求数均衡,VLLM_USE_PP_BALANCE控制，默认开启 · 48cf947c
  jujl1 authored Oct 31, 2025
  
  48cf947c
- 根据不同场景，更新默认调度和分离调度的选择 · 244b534f
  zhuwenwen authored Nov 20, 2025
  
  244b534f
- use schedule_split_pd (dpsk mtp + fullgraph) · dbbc0b2e
  zhuwenwen authored Nov 20, 2025
  
  dbbc0b2e
- USE_FUSED_SILU_MUL_QUANT默认改成开启 · 421850cb
  wujl5 authored Nov 20, 2025
  
  421850cb
- DS_v2_w4a8_CRQ增加slilu_mul_quant支持 · 075841f3
  wujl5 authored Nov 20, 2025
  
  075841f3
- MLA模块CRQ融合分支增加rms_cuda_opt · 8c646ebe
  wujl5 authored Nov 20, 2025
  
  8c646ebe
19 Nov, 2025 6 commits
- 修复pd分离开cp引起的校检问题 · 22a14b84
  zhuwenwen authored Nov 19, 2025
```
修改schedule_default和schedule_split_pd的选择
```
  22a14b84
- update m // 8 · ea2c27ab
  zhuwenwen authored Nov 19, 2025
  
  ea2c27ab
- update VLLM_USE_PD_SPLIT=0 · 90fc8f66
  zhuwenwen authored Nov 19, 2025
  
  90fc8f66
- set VLLM_USE_PD_SPLIT=0 (dpsk-v3) · d95a8fff
  zhuwenwen authored Nov 19, 2025
  
  d95a8fff
- add qwen3-30B tp2 tn moe json · 7270e6d9
  zhuwenwen authored Nov 19, 2025
  
  7270e6d9
- set VLLM_USE_LIGHTOP_FILL_MOE_ALIGN=0 · 46006aee
  zhuwenwen authored Nov 19, 2025
  
  46006aee
18 Nov, 2025 1 commit
- deepseekv2-w4a8支持custom-rms-quant融合 · 3e6729e0
  wujl5 authored Nov 18, 2025
  
  3e6729e0
17 Nov, 2025 4 commits
- update VLLM_USE_LIGHTOP_FILL_MOE_ALIGN · 813f81fb
  zhuwenwen authored Nov 17, 2025
  
  813f81fb
- set VLLM_USE_LIGHTOP_FILL_MOE_ALIN=0 for dpsk · 70f1c878
  zhuwenwen authored Nov 17, 2025
  
  70f1c878
- add VLLM_USE_LIGHTOP_FILL_MOE_ALIN · 904b87ba
  zhuwenwen authored Nov 17, 2025
  
  904b87ba
- add VLLM_USE_LIGHTOP_FILL_MOE_ALIN · cff5c2d2
  zhuwenwen authored Nov 17, 2025
  
  cff5c2d2