GitLab

fix: moe quant bug and attention bug

See merge request dcutoolkit/deeplearing/vllm!275

去掉宽松mtp中的隐式同步

See merge request dcutoolkit/deeplearing/vllm!274

[fix]解决宽松mtp1报错

See merge request dcutoolkit/deeplearing/vllm!272

Fix blaslt miss bias.

See merge request dcutoolkit/deeplearing/vllm!270

[feat]支持宽松mtp

See merge request dcutoolkit/deeplearing/vllm!269

[pref]: DS_v2_w8a8模型融掉moe.quant

See merge request dcutoolkit/deeplearing/vllm!268

deepseek_v2_w8a8 增加 silu_mul_quant融合

See merge request dcutoolkit/deeplearing/vllm!265

set VLLM_USE_LIGHTOP_FILL_MOE_ALIGN=1, VLLM_USE_OPT_ZEROS=1 and VLLM_USE_PP_SYNC=1

feat: pp mtp加入零消耗调度，加入环境变量VLLM_USE_ZERO_MTP，默认打开

See merge request dcutoolkit/deeplearing/vllm!264

feat: pipeline_parallel新增pp域请求数均衡,VLLM_USE_PP_BALANCE控制，默认开启

See merge request dcutoolkit/deeplearing/vllm!262

deepseek_v2_w4a8模型forward_CRQ分支逻辑增加slilu_mul_quant融合

See merge request dcutoolkit/deeplearing/vllm!261