GitLab

Add new benchmark configurations for gfx936_80cu with E=512,N=64 and E=512,N=128 Qwen3-Next-80B-A3B-Instruct nn tp4 tp8 moe json

See merge request dcutoolkit/deeplearing/vllm!283

Add new benchmark configurations for gfx936_80cu with E=512,N=64 and E=512,N=128 Qwen3-Next-80B-A3B-Instruct nn tp4 tp8 moe json

add VLLM_USE_OPT_RESHAPE_AND_CACHE、VLLM_USE_FUSE_SILU_AND_MUL and VLLM_USE_TOPK_RENORM for qwen3-30b

[fix]解决deepseek模型cudagraph模式下精度异常问题

See merge request dcutoolkit/deeplearing/vllm!278

修复schedule_default，schedule_split_pd，因kv cache耗尽，服务挂掉的问题

See merge request dcutoolkit/deeplearing/vllm!266

update VLLM_USE_PD_SPLIT=0 (for dspk)and  VLLM_USE_PD_SPLIT=1 (for others)

add VLLM_USE_PP_SYNC to use pp sync
update qwen3 of rmsnorm

[feat]支持prefill和decoding分开调度

See merge request dcutoolkit/deeplearing/vllm!260

Add minimax_m2

See merge request dcutoolkit/deeplearing/vllm!258

[fix]解决moe_fused_gate编译错误

See merge request dcutoolkit/deeplearing/vllm!254

set default_max_num_batched_tokens = 10240
update qwen3_moe of layernorm
off lightop of moe_fused_gate

add VLLM_USE_PD_SPLIT to split prefill and decode
replace triton_ of rms and act_and_mul

[fix]解决moe_fused_gate编译错误，去掉mla中mtp部分的修改

See merge request dcutoolkit/deeplearing/vllm!251

add deps of pd-pp