GitLab

update VLLM_USE_PD_SPLIT=0 (for dspk)and  VLLM_USE_PD_SPLIT=1 (for others)

add VLLM_USE_PP_SYNC to use pp sync
update qwen3 of rmsnorm

set default_max_num_batched_tokens = 10240
update qwen3_moe of layernorm
off lightop of moe_fused_gate

add VLLM_USE_PD_SPLIT to split prefill and decode
replace triton_ of rms and act_and_mul

This reverts commit e9cb2241.

update the layout of weight_loader_v2 in ColumnParallelLinear and update the initialization of is_quantification

Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

Signed-off-by: simon-mo <simon.mo@hey.com>