GitLab

feat: support moe sum when topk==9

bugfix: Fix mtp model load error when eable shared experts fusion.

update VLLM_USE_LIGHTOP_RMS_ROPE_CONCAT impl

restore the default settings of disable_cascade_attn
add VLLM_USE_OPT_ZEROS to replace triton_ (torch.zeros)
set default_max_num_batched_tokens = 10240
update qwen3_moe of layernorm

2.解决mtp >1 大EP推理all gather卡住问题

This reverts merge request !169

Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>

Signed-off-by: simon-mo <simon.mo@hey.com>

Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>

Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>