GitLab

fix the error in test_moe caused by moe align not supporting 511
multi-modal switching to torch implementation on z100l&k100

[kernels] update moe_align_block_size and moe_sum interface

[FIX] 修复mtp和VLLM_USE_TRITON_CAT不能一起开的bug

This reverts merge request !169

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

Signed-off-by: wang.yuqi <noooop@126.com>

Signed-off-by: sangbumlikeagod <oironese@naver.com>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Signed-off-by: Bill Nell <bnell@redhat.com>

Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>

Signed-off-by: wang.yuqi <noooop@126.com>