GitLab

set USE_FUSED_RMS_QUANT=1 and USE_FUSED_SILU_MUL_QUANT=1

fix the error in test_moe caused by moe align not supporting 511
multi-modal switching to torch implementation on z100l&k100

This reverts commit e202dd27.

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>

Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>

Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Duncan Moss <dmoss@nvidia.com>

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

Signed-off-by: wang.yuqi <noooop@126.com>

Signed-off-by: sangbumlikeagod <oironese@naver.com>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Nick Hill <nhill@redhat.com>

Signed-off-by: Seiji Eicher <seiji@anyscale.com>

Signed-off-by: Bill Nell <bnell@redhat.com>

Signed-off-by: Andy Xie <andy.xning@gmail.com>

Signed-off-by: wang.yuqi <noooop@126.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Nick Hill <nhill@redhat.com>

Signed-off-by: QscQ <qscqesze@gmail.com>
Signed-off-by: qingjun <qingjun@minimaxi.com>

Signed-off-by: Chenheli Hua <huachenheli@outlook.com>

Signed-off-by: Nick Hill <nhill@redhat.com>