GitLab

support prefix cache on kme
fix the error in test_moe caused by moe align not supporting 511 and 211
multi-modal switching to torch implementation on z100l&k100

fix the error in test_moe caused by moe align not supporting 511
multi-modal switching to torch implementation on z100l&k100

This reverts commit e202dd27.

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>

Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>

Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>

Signed-off-by: Tianyuan Wu <Tianyuan.Wu@amd.com>

Signed-off-by: jiang1.li <jiang1.li@intel.com>

2.支持设置v1的chunked_prefill开关

Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>

Signed-off-by: Seiji Eicher <seiji@anyscale.com>

Signed-off-by: Chenyaaang <chenyangli@google.com>

Signed-off-by: mgoin <mgoin64@gmail.com>

Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: fsx950223 <fsx950223@outlook.com>
Co-authored-by: charlifu <charlifu@amd.com>

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>

Signed-off-by: charlifu <charlifu@amd.com>

Signed-off-by: Isotr0py <2037008807@qq.com>

Signed-off-by: jiang1.li <jiang1.li@intel.com>

Signed-off-by: mgoin <mgoin64@gmail.com>

Signed-off-by: mgoin <mgoin64@gmail.com>