GitLab

support prefix cache on kme
fix the error in test_moe caused by moe align not supporting 511 and 211
multi-modal switching to torch implementation on z100l&k100

fix the error in test_moe caused by moe align not supporting 511
multi-modal switching to torch implementation on z100l&k100

Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>

Signed-off-by: Tianyuan Wu <Tianyuan.Wu@amd.com>

2.支持设置v1的chunked_prefill开关

Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: fsx950223 <fsx950223@outlook.com>
Co-authored-by: charlifu <charlifu@amd.com>

Signed-off-by: charlifu <charlifu@amd.com>

Signed-off-by: simon-mo <simon.mo@hey.com>

Signed-off-by: charlifu <charlifu@amd.com>

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>

Signed-off-by: Mengqing Cao <cmq0113@163.com>

Signed-off-by: Felix Marty <felmarty@amd.com>

Signed-off-by: Andy Xie <andy.xning@gmail.com>

Signed-off-by: Mengqing Cao <cmq0113@163.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: Hosang Yoon <hosang.yoon@amd.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: Jade Zheng <zheng.shoujian@outlook.com>

Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: qli88 <qiang.li2@amd.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>

Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: charlifu <charlifu@amd.com>