GitLab

issue/434 - added bf16 support for Cambricon MLU

* issue/436: support kunlun rope U32

* issue/436: 支持9g7b 4b模型

---------
Co-authored-by: zhangyue <zhangyue@qiyuanlab.com>

issue/434 hccl support bf16

Signed-off-by: Ceng <441651826@qq.com>

Signed-off-by: Ceng <441651826@qq.com>

Issue/428: Merge `rope_v2` into `rope`

issue/428: update the rope implementation on Ascend, Cambricon, and Kunlun to use the refactored interface and return unimplemented error for NEOX-style algorithm

* issue/450: change indexToReducedOffset() to indexToOffset in elementwise framework on CPU, NVIDIA, Cambricon, Metax, Moore, and Kunlun

* issue/450: remove indexToReducedOffset() in all platforms

* issue/450: add the testcases that pinpoint the issue in infiniop-test

issue/450: change indexToReducedOffset() to indexToOffset in elementwise framework on CPU, NVIDIA, Cambricon, Metax, Moore, and Kunlun

issue/434 nccl support bf16

issue/425: implement GEMM with MUBLAS and MUDNN backends in moore gpu

issue/416: p800 rearrange kernel

issue/342: 昆仑芯P800上random_sample算子

issue/421: 适配 rmsnorm 测例修改，支持 bf16 和 f16数据类型 weights

issue/418: 解决 p800 上手写算子引用 sm 上指针的报错问题