GitLab

- Ensure embedding tensors are on the same device. Change format.
- Optimize embedding kernel with vectorized memory access and __ldg
- Add vectorized memory access using float4/float2, half2, and bfloat162
- Use __ldg instruction for read-only weight and indices access
- Add memory alignment checks to enable vectorized paths
- Add __restrict__ keywords for better compiler optimization
- Implement dynamic block size selection based on embedding_dim

* can commit

* can exec sm_90a

* can exec < sm_90

* fix format

* fix format

* 增加测试，测试对标sglang test

* fix format 1

* fix format 2

* add compile option to disable cutlass

This reverts commit 25258029.

issue/744: softplus

issue/744: kunlun softplus

issue/744: delete F64

Signed-off-by: Ceng23333 <441651826@qq.com>

* issue/739 - support batched RoPE on Nvidia and CPU

* issue/739 - metax, moore batched rope

* issue/739 - adjust metax flags

* issue/739 - added a rope module interface to forward inplace in output tensor

- Implement Moore backend for add, mul, and silu elementwise operations
- Filter unsupported dtypes (BF16, F64) for Moore platform in tests

* ISSUE/628 适配QY C610 GPU，增加编译选项，适配已有算子。添加bge类模型所需的算子，包括gelu,layer_norm，lp_norm(支持l1，l2 norm)，relu，softmax，tanh。

---------
Co-authored-by: xgqdut2016 <kenan_gewei@163.com>
Co-authored-by: xgqdut2016 <140036308+xgqdut2016@users.noreply.github.com>

* initial add mc support for meta

* add command description for maca compilation

* rebase metax maca support to main

* issue/445 - clang format code on ubuntu

* issue//445 - change config from use_mc to use-mc and format code

* fix compile bug on cuda 13.0

* issue/367 - clang format code on ubuntu

---------
Co-authored-by: root <root@Crapromer>

Co-authored-by: pengcheng888 <pengcheng@example.com>

Co-authored-by: wawahejun <hejunlbbc@gmail.com>
Co-authored-by: zhuyue <zhuyue@qiyuanlab.com>