GitLab

issue/811 use relax graph capture mode

issue/925 - Speed up `scripts/build_ntops.py` and `src/infiniop/ninetoothed/build.py` with `concurrent.futures`

对 `NineToothedTensor` 进行 C++ 层封装

加入使用数组作为 `shape` 和 `strides` 创建 `ninetoothed::Tensor` 的方式

使用 `ninetoothed::Tensor` 接入九齿的 ReLU 算子

Add an include guard to `ninetoothed/utils.h`

- Ensure embedding tensors are on the same device. Change format.
- Optimize embedding kernel with vectorized memory access and __ldg
- Add vectorized memory access using float4/float2, half2, and bfloat162
- Use __ldg instruction for read-only weight and indices access
- Add memory alignment checks to enable vectorized paths
- Add __restrict__ keywords for better compiler optimization
- Implement dynamic block size selection based on embedding_dim

issue/811 fix tensor to blob and resume

issue/811 support cuda graph capture

issue/810 feat: allow graph tensor to resume to allocator's tracking

issue/920 RoPE supports longrope

issue/811 remove shortcut for cpu runtime

issue/867 fix cpu malloc

issue/867 fix page caching api, paged attn support more head dims