- 27 Jan, 2026 24 commits
-
-
PanZezhong authored
-
wooway777 authored
-
wooway777 authored
-
wooway777 authored
-
PanZezhong authored
-
wooway777 authored
-
wooway777 authored
-
wooway777 authored
-
wooway777 authored
-
wooway777 authored
-
Jiacheng Huang authored
issue/925 - Speed up `scripts/build_ntops.py` and `src/infiniop/ninetoothed/build.py` with `concurrent.futures`
-
Jiacheng Huang authored
对 `NineToothedTensor` 进行 C++ 层封装 加入使用数组作为 `shape` 和 `strides` 创建 `ninetoothed::Tensor` 的方式 使用 `ninetoothed::Tensor` 接入九齿的 ReLU 算子 Add an include guard to `ninetoothed/utils.h`
-
wooway777 authored
-
PanZezhong authored
-
wooway777 authored
-
wooway777 authored
-
wooway777 authored
-
PanZezhong authored
-
wooway777 authored
-
wooway777 authored
-
wooway777 authored
-
gongchensu authored
- Ensure embedding tensors are on the same device. Change format. - Optimize embedding kernel with vectorized memory access and __ldg - Add vectorized memory access using float4/float2, half2, and bfloat162 - Use __ldg instruction for read-only weight and indices access - Add memory alignment checks to enable vectorized paths - Add __restrict__ keywords for better compiler optimization - Implement dynamic block size selection based on embedding_dim
-
wooway777 authored
-
wooway777 authored
-
- 22 Jan, 2026 3 commits
-
-
PanZezhong1725 authored
issue/811 fix tensor to blob and resume
-
PanZezhong authored
-
PanZezhong1725 authored
issue/811 support cuda graph capture
-
- 21 Jan, 2026 3 commits
-
-
PanZezhong authored
-
PanZezhong authored
-
PanZezhong1725 authored
issue/810 feat: allow graph tensor to resume to allocator's tracking
-
- 19 Jan, 2026 1 commit
-
-
PanZezhong authored
-
- 16 Jan, 2026 1 commit
-
-
Haojie Wang authored
issue/920 RoPE supports longrope
-
- 15 Jan, 2026 2 commits
-
-
PanZezhong1725 authored
issue/811 remove shortcut for cpu runtime
-
PanZezhong authored
-
- 14 Jan, 2026 1 commit
-
-
PanZezhong authored
-
- 12 Jan, 2026 4 commits
-
-
PanZezhong1725 authored
issue/867 fix cpu malloc
-
PanZezhong authored
-
PanZezhong1725 authored
issue/867 fix page caching api, paged attn support more head dims
-
PanZezhong authored
-
- 10 Jan, 2026 1 commit
-
-
Haojie Wang authored
issue/810 static compute graph infra
-