Commits · 8cf62baac17a54c3d0caad13ec59cb497c738155 · jerrrrry / infinilm

26 Dec, 2025 2 commits
- Merge pull request #163 from InfiniTensor/issue/125-paged · 8cf62baa
  PanZezhong1725 authored Dec 26, 2025
```
issue/125 添加Paged KV Cache接口
```
  8cf62baa
- issue/125 添加Paged KV Cache接口 · f147eb02
  PanZezhong authored Dec 26, 2025
  
  f147eb02
24 Dec, 2025 3 commits
- Merge pull request #158 from InfiniTensor/issue/157 · 11007392
  PanZezhong1725 authored Dec 24, 2025
```
issue/157 - add/adjust cambricon support in scripts
```
  11007392
- Merge pull request #156 from InfiniTensor/issue/125_pzz · d0239867
  PanZezhong1725 authored Dec 24, 2025
```
issue/125 统一Cache接口
```
  d0239867
- issue/157 - add/adjust cambricon support in scripts · 9f1e0cb0
  wooway777 authored Dec 24, 2025
  
  9f1e0cb0
23 Dec, 2025 2 commits
- issue/125 统一Cache接口 · ff00b5c8
  PanZezhong authored Dec 23, 2025
  
  ff00b5c8
- issue/150 移除推理接口中的 `dtype` 传递 · 13a4154a
  Jiacheng Huang authored Dec 23, 2025
  
  13a4154a
22 Dec, 2025 2 commits
- Merge pull request #148 from xgqdut2016/issue/147 · 91c06fd9
  qinyiqun authored Dec 22, 2025
```
Issue/147：增加QY机器编译选项
```
  91c06fd9
- issue/147: 增加QY device · 3a426695
  xgqdut2016 authored Nov 19, 2025
  
  3a426695
19 Dec, 2025 1 commit
- issue/135: 统一 `InferEngine::forward` 和 `Model::forward` 接口 · 5b5ff780
  Jiacheng Huang authored Dec 19, 2025
  
  5b5ff780
18 Dec, 2025 3 commits

issue/140 准确率脚本支持torch，添加总吞吐 (#141) · 3a1c0a28
PanZezhong1725 authored Dec 18, 2025

3a1c0a28
issue/140 准确率脚本支持torch，添加总吞吐 · 9e434492
PanZezhong authored Dec 18, 2025

9e434492

issue/122 :更新benchmark脚本和README.md (#123) · 7862a723

Ceng authored Dec 18, 2025



* issue/122 :更新benchmark脚本和README.md
Signed-off-by: Ceng23333 <441651826@qq.com>

* .
Signed-off-by: Ceng23333 <441651826@qq.com>

* fix input_ids
Signed-off-by: Ceng23333 <441651826@qq.com>

* explicitly split mmul all subject
Signed-off-by: Ceng23333 <441651826@qq.com>

---------
Signed-off-by: Ceng23333 <441651826@qq.com>

7862a723

17 Dec, 2025 1 commit
- issue/134: 统一模型配置 · cdce626e
  Jiacheng Huang authored Dec 17, 2025
  
  cdce626e
11 Dec, 2025 3 commits
- Merge pull request #126 from pengcheng888/issue/115_2 · faa5d405
  pengcheng888 authored Dec 11, 2025
```
issue/115 完善bench.py文件
```
  faa5d405
- issue/115 完善bench.py文件 · 1b5d1ea7
  pengcheng888 authored Dec 11, 2025
  
  1b5d1ea7
- Merge pull request #124 from InfiniTensor/issue/121 · 6498332e
  thatPepe authored Dec 11, 2025
```
Issue/121 - cache managements
```
  6498332e
10 Dec, 2025 3 commits
- Merge pull request #117 from InfiniTensor/issue/116 · 295aacd1
  PanZezhong1725 authored Dec 10, 2025
```
issue/116 - using batched rope
```
  295aacd1
- Merge pull request #120 from pengcheng888/issue/115 · 1b3391eb
  pengcheng888 authored Dec 10, 2025
```
issue/115 - 添加 bench.py
```
  1b3391eb
- issue/115 - 添加 bench.py · 13df67c9
  pengcheng888 authored Dec 10, 2025
  
  13df67c9
09 Dec, 2025 5 commits
- issue/116 - using batched rope · e8245b7d
  wooway777 authored Dec 09, 2025
  
  e8245b7d
- Merge pull request #119 from pengcheng888/issue/112 · 78ce921e
  PanZezhong1725 authored Dec 09, 2025
```
issue/114 - 添加读取.bin文件权重的代码，更新readme
```
  78ce921e
- issue/114 - 添加读取.bin文件权重的代码，更新readme · 300470cb
  pengcheng888 authored Dec 09, 2025
  
  300470cb
- Merge pull request #118 from InfiniTensor/issue/114 · 2abef3b7
  PanZezhong1725 authored Dec 09, 2025
```
issue/114 QKVParallelLinear, GateUpParallelLinear
```
  2abef3b7
- issue/114 QKV linear and GateUp linear · 4ea1f3b6
  PanZezhong authored Dec 09, 2025
  
  4ea1f3b6
08 Dec, 2025 3 commits
- Merge pull request #113 from pengcheng888/issue/111_1 · 81081f3c
  PanZezhong1725 authored Dec 08, 2025
```
issue/111 - 9g7b分布式
```
  81081f3c
- issue/111 - 9g7b分布式 · 39790c1e
  Your Name authored Dec 08, 2025
  
  39790c1e
- issue/106 适配模型9G7B · 9c256a17
  Ceng authored Dec 08, 2025
  
  9c256a17
07 Dec, 2025 2 commits
- Merge pull request #105 from pengcheng888/issue/102 · 39bea30a
  pengcheng888 authored Dec 07, 2025
```
issue/102 - 添加逐文件和逐tensor 读取权重文件的函数
```
  39bea30a
- issue/102 - 添加逐文件和逐tensor从model.savetensor读取权重的函数 · 7128a9a5
  pengcheng888 authored Dec 07, 2025
  
  7128a9a5
06 Dec, 2025 3 commits
- Merge pull request #108 from InfiniTensor/issue/92-b · 8c224092
  PanZezhong1725 authored Dec 06, 2025
```
issue/92 将run改为异步
```
  8c224092
- issue/92 将run改为异步 · 9c4020a4
  PanZezhong authored Dec 06, 2025
  
  9c4020a4
- issue/92 添加InferEngine，支持多线程推理 · 3d328d61
  PanZezhong1725 authored Dec 06, 2025
  
  3d328d61
05 Dec, 2025 1 commit
- fix xmake · 0794f307
  PanZezhong authored Dec 05, 2025
  
  0794f307
04 Dec, 2025 6 commits
- Merge pull request #104 from InfiniTensor/issue/103 · f88a06f3
  PanZezhong1725 authored Dec 04, 2025
```
issue/103 新版分布式推理基建
```
  f88a06f3
- Merge pull request #101 from pengcheng888/issue/89 · 9dd10678
  pengcheng888 authored Dec 04, 2025
```
issue/89 在python的llama中使用matmul函数、以及减少Tensor对象创建次数
```
  9dd10678
- issue/103 新版分布式推理基建 · 1f5ab1c5
  PanZezhong authored Dec 04, 2025
  
  1f5ab1c5
- issue/89 针对python的llama结构，使用matmul函数、减少Tensor对象创建次数 · 7e59976b
  pengcheng888 authored Dec 04, 2025
  
  7e59976b
- Merge pull request #98 from InfiniTensor/issue/97 · 36f8eab7
  PanZezhong1725 authored Dec 04, 2025
```
issue/97 Attention 和 KVCache 支持 batch 维度
```
  36f8eab7
- Merge pull request #100 from InfiniTensor/issue/99 · 42f9d47d
  PanZezhong1725 authored Dec 04, 2025
```
issue/99 - relocated pybind contents
```
  42f9d47d