Commits · 9e434492c06ea08822b7fe7b515a00d968a139f2 · jerrrrry / infinilm

18 Dec, 2025 2 commits

issue/140 准确率脚本支持torch，添加总吞吐 · 9e434492
PanZezhong authored Dec 18, 2025

9e434492

issue/122 :更新benchmark脚本和README.md (#123) · 7862a723

Ceng authored Dec 18, 2025



* issue/122 :更新benchmark脚本和README.md
Signed-off-by: Ceng23333 <441651826@qq.com>

* .
Signed-off-by: Ceng23333 <441651826@qq.com>

* fix input_ids
Signed-off-by: Ceng23333 <441651826@qq.com>

* explicitly split mmul all subject
Signed-off-by: Ceng23333 <441651826@qq.com>

---------
Signed-off-by: Ceng23333 <441651826@qq.com>

7862a723

17 Dec, 2025 1 commit
- issue/134: 统一模型配置 · cdce626e
  Jiacheng Huang authored Dec 17, 2025
  
  cdce626e
11 Dec, 2025 3 commits
- Merge pull request #126 from pengcheng888/issue/115_2 · faa5d405
  pengcheng888 authored Dec 11, 2025
```
issue/115 完善bench.py文件
```
  faa5d405
- issue/115 完善bench.py文件 · 1b5d1ea7
  pengcheng888 authored Dec 11, 2025
  
  1b5d1ea7
- Merge pull request #124 from InfiniTensor/issue/121 · 6498332e
  thatPepe authored Dec 11, 2025
```
Issue/121 - cache managements
```
  6498332e
10 Dec, 2025 3 commits
- Merge pull request #117 from InfiniTensor/issue/116 · 295aacd1
  PanZezhong1725 authored Dec 10, 2025
```
issue/116 - using batched rope
```
  295aacd1
- Merge pull request #120 from pengcheng888/issue/115 · 1b3391eb
  pengcheng888 authored Dec 10, 2025
```
issue/115 - 添加 bench.py
```
  1b3391eb
- issue/115 - 添加 bench.py · 13df67c9
  pengcheng888 authored Dec 10, 2025
  
  13df67c9
09 Dec, 2025 5 commits
- issue/116 - using batched rope · e8245b7d
  wooway777 authored Dec 09, 2025
  
  e8245b7d
- Merge pull request #119 from pengcheng888/issue/112 · 78ce921e
  PanZezhong1725 authored Dec 09, 2025
```
issue/114 - 添加读取.bin文件权重的代码，更新readme
```
  78ce921e
- issue/114 - 添加读取.bin文件权重的代码，更新readme · 300470cb
  pengcheng888 authored Dec 09, 2025
  
  300470cb
- Merge pull request #118 from InfiniTensor/issue/114 · 2abef3b7
  PanZezhong1725 authored Dec 09, 2025
```
issue/114 QKVParallelLinear, GateUpParallelLinear
```
  2abef3b7
- issue/114 QKV linear and GateUp linear · 4ea1f3b6
  PanZezhong authored Dec 09, 2025
  
  4ea1f3b6
08 Dec, 2025 3 commits
- Merge pull request #113 from pengcheng888/issue/111_1 · 81081f3c
  PanZezhong1725 authored Dec 08, 2025
```
issue/111 - 9g7b分布式
```
  81081f3c
- issue/111 - 9g7b分布式 · 39790c1e
  Your Name authored Dec 08, 2025
  
  39790c1e
- issue/106 适配模型9G7B · 9c256a17
  Ceng authored Dec 08, 2025
  
  9c256a17
07 Dec, 2025 2 commits
- Merge pull request #105 from pengcheng888/issue/102 · 39bea30a
  pengcheng888 authored Dec 07, 2025
```
issue/102 - 添加逐文件和逐tensor 读取权重文件的函数
```
  39bea30a
- issue/102 - 添加逐文件和逐tensor从model.savetensor读取权重的函数 · 7128a9a5
  pengcheng888 authored Dec 07, 2025
  
  7128a9a5
06 Dec, 2025 3 commits
- Merge pull request #108 from InfiniTensor/issue/92-b · 8c224092
  PanZezhong1725 authored Dec 06, 2025
```
issue/92 将run改为异步
```
  8c224092
- issue/92 将run改为异步 · 9c4020a4
  PanZezhong authored Dec 06, 2025
  
  9c4020a4
- issue/92 添加InferEngine，支持多线程推理 · 3d328d61
  PanZezhong1725 authored Dec 06, 2025
  
  3d328d61
05 Dec, 2025 1 commit
- fix xmake · 0794f307
  PanZezhong authored Dec 05, 2025
  
  0794f307
04 Dec, 2025 8 commits
- Merge pull request #104 from InfiniTensor/issue/103 · f88a06f3
  PanZezhong1725 authored Dec 04, 2025
```
issue/103 新版分布式推理基建
```
  f88a06f3
- Merge pull request #101 from pengcheng888/issue/89 · 9dd10678
  pengcheng888 authored Dec 04, 2025
```
issue/89 在python的llama中使用matmul函数、以及减少Tensor对象创建次数
```
  9dd10678
- issue/103 新版分布式推理基建 · 1f5ab1c5
  PanZezhong authored Dec 04, 2025
  
  1f5ab1c5
- issue/89 针对python的llama结构，使用matmul函数、减少Tensor对象创建次数 · 7e59976b
  pengcheng888 authored Dec 04, 2025
  
  7e59976b
- Merge pull request #98 from InfiniTensor/issue/97 · 36f8eab7
  PanZezhong1725 authored Dec 04, 2025
```
issue/97 Attention 和 KVCache 支持 batch 维度
```
  36f8eab7
- Merge pull request #100 from InfiniTensor/issue/99 · 42f9d47d
  PanZezhong1725 authored Dec 04, 2025
```
issue/99 - relocated pybind contents
```
  42f9d47d
- issue/99 - relocated pybind contents · 3e398429
  wooway777 authored Dec 04, 2025
  
  3e398429
- issue/97 推理脚本支持batch · 6f624c94
  PanZezhong authored Dec 04, 2025
  
  6f624c94
03 Dec, 2025 4 commits
- issue/97 Attention 和 KVCache 支持 batch 维度 · 0da7b5db
  PanZezhong authored Dec 03, 2025
  
  0da7b5db
- Merge pull request #96 from InfiniTensor/issue/95 · a1f6e517
  PanZezhong1725 authored Dec 03, 2025
```
issue/95 将pybind target命名为_infinilm
```
  a1f6e517
- issue/95 将pybind target命名为_infinilm · 38ac084d
  PanZezhong authored Dec 03, 2025
  
  38ac084d
- Merge pull request #75 from InfiniTensor/issue/74 · ae3ebe19
  PanZezhong1725 authored Dec 03, 2025
```
Issue/74 基于InfiniCore::nn::module适配Llama模型
```
  ae3ebe19
02 Dec, 2025 1 commit
- issue/74 add c++ Llama models and align to AutoLlama interface · d6a641d3
  Ceng23333 authored Dec 02, 2025
```
Signed-off-by: Ceng23333 <441651826@qq.com>
```
  d6a641d3
26 Nov, 2025 4 commits
- Merge pull request #87 from InfiniTensor/issue/86 · 3c6ad521
  PanZezhong1725 authored Nov 26, 2025
```
issue/86 - 添加计算结束前的同步函数
```
  3c6ad521
- issue/86 - 添加计算结束前的同步函数 · 0a5f4d71
  pengcheng888 authored Nov 26, 2025
  
  0a5f4d71
- Merge pull request #68 from InfiniTensor/fix_std_move · efc19d7c
  PanZezhong1725 authored Nov 26, 2025
```
removed std::move
```
  efc19d7c
- Merge pull request #84 from pengcheng888/issue/83 · fa7ca75d
  PanZezhong1725 authored Nov 26, 2025
```
issue/83 - 添加AutoLlama类，支持创建不同backend的模型
```
  fa7ca75d