README.md 2.95 KB
Newer Older
jerrrrry's avatar
jerrrrry committed
1
2
3
4
5
6
7
8
9
10
11
12
13
# 🚀 一键启动工具集 | EasyStart v0.1

![Banner](https://placehold.co/1200x400/2a4365/white?text=EasyStart-AI-Testing-Toolkit) <!-- 建议替换为实际项目横幅图 -->

## 🌟 核心功能

| 功能模块 | 适用场景 | 特色亮点 |
|---------|----------|----------|
| **1. 环境测试** | 基础硬件验证 | ROCm带宽测试/ACS监控/全栈状态检查 |
| **2. 环境测试+模型下载+推理** | 交付验证 | 自动下载Modelscope模型/批量测试 |
| **3. 环境测试+批量推理** | 压力测试 | 支持本地模型/Docker集成 |

## 🛠️ 快速开始
jerrrrry's avatar
jerrrrry committed
14
### 1️⃣一键启动环境测试
jerrrrry's avatar
jerrrrry committed
15
16
17
18

```bash
git clone https://developer.sourcefind.cn/codes/jerrrrry/easystart_v0.1.git
cd easystart_v0.1/
jerrrrry's avatar
jerrrrry committed
19
bash start.sh
jerrrrry's avatar
jerrrrry committed
20

jerrrrry's avatar
jerrrrry committed
21
22
   测试项包含:

jerrrrry's avatar
jerrrrry committed
23
   1:rocm\_bandwidth\_test
jerrrrry's avatar
jerrrrry committed
24

jerrrrry's avatar
jerrrrry committed
25
   2:Rccl 4卡&8卡带宽测试
jerrrrry's avatar
jerrrrry committed
26

jerrrrry's avatar
jerrrrry committed
27
   3:贵哥发版的dcu\_env\_check
jerrrrry's avatar
jerrrrry committed
28

jerrrrry's avatar
jerrrrry committed
29
   4:ACS监控
jerrrrry's avatar
jerrrrry committed
30

jerrrrry's avatar
jerrrrry committed
31
32
33
34
35
36
37
38
39
   5:CPU&DCU状态

   6:存储&内存状态

   7:网络状态

   <a name="heading_1"></a>**测试结果**

   测试结果保存在 ./outputs/env\_check\_outputs
jerrrrry's avatar
jerrrrry committed
40
   ![图片描述](images/1.png)
jerrrrry's avatar
jerrrrry committed
41

jerrrrry's avatar
jerrrrry committed
42
43
44
45
46





jerrrrry's avatar
jerrrrry committed
47
48
49
50
   <a name="heading_2"></a>**2\_env\_check&model\_download&llm\_inference**

   一键启动环境测试+模型下载+llm推理:

jerrrrry's avatar
jerrrrry committed
51
   https://developer.sourcefind.cn/codes/jerrrrry/easystart_v0.1/-/tree/main/2_env_check%26model_download%26llm_inference
jerrrrry's avatar
jerrrrry committed
52

jerrrrry's avatar
jerrrrry committed
53
   |git clone https://developer.sourcefind.cn/codes/jerrrrry/easystart_v0.1.git<br>cd 2\_env\_check&model\_download&llm\_inference/<br>bash start.sh|
jerrrrry's avatar
jerrrrry committed
54
55
   | :- |

jerrrrry's avatar
jerrrrry committed
56
57
   ![图片描述](images/2.png)

jerrrrry's avatar
jerrrrry committed
58
59
60
61
   只需将要测试的模型ID**(对应modelscope的模型ID)**传入**download-list.cfg**

   <a name="heading_3"></a>**Tips**

jerrrrry's avatar
jerrrrry committed
62
   1:download-list.cfg里的格式为:**模型ID;本地保存路径**
jerrrrry's avatar
jerrrrry committed
63

jerrrrry's avatar
jerrrrry committed
64
65
   ![图片描述](images/3.png)

jerrrrry's avatar
jerrrrry committed
66
   2:可以写入多个模型下载且**会进行批量测试**
jerrrrry's avatar
jerrrrry committed
67

jerrrrry's avatar
jerrrrry committed
68
   3:模型测试参数通过**model\_to\_test.cfg**传入,**需注意model\_to\_test.cfg的传参格式**
jerrrrry's avatar
jerrrrry committed
69

jerrrrry's avatar
jerrrrry committed
70
71
   ![图片描述](images/4.png)

jerrrrry's avatar
jerrrrry committed
72
73
74
75
76
77
   <a name="heading_4"></a>**测试结果**

   测试结果保存在 ./outputs/env\_check\_outputs和 ./outputs/inference\_outputs

   下载的模型会保存在 ./outputs/models

jerrrrry's avatar
jerrrrry committed
78
79
   ![图片描述](images/5.png)

jerrrrry's avatar
jerrrrry committed
80
81
   <a name="heading_5"></a>**推理结果**

jerrrrry's avatar
jerrrrry committed
82
83
   ![图片描述](images/6.png)

jerrrrry's avatar
jerrrrry committed
84
85
   <a name="heading_6"></a>**测试日志**

jerrrrry's avatar
jerrrrry committed
86
87
   ![图片描述](images/7.png)

jerrrrry's avatar
jerrrrry committed
88
89
90
91
   <a name="heading_7"></a>**3\_env\_check&batches\_llm\_inference**

   一键启动环境测试+批量llm推理:

jerrrrry's avatar
jerrrrry committed
92
   https://developer.sourcefind.cn/codes/jerrrrry/easystart_v0.1/-/tree/main/3_env_check%26batches_llm_inference
jerrrrry's avatar
jerrrrry committed
93

jerrrrry's avatar
jerrrrry committed
94
   |git clone https://developer.sourcefind.cn/codes/jerrrrry/easystart_v0.1.git<br>cd 3\_env\_check&batches\_llm\_inference/<br>bash start.sh|
jerrrrry's avatar
jerrrrry committed
95
96
97
98
99
100
101
102
103
104
   | :- |

   **只需在start.sh中挂载本地大模型到docker里** 

   **修改model\_to\_test.cfg里的测试参数**

   <a name="heading_8"></a>**测试结果**

   测试结果保存在 ./outputs/inference\_outputs

jerrrrry's avatar
jerrrrry committed
105
106
   ![图片描述](images/8.png)