Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Telechat_pytorch
Commits
8f2dbdd6
Commit
8f2dbdd6
authored
Nov 11, 2024
by
dcuai
Browse files
Update README.md
parent
db1de1e2
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
10 additions
and
12 deletions
+10
-12
README.md
README.md
+10
-12
No files found.
README.md
View file @
8f2dbdd6
...
@@ -86,10 +86,9 @@ pip install auto-gptq -i https://pypi.mirrors.ustc.edu.cn/simple/
...
@@ -86,10 +86,9 @@ pip install auto-gptq -i https://pypi.mirrors.ustc.edu.cn/simple/
## 推理
测试
## 推理
### TeleChat-7B
### TeleChat-7B
进入Telechat/inference_telechat
进入Telechat/inference_telechat
```
```
...
@@ -106,25 +105,23 @@ bash infer.sh
...
@@ -106,25 +105,23 @@ bash infer.sh
bash infer.sh
bash infer.sh
```
```
## 微调训练
## 训练
```
```
cd Telechat/ms-swift/examples/pytorch/llm
cd Telechat/ms-swift/examples/pytorch/llm
```
```
### 单机单卡LORA微调训练
### 单机单卡LORA微调
```
```
bash sft_single_lora.sh
bash sft_single_lora.sh
```
```
### 单机多卡LORA微调
### 单机多卡LORA微调
训练
```
```
bash sft_multi_lora.sh
bash sft_multi_lora.sh
```
```
### 单机多卡全参微调
### 单机多卡全参微调
训练
```
```
bash sft_multi_full.sh
bash sft_multi_full.sh
...
@@ -137,9 +134,10 @@ bash sft_multi_full.sh
...
@@ -137,9 +134,10 @@ bash sft_multi_full.sh
bash infer.sh
bash infer.sh
```
```
结果如下:
## result
<div
align=
center
>

<img
src=
"./推理1.png"
/>
</div>
## 量化
## 量化
...
@@ -166,7 +164,7 @@ LLM
...
@@ -166,7 +164,7 @@ LLM
运营商、科研、教育
运营商、科研、教育
## 源码仓库及问题反馈
## 源码仓库及问题反馈
https://developer.
hpccube.com/codes/-/ide/project
/modelzoo/telechat/tree/master
/
https://developer.
sourcefind.cn/codes
/modelzoo/telechat/
-/
tree/master
## 参考资料
## 参考资料
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment