Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
FinGPT-glm_pytorch
Commits
b5dc26d0
Commit
b5dc26d0
authored
May 22, 2024
by
dcuai
Browse files
Update README.md
parent
6c44fc97
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
9 additions
and
11 deletions
+9
-11
README.md
README.md
+9
-11
No files found.
README.md
View file @
b5dc26d0
# FinGPT
# FinGPT
-glm
## 论文
## 论文
-
[
论文地址]
[FinGPT: Open-Source Financial Large Language Models
](
https://arxiv.org/abs/2306.06031
)
-
[
FinGPT: Open-Source Financial Large Language Models
](
https://arxiv.org/abs/2306.06031
)
## 模型结构
## 模型结构
GLM是一个开放的双语(中英)双向密集模型,使用通用语言模型(GLM)算法进行预训练。GLM是一种基于Transformer的语言模型,以自回归空白填充为训练目标。
GLM是一个开放的双语(中英)双向密集模型,使用通用语言模型(GLM)算法进行预训练。GLM是一种基于Transformer的语言模型,以自回归空白填充为训练目标。
...
@@ -23,8 +23,6 @@ docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-ubuntu22.04-dt
...
@@ -23,8 +23,6 @@ docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-ubuntu22.04-dt
docker run -it -v /path/your_code_data/:/path/your_code_data/ -v /opt/hyhal/:/opt/hyhal/:ro --shm-size=64G --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name fingpt <your imageID> bash
docker run -it -v /path/your_code_data/:/path/your_code_data/ -v /opt/hyhal/:/opt/hyhal/:ro --shm-size=64G --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name fingpt <your imageID> bash
docker exec -it fingpt bash
cd /path/your_code_data/FinGPT
cd /path/your_code_data/FinGPT
pip install -r requirements.txt -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
pip install -r requirements.txt -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
...
@@ -34,7 +32,7 @@ pip install deepspeed-0.12.3+gitfe61783.abi0.dtk2310.torch2.1.0a0-cp310-cp310-ma
...
@@ -34,7 +32,7 @@ pip install deepspeed-0.12.3+gitfe61783.abi0.dtk2310.torch2.1.0a0-cp310-cp310-ma
### Dockerfile(方法二)
### Dockerfile(方法二)
```
```
cd
/path/your_code_data/FinGPT/
docker
cd docker
docker build --no-cache -t fingpt:latest .
docker build --no-cache -t fingpt:latest .
...
@@ -45,17 +43,16 @@ cd /path/your_code_data/FinGPT
...
@@ -45,17 +43,16 @@ cd /path/your_code_data/FinGPT
pip install deepspeed-0.12.3+gitfe61783.abi0.dtk2310.torch2.1.0a0-cp310-cp310-manylinux2014_x86_64.whl
pip install deepspeed-0.12.3+gitfe61783.abi0.dtk2310.torch2.1.0a0-cp310-cp310-manylinux2014_x86_64.whl
```
```
### Anaconda(方法三)
### Anaconda(方法三)
关于本项目DCU显卡所需的特殊深度学习库可从光合开发者社区下载安装:
https://developer.hpccube.com/tool/
```
```
DTK驱动:dtk23.10
DTK驱动:dtk23.10
python:python3.10
python:python3.10
torch: 2.1.0
torch: 2.1.0
transformers: >=4.37.2
torchvision: 0.16.0
apex: 1.1.0
deepspped: 0.12.3
deepspped: 0.12.3
datasets: 2.14.3
accelerate: 0.27.2
peft: 0.10.0
trl: 0.8.1
gradio: >=3.38.0,<=4.0.0
```
```
`Tips:以上dtk驱动、python、paddle等DCU相关工具版本需要严格一一对应`
`Tips:以上dtk驱动、python、paddle等DCU相关工具版本需要严格一一对应`
...
@@ -107,6 +104,7 @@ python data_process.py
...
@@ -107,6 +104,7 @@ python data_process.py
```
```
## 训练
## 训练
根据实际情况在脚本中修改权重相关路径
### 单机多卡
### 单机多卡
```
```
bash multi_dcu_train.sh
bash multi_dcu_train.sh
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment