Commit b5dc26d0 authored by dcuai's avatar dcuai
Browse files

Update README.md

parent 6c44fc97
# FinGPT
# FinGPT-glm
## 论文
- [论文地址] [FinGPT: Open-Source Financial Large Language Models](https://arxiv.org/abs/2306.06031)
- [FinGPT: Open-Source Financial Large Language Models](https://arxiv.org/abs/2306.06031)
## 模型结构
GLM是一个开放的双语(中英)双向密集模型,使用通用语言模型(GLM)算法进行预训练。GLM是一种基于Transformer的语言模型,以自回归空白填充为训练目标。
......@@ -23,8 +23,6 @@ docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-ubuntu22.04-dt
docker run -it -v /path/your_code_data/:/path/your_code_data/ -v /opt/hyhal/:/opt/hyhal/:ro --shm-size=64G --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name fingpt <your imageID> bash
docker exec -it fingpt bash
cd /path/your_code_data/FinGPT
pip install -r requirements.txt -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
......@@ -34,7 +32,7 @@ pip install deepspeed-0.12.3+gitfe61783.abi0.dtk2310.torch2.1.0a0-cp310-cp310-ma
### Dockerfile(方法二)
```
cd /path/your_code_data/FinGPT/docker
cd docker
docker build --no-cache -t fingpt:latest .
......@@ -45,17 +43,16 @@ cd /path/your_code_data/FinGPT
pip install deepspeed-0.12.3+gitfe61783.abi0.dtk2310.torch2.1.0a0-cp310-cp310-manylinux2014_x86_64.whl
```
### Anaconda(方法三)
关于本项目DCU显卡所需的特殊深度学习库可从光合开发者社区下载安装:
https://developer.hpccube.com/tool/
```
DTK驱动:dtk23.10
python:python3.10
torch: 2.1.0
transformers: >=4.37.2
torchvision: 0.16.0
apex: 1.1.0
deepspped: 0.12.3
datasets: 2.14.3
accelerate: 0.27.2
peft: 0.10.0
trl: 0.8.1
gradio: >=3.38.0,<=4.0.0
```
`Tips:以上dtk驱动、python、paddle等DCU相关工具版本需要严格一一对应`
......@@ -107,6 +104,7 @@ python data_process.py
```
## 训练
根据实际情况在脚本中修改权重相关路径
### 单机多卡
```
bash multi_dcu_train.sh
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment