Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
LLAMA_paddle
Commits
58bee01b
Commit
58bee01b
authored
Jan 04, 2024
by
yuguo-Jack
Browse files
readme
parent
cc5c9409
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
0 deletions
+8
-0
README.md
README.md
+8
-0
No files found.
README.md
View file @
58bee01b
...
@@ -236,6 +236,8 @@ python3 -u -m paddle.distributed.launch --gpus "0,1,2,3,4,5,6,7" finetune_gener
...
@@ -236,6 +236,8 @@ python3 -u -m paddle.distributed.launch --gpus "0,1,2,3,4,5,6,7" finetune_gener
### 训练benchmark
### 训练benchmark
使用的GPGPU:8张DCU-Z100L-32G。
数据集使用
[
tatsu-lab/alpaca · Datasets at Hugging Face
](
https://huggingface.co/datasets/tatsu-lab/alpaca
)
,将数据集放置在./examples/benchmark/peft/paddle下:
数据集使用
[
tatsu-lab/alpaca · Datasets at Hugging Face
](
https://huggingface.co/datasets/tatsu-lab/alpaca
)
,将数据集放置在./examples/benchmark/peft/paddle下:
```
```
...
@@ -256,6 +258,8 @@ RCCL_NCHANNELS=8 HSA_FORCE_FINE_GRAIN_PCIE=1 python3 -m paddle.distributed.launc
...
@@ -256,6 +258,8 @@ RCCL_NCHANNELS=8 HSA_FORCE_FINE_GRAIN_PCIE=1 python3 -m paddle.distributed.launc
### 推理benchmark 1
### 推理benchmark 1
使用的GPGPU:1张DCU-Z100L-32G。
```
```
cd ./examples/benchmark/peft/paddle
cd ./examples/benchmark/peft/paddle
python3 inference_benchmark.py --model_name_or_path facebook/llama-13b --dtype float16 --do_forward --do_generate
python3 inference_benchmark.py --model_name_or_path facebook/llama-13b --dtype float16 --do_forward --do_generate
...
@@ -263,6 +267,8 @@ python3 inference_benchmark.py --model_name_or_path facebook/llama-13b --dtyp
...
@@ -263,6 +267,8 @@ python3 inference_benchmark.py --model_name_or_path facebook/llama-13b --dtyp
### 推理benchmark 2(换用[PaddleNLP-develop](https://github.com/PaddlePaddle/PaddleNLP/tree/28158b9735837495e6c73f848925e1d72b821863))
### 推理benchmark 2(换用[PaddleNLP-develop](https://github.com/PaddlePaddle/PaddleNLP/tree/28158b9735837495e6c73f848925e1d72b821863))
使用的GPGPU:1张DCU-Z100L-32G。
```
```
pip3 uninstall paddlenlp
pip3 uninstall paddlenlp
cd ./llm
cd ./llm
...
@@ -272,6 +278,8 @@ python3 predictor.py --model_name_or_path facebook/llama-13b --dtype float16 --s
...
@@ -272,6 +278,8 @@ python3 predictor.py --model_name_or_path facebook/llama-13b --dtype float16 --s
### LAMBADA推理评估
### LAMBADA推理评估
使用的GPGPU:1张DCU-Z100L-32G。
```
```
cd ./examples/benchmark/lambada
cd ./examples/benchmark/lambada
wget https://paddlenlp.bj.bcebos.com/data/benchmark/lambada_test.jsonl
wget https://paddlenlp.bj.bcebos.com/data/benchmark/lambada_test.jsonl
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment