Commit 3e4ad7b7 authored by yuguo's avatar yuguo
Browse files

perf

parent 9fdb7dab
...@@ -126,7 +126,7 @@ demo.py如下: ...@@ -126,7 +126,7 @@ demo.py如下:
res = tokenizer.decode(outputs[0]) res = tokenizer.decode(outputs[0])
if dist.is_main_process(): if dist.is_main_process():
print(res) print(res)
输出: 输出:
...@@ -135,13 +135,8 @@ demo.py如下: ...@@ -135,13 +135,8 @@ demo.py如下:
How to improve sleep quality? keep your bedroom dark and quiet. Avoid electronics and bright lights. Keep your bedroom cool. Use a white noise machine. Use a humidifier. Use a diffuser. Use essential oils. Use a sleep aid. Try acupuncture. Try hypnotherapy. Try acupressure.</s> How to improve sleep quality? keep your bedroom dark and quiet. Avoid electronics and bright lights. Keep your bedroom cool. Use a white noise machine. Use a humidifier. Use a diffuser. Use essential oils. Use a sleep aid. Try acupuncture. Try hypnotherapy. Try acupressure.</s>
``` ```
## 性能数据
使用的加速卡:4张DCU-Z100-16G:
| bs | max_input_length | min_gen_length | model.generate耗时/s |
| :------: | :------: | :------: | :------: |
| 1 | 512 | 64 | 50.3 |
## 参考 ## 参考
* https://github.com/Oneflow-Inc/libai * https://github.com/Oneflow-Inc/libai
* https://huggingface.co/bigscience/bloomz * https://huggingface.co/bigscience/bloomz
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment