Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
BERT-Large-squad_onnxruntime
Commits
dac33d3a
"vscode:/vscode.git/clone" did not exist on "2c6a6c97b3ff07b4b80ed3b53518d42eb38d4295"
Commit
dac33d3a
authored
Sep 24, 2024
by
dcuai
Browse files
Update dtk2404
parent
6d6a90c4
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
4 deletions
+6
-4
README.md
README.md
+6
-4
No files found.
README.md
View file @
dac33d3a
# bert_large_squad_
onnxruntime
# bert_large_squad_
## 论文
[
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
](
https://arxiv.org/pdf/1810.04805.pdf
)
## 模型结构
...
...
@@ -11,11 +11,12 @@ bert_large_squad模型的主要参数为:24个transformer层、1024个hidden s

## 数据集
暂无合适中文数据集
## 环境配置
在
[
光源
](
https://www.sourcefind.cn/#/service-details
)
可拉取推理的docker镜像
,在
[
光合开发者社区
](
https://cancon.hpccube.com:65024/4/main/
)
可下载onnxruntime安装包
。bert_large_squad_onnx推荐的镜像如下:
在
[
光源
](
https://www.sourcefind.cn/#/service-details
)
可拉取推理的docker镜像。bert_large_squad_onnx推荐的镜像如下:
```
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:ort1.1
4
.0_migraphx
3.0.0-dtk22.10.1
docker run -d -t --privileged --device=/dev/kfd --device=/dev/dri/ --network=host --group-add video --name bert-test image.sourcefind.cn:5000/dcu/admin/base/custom:ort1.1
4
.0_migraphx
3.0.0-dtk22.10.1
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:ort1.1
5
.0_migraphx
4.2.2_dtk2404
docker run -d -t --privileged
--shm-size=32g
--device=/dev/kfd --device=/dev/dri/ --network=host --group-add video --name bert-test
-v /opt/hyhal:/opt/hyhal:ro
image.sourcefind.cn:5000/dcu/admin/base/custom:ort1.1
5
.0_migraphx
4.2.2_dtk2404 bash
docker exec -it bert-test bash
```
在
[
huggingface
](
https://huggingface.co/ctuning/mlperf-inference-bert-onnx-fp32-squad-v1.1
)
下载模型model.onnx到当前目录
...
...
@@ -32,6 +33,7 @@ python3 fp16-convert.py
```
python3 main.py
```
## result

### 精度
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment