Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Mistral-Small_pytorch
Commits
e9c00134
Commit
e9c00134
authored
Jun 20, 2025
by
chenych
Browse files
Change docker
parent
4a17b888
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
7 deletions
+2
-7
README.md
README.md
+1
-6
docker/Dockerfile
docker/Dockerfile
+1
-1
No files found.
README.md
View file @
e9c00134
...
...
@@ -23,7 +23,7 @@ Mistral Small 3.1 (25.03) 是一款多用途模型,专为编程、数学推理
### Docker(方法一)
```
bash
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:vllm0.8.5-ubuntu22.04-dtk25.04-rc7-das1.5-py3.10-20250
521
-fixpy-rocblas0
521-beta
2
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:vllm0.8.5-ubuntu22.04-dtk25.04-rc7-das1.5-py3.10-20250
612
-fixpy-rocblas0
611-rc
2
docker run
-it
--shm-size
200g
--network
=
host
--name
{
docker_name
}
--privileged
--device
=
/dev/kfd
--device
=
/dev/dri
--device
=
/dev/mkfd
--group-add
video
--cap-add
=
SYS_PTRACE
--security-opt
seccomp
=
unconfined
-u
root
-v
/path/your_code_data/:/path/your_code_data/
-v
/opt/hyhal/:/opt/hyhal/:ro
{
imageID
}
bash
cd
/your_code_path/mistral-small_pytorch
...
...
@@ -86,11 +86,6 @@ SFT训练脚本示例,参考`llama-factory/train_lora`下对应yaml文件。
## 推理
### vllm 推理
#### offline
需要先修改vllm代码:如图
<div
align=
center
>
<img
src=
"./doc/img_v3_02n6_c32e8a36-8338-4dff-9aec-d710746a61fg.jpg"
/>
</div>
修改完成后,执行下面的方法。
```
bash
python infer_vllm.py
--model_name_or_path
/path_of/model
...
...
docker/Dockerfile
View file @
e9c00134
FROM
image.sourcefind.cn:5000/dcu/admin/base/custom:vllm0.8.5-ubuntu22.04-dtk25.04-rc7-das1.5-py3.10-20250521-fixpy-rocblas0521-beta2
\ No newline at end of file
FROM
image.sourcefind.cn:5000/dcu/admin/base/custom:vllm0.8.5-ubuntu22.04-dtk25.04-rc7-das1.5-py3.10-20250612-fixpy-rocblas0611-rc2
\ No newline at end of file
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment