Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
MiniMax_vllm
Commits
a65153cc
Commit
a65153cc
authored
Jul 07, 2025
by
chenzk
Browse files
v1.0.3
parent
382e4bc3
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
README.md
README.md
+2
-2
No files found.
README.md
View file @
a65153cc
...
...
@@ -158,7 +158,7 @@ docker run -it --shm-size=192G --network=host --ipc=host -p 8000:8000 -v $PWD/Mi
```
cd /home/MiniMax-M1/docker
docker build --no-cache -t minimax:latest .
docker run --shm-size=192G --name minimax --network=host --ipc=host -p 8000:8000 -v /opt/hyhal:/opt/hyhal:ro --privileged=true --device=/dev/kfd --device=/
/
dev/dri/ --group-add video -v $PWD/../../MiniMax-M1:/home/MiniMax-M1 -it minimax bash
docker run --shm-size=192G --name minimax --network=host --ipc=host -p 8000:8000 -v /opt/hyhal:/opt/hyhal:ro --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video -v $PWD/../../MiniMax-M1:/home/MiniMax-M1 -it minimax bash
# 若遇到Dockerfile启动的方式安装环境需要长时间等待,可注释掉里面的pip安装,启动容器后再安装python库:pip install -r requirements.txt。
```
### Anaconda(方法三)
...
...
@@ -229,7 +229,7 @@ curl http://0.0.0.0:8000/v1/chat/completions -H "Content-Type: application/j
方法二:vllm离线推理
python infer_vllm.py # 此处以MiniMax-M1-40k进行示例,MiniMax-M1-80k的推理方式同理,MiniMax-M1-80k的最低硬件需求与MiniMax-M1-40k几乎一致。
# 对于报错:AttributeError: 'NoneType' object has no attribute 'info'
# 注释掉此行原始代码的logger日志打印即可:/usr/local/lib/python3.10/dist-packages/vllm/executor/ray_distributed_executor.py", line 127
# 注释掉此行原始代码的logger日志打印即可:
"
/usr/local/lib/python3.10/dist-packages/vllm/executor/ray_distributed_executor.py", line 127
```
更多资料可参考源项目中的
[
`README_origin`
](
./README_origin.md
)
。
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment