Skip to content

GitLab

Commit 25e51f9c authored by laibao's avatar laibao
Browse files

No commit message 

No commit message
parent 1591c294
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
README.md
View file @ 25e51f9c
...@@ -212,6 +212,8 @@ ssh -L 8000:计算节点IP:8000 -L 8001:计算节点IP:8001 用户名@登录节 ...@@ -212,6 +212,8 @@ ssh -L 8000:计算节点IP:8000 -L 8001:计算节点IP:8001 用户名@登录节
vllm serve internlm/internlm2_5-7b --enforce-eager --dtype float16 --trust-remote-code --port 8000 --host "0.0.0.0" vllm serve internlm/internlm2_5-7b --enforce-eager --dtype float16 --trust-remote-code --port 8000 --host "0.0.0.0"
``` ```
如果提示上下文受限，可以添加--max-model-len 64000
4.启动gradio服务 4.启动gradio服务
``` ```
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment