No commit message

No commit message

No commit message
25e51f9c · laibao · 1591c294 · 25e51f9c
Commit 25e51f9c authored Dec 17, 2024 by laibao
Hide whitespace changes
Inline Side-by-side

Showing with 2 additions and 0 deletions

README.md README.md +2 -0

No files found.
--- a/README.md
+++ b/README.md
@@ -212,6 +212,8 @@ ssh -L 8000:计算节点IP:8000 -L 8001:计算节点IP:8001 用户名@登录节
 vllm serve internlm/internlm2_5-7b --enforce-eager --dtype float16 --trust-remote-code --port 8000 --host "0.0.0.0"
 ```

+如果提示上下文受限，可以添加--max-model-len 64000
+
 4.启动gradio服务

 ```