Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
InternLM_vllm
Commits
89e69f24
Commit
89e69f24
authored
Nov 27, 2024
by
laibao
Browse files
No commit message
No commit message
parent
b4c46fe7
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
6 additions
and
3 deletions
+6
-3
README.md
README.md
+6
-3
doc/internlm_logo.png
doc/internlm_logo.png
+0
-0
image/README/1732692191521.png
image/README/1732692191521.png
+0
-0
No files found.
README.md
View file @
89e69f24
# Internlm_vllm
# Internlm_vllm

## 论文
## 论文
`InternLM2 Technical Report`
`InternLM2 Technical Report`
...
@@ -77,8 +79,8 @@ conda create -n internlm_vllm python=3.10
...
@@ -77,8 +79,8 @@ conda create -n internlm_vllm python=3.10
### 模型下载
### 模型下载
| 基座模型
|
|
|
|
| 基座模型
|
|
|
|
| -----------------------------------------------------------
|
----------------------------------------------------------- | -------------------------------------------------------------
|
--------------------------------------------------------------- |
| -----------------------------------------------------------
------------------ | ------------------
----------------------------------------------------------- | -------------------------------------------------------------
------------------ | ------------------
--------------------------------------------------------------- |
|
[
internlm2-7b
](
http://113.200.138.88:18080/aimodels/internlm/internlm2-7b.git
)
|
[
internlm2-20b
](
http://113.200.138.88:18080/aimodels/internlm/internlm2-20b.git
)
|
[
internlm2_5-7b
](
http://113.200.138.88:18080/aimodels/internlm/internlm2_5-7b.git
)
|
[
internlm2_5-20b
](
http://113.200.138.88:18080/aimodels/internlm/internlm2_5-20b.git
)
|
|
[
internlm2-7b
](
http://113.200.138.88:18080/aimodels/internlm/internlm2-7b.git
)
|
[
internlm2-20b
](
http://113.200.138.88:18080/aimodels/internlm/internlm2-20b.git
)
|
[
internlm2_5-7b
](
http://113.200.138.88:18080/aimodels/internlm/internlm2_5-7b.git
)
|
[
internlm2_5-20b
](
http://113.200.138.88:18080/aimodels/internlm/internlm2_5-20b.git
)
|
### 离线批量推理
### 离线批量推理
...
@@ -199,11 +201,12 @@ python gradio_openai_chatbot_webserver.py --model "internlm/internlm2_5-7b" --m
...
@@ -199,11 +201,12 @@ python gradio_openai_chatbot_webserver.py --model "internlm/internlm2_5-7b" --m
```
```
chmod +x frpc_linux_amd64_v0.*
chmod +x frpc_linux_amd64_v0.*
```
```
2.
3 端口映射
2.
3 端口映射
```
```
ssh -L 8000:计算节点IP:8000 -L 8001:计算节点IP:8001 用户名@登录节点 -p 登录节点端口
ssh -L 8000:计算节点IP:8000 -L 8001:计算节点IP:8001 用户名@登录节点 -p 登录节点端口
```
```
3.
启动OpenAI兼容服务
3.
启动OpenAI兼容服务
...
...
doc/internlm_logo.png
0 → 100644
View file @
89e69f24
7.22 KB
image/README/1732692191521.png
0 → 100644
View file @
89e69f24
7.22 KB
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment