Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
ChatGLM2-6B_fastllm
Commits
6d950647
Commit
6d950647
authored
Sep 11, 2023
by
zhouxiang
Browse files
修改readme描述
parent
f43c9349
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
12 additions
and
1 deletion
+12
-1
README.md
README.md
+10
-0
cli_demo.py
cli_demo.py
+2
-1
No files found.
README.md
View file @
6d950647
...
...
@@ -15,6 +15,16 @@ ChatGLM**2**-6B 是开源中英双语对话模型 [ChatGLM-6B](https://github.co
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:glm-ft-v1.0
```
### 容器启动
模型推理容器启动命令参考如下,用户根据需要修改:
```
# <container_name> 自定义容器名
# <project_path> 当前工程所在路径
docker run -it --name=<container_name> -v <project_path>:/work --device=/dev/kfd --device=/dev/dri --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --shm-size=16G --group-add 39 image.sourcefind.cn:5000/dcu/admin/base/custom:glm-ft-v1.0 /bin/bash
```
### 安装方法
```
...
...
cli_demo.py
View file @
6d950647
# coding=utf-8
import
argparse
from
fastllm_pytools
import
llm
def
args_parser
():
parser
=
argparse
.
ArgumentParser
(
description
=
'
fastl
lm_chat_demo'
)
parser
=
argparse
.
ArgumentParser
(
description
=
'
g
lm_chat_demo'
)
parser
.
add_argument
(
'-p'
,
'--path'
,
type
=
str
,
required
=
True
,
default
=
''
,
help
=
'模型文件的路径'
)
args
=
parser
.
parse_args
()
return
args
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment