Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Qwen-7B_fastllm
Commits
9869dc3e
"vscode:/vscode.git/clone" did not exist on "180ab8c8464d1c2a22556df9923696bbc2c92076"
Commit
9869dc3e
authored
Nov 08, 2023
by
zhouxiang
Browse files
修改readme
parent
597fe8a4
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
2 deletions
+2
-2
README.md
README.md
+1
-1
cli_demo_batch.py
cli_demo_batch.py
+1
-1
No files found.
README.md
View file @
9869dc3e
...
...
@@ -76,7 +76,7 @@ python setup.py install
# 如果有现成的原版qwen-7b的运行环境中,可以将模型转换脚本qwen2flm.py移动到原版qwen-7b的运行环境中,
# 也可以通过执行pip install -r requirements.txt安装模型转换所需依赖;
# 如果使用已经下载完成的模型或者自己finetune的模型需要修改qwen2flm.py文件中创建tokenizer, model时的模型存放路径
# 执行:
#
在本工程目录下
执行:
python3 qwen2flm.py qwen-7b-fp16.bin float16 # 导出fp16模型,参数为导出的模型路径
python3 qwen2flm.py qwen-7b-int8.bin int8 # 导出int8模型,参数为导出的模型路径
```
...
...
cli_demo_batch.py
View file @
9869dc3e
...
...
@@ -13,7 +13,7 @@ if __name__ == "__main__":
model_path
=
args
.
path
prompts
=
[
"深圳有什么好玩的"
,
"上海有什么好玩的"
,
"晚上睡不着怎么办"
,
"南京有什么好吃的"
]
prompts
=
[
"深圳有什么好玩的"
,
"上海有什么好玩的"
,
"晚上睡不着怎么办"
,
"南京有什么好吃的"
]
*
2
print
(
prompts
)
responses
,
historys
=
[],
[]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment