Skip to content

GitLab

"src/include/utility.hpp" did not exist on "0a386c46a9f05b95b8bc5d710ffce664f5fd0d41"
Commit 348ae0f2 authored by gaoqiong's avatar gaoqiong
Browse files

增加完善lmdeploy测评步骤

parent b837f688
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
configs/eval_llama2_chat_lmdeploy.py
View file @ 348ae0f2
...@@ -20,7 +20,7 @@ models = [ ...@@ -20,7 +20,7 @@ models = [
dict( dict(
type=TurboMindModel, type=TurboMindModel,
abbr='llama-2-7b-chat-hf-lmdeploy', abbr='llama-2-7b-chat-hf-lmdeploy',
path="/dataset/llm-models/llama2/Llama-2-7b-chat-hf", path="Llama-2-7b-chat-hf",
meta_template=llama_chat_meta_template, meta_template=llama_chat_meta_template,
engine_config=dict(session_len=4096, engine_config=dict(session_len=4096,
max_batch_size=32), max_batch_size=32),
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment