Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
opencompass
Commits
b3797475
"...resnet50_tensorflow.git" did not exist on "8c7699ceacfa5bec10bccc9879705d73b0d8db85"
Commit
b3797475
authored
May 30, 2024
by
zhuwenwen
Browse files
add baichuan2-vllm config
parent
31a9e33f
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
36 additions
and
0 deletions
+36
-0
configs/eval_baichuan2_chat_vllm.py
configs/eval_baichuan2_chat_vllm.py
+36
-0
No files found.
configs/eval_baichuan2_chat_vllm.py
0 → 100644
View file @
b3797475
from
mmengine.config
import
read_base
with
read_base
():
from
.datasets.ARC_c.ARC_c_gen_1e0de5
import
ARC_c_datasets
from
.datasets.ARC_e.ARC_e_gen_1e0de5
import
ARC_e_datasets
from
.datasets.ceval.ceval_gen_5f30c7
import
ceval_datasets
from
.summarizers.example
import
summarizer
datasets
=
sum
([
v
for
k
,
v
in
locals
().
items
()
if
k
.
endswith
(
"_datasets"
)
or
k
==
'datasets'
],
[])
work_dir
=
'./outputs/baichuan2-chat/'
from
opencompass.models
import
VLLM
baichuan2_meta_template
=
dict
(
round
=
[
dict
(
role
=
'HUMAN'
,
begin
=
'<reserved_106>'
),
dict
(
role
=
'BOT'
,
begin
=
'<reserved_107>'
,
generate
=
True
),
],
)
models
=
[
dict
(
type
=
VLLM
,
abbr
=
'baichuan2-7b-chat-vllm'
,
path
=
"Baichuan2-7B-Chat"
,
model_kwargs
=
dict
(
tensor_parallel_size
=
1
),
meta_template
=
baichuan2_meta_template
,
max_out_len
=
100
,
max_seq_len
=
2048
,
batch_size
=
1
,
generation_kwargs
=
dict
(
temperature
=
0
),
run_cfg
=
dict
(
num_gpus
=
1
,
num_procs
=
1
),
)
]
\ No newline at end of file
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment