Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
opencompass
Commits
0b7de67c
Unverified
Commit
0b7de67c
authored
Apr 28, 2024
by
bittersweet1999
Committed by
GitHub
Apr 28, 2024
Browse files
fix prompt template (#1104)
parent
1013dce6
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
13 additions
and
6 deletions
+13
-6
configs/eval_internlm_flames_chat.py
configs/eval_internlm_flames_chat.py
+13
-6
No files found.
configs/eval_internlm_flames_chat.py
View file @
0b7de67c
...
@@ -68,6 +68,13 @@ infer = dict(
...
@@ -68,6 +68,13 @@ infer = dict(
## ------------- JudgeLLM Configuration---------------------------------
## ------------- JudgeLLM Configuration---------------------------------
internlm1_chat_template
=
dict
(
round
=
[
dict
(
role
=
'HUMAN'
,
begin
=
'<|User|>:'
,
end
=
'
\n
'
),
dict
(
role
=
'BOT'
,
begin
=
'<|Bot|>:'
,
end
=
'<eoa>
\n
'
,
generate
=
True
),
],
)
judge_models
=
[
judge_models
=
[
dict
(
dict
(
type
=
HuggingFaceCausalLM
,
type
=
HuggingFaceCausalLM
,
...
@@ -84,17 +91,17 @@ judge_models = [
...
@@ -84,17 +91,17 @@ judge_models = [
use_fast
=
False
,
use_fast
=
False
,
trust_remote_code
=
True
,
trust_remote_code
=
True
,
),
),
max_out_len
=
2048
,
generation_kwargs
=
{
"do_sample"
:
True
},
max_seq_len
=
2048
,
max_out_len
=
512
,
max_seq_len
=
4096
,
batch_size
=
8
,
batch_size
=
8
,
meta_template
=
_meta
_template
,
meta_template
=
internlm1_chat
_template
,
run_cfg
=
dict
(
num_gpus
=
1
,
num_procs
=
1
),
run_cfg
=
dict
(
num_gpus
=
1
,
num_procs
=
1
),
end_str
=
'<|im_end|>'
,
end_str
=
'<eoa>'
,
generation_kwargs
=
{
"eos_token_id"
:
[
2
,
92542
],
"do_sample"
:
True
},
batch_padding
=
True
,
)
)
]
]
## ------------- Evaluation Configuration----------------
## ------------- Evaluation Configuration----------------
eval
=
dict
(
eval
=
dict
(
partitioner
=
dict
(
partitioner
=
dict
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment