Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
opencompass
Commits
edb23d15
Unverified
Commit
edb23d15
authored
Jul 17, 2023
by
Leymore
Committed by
GitHub
Jul 17, 2023
Browse files
[Feature] Add baichuan13b model configs (#60)
* [Feature] Add baichuan13b * update num_gpus
parent
1326aff7
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
40 additions
and
0 deletions
+40
-0
configs/models/hf_baichuan_13b_base.py
configs/models/hf_baichuan_13b_base.py
+20
-0
configs/models/hf_baichuan_13b_chat.py
configs/models/hf_baichuan_13b_chat.py
+20
-0
No files found.
configs/models/hf_baichuan_13b_base.py
0 → 100644
View file @
edb23d15
from
opencompass.models
import
HuggingFaceCausalLM
models
=
[
dict
(
type
=
HuggingFaceCausalLM
,
abbr
=
'baichuan-13b-base-hf'
,
path
=
"baichuan-inc/Baichuan-13B-Base"
,
tokenizer_path
=
'baichuan-inc/Baichuan-13B-Base'
,
tokenizer_kwargs
=
dict
(
padding_side
=
'left'
,
truncation_side
=
'left'
,
trust_remote_code
=
True
,
use_fast
=
False
,),
max_out_len
=
100
,
max_seq_len
=
2048
,
batch_size
=
8
,
model_kwargs
=
dict
(
device_map
=
'auto'
,
trust_remote_code
=
True
,
revision
=
'77d74f449c4b2882eac9d061b5a0c4b7c1936898'
),
run_cfg
=
dict
(
num_gpus
=
2
,
num_procs
=
1
),
)
]
configs/models/hf_baichuan_13b_chat.py
0 → 100644
View file @
edb23d15
from
opencompass.models
import
HuggingFaceCausalLM
models
=
[
dict
(
type
=
HuggingFaceCausalLM
,
abbr
=
'baichuan-13b-chat-hf'
,
path
=
"baichuan-inc/Baichuan-13B-Chat"
,
tokenizer_path
=
'baichuan-inc/Baichuan-13B-Chat'
,
tokenizer_kwargs
=
dict
(
padding_side
=
'left'
,
truncation_side
=
'left'
,
trust_remote_code
=
True
,
use_fast
=
False
,),
max_out_len
=
100
,
max_seq_len
=
2048
,
batch_size
=
8
,
model_kwargs
=
dict
(
device_map
=
'auto'
,
trust_remote_code
=
True
,
revision
=
'75cc8a7e5220715ebccb771581e6ca8c1377cf71'
),
run_cfg
=
dict
(
num_gpus
=
2
,
num_procs
=
1
),
)
]
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment