Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
opencompass
Commits
5f2e7c34
Unverified
Commit
5f2e7c34
authored
Jul 06, 2023
by
Leymore
Committed by
GitHub
Jul 06, 2023
Browse files
Add models (#18)
* Add models * Add comments
parent
7596c356
Changes
22
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
46 additions
and
0 deletions
+46
-0
configs/models/hf_vicuna_v1.3_7b.py
configs/models/hf_vicuna_v1.3_7b.py
+22
-0
configs/models/hf_wizardlm_7b.py
configs/models/hf_wizardlm_7b.py
+24
-0
No files found.
configs/models/hf_vicuna_v1.3_7b.py
0 → 100644
View file @
5f2e7c34
from
opencompass.models
import
HuggingFaceCausalLM
models
=
[
dict
(
type
=
HuggingFaceCausalLM
,
abbr
=
'vicuna-7b-hf'
,
path
=
"lmsys/vicuna-7b-v1.3"
,
tokenizer_path
=
'lmsys/vicuna-7b-v1.3'
,
tokenizer_kwargs
=
dict
(
padding_side
=
'left'
,
truncation_side
=
'left'
,
use_fast
=
False
,
),
max_out_len
=
100
,
max_seq_len
=
2048
,
batch_size
=
8
,
model_kwargs
=
dict
(
device_map
=
'auto'
),
batch_padding
=
False
,
# if false, inference with for-loop without batch padding
run_cfg
=
dict
(
num_gpus
=
1
,
num_procs
=
1
)
)
]
configs/models/hf_wizardlm_7b.py
0 → 100644
View file @
5f2e7c34
from
opencompass.models
import
HuggingFaceCausalLM
models
=
[
dict
(
type
=
HuggingFaceCausalLM
,
abbr
=
'wizardlm-7b-hf'
,
path
=
'TheBloke/wizardLM-7B-HF'
,
tokenizer_path
=
'TheBloke/wizardLM-7B-HF'
,
tokenizer_kwargs
=
dict
(
padding_side
=
'left'
,
truncation_side
=
'left'
,
trust_remote_code
=
True
,
),
max_out_len
=
100
,
max_seq_len
=
2048
,
batch_size
=
8
,
model_kwargs
=
dict
(
device_map
=
'auto'
,
trust_remote_code
=
True
,
),
run_cfg
=
dict
(
num_gpus
=
1
,
num_procs
=
1
),
)
]
Prev
1
2
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment