Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
opencompass
Commits
29598e36
Unverified
Commit
29598e36
authored
Jul 18, 2023
by
Hubert
Committed by
GitHub
Jul 18, 2023
Browse files
[Feat] add falcon-40b (#76)
* [Feat] add falcon-40b * minor fix
parent
311bf0da
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
21 additions
and
0 deletions
+21
-0
configs/models/hf_falcon_40b.py
configs/models/hf_falcon_40b.py
+21
-0
No files found.
configs/models/hf_falcon_40b.py
0 → 100644
View file @
29598e36
# Only torch >=2.0 is supported for falcon-40b
from
opencompass.models
import
HuggingFaceCausalLM
models
=
[
dict
(
type
=
HuggingFaceCausalLM
,
abbr
=
'falcon-40b-hf'
,
path
=
'tiiuae/falcon-40b'
,
tokenizer_path
=
'tiiuae/falcon-40b'
,
tokenizer_kwargs
=
dict
(
padding_side
=
'left'
,
truncation_side
=
'left'
,
trust_remote_code
=
True
,
),
max_out_len
=
100
,
max_seq_len
=
2048
,
batch_size
=
8
,
model_kwargs
=
dict
(
trust_remote_code
=
True
,
device_map
=
'auto'
,
revision
=
'561820f7eef0cc56a31ea38af15ca1acb07fab5d'
),
run_cfg
=
dict
(
num_gpus
=
4
,
num_procs
=
1
),
)
]
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment