Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
UMT5_pytorch
Commits
3250979c
Commit
3250979c
authored
Aug 22, 2024
by
wanglch
Browse files
Delete config.json
parent
941374e6
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
32 deletions
+0
-32
umt5_base/config.json
umt5_base/config.json
+0
-32
No files found.
umt5_base/config.json
deleted
100644 → 0
View file @
941374e6
{
"_name_or_path"
:
"ArthurZ/umt5-base"
,
"architectures"
:
[
"UMT5ForConditionalGeneration"
],
"d_ff"
:
2048
,
"d_kv"
:
64
,
"d_model"
:
768
,
"decoder_start_token_id"
:
0
,
"dense_act_fn"
:
"gelu_new"
,
"dropout_rate"
:
0.1
,
"eos_token_id"
:
1
,
"feed_forward_proj"
:
"gated-gelu"
,
"initializer_factor"
:
1.0
,
"is_encoder_decoder"
:
true
,
"is_gated_act"
:
true
,
"layer_norm_epsilon"
:
1e-06
,
"num_decoder_layers"
:
12
,
"num_heads"
:
12
,
"num_layers"
:
12
,
"output_past"
:
true
,
"pad_token_id"
:
0
,
"relative_attention_max_distance"
:
128
,
"relative_attention_num_buckets"
:
32
,
"scalable_attention"
:
true
,
"tie_word_embeddings"
:
false
,
"tokenizer_class"
:
"T5Tokenizer"
,
"torch_dtype"
:
"float32"
,
"transformers_version"
:
"4.31.0.dev0"
,
"use_cache"
:
true
,
"vocab_size"
:
256384
}
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment