Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
21e128d8
Commit
21e128d8
authored
May 06, 2023
by
Julen Etxaniz
Browse files
add bloom, xglm and llama results
parent
0542d35d
Changes
141
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
47 additions
and
0 deletions
+47
-0
results/xglm/xglm-7.5B/xglm-7.5B_xwinograd_0-shot.json
results/xglm/xglm-7.5B/xglm-7.5B_xwinograd_0-shot.json
+47
-0
No files found.
results/xglm/xglm-7.5B/xglm-7.5B_xwinograd_0-shot.json
0 → 100644
View file @
21e128d8
{
"results"
:
{
"xwinograd_zh"
:
{
"acc"
:
0.7281746031746031
,
"acc_stderr"
:
0.01983712759311063
},
"xwinograd_ru"
:
{
"acc"
:
0.6317460317460317
,
"acc_stderr"
:
0.027219500732466696
},
"xwinograd_pt"
:
{
"acc"
:
0.6730038022813688
,
"acc_stderr"
:
0.028982074243683254
},
"xwinograd_en"
:
{
"acc"
:
0.7948387096774193
,
"acc_stderr"
:
0.008376626547826555
},
"xwinograd_jp"
:
{
"acc"
:
0.6496350364963503
,
"acc_stderr"
:
0.01541389159576608
},
"xwinograd_fr"
:
{
"acc"
:
0.6506024096385542
,
"acc_stderr"
:
0.05265151356440471
}
},
"versions"
:
{
"xwinograd_zh"
:
0
,
"xwinograd_ru"
:
0
,
"xwinograd_pt"
:
0
,
"xwinograd_en"
:
0
,
"xwinograd_jp"
:
0
,
"xwinograd_fr"
:
0
},
"config"
:
{
"model"
:
"hf-causal-experimental"
,
"model_args"
:
"pretrained=facebook/xglm-7.5B,use_accelerate=True"
,
"num_fewshot"
:
0
,
"batch_size"
:
"auto"
,
"device"
:
"cuda"
,
"no_cache"
:
true
,
"limit"
:
null
,
"bootstrap_iters"
:
100000
,
"description_dict"
:
{}
}
}
Prev
1
…
4
5
6
7
8
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment