Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
7c9da714
Commit
7c9da714
authored
Mar 11, 2022
by
Jonathan Tow
Committed by
Jon Tow
Mar 18, 2022
Browse files
Refactor `Task` download
parent
7064d6b9
Changes
84
Expand all
Show whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
48 additions
and
60 deletions
+48
-60
lm_eval/tasks/wikitext.py
lm_eval/tasks/wikitext.py
+16
-29
lm_eval/tasks/winogrande.py
lm_eval/tasks/winogrande.py
+11
-4
lm_eval/tasks/wsc273.py
lm_eval/tasks/wsc273.py
+19
-25
setup.py
setup.py
+2
-2
No files found.
lm_eval/tasks/wikitext.py
View file @
7c9da714
This diff is collapsed.
Click to expand it.
lm_eval/tasks/winogrande.py
View file @
7c9da714
This diff is collapsed.
Click to expand it.
lm_eval/tasks/wsc273.py
View file @
7c9da714
This diff is collapsed.
Click to expand it.
setup.py
View file @
7c9da714
...
@@ -21,8 +21,7 @@ setuptools.setup(
...
@@ -21,8 +21,7 @@ setuptools.setup(
python_requires
=
'>=3.6'
,
python_requires
=
'>=3.6'
,
install_requires
=
[
install_requires
=
[
"black"
,
"black"
,
"best_download==0.0.9"
,
"datasets==2.0.0"
,
"datasets==1.15.1"
,
"click>=7.1"
,
"click>=7.1"
,
"scikit-learn>=0.24.1"
,
"scikit-learn>=0.24.1"
,
"torch>=1.7"
,
"torch>=1.7"
,
...
@@ -43,6 +42,7 @@ setuptools.setup(
...
@@ -43,6 +42,7 @@ setuptools.setup(
"openai==0.6.4"
,
"openai==0.6.4"
,
"jieba==0.42.1"
,
"jieba==0.42.1"
,
"nagisa==0.2.7"
,
"nagisa==0.2.7"
,
"bleurt@https://github.com/google-research/bleurt/archive/b610120347ef22b494b6d69b4316e303f5932516.zip#egg=bleurt"
],
],
dependency_links
=
[
dependency_links
=
[
"https://github.com/google-research/bleurt/archive/b610120347ef22b494b6d69b4316e303f5932516.zip#egg=bleurt"
,
"https://github.com/google-research/bleurt/archive/b610120347ef22b494b6d69b4316e303f5932516.zip#egg=bleurt"
,
...
...
Prev
1
2
3
4
5
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment