Skip to content

GitLab

"llm/vscode:/vscode.git/clone" did not exist on "4c4c730a0a9630eec5043ecf7c2821fcc52f625d"
Commit 87e147e1 authored by lintangsutawika's avatar lintangsutawika
Browse files

reformat

parent 6accb48f
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 4 deletions
lm_eval/filters/extraction.py
View file @ 87e147e1
...@@ -45,7 +45,6 @@ class WhitespaceFilter(Filter): ...@@ -45,7 +45,6 @@ class WhitespaceFilter(Filter):
pass pass
def apply(self, resps): def apply(self, resps):
def filter_set(inst): def filter_set(inst):
filtered_resp = [] filtered_resp = []
...@@ -59,4 +58,4 @@ class WhitespaceFilter(Filter): ...@@ -59,4 +58,4 @@ class WhitespaceFilter(Filter):
filtered_resps = [filter_set(resp) for resp in resps] filtered_resps = [filter_set(resp) for resp in resps]
return filtered_resps return filtered_resps
\ No newline at end of file
lm_eval/tasks/triviaqa/default.yaml
View file @ 87e147e1
...@@ -12,13 +12,13 @@ target_delimiter: "" ...@@ -12,13 +12,13 @@ target_delimiter: ""
generation_kwargs: generation_kwargs:
until: until:
- "\n" - "\n"
- "." - "."
- "," - ","
do_sample: false do_sample: false
temperature: 0.0 temperature: 0.0
filter_list: filter_list:
- name: remove_whitespace - name: remove_whitespace
filter: filter:
- function: remove_whitespace - function: remove_whitespace
- function: take_first - function: take_first
metric_list: metric_list:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment