- 08 May, 2024 1 commit
-
-
lintangsutawika authored
-
- 07 May, 2024 19 commits
-
-
lintangsutawika authored
-
lintangsutawika authored
-
lintangsutawika authored
-
lintangsutawika authored
-
lintangsutawika authored
-
lintangsutawika authored
-
lintangsutawika authored
-
Hailey Schoelkopf authored
* fix auto-batch size bug for seq2seq models * alphabetize task + group tables ; fix eval tracker bug * fix eval tracker bug
-
Hailey Schoelkopf authored
* add Hendrycks MATH (no sympy checking) variant * add readmes for MATH tasks
-
KonradSzafer authored
-
lintangsutawika authored
-
Hailey Schoelkopf authored
-
lintangsutawika authored
-
lintangsutawika authored
-
lintangsutawika authored
-
lintangsutawika authored
-
lintangsutawika authored
-
lintangsutawika authored
-
lintangsutawika authored
-
- 06 May, 2024 3 commits
-
-
aditya thomas authored
-
LSinev authored
* Added fewshot sampling seeds to evaluator.simple_evaluate signature Way to control seed of fewshot sampling may help with #1591 * Added ability for custom sampler for ConfigurableTask May be set in config like ``` fewshot_config: sampler: !function utils.MyFewshotSampler ``` * explicitly set fewshot random generator seed for HFLM generate_until_task test * add backward compatibility for three args seed setup * save seeds info to logs/reports
-
lintangsutawika authored
-
- 05 May, 2024 4 commits
-
-
ciaranby authored
-
Muhammad Bin Usman authored
fix `----hf_hub_log_args` to `--hf_hub_log_args`
-
kwrobel.eth authored
* remove echo parameter in OpenAI completions API * remove context length parameter doc string
-
KonradSzafer authored
-
- 03 May, 2024 2 commits
-
-
KonradSzafer authored
-
KonradSzafer authored
* evaluation tracker implementation * OVModelForCausalLM test fix * typo fix * moved methods args * multiple args in one flag * loggers moved to dedicated dir * improved filename sanitization
-
- 02 May, 2024 2 commits
-
-
Helena Kloosterman authored
* Add option to set OpenVINO config * Use utils.eval_logger for logging
-
bcicc authored
* vllm lora support * remove print * version check, rename lora kwarg
-
- 01 May, 2024 4 commits
-
-
Simran Arora authored
* upload new tasks * add readmes * run linters --------- Co-authored-by:haileyschoelkopf <hailey@eleuther.ai>
-
Zehan Li authored
* Update utils.py This is a 4-choice task, option_e is null for all but 3 samples * Fix options Adaptive choices * add option e * bump multilingual arc version --------- Co-authored-by:Hailey Schoelkopf <65563625+haileyschoelkopf@users.noreply.github.com>
-
Gabriel Mukobi authored
* Add Pile-10k readme * Add Pile-10k task configuration file
-
Chujie Zheng authored
-
- 26 Apr, 2024 2 commits
-
-
Nikita Lozhnikov authored
* Add register_filter decorator * Add register_filter docs
-
giorgossideris authored
* Support individual scrolls datasets * Add qmsum context * Fix formatting
-
- 25 Apr, 2024 3 commits
-
-
lintangsutawika authored
-
lintangsutawika authored
-
-