- 08 May, 2024 1 commit
-
-
Konrad authored
-
- 06 May, 2024 1 commit
-
-
LSinev authored
* Added fewshot sampling seeds to evaluator.simple_evaluate signature Way to control seed of fewshot sampling may help with #1591 * Added ability for custom sampler for ConfigurableTask May be set in config like ``` fewshot_config: sampler: !function utils.MyFewshotSampler ``` * explicitly set fewshot random generator seed for HFLM generate_until_task test * add backward compatibility for three args seed setup * save seeds info to logs/reports
-
- 20 Dec, 2023 1 commit
-
-
Baber Abbasi authored
* add ruff and isort. remove black and flake8 * remove unnecessary dependencies * remove dependency from table * change order * ran ruff * check 3.9 * exclude evaluator * update CI workflow * use ruff config in pyproject.toml * test * add isort rules to ruff * sort imports * import `make_table` * try stages for no-commit-to-branch * turn on mypy for pre-commit * test * test * test * change no-commit-to-branch to default * nits * fixed dependency
-
- 04 Dec, 2023 1 commit
-
-
Hailey Schoelkopf authored
-
- 15 Sep, 2023 1 commit
-
-
haileyschoelkopf authored
-
- 14 Sep, 2023 1 commit
-
-
baberabb authored
-
- 25 Aug, 2023 1 commit
-
-
Ethan Smith authored
This adds a bunch of simple annotations suggested by https://github.com/JelleZijlstra/autotyping.
-
- 09 Aug, 2023 1 commit
-
-
lintangsutawika authored
-
- 13 Jul, 2023 3 commits
-
-
lintangsutawika authored
-
lintangsutawika authored
-
lintangsutawika authored
-
- 22 Jun, 2023 1 commit
-
-
Hailey Schoelkopf authored
-
- 21 Jun, 2023 4 commits
-
-
Hailey Schoelkopf authored
-
Lintang Sutawika authored
-
Lintang Sutawika authored
Use `target_delimiter`
-
lintangsutawika authored
-
- 16 Jun, 2023 1 commit
-
-
haileyschoelkopf authored
-
- 19 May, 2023 1 commit
-
-
lintangsutawika authored
-
- 01 May, 2023 1 commit
-
-
haileyschoelkopf authored
-
- 19 Apr, 2023 1 commit
-
-
haileyschoelkopf authored
-