- 10 May, 2023 1 commit
-
-
Jeffrey Quesnelle authored
-
- 02 May, 2023 1 commit
-
-
Benjamin Fattori authored
-
- 28 Apr, 2023 1 commit
-
-
yurodiviy authored
* Support bigbench-hard json tasks using multiple_choice_grade * Add support for greedy decoding in bigbench tasks * move bigbench_resources to datasets * rectify changes to rf.greedy_until w upstream * make path to resource import reflect new location --------- Co-authored-by:haileyschoelkopf <hailey.schoelkopf@yale.edu>
-
- 15 Apr, 2023 1 commit
-
-
Benjamin Fattori authored
-
- 12 Apr, 2023 1 commit
-
-
Benjamin Fattori authored
-
- 11 Apr, 2023 1 commit
-
-
Benjamin Fattori authored
-
- 16 Mar, 2023 2 commits
-
-
Benjamin Fattori authored
-
Benjamin Fattori authored
-
- 10 Mar, 2023 1 commit
-
-
Benjamin Fattori authored
ll_rolling computes adaptive bs separately and passes computed bs to _ll_tokens to avoid recomputation
-
- 09 Mar, 2023 1 commit
-
-
Benjamin Fattori authored
-
- 03 May, 2022 2 commits
-
-
Fabrizio Milo authored
-
Fabrizio Milo authored
-
- 29 Apr, 2022 4 commits
- 28 Apr, 2022 5 commits
-
-
Tian Yun authored
-
Tian Yun authored
-
Tian Yun authored
-
tomlimi authored
-
Zdenek Kasner authored
-
- 27 Apr, 2022 8 commits
-
-
jon-tow authored
-
Tian Yun authored
-
cjlovering authored
-
cjlovering authored
-
cjlovering authored
-
Zdenek Kasner authored
-
cjlovering authored
- saves the doc idx by order in dataset - saves the full ctx. we can turn this off it is too much memory - saves the idx of the fewshot examples - saves the source (test/val) of the fewshot examples - TODO: We now need to return the pred/target from process_results - TODO: Make it so override-ed process-resutls don't have to re-impl this.
-
jon-tow authored
-
- 26 Apr, 2022 11 commits
-
-
cjlovering authored
-
cjlovering authored
Updated doc: If the answer choices is empty, then it is generation; else ranked choice. This will be the canonical approach when using PS.
-
cjlovering authored
-
cjlovering authored
-
cjlovering authored
-
cjlovering authored
-
cjlovering authored
-
cjlovering authored
-
jon-tow authored
Turned off generation tasks for now. Changed process to look at the metrics. Only accuracy implemented.
-
jon-tow authored
-
jon-tow authored
-