- 27 Apr, 2022 7 commits
-
-
Tian Yun authored
-
cjlovering authored
-
cjlovering authored
-
cjlovering authored
-
cjlovering authored
- saves the doc idx by order in dataset - saves the full ctx. we can turn this off it is too much memory - saves the idx of the fewshot examples - saves the source (test/val) of the fewshot examples - TODO: We now need to return the pred/target from process_results - TODO: Make it so override-ed process-resutls don't have to re-impl this.
-
jon-tow authored
-
Tian Yun authored
-
- 26 Apr, 2022 27 commits
-
-
cjlovering authored
-
cjlovering authored
Updated doc: If the answer choices is empty, then it is generation; else ranked choice. This will be the canonical approach when using PS.
-
Tian Yun authored
-
jon-tow authored
-
cjlovering authored
-
cjlovering authored
-
Tian Yun authored
-
Tian Yun authored
-
cjlovering authored
-
cjlovering authored
-
cjlovering authored
-
cjlovering authored
-
jon-tow authored
-
cjlovering authored
-
jon-tow authored
-
cjlovering authored
-
jon-tow authored
Turned off generation tasks for now. Changed process to look at the metrics. Only accuracy implemented.
-
jon-tow authored
-
cjlovering authored
-
cjlovering authored
-
cjlovering authored
-
cjlovering authored
-
cjlovering authored
-
cjlovering authored
-
cjlovering authored
-
jon-tow authored
-
jon-tow authored
-
- 25 Apr, 2022 6 commits
-
-
jon-tow authored
-
jon-tow authored
-
jon-tow authored
-
jon-tow authored
-
cjlovering authored
-
cjlovering authored
-