Skip to content

GitLab

Switch branch/tag
  1. 17 Dec, 2023 1 commit
    • Wis Kojohnjaratkul's avatar
      [WIP] Add IFEval / Instruction-Following Eval (#1087) · aa61f940
      Wis Kojohnjaratkul authored 
      * Add IFEval task

* Check and download nltk punkt if not already downloaded

* Update gen_max_toks to 2048 to support "900 words+" instructions

* Resolve pre-commit linting issues

* Reduce max_gen_toks to 1280 to conserve token usage

* Add warning message in `process_results` call for non chat-finetuned models
      aa61f940
  3. 15 Dec, 2023 1 commit
  5. 04 Dec, 2023 1 commit
  7. 27 Nov, 2023 1 commit
  9. 22 Nov, 2023 1 commit
  11. 24 Oct, 2023 5 commits
  13. 12 Oct, 2023 2 commits
  15. 04 Oct, 2023 2 commits
  17. 21 Sep, 2023 1 commit
  19. 18 Sep, 2023 2 commits
  21. 14 Sep, 2023 3 commits
  23. 25 Aug, 2023 1 commit