1. 19 Jun, 2025 1 commit
  2. 19 Jan, 2025 1 commit
  3. 23 Aug, 2024 1 commit
  4. 13 Jun, 2024 1 commit
  5. 26 Feb, 2024 1 commit
  6. 17 Dec, 2023 1 commit
    • Wis Kojohnjaratkul's avatar
      [WIP] Add IFEval / Instruction-Following Eval (#1087) · aa61f940
      Wis Kojohnjaratkul authored
      * Add IFEval task
      
      * Check and download nltk punkt if not already downloaded
      
      * Update gen_max_toks to 2048 to support "900 words+" instructions
      
      * Resolve pre-commit linting issues
      
      * Reduce max_gen_toks to 1280 to conserve token usage
      
      * Add warning message in `process_results` call for non chat-finetuned models
      aa61f940