1. 24 Dec, 2024 1 commit
    • Firoj Alam, Scientist, QCRI's avatar
      AraDICE task config file (#2507) · 932e8f9e
      Firoj Alam, Scientist, QCRI authored
      
      
      * added aradice
      
      * Added ArabicMMLU Lev Configs
      
      * added ArabicMMLU egy configs
      
      * Added boolq configs
      
      * Added cultural bench configs
      
      * added openbookqa configs
      
      * Added PiQA configs
      
      * added winogrande configs
      
      * Added truthfulQA configs
      
      * Added aradice group config
      
      * Remove deleted files from repository
      
      * modified arabimmlu configs
      
      * modified metadata versions
      
      * fixed formatting using ruff
      
      * added aradice tasks information
      
      * pre-commit
      
      * Uptaded openbookqa utils
      
      * fixed formatting on obqa
      
      ---------
      Co-authored-by: default avatarBasel Mousi <bmousi@hbku.edu.qa>
      Co-authored-by: default avatarBaber <baber@hey.com>
      932e8f9e
  2. 10 Jun, 2024 1 commit
  3. 07 Jun, 2024 1 commit
  4. 21 Dec, 2023 1 commit
  5. 28 Nov, 2023 2 commits
  6. 14 Aug, 2023 1 commit
  7. 13 Jul, 2023 1 commit
  8. 11 Jul, 2023 1 commit
  9. 05 Jul, 2023 1 commit
  10. 16 Jun, 2023 1 commit
  11. 12 Jun, 2023 1 commit
    • Hailey Schoelkopf's avatar
      [Refactor] [WIP] New YAML advanced docs (#567) · 79b972d6
      Hailey Schoelkopf authored
      
      
      * add wip gsm8k yaml
      
      * cleanup tasks dir
      
      * push gsm8k yaml changes
      
      * rename gpt2.py
      
      * add updated gsm8k , triviaqa baseline
      
      * add new cot yaml
      
      * allow for multiple filter pipelines, new filter types
      
      * updated gsm8k + sampling gen configs
      
      * cleanup self-consistency yaml
      
      * push outline for advanced docs
      
      * push docs checklist
      
      * switch to inheritance for many tasks
      
      * acc_norm and acc_mutual_info fixed
      
      * fix missing newline in error msg
      
      * remove many .py tasks
      
      * updated GSM8k
      
      * added more doc
      
      * Update advanced_task_guide.md
      
      Added list of parameters
      
      * Update advanced_task_guide.md
      
      * Added details on listing metrics
      
      * Update advanced_task_guide.md
      
      * Added more explanation
      
      * modify current default filter name
      
      * add new tags to tasks
      
      * remove a lingering print()
      
      * add rest of param docs, cleanup deprecated fields
      
      * push docs update
      
      * move ALL_TASKS definition location
      
      * confirm write_out.py works if no description dict passed
      
      ---------
      Co-authored-by: default avatarlintangsutawika <lintang@sutawika.com>
      79b972d6
  12. 08 Jun, 2023 1 commit
  13. 02 Jun, 2023 1 commit