1. 22 Sep, 2025 1 commit
    • priverabsc's avatar
      Add eqbench tasks in Spanish and Catalan (#3168) · de496b80
      priverabsc authored
      * Add eqbench tasks in Spanish and Catalan
      
      * Incremented catalan_bench and spanish_bench versions. Added 'multilingual' folder inside 'eq_bench' and moved the eqbench_ca and eqbench_es .yaml to that folder. Updated the tasks README with eqbench_es and eqbench_ca, expliciting inside each description both the Hugging Face link and the translation method.
      
      * Fixed tasks table.
      
      * remove test_task.sh and results folder
      
      * Add utils.py to multilingual folder
      de496b80
  2. 06 Mar, 2024 1 commit
    • Peter Bevan's avatar
      Add EQ-Bench as per #1459 (#1511) · c5acce0c
      Peter Bevan authored
      * Start adding eq-bench
      
      * Start adding to yaml and utils
      
      * Get metric working
      
      * Add README
      
      * Handle cases where answer is not parseable
      
      * Deal with unparseable answers and add percent_parseable metric
      
      * Update README
      c5acce0c