• am-bean's avatar
    New task: Lingoly (#2198) · 8b41f925
    am-bean authored
    * Setting up lingoly task
    
    * Testing yaml changes to debug
    
    * Adding pre-commit hooks
    
    * Functional LingOly benchmark
    
    * Renaming files and adding grouping
    
    * Extending group aggregations to allow custom functions. Setting up custom lingoly aggregation using difference in scores.
    8b41f925
evaluator_utils.py 21.6 KB