• Michele Resta's avatar
    Optimization for evalita-llm rouge computation (#2878) · 22bd2bcb
    Michele Resta authored
    
    
    * feat: initial commit with templates for evalita evaluation
    
    * fix: change rule for generate_until
    
    * feat: modified yaml to use reduced version of NER test datasets
    
    * feat: added templates to use reduced dataset for summarization (fanpage and ilpost)
    
    * Add Six Prompts for Each Multiple-Choice Task
    
    * fix: fastest eval for summarization
    
    * chore: linted with ruff
    
    * chore: linted with ruff
    
    ---------
    Co-authored-by: default avatarrzanoli <zanoli@fbk.eu>
    22bd2bcb
utils.py 16.2 KB