• Baber Abbasi's avatar
    add Mbpp instruct (#2995) · 60e85da5
    Baber Abbasi authored
    * feat: add mbpp_instruct
    
    * fix: update generation_kwargs to use an empty until list
    
    * fix: correct predictions formatting in pass_at_1 function
    
    * fix: improve code block extraction by checking first without opening backticks
    
    * fix mbpp `pass_at_1`
    60e85da5
utils.py 3.43 KB