"lm_eval/tasks/headqa/headqa_es.yaml" did not exist on "80a0302a4b862e8ee4040ed23fe77762529120ce"
  • Baber Abbasi's avatar
    truncate thinking tags in generations (#3145) · 51ede33c
    Baber Abbasi authored
    * feat: add postprocessing for generated text to strip stop sequences and thinking tokens
    
    * nit
    
    * fix: trim leading whitespace after stripping thinking tokens from generation
    
    * feat: add think_end_token to model_args
    
    * nit
    
    * nit
    
    * nit
    
    * add to readme
    
    * nit
    51ede33c
sglang_causallms.py 20.5 KB