• Baber Abbasi's avatar
    truncate thinking tags in generations (#3145) · 51ede33c
    Baber Abbasi authored
    * feat: add postprocessing for generated text to strip stop sequences and thinking tokens
    
    * nit
    
    * fix: trim leading whitespace after stripping thinking tokens from generation
    
    * feat: add think_end_token to model_args
    
    * nit
    
    * nit
    
    * nit
    
    * add to readme
    
    * nit
    51ede33c
utils.py 31.5 KB