"demo/pdf2md.bak" did not exist on "872cd73f4a0b631eec120ce70d92fe6718395fb8"
  • Baber Abbasi's avatar
    truncate thinking tags in generations (#3145) · 51ede33c
    Baber Abbasi authored
    * feat: add postprocessing for generated text to strip stop sequences and thinking tokens
    
    * nit
    
    * fix: trim leading whitespace after stripping thinking tokens from generation
    
    * feat: add think_end_token to model_args
    
    * nit
    
    * nit
    
    * nit
    
    * add to readme
    
    * nit
    51ede33c
README.md 47 KB