1. 06 Jun, 2024 1 commit
  2. 05 Jun, 2024 1 commit
  3. 04 Jun, 2024 1 commit
  4. 03 Jun, 2024 1 commit
    • Ahmed Moubtahij's avatar
      Token healing (#30081) · 39b2ff69
      Ahmed Moubtahij authored
      
      
      * token healing impl + trie with extensions
      
      * make fixup
      
      * prefix-robust space tokenization
      
      * examples readme and requirements
      
      * make fixup
      
      * allow input prompt and model
      
      * redundant defaults
      
      * Specialized Trie
      
      * make fixup
      
      * updated tests with new inherited Tree
      
      * input ids to auto device_map
      
      * rm unused import
      
      * Update src/transformers/generation/utils.py
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      
      * naming convention
      
      * Revert "naming convention"
      
      This reverts commit dd39d9c5b7a969e2d8a8d2a8e54f121b82dc44f0.
      
      * naming convention
      
      * last -hopefully- changes
      
      ---------
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      39b2ff69
  5. 23 May, 2024 1 commit
  6. 22 May, 2024 2 commits
  7. 21 May, 2024 1 commit
  8. 07 May, 2024 5 commits
  9. 01 May, 2024 12 commits
  10. 24 Apr, 2024 1 commit
  11. 18 Apr, 2024 1 commit
  12. 15 Apr, 2024 1 commit
  13. 25 Mar, 2024 1 commit
  14. 15 Mar, 2024 1 commit
  15. 11 Mar, 2024 1 commit
  16. 16 Feb, 2024 1 commit
  17. 12 Feb, 2024 1 commit
  18. 06 Feb, 2024 2 commits
  19. 05 Feb, 2024 1 commit
  20. 02 Feb, 2024 1 commit
    • Klaus Hipp's avatar
      [Docs] Fix spelling and grammar mistakes (#28825) · 721ee783
      Klaus Hipp authored
      * Fix typos and grammar mistakes in docs and examples
      
      * Fix typos in docstrings and comments
      
      * Fix spelling of `tokenizer` in model tests
      
      * Remove erroneous spaces in decorators
      
      * Remove extra spaces in Markdown link texts
      721ee783
  21. 29 Jan, 2024 1 commit
  22. 18 Jan, 2024 1 commit
  23. 12 Jan, 2024 1 commit