1. 19 Jul, 2022 1 commit
  2. 18 Jul, 2022 5 commits
  3. 13 Jul, 2022 2 commits
  4. 11 Jul, 2022 1 commit
  5. 07 Jul, 2022 2 commits
  6. 06 Jul, 2022 2 commits
  7. 04 Jul, 2022 3 commits
  8. 01 Jul, 2022 2 commits
  9. 30 Jun, 2022 2 commits
  10. 29 Jun, 2022 4 commits
  11. 28 Jun, 2022 3 commits
  12. 27 Jun, 2022 1 commit
    • Matt's avatar
      Add a TF in-graph tokenizer for BERT (#17701) · ee0d001d
      Matt authored
      * Add a TF in-graph tokenizer for BERT
      
      * Add from_pretrained
      
      * Add proper truncation, option handling to match other tokenizers
      
      * Add proper imports and guards
      
      * Add test, fix all the bugs exposed by said test
      
      * Fix truncation of paired texts in graph mode, more test updates
      
      * Small fixes, add a (very careful) test for savedmodel
      
      * Add tensorflow-text dependency, make fixup
      
      * Update documentation
      
      * Update documentation
      
      * make fixup
      
      * Slight changes to tests
      
      * Add some docstring examples
      
      * Update tests
      
      * Update tests and add proper lowercasing/normalization
      
      * make fixup
      
      * Add docstring for padding!
      
      * Mark slow tests
      
      * make fixup
      
      * Fall back to BertTokenizerFast if BertTokenizer is unavailable
      
      * Fall back to BertTokenizerFast if BertTokenizer is unavailable
      
      * make fixup
      
      * Properly handle tensorflow-text dummies
      ee0d001d
  13. 24 Jun, 2022 2 commits
  14. 23 Jun, 2022 2 commits
  15. 21 Jun, 2022 3 commits
  16. 18 Jun, 2022 1 commit
    • Rafael Zimmer's avatar
      Added translation of index.mdx to Portuguese Issue #16824 (#17565) · 0d92798b
      Rafael Zimmer authored
      
      
      * Added translation of installation.mdx to Portuguese, as well
      as default templates of _toctree.yml and _config.py
      
      * [ build_documentation.yml ] - Updated doc_builder to build
      documentation in Portuguese.
      [ pipeline_tutorial.mdx ] - Created translation for the pipeline_tutorial.mdx.
      
      * [ build_pr_documentation.yml ] - Added pt language to pr_documentation builder.
      
      [ pipeline_tutorial.mdx ] - Grammar changes.
      
      * [ accelerate.mdx ] - Translated to Portuguese the acceleration tutorial.
      
      * [ multilingual.mdx ] - Added portuguese translation for multilingual tutorial.
      
      [ training.mdx ] - Added portuguese translation for training tutorial.
      
      * [ preprocessing.mdx ] - WIP
      
      * Update _toctree.yml
      
      * Adding Pr茅-processamento to _toctree.yml
      
      * Update accelerate.mdx
      
      * Nits and eliminate preprocessing file while it is ready
      
      * [ index.mdx ] - Translated to Portuguese the index apresentation page.
      
      * [ docs/source/pt ] - Updated _toctree.yml to match newest translations.
      
      * Fix build_pr_documentation.yml
      
      * Fix index nits
      
      * nits in _toctree
      Co-authored-by: default avatarOmar U. Espejel <espejelomar@gmail.com>
      0d92798b
  17. 15 Jun, 2022 2 commits
  18. 14 Jun, 2022 2 commits