"tests/tokenization/test_tokenization_utils.py" did not exist on "9e033649991d3785e1d1e9e1da87ba37bb223503"
- 30 Aug, 2023 2 commits
-
-
Aman Gupta Karmani authored
fix minor documentation typo
-
Nino Risteski authored
deleted unnecessary comma in the Adding a new model section.
-
- 29 Aug, 2023 24 commits
-
-
Joao Gante authored
-
Nino Risteski authored
_toctree.yml file. broken link, now fixed.
-
Haylee Schäfer authored
* support loading base64 images * add test * mention in docs * remove the logging * sort imports * update error message * Update tests/utils/test_image_utils.py Co-authored-by:
amyeroberts <22614925+amyeroberts@users.noreply.github.com> * restructure to catch base64 exception * doesn't like the newline * download files * format * optimize imports * guess it needs a space? * support loading base64 images * add test * remove the logging * sort imports * restructure to catch base64 exception * doesn't like the newline * download files * optimize imports * guess it needs a space? --------- Co-authored-by:
-
amyeroberts authored
Allocate result array ahead of time
-
Sanchit Gandhi authored
-
Susnato Dhar authored
update checkpoints
-
Arthur authored
🤦 update warning to If you want to use the new behaviour, set `legacy=False`. instead of True -
Sohyun Sim authored
* docs: ko: community.md * feat: deepl draft * fix: manual edits * fix: resolve suggestions Co-authored-by:
Hyeonseo Yun <0525yhs@gmail.com> Co-authored-by:
SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com> --------- Co-authored-by:
-
heuristicwave authored
* dos: ko: add_new_pipeline.mdx * feat: chatgpt draft * fix: manual edits * docs: ko: add_new_pipeline Update _toctree * Update docs/source/ko/add_new_pipeline.md Co-authored-by:
Wonhyeong Seo <wonhseo@kakao.com> * Update docs/source/ko/add_new_pipeline.md Co-authored-by:
-
Joao Gante authored
Tests: detect lines removed from "utils/not_doctested.txt" and doctest ALL generation files (#25763)
-
Chau Nguyen authored
* Update trainer.py (error with checking steps in args.eval_accumulation_steps to gather tensors) While the deprecated code has the correct check (line 3772): "if args.eval_accumulation_steps is not None and (step + 1) % args.eval_accumulation_steps == 0:" The current code does not (line 3196): "if args.eval_accumulation_steps is not None and self.accelerator.sync_gradients:" We need to check "(step + 1) % args.eval_accumulation_steps == 0". Hence, the line 3196 should be modified to: "if args.eval_accumulation_steps is not None and (step + 1) % args.eval_accumulation_steps == 0 and self.accelerator.sync_gradients:" * Fix error with checking args.eval_accumulation_steps to gather tensors
-
MinJae Kang authored
* docs: ko-model_memory_anatomy.md * feat: chatgpt draft * feat: manual edits * feat: change document title * feat: manual edits * fix: resolve suggestion Co-authored-by:
heuristicwave <31366038+heuristicwave@users.noreply.github.com> * fix: resolve suggestion Co-authored-by:
Sohyun Sim <96299403+sim-so@users.noreply.github.com> * fix: resolve suggestion Co-authored-by:
-
SeongWooChoi authored
* docs: ko: peft.mdx * feat: chatgpt draft * fix: manual edits * fix: resolve suggestions Co-authored-by:
Steven Liu <59462357+stevhliu@users.noreply.github.com> Co-authored-by:
-
Dongkeun Yoon authored
* fix warning triggering for xglm.embed_positions * Make TF variable a tf.constant to match (and fix some spelling) --------- Co-authored-by:Matt <rocketknight1@gmail.com>
-
Arthur authored
* return when length is zero * Add tests Co-authored-by:
Avnish Narayan <38871737avnishn@users.noreply.github.com> * Co-authored-by: avnishn <38871737+avnishn@users.noreply.github.com> * codeLlama doc should not be on Main * update test --------- Co-authored-by:
-
Omar Sanseviero authored
* Update code_llama.md * Update code_llama.md
-
zspo authored
-
Younes Belkada authored
-
Sourab Mangrulkar authored
fix bug
-
NielsRogge authored
* First draft * More improvements * Fix all tests * More improvements * Add backbone test * Improve docstring * Address comments * Rename attribute * Remove expected output * Update src/transformers/models/dinov2/modeling_dinov2.py Co-authored-by:
-
NielsRogge authored
* First draft * Fix READMEs * Update return_dict * Add more tests * Fix docstrings * Address comments * Address more comments * Address more comments * Address more comments, fix test * Fix test
-
Lorenzo Battistela authored
* fixing name position_embeddings to object_queries * [fix] renaming variable and docstring do object queries * [fix] comment position_embedding to object queries * [feat] changes from make-fix-copies to keep consistency * Revert "[feat] changes from make-fix-copies to keep consistency" This reverts commit 56e3e9ede1d32f7aeefba707ddfaf12c9b4b9e7e. * [tests] fix wrong expected score * [fix] wrong assignment causing wrong tensor shapes * [fix] fixing position_embeddings to object queries to keep consistency (make fix copies) * [fix] make fix copies, renaming position_embeddings to object_queries * [fix] positional_embeddingss to object queries, fixes from make fix copies * [fix] comments frmo make fix copies * [fix] adding args validation to keep version support * [fix] adding args validation to keep version support -conditional detr * [fix] adding args validation to keep version support - maskformer * [style] make fixup style fixes * [feat] adding args checking * [feat] fixcopies and args checking * make fixup * make fixup --------- Co-authored-by:Lorenzobattistela <lorenzobattistela@gmail.com>
-
Aman Gupta Karmani authored
-
Arup De authored
* add FSDP config option to enable activation-checkpointing * update docs * add checks and remove redundant code * fix formatting error
-
- 28 Aug, 2023 5 commits
-
-
Stas Bekman authored
[idefics] fix vision's hidden_act
-
David Reguera authored
* Add type hints for MGP STR model * Add missing type hints for plbart model * Add type hints for Pix2struct model * Add missing type hints to Rag model and tweak the docstring * Add missing type hints to Sam model * Add missing type hints to Swin2sr model * Fix a type hint for Pix2StructTextModel Co-authored-by:
Matt <Rocketknight1@users.noreply.github.com> * Fix typo on Rag model docstring Co-authored-by:
-
David Reguera authored
* Add type hints for table_transformer * Add type hints to Timesformer model * Add type hints to Timm Backbone model * Add type hints to TVLT family models * Add type hints to Vivit family models * Use the typing instance instead of the python builtin. * Fix the `replace_return_docstrings` decorator for Vivit model Co-authored-by:
-
David Reguera authored
* Add missing type hint to cpmant * Add type hints to decision_transformer model * Add type hints to deformable_detr models * Add type hints to detr models * Add type hints to deta models * Add type hints to dpr models * Update attention mask type hint Co-authored-by:
-
Arthur authored
* add a warning=True tip to the Llama2 doc * code llama needs a tip too * doc nit * build PR doc * doc nits Co-authored-by:
Lysandre <lysandre@huggingface.co> --------- Co-authored-by:
-
- 26 Aug, 2023 1 commit
-
-
Tigran Khachatryan authored
* fix docstrings and examples * docstring update * add missing whitespace
-
- 25 Aug, 2023 8 commits
-
-
Stas Bekman authored
-
Arthur authored
* add all * Revert "Delete .github directory" This reverts commit 9b0ff7b052e2b20b629a26fb13606b78a42944d1. * make conversion script backward compatible * fixup * more styling * copy to llama changes * fix repo consistency * nits * document correct classes * updates * more fixes * nits * update auto mappings * add readmes * smallupdates * llama-code replace with llama_code * make fixup * updates to the testsing suite * fix fast nits * more small fixes * fix decode * fix template processing * properly reset the normalizer * nits processor * tokenization tests pass * styling * last tests * additional nits * one test is left * nits Co-authored-by faabian <faabian@users.noreply.github.com> * update failing test * fixup * remove decode infilling users should handle it on their onw after generation, padding can be a problem * update * make test slow and more meaningfull * fixup * doc update * fixup * Apply suggestions from code review * add kwargs doc * tokenizer requires `requires_backend` * type requires_backends * CodeLlama instead of LlamaCode * more name cahnges * nits * make doctests happy * small pipeline nits * last nit * Apply suggestions from code review Co-authored-by:
Sylvain Gugger <35901082+sgugger@users.noreply.github.com> * update * add codellama to toctree --------- Co-authored-by:
-
Alan Ji authored
* fix a typo in docsting * Update src/transformers/modeling_utils.py Co-authored-by:
Arthur <48595927+ArthurZucker@users.noreply.github.com> --------- Co-authored-by:
statelesshz <jihuazhong1@huawei.com> Co-authored-by:
-
Tianlin Liu authored
* Correct attention mask dtype * reformat code * add a test for boolean mask * convert test to fast test * delete unwanted print * use assertTrue for testing
-
Younes Belkada authored
* move deepspeed to `lib_integrations.deepspeed` * more refactor * oops * fix slow tests * Fix docs * fix docs * addess feedback * address feedback * final modifs for PEFT * fixup * ok now * trigger CI * trigger CI again * Update docs/source/en/main_classes/deepspeed.md Co-authored-by:
-
David Reguera authored
* Add missing type hints for ErnieM family * Add missing type hints for EsmForProteinFolding model * Add missing type hints for Graphormer model * Add type hints for InstructBlipQFormer model * Add missing type hints for LayoutLMForMaskedLM model * Add missing type hints for LukeForEntitySpanClassification model
-
Joao Gante authored
-
Marc Sun authored
* fix encoder hook * style
-
