- 14 Dec, 2022 3 commits
-
-
NielsRogge authored
* Improve tests * Improve TF tests * Apply suggestion * Fix test Co-authored-by:Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
-
Yih-Dar authored
Co-authored-by:ydshieh <ydshieh@users.noreply.github.com>
-
amyeroberts authored
-
- 13 Dec, 2022 8 commits
-
-
Yih-Dar authored
Uninstall torch_tensorrt for now Co-authored-by: -
Nicolas Patry authored
Co-authored-by: -
Hazrul Akmal authored
* added model resources for xlm-roberta * added model resources for xlm-roberta * resolve suggested changes * add resources to xlm-roberta
-
NielsRogge authored
* Add first draft * Add out_features attribute to config * Add corresponding test * Add Dinat backbone * Add BackboneMixin * Add Backbone mixin, improve tests * Fix embeddings * Fix bug * Improve backbones * Fix Nat backbone tests * Fix Dinat backbone tests * Apply suggestions Co-authored-by: -
dhansmair authored
`image = to_channel_dimension_format(image, ChannelDimension.LAST)` is redundant as this same conversion is also applied in to_pil_image(). This redundant call actually makes the training fail in rare cases. The problem can be reproduced with the following code snippet: ``` from transformers.models.clip import CLIPFeatureExtractor vision_processor = CLIPFeatureExtractor.from_pretrained('openai/clip-vit-large-patch14') images = [ torch.rand(size=(3, 2, 10), dtype=torch.float), torch.rand(size=(3, 10, 1), dtype=torch.float), torch.rand(size=(3, 1, 10), dtype=torch.float) ] for image in images: processed_image = vision_processor(images=image, return_tensors="pt")['pixel_values'] print(processed_image.shape) assert processed_image.shape == torch.Size([1, 3, 224, 224]) ``` The last image has a height of 1 pixel. The second call to to_channel_dimesion_format() will transpose the image, and the height dimension is wrongly treated as the channels dimension afterwards. Because of this, the following normalize() step will result in an exception. -
Matt authored
* Fix AdamWeightDecay for TF * Fix AdamWeightDecay for TF * make fixup
-
Yih-Dar authored
* Fix the pipeline test regarding TF * Fix the pipeline test regarding TF * update comment Co-authored-by: -
Younes Belkada authored
* add `keep_in_fp32_modules` support * pass it as class attribute * few modifs - make tests `slow` - fix logic * better logic * fix failing test * `bfloat16` support * Update src/transformers/modeling_utils.py Co-authored-by:
Sylvain Gugger <35901082+sgugger@users.noreply.github.com> * fix * simplify tests * simplify tests * fix test * modify message * more checks * fix failing tests * add more conditions - add `is_accelerate_available` - fixes pipleine tests that failed * add suggestions * Update src/transformers/modeling_utils.py Co-authored-by:
-
- 12 Dec, 2022 18 commits
-
-
Yih-Dar authored
Co-authored-by: -
Yih-Dar authored
Co-authored-by: -
amyeroberts authored
* Add decorator for flaky tests * Fix up
-
Sylvain Gugger authored
* Disambiguate test for required_input in tokenization base file. * Add test for size
-
Sylvain Gugger authored
-
Ariel Ekgren authored
* Add templates for gpt-sw3 * Add templates for gpt-sw3 * Added sentencepiece tokenizer * intermediate commit with many changes * fixed conflicts * Init commit for tokenization port * Tokenization progress * Remove fast tokenizer * Clean up and rename spm.model -> spiece.model * Remove TF -> PT conversion script template, Clean up Megatron -> PT script * Optimize encode & decode performance * added new attention * added new attention * attention for gpt-sw3 working * attention good * Cache is now working * fixed attention mask so that it works with causal attention * fixed badbmm bug for cpu and caching * updated config with correct parameters * Refactor and leave optimizations as separate functions to avoid breaking expected functionality * Fix special tokens mapping for both tokenizers * cleaning up of code and comments * HF compatible attention outputs * Tokenizer now passing tests, add documentation * Update documentation * reverted back to base implementation after checking that it is identical to pretrained model * updated gpt-sw3 config * updated conversion script * aligned parameters with gpt-sw3 config * changed default scale_attn_by_inverse_layer_idx to true * removed flag from conversion script * added temporary model path * reverted back to functioning convert script * small changes to default config * updated tests for gpt-sw3 * make style, make quality, minor cleanup * Change local paths to testing online repository * Change name: GptSw3 -> GPTSw3 * Remove GPTSw3TokenizerFast references * Use official model repository and add more model sizes * Added reference to 6.7b model * Add GPTSw3DoubleHeadsModel to IGNORE_NON_AUTO_CONFIGURED, like GPT2DoubleHeadsModel * Remove pointers to non-existing TFGPTSw3 * Add GPTSw3 to docs/_toctree.yml * Remove TF artifacts from GPTSw3 in __init__ files * Update README:s with 'make fix-copies' * Add 20b model to archive list * Add documentation for GPT-Sw3 * Fix typo in documentation for GPT-Sw3 * Do 'make fix-copies' again after having updated docs * Fix some typos in docs * Update src/transformers/models/gpt_sw3/configuration_gpt_sw3.py Co-authored-by:
Arthur <48595927+ArthurZucker@users.noreply.github.com> * Update src/transformers/models/gpt_sw3/configuration_gpt_sw3.py Co-authored-by:
JoeyOhman <joeyoh@kth.se> Co-authored-by:
-
amyeroberts authored
* Add require_vision decorator * Fixup * Use requires_backends * Add requires_backend to utils functions
-
Steven Liu authored
* clarify docstring * make style
-
Matt authored
* Convert tokenizer outputs for Keras in doc example * Das deutsche Beispiel auch korrigieren
-
Juanjo do Olmo authored
* Create and translate to Spanish debugging.mdx * solved typo error in a header * Update debugging.mdx * Update debugging.mdx * Update docs/source/es/debugging.mdx Co-authored-by:
Omar Sanseviero <osanseviero@gmail.com> * Update docs/source/es/debugging.mdx Co-authored-by:
-
Sourab Mangrulkar authored
-
stanleycai95 authored
-
Ian C authored
* Initial commit * Add type hints for two major classes * Run make fixup * Fix output type for Whisper * Run isort to fix imports
-
Nicolas Patry authored
-
Yih-Dar authored
Co-authored-by: -
Peter authored
*
✨ add accelerate support for LongT5 models Signed-off-by:peter szemraj <peterszemraj@gmail.com> * fix `accelerate` tests * Trigger CI test Signed-off-by:
younesbelkada <younesbelkada@gmail.com>
-
Alberto Mario Ceballos-Arroyo authored
* Fix minor typo in question_answering.mdx * Fixes minor typo in the english version of tasks/asr.mdx * Update _toctree.yml * Translate add_new_pipeline.mdx into Spanish * Fixes some typos in the English version of add_new_pipeline.mdx * Translate asr.mdx into Spanish * Fixes small typos in add_new_pipeline.mdx * Update docs/source/es/add_new_pipeline.mdx Suggestion by @osanseviero Co-authored-by:
-
Salvo Cavallaro authored
-
- 09 Dec, 2022 7 commits
-
-
Sylvain Gugger authored
* Fix rendering issue in quicktour * Separate in two blocks
-
Younes Belkada authored
* fix last slow test * revert deletion * Update src/transformers/models/vit_hybrid/modeling_vit_hybrid.py
-
amyeroberts authored
-
amyeroberts authored
* Replace FE references with IPs * Update processor tests * Update src/transformers/models/clip/processing_clip.py Co-authored-by:
-
Yih-Dar authored
Co-authored-by: -
Michael Benayoun authored
* Change transformers.onnx to use optimum.exporters.onnx * Update doc * Remove print * Fix transformers.onnx cli * Update documentation * Update documentation * Small fixes * Fix log message * Apply suggestions * Update src/transformers/onnx/__main__.py Co-authored-by:
lewtun <lewis.c.tunstall@gmail.com> * Update src/transformers/onnx/__main__.py Co-authored-by:
Michael Benayoun <michael@huggingface.co> Co-authored-by:
-
NielsRogge authored
* Improve ResNet backbone * Improve Bit backbone * Improve docstrings * Fix default stage * Apply suggestions from code review Co-authored-by:
-
- 08 Dec, 2022 4 commits
-
-
Nathan Raw authored
*
🚧 wip video classification pipeline *🚧 wip - add is_decord_available check *🐛 add missing import *✅ add tests *🔧 add decord to setup extras *🚧 add is_decord_available *✨ add video-classification pipeline *📝 add video classification pipe to docs *🐛 add missing VideoClassificationPipeline import *📌 add decord install in test runner *✅ fix url inputs to video-classification pipeline *✨ updates from review *📝 add video cls pipeline to docs *📝 add docstring *🔥 remove unused import *🔥 remove some code *📝 docfix -
amyeroberts authored
* Add deprecation warning when image FE instantiated * Update src/transformers/models/beit/feature_extraction_beit.py Co-authored-by:
-
IMvision12 authored
* Create test_tokenization_led.py * Update test_tokenization_led.py * Update test_tokenization_led.py * Update test_tokenization_led.py * Update test_tokenization_led.py * Update test_tokenization_led.py * Update test_tokenization_led.py * Update test_tokenization_led.py * Update test_tokenization_led.py
-
amyeroberts authored
* fix donut image processor * Update test values * Apply lower bound on resizing size * Add in missing size param * Resolve resize channel_dimension bug * Update src/transformers/image_transforms.py
-
