GitLab

Update overview.md

* fix

* fix

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* Fix env.py in cases where torch is not present

* Simplify the fix (and avoid some issues)

* Improve `transformers-cli env` reporting

* move the line `"Using GPU in script?": "<fill in>"` to in if conditional
statement

* same option for npu

* Fix has_file in offline mode

* harmonize env variable for offline mode

* Switch to HF_HUB_OFFLINE

* fix test

* revert test_offline to test TRANSFORMERS_OFFLINE

* Add new offline test

* merge conflicts

* docs

* add mistral v3 conversion script

* Update src/transformers/models/mistral/convert_mistral_weights_to_hf.py
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* fixup

---------
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* quanto latest version was refactored

* add error msg

* incorrect compare sign

* Update src/transformers/cache_utils.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

---------
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Deprecate models
- graphormer
- time_series_transformer
- xlm_prophetnet
- qdqbert
- nat
- ernie_m
- tvlt
- nezha
- mega
- jukebox
- vit_hybrid
- x_clip
- deta
- speech_to_text_2
- efficientformer
- realm
- gptsan_japanese

* Fix up

* Fix speech2text2 imports

* Make sure message isn't indented

* Fix docstrings

* Correctly map for deprecated models from model_type

* Uncomment out

* Add back time series transformer and x-clip

* Import fix and fix-up

* Fix up with updated ruff

Update _redirects.yml

* fix flan t5 tests

* better format

fix
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

Update modeling_opt.py

add accelerate

* Render chat template tojson filter as unicode

* ruff--

* add peft references

* add peft references

* Update docs/source/en/peft.md

* Update docs/source/en/peft.md

* fix tests

* style

* Update tests/generation/test_utils.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

---------
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Fix failing tokenizer tests

* Use small tokenizer

* Fix remaining reference

* Update docs

* Add PaliGemma resources

* Address comment

* Update docs

* Add test for multiple images

* [run slow] owlv2

* Fix box rescaling

* [run slow] owlv2

Remove float64

* Unit test to verify fix
Signed-off-by: Raphael Glon <oOraph@users.noreply.github.com>

* fix from_pretrained in offline mode when model is preloaded in cache
Signed-off-by: Raphael Glon <oOraph@users.noreply.github.com>

* minor: fmt
Signed-off-by: Raphael Glon <oOraph@users.noreply.github.com>

---------
Signed-off-by: Raphael Glon <oOraph@users.noreply.github.com>
Co-authored-by: Raphael Glon <oOraph@users.noreply.github.com>

* Remove backend checks in training_args.py

* Expilicit initialize the device

---------
Co-authored-by: tonghengwen <tonghengwen@cambricon.com>

Update quicktour.md to fix broken link

Missing '/' in attention mask link in the transformers quicktour

fix
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

use main
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

skip
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* fix pad_to_max_length Whisper

* add tests

* make style

fix quanto tests

* Fix link in dbrx.md

* remove "though this may not be up to date"

---------
Co-authored-by: Lysandre Debut <hi@lysand.re>

[push-ci-image]
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* fix devices and dtype assignments

* [run-slow]paligemma

* seems like `split_special_tokens` is used here

* split special token

* add new line at end of file

* moving split special token test to common tests

* added assertions

* test

* fixup

* add co-author

* passing rest of args to gptsan_japanese, fixing tests

* removing direct comparison of fast and slow models

* adding test support for UDOP and LayoutXLM

* ruff fix

* readd check if slow tokenizer

* modify test to handle bos tokens

* removing commented function

* trigger build

* applying review feedback - updated docstrings, var names, and simplified tests

* ruff fixes

* Update tests/test_tokenization_common.py
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* applying feedback, comments

* shutil temp directory fix

---------
Co-authored-by: Arthur Zucker <arthur.zucker@gmail.com>
Co-authored-by: Ita Zaporozhets <itazaporozhets@Itas-MBP.localdomain>
Co-authored-by: itazap <itazap@users.noreply.github.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
Co-authored-by: Ita Zaporozhets <itazaporozhets@Itas-MacBook-Pro.local>