Skip to content

GitLab

Switch branch/tag
  1. 12 May, 2022 2 commits
  3. 11 May, 2022 2 commits
    • Amanpreet Singh's avatar
      [feat] Add FLAVA model (#16654) · a10f6183
      Amanpreet Singh authored 
      * [WIP] Add FLAVA model

This PR aims to add [FLAVA](ihttps://arxiv.org/abs/2112.04482) model to the transformers repo.

Following checklist delineates the list of things to be done for this PR
to be complete:

[x] Flava init
[x] Flava base models
[x] Flava layers
[x] Flava Configs
[x] Flava encoders
[x] Flava pretraining models
[ ] Flava classification/retrieval models (To be added in a separate PR)
[x] Documentation updates 
[x] Imports updates 
[x] Argstring updates
[x] Flava pretrained checkpoints 
[x] Flava tests
[x] Flava processors 
[x] Sanity check
[x] Lint
      a10f6183
    • hasan salim kanmaz's avatar
      [WIP] Enable reproducibility for distributed trainings (#16907) · c33f6046
      hasan salim kanmaz authored 
      

* add seed worker and set_deterministic_seed_for_cuda function to enforce reproducability

* change function name to enable determinism, add docstrings, reproducability support for tf

* change function name to enable_determinism_for_distributed_training

* revert changes in set_seed and call set_seed within enable_full_determinism

* add one position argument for seed_worker function

* add full_determinism flag in training args and call enable_full_determinism when it is true

* add enable_full_determinism to documentation

* apply make fixup after the last commit

* Update src/transformers/training_args.py
Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
      c33f6046
  5. 10 May, 2022 2 commits
  7. 09 May, 2022 4 commits
  9. 06 May, 2022 1 commit
  11. 05 May, 2022 1 commit
  13. 04 May, 2022 3 commits
  15. 03 May, 2022 2 commits
    • Sylvain Gugger's avatar
      Make Trainer compatible with sharded checkpoints (#17053) · a8fa2f91
      Sylvain Gugger authored 
      * Make Trainer compatible with sharded checkpoints

* Add doc
      a8fa2f91
    • Sanchit Gandhi's avatar
      [FlaxBert] Add ForCausalLM (#16995) · cd9274d0
      Sanchit Gandhi authored 
      * [FlaxBert] Add ForCausalLM

* make style

* fix output attentions

* Add RobertaForCausalLM

* remove comment

* fix fx-to-pt model loading

* remove comment

* add modeling tests

* add enc-dec model tests

* add big_bird

* add electra

* make style

* make repo-consitency

* add to docs

* remove roberta test

* quality

* amend cookiecutter

* fix attention_mask bug in flax bert model tester

* tighten pt-fx thresholds to 1e-5

* add 'copied from' statements

* amend 'copied from' statements

* amend 'copied from' statements

* quality
      cd9274d0
  17. 02 May, 2022 2 commits
    • Lysandre Debut's avatar
      Allow all imports from transformers (#17050) · bb2e088b
      Lysandre Debut authored
      bb2e088b
    • NielsRogge's avatar
      Add YOLOS (#16848) · 1ac69874
      NielsRogge authored 
      

* First draft

* Add YolosForObjectDetection

* Make forward pass work

* Add mid position embeddings

* Add interpolation of position encodings

* Add expected values

* Add YOLOS to tests

* Add integration test

* Support tiny model as well

* Support all models in conversion script

* Remove mid_pe_size attribute

* Make more tests pass

* Add model to README and fix config

* Add copied from statements

* Rename base_model_prefix to vit

* Add missing YOLOS_PRETRAINED_CONFIG_ARCHIVE_MAP

* Apply suggestions from code review

* Apply more suggestions from code review

* Convert remaining checkpoints

* Improve docstrings

* Add YolosFeatureExtractor

* Add feature extractor to docs

* Add corresponding tests

* Fix style

* Fix docs

* Apply suggestion from code review

* Fix bad rebase

* Fix some more bad rebase

* Fix missing character

* Improve docs and variable names
Co-authored-by: default avatarNiels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
      1ac69874
  19. 30 Apr, 2022 1 commit
  21. 29 Apr, 2022 1 commit
  23. 27 Apr, 2022 1 commit
  25. 26 Apr, 2022 2 commits
  27. 25 Apr, 2022 2 commits
  29. 23 Apr, 2022 1 commit
  31. 22 Apr, 2022 1 commit
  33. 21 Apr, 2022 1 commit
  35. 20 Apr, 2022 2 commits
  37. 18 Apr, 2022 2 commits
  39. 13 Apr, 2022 1 commit
  41. 12 Apr, 2022 3 commits
  43. 11 Apr, 2022 2 commits
  45. 08 Apr, 2022 1 commit