Commits · 44f5b260fe7a69cbd82be91b58c62a2879d530fa · chenpangpang / transformers

"examples/flax/vscode:/vscode.git/clone" did not exist on "95091e1582688c2ffd8342918f3eb0e3abeeb0c8"

14 Jul, 2021 1 commit

flax model parallel training (#12590) · 44f5b260

Suraj Patil authored Jul 14, 2021

* update scripts

* add copyright

* add logging

* cleanup

* add z loss

* add readme

* shard description

* update readme

44f5b260

12 Jul, 2021 2 commits
- Update timeline for Flax event evaluation · c523b241
  Omar Sanseviero authored Jul 12, 2021
  
  c523b241
- Point to the right file for hybrid CLIP (#12599) · 2dd9440d
  Eduardo Gonzalez Ponferrada authored Jul 11, 2021
  
  2dd9440d
09 Jul, 2021 1 commit
- Add Flax sprint project evaluation section (#12592) · 8fe836af
  Omar Sanseviero authored Jul 09, 2021
  
  8fe836af
07 Jul, 2021 2 commits
- fix loading clip vision model (#12566) · d7e156bd
  Suraj Patil authored Jul 07, 2021
  
  d7e156bd
- [Flax] Allow retraining from save checkpoint (#12559) · 7d321b76
  Patrick von Platen authored Jul 07, 2021
```
* fix_torch_device_generate_test

* remove @

* finish
```
  7d321b76
06 Jul, 2021 4 commits
- Replace `nn.Moudle` by `nn.Module` (#12541) · 09af5bde
  SaulLu authored Jul 06, 2021
  
  09af5bde
- Update README.md · f42a0abf
  Patrick von Platen authored Jul 06, 2021
  
  f42a0abf
- Update README (#12540) · 029b9d3f
  Suzana Ilić authored Jul 06, 2021
  
  029b9d3f
- [Flax] Fix hybrid clip (#12519) · f5b0c1ec
  Suraj Patil authored Jul 06, 2021
```
* fix saving and loading

* update readme
```
  f5b0c1ec
05 Jul, 2021 6 commits
- [Wav2Vec2] Flax - Adapt wav2vec2 script (#12520) · 7d6285a9
  Patrick von Platen authored Jul 05, 2021
```
* fix_torch_device_generate_test

* remove @

* adapt flax pretrain script
```
  7d6285a9
- [Flax] Dataset streaming example (#12470) · 9b908105
  Patrick von Platen authored Jul 05, 2021
```
* fix_torch_device_generate_test

* remove @

* upload

* finish dataset streaming

* adapt readme

* finish

* up

* up

* up

* up

* Apply suggestions from code review

* finish

* make style

* make style2

* finish
Co-authored-by: Patrick von Platen <patrick@huggingface.co>
```
  9b908105
- flax.linen.apply takes state as the first param, followed by the input (#12510) · eceb1042
  Navjot authored Jul 05, 2021
  
  eceb1042
- [Flax] Fix wav2vec2 pretrain arguments (#12498) · e799e0f1
  Akmal authored Jul 05, 2021
  
  e799e0f1
- [examples/flax] clip style image-text training example (#12491) · 23ab0b69
  Suraj Patil authored Jul 05, 2021
```
* clip style example

* fix post init

* add requirements

* update readme, few small fixes
```
  23ab0b69
- Add `Repository` import to the FLAX example script (#12501) · 89a8739f
  Lysandre Debut authored Jul 05, 2021
  
  89a8739f
04 Jul, 2021 1 commit
- Update README.md · 2df63282
  Patrick von Platen authored Jul 04, 2021
  
  2df63282
02 Jul, 2021 5 commits
- Add guide on how to build demos for the Flax sprint (#12468) · a76eebfc
  Omar Sanseviero authored Jul 02, 2021
  
  a76eebfc
- Update README.md · b21905e0
  Patrick von Platen authored Jul 02, 2021
  
  b21905e0
- Update README.md · d24a5231
  Patrick von Platen authored Jul 02, 2021
  
  d24a5231
- Update README.md · e3fce2f8
  Patrick von Platen authored Jul 02, 2021
```
Thanks a lot @BirgerMoell
```
  e3fce2f8
- fixed typo in flax-projects readme (#12466) · b4ecc6be
  Matthew LeMay authored Jul 02, 2021
  
  b4ecc6be
01 Jul, 2021 4 commits

Add TPU README (#12463) · 7f87bfc9

Patrick von Platen authored Jul 01, 2021



* Add TPU README

* Apply suggestions from code review

* Update examples/research_projects/jax-projects/README.md

* Update examples/research_projects/jax-projects/README.md
Co-authored-by: Stefan Schweter <stefan@schweter.it>
Co-authored-by: Stefan Schweter <stefan@schweter.it>

7f87bfc9

Update README.md · 1457839f
Patrick von Platen authored Jul 01, 2021

1457839f
Added talk details (#12465) · c18af5d4
Suzana Ilić authored Jul 01, 2021

c18af5d4

[Flax community event] How to use hub during training (#12447) · b655f16d

Patrick von Platen authored Jul 01, 2021



* fix_torch_device_generate_test

* remove @

* upload

* finish doc

* Apply suggestions from code review
Co-authored-by: Omar Sanseviero <osanseviero@users.noreply.github.com>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Julien Chaumond <chaumond@gmail.com>

* finish
Co-authored-by: Omar Sanseviero <osanseviero@users.noreply.github.com>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Julien Chaumond <chaumond@gmail.com>

b655f16d

30 Jun, 2021 4 commits

[Flax] Add wav2vec2 (#12271) · 0d1f67e6

Patrick von Platen authored Jun 30, 2021



* fix_torch_device_generate_test

* remove @

* start flax wav2vec2

* save intermediate

* forward pass has correct shape

* add weight norm

* add files

* finish ctc

* make style

* finish gumbel quantizer

* correct docstrings

* correct some more files

* fix vit

* finish quality

* correct tests

* correct docstring

* correct tests

* start wav2vec2 pretraining script

* save intermediate

* start pretraining script

* finalize pretraining script

* finish

* finish

* small typo

* finish

* correct

* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Suraj Patil <surajp815@gmail.com>

* make style

* push
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Suraj Patil <surajp815@gmail.com>

0d1f67e6

[JAX/Flax readme] add philosophy doc (#12419) · 3f36a2c0

Suraj Patil authored Jun 30, 2021



* add philosophy doc

* fix typos

* update doc

* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* address Patricks suggestions

* add a training example and fix typos

* jit the training step

* jit train step

* fix example code

* typo

* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

3f36a2c0

Add to talks section (#12442) · 1ad1c4a8
Suzana Ilić authored Jun 30, 2021

1ad1c4a8
Added to talks section (#12433) · 90d69456
Suzana Ilić authored Jun 30, 2021
```
Added one more confirmed speaker, zoom links and gcal event links
```
90d69456

29 Jun, 2021 2 commits
- Added talks (#12415) · b440b8d1
  Suzana Ilić authored Jun 29, 2021
  
  b440b8d1
- minor fixes in original RAG training (#12395) · 5257818e
  Shamane Siri authored Jun 30, 2021
  
  5257818e
28 Jun, 2021 3 commits

[Flax] Add T5 pretraining script (#12355) · 31c3e7e7

Patrick von Platen authored Jun 28, 2021



* fix_torch_device_generate_test

* remove @

* add length computatan

* finish masking

* finish

* upload

* fix some bugs

* finish

* fix dependency table

* correct tensorboard

* Apply suggestions from code review

* correct processing

* slight change init

* correct some more mistakes

* apply suggestions

* improve readme

* fix indent

* Apply suggestions from code review
Co-authored-by: SaulLu <55560583+SaulLu@users.noreply.github.com>

* correct tokenizer

* finish

* finish

* finish

* finish
Co-authored-by: Patrick von Platen <patrick@huggingface.co>
Co-authored-by: SaulLu <55560583+SaulLu@users.noreply.github.com>

31c3e7e7

Update README.md · 27b6ac46
Patrick von Platen authored Jun 28, 2021

27b6ac46

[Flax community event] Add more description to readme (#12398) · 89b57a66

Patrick von Platen authored Jun 28, 2021



* fix_torch_device_generate_test

* remove @

* boom boom

* correct typos

* Apply suggestions from code review
Co-authored-by: Suraj Patil <surajp815@gmail.com>

* Apply suggestions from code review
Co-authored-by: Suzana Ilić <io.suzanai@gmail.com>

* Apply suggestions from code review
Co-authored-by: Suraj Patil <surajp815@gmail.com>
Co-authored-by: Suzana Ilić <io.suzanai@gmail.com>

89b57a66

25 Jun, 2021 3 commits
- remove extra white space from log format (#12360) · 4a872cae
  Stas Bekman authored Jun 25, 2021
  
  4a872cae
- Add FlaxBigBird QuestionAnswering script (#12233) · 332a2458
  Vasudev Gupta authored Jun 25, 2021
```
* port bigbird script

* adapt script a bit

* change location

* adapt more

* save progress

* init commit

* style

* dataset script tested

* readme add
```
  332a2458
- Update README.md · aa550c4a
  Patrick von Platen authored Jun 25, 2021
  
  aa550c4a
24 Jun, 2021 1 commit
- Add flax/jax quickstart (#12342) · f2c4ce7e
  Marc van Zee authored Jun 24, 2021
  
  f2c4ce7e
23 Jun, 2021 1 commit
- [Flax/JAX] Add how to propose projects markdown (#12311) · 44739c81
  Patrick von Platen authored Jun 23, 2021
```
* fix_torch_device_generate_test

* remove @

* finish

* make style
```
  44739c81