Commits · a76eebfc806b863bf1eb721ba8c49ef9c2f5049f · chenpangpang / transformers

"...research_projects/seq2seq-distillation/lightning_base.py" did not exist on "6c87b73d6ba22935d1ebc994643fee2eef6f40e1"

02 Jul, 2021 5 commits
- Add guide on how to build demos for the Flax sprint (#12468) · a76eebfc
  Omar Sanseviero authored Jul 02, 2021
  
  a76eebfc
- Update README.md · b21905e0
  Patrick von Platen authored Jul 02, 2021
  
  b21905e0
- Update README.md · d24a5231
  Patrick von Platen authored Jul 02, 2021
  
  d24a5231
- Update README.md · e3fce2f8
  Patrick von Platen authored Jul 02, 2021
```
Thanks a lot @BirgerMoell
```
  e3fce2f8
- fixed typo in flax-projects readme (#12466) · b4ecc6be
  Matthew LeMay authored Jul 02, 2021
  
  b4ecc6be
01 Jul, 2021 4 commits

Add TPU README (#12463) · 7f87bfc9

Patrick von Platen authored Jul 01, 2021



* Add TPU README

* Apply suggestions from code review

* Update examples/research_projects/jax-projects/README.md

* Update examples/research_projects/jax-projects/README.md
Co-authored-by: Stefan Schweter <stefan@schweter.it>
Co-authored-by: Stefan Schweter <stefan@schweter.it>

7f87bfc9

Update README.md · 1457839f
Patrick von Platen authored Jul 01, 2021

1457839f
Added talk details (#12465) · c18af5d4
Suzana Ilić authored Jul 01, 2021

c18af5d4

[Flax community event] How to use hub during training (#12447) · b655f16d

Patrick von Platen authored Jul 01, 2021



* fix_torch_device_generate_test

* remove @

* upload

* finish doc

* Apply suggestions from code review
Co-authored-by: Omar Sanseviero <osanseviero@users.noreply.github.com>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Julien Chaumond <chaumond@gmail.com>

* finish
Co-authored-by: Omar Sanseviero <osanseviero@users.noreply.github.com>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Julien Chaumond <chaumond@gmail.com>

b655f16d

30 Jun, 2021 4 commits

[Flax] Add wav2vec2 (#12271) · 0d1f67e6

Patrick von Platen authored Jun 30, 2021



* fix_torch_device_generate_test

* remove @

* start flax wav2vec2

* save intermediate

* forward pass has correct shape

* add weight norm

* add files

* finish ctc

* make style

* finish gumbel quantizer

* correct docstrings

* correct some more files

* fix vit

* finish quality

* correct tests

* correct docstring

* correct tests

* start wav2vec2 pretraining script

* save intermediate

* start pretraining script

* finalize pretraining script

* finish

* finish

* small typo

* finish

* correct

* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Suraj Patil <surajp815@gmail.com>

* make style

* push
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Suraj Patil <surajp815@gmail.com>

0d1f67e6

[JAX/Flax readme] add philosophy doc (#12419) · 3f36a2c0

Suraj Patil authored Jun 30, 2021



* add philosophy doc

* fix typos

* update doc

* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* address Patricks suggestions

* add a training example and fix typos

* jit the training step

* jit train step

* fix example code

* typo

* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

3f36a2c0

Add to talks section (#12442) · 1ad1c4a8
Suzana Ilić authored Jun 30, 2021

1ad1c4a8
Added to talks section (#12433) · 90d69456
Suzana Ilić authored Jun 30, 2021
```
Added one more confirmed speaker, zoom links and gcal event links
```
90d69456

29 Jun, 2021 1 commit
- Added talks (#12415) · b440b8d1
  Suzana Ilić authored Jun 29, 2021
  
  b440b8d1
28 Jun, 2021 3 commits

[Flax] Add T5 pretraining script (#12355) · 31c3e7e7

Patrick von Platen authored Jun 28, 2021



* fix_torch_device_generate_test

* remove @

* add length computatan

* finish masking

* finish

* upload

* fix some bugs

* finish

* fix dependency table

* correct tensorboard

* Apply suggestions from code review

* correct processing

* slight change init

* correct some more mistakes

* apply suggestions

* improve readme

* fix indent

* Apply suggestions from code review
Co-authored-by: SaulLu <55560583+SaulLu@users.noreply.github.com>

* correct tokenizer

* finish

* finish

* finish

* finish
Co-authored-by: Patrick von Platen <patrick@huggingface.co>
Co-authored-by: SaulLu <55560583+SaulLu@users.noreply.github.com>

31c3e7e7

Update README.md · 27b6ac46
Patrick von Platen authored Jun 28, 2021

27b6ac46

[Flax community event] Add more description to readme (#12398) · 89b57a66

Patrick von Platen authored Jun 28, 2021



* fix_torch_device_generate_test

* remove @

* boom boom

* correct typos

* Apply suggestions from code review
Co-authored-by: Suraj Patil <surajp815@gmail.com>

* Apply suggestions from code review
Co-authored-by: Suzana Ilić <io.suzanai@gmail.com>

* Apply suggestions from code review
Co-authored-by: Suraj Patil <surajp815@gmail.com>
Co-authored-by: Suzana Ilić <io.suzanai@gmail.com>

89b57a66

25 Jun, 2021 2 commits
- Add FlaxBigBird QuestionAnswering script (#12233) · 332a2458
  Vasudev Gupta authored Jun 25, 2021
```
* port bigbird script

* adapt script a bit

* change location

* adapt more

* save progress

* init commit

* style

* dataset script tested

* readme add
```
  332a2458
- Update README.md · aa550c4a
  Patrick von Platen authored Jun 25, 2021
  
  aa550c4a
24 Jun, 2021 1 commit
- Add flax/jax quickstart (#12342) · f2c4ce7e
  Marc van Zee authored Jun 24, 2021
  
  f2c4ce7e
23 Jun, 2021 1 commit
- [Flax/JAX] Add how to propose projects markdown (#12311) · 44739c81
  Patrick von Platen authored Jun 23, 2021
```
* fix_torch_device_generate_test

* remove @

* finish

* make style
```
  44739c81
22 Jun, 2021 1 commit

[Flax] Main doc for event orga (#12305) · 64029abe

Patrick von Platen authored Jun 22, 2021

* fix_torch_device_generate_test

* remove @

* push

* finish

* some typos

* add more info on communication

* add suggestions

64029abe