Commits · 66b0090877db3f9b65f24b21400f1e29a23f72d6 · chenpangpang / transformers

12 Nov, 2018 1 commit
- add fp16 training · 66b00908
  thomwolf authored Nov 12, 2018
  
  66b00908
10 Nov, 2018 1 commit
- fixing learning rate schedule when using gradient_accumulation_steps · a81a1ef8
  thomwolf authored Nov 10, 2018
  
  a81a1ef8
09 Nov, 2018 1 commit
- remove duplicate accumulate gradient step arguments · 34bdc8b5
  thomwolf authored Nov 09, 2018
  
  34bdc8b5
07 Nov, 2018 3 commits
- typo fix in output tuple · 48d4a531
  thomwolf authored Nov 07, 2018
  
  48d4a531
- cleaning up - speeding up a bit multi-gpu · dbc318a4
  thomwolf authored Nov 07, 2018
  
  dbc318a4
- fixing pre-processing bug - averaging loss for gradient accumulation - no_grad on evaluation · 6bb7510a
  thomwolf authored Nov 07, 2018
  
  6bb7510a
04 Nov, 2018 10 commits
- Fix `args.gradient_accumulation_steps` used before assigment. · 290633b8
  VictorSanh authored Nov 04, 2018
  
  290633b8
- Fix bug train_batch_size not an int. · 649e9774
  VictorSanh authored Nov 04, 2018
```
Division makes args.train_batch_size becoming a float.
cc @thomwolf
```
  649e9774
- Small logger bug (multi-gpu, distribution) in training · d55c3ae8
  VictorSanh authored Nov 04, 2018
  
  d55c3ae8
- clean up + mask is long · 3ddff783
  thomwolf authored Nov 04, 2018
  
  3ddff783
- remove old methods · c6207d85
  thomwolf authored Nov 04, 2018
  
  c6207d85
- add distributed training · 965b2565
  thomwolf authored Nov 04, 2018
  
  965b2565
- add gradient accumulation · 1ceac85e
  thomwolf authored Nov 04, 2018
  
  1ceac85e
- clean up · 6b0da96b
  thomwolf authored Nov 04, 2018
  
  6b0da96b
- logging + update copyright · 834b485b
  thomwolf authored Nov 04, 2018
  
  834b485b
- multi-gpu cleanup · 1701291e
  thomwolf authored Nov 04, 2018
  
  1701291e
03 Nov, 2018 13 commits
- update readme, file names, removing TF code, moving tests · f8276008
  thomwolf authored Nov 03, 2018
  
  f8276008
- fix typo · 1ba5b58c
  VictorSanh authored Nov 03, 2018
  
  1ba5b58c
- Fix both loss and eval metrics -> more coherence on the loss (eval vs train and tf vs pt) · 5858e8e4
  VictorSanh authored Nov 03, 2018
  
  5858e8e4
- Fix import on initalization · cd09cd5b
  VictorSanh authored Nov 03, 2018
  
  cd09cd5b
- special edition script · 04287a4d
  thomwolf authored Nov 03, 2018
  
  04287a4d
- Add seed in initialization · a1af5247
  VictorSanh authored Nov 03, 2018
  
  a1af5247
- Fix loss loss logging for multi-gpu compatibility · 4faeb38b
  Ubuntu authored Nov 03, 2018
  
  4faeb38b
- add model.zero_grad() · cb76c1dd
  thomwolf authored Nov 03, 2018
  
  cb76c1dd
- fixing optimization · 088ad458
  thomwolf authored Nov 03, 2018
  
  088ad458
- Create DataParallel model if several GPUs · 5f432480
  VictorSanh authored Nov 03, 2018
  
  5f432480
- Small typo in `trange` · 391a4ec2
  VictorSanh authored Nov 03, 2018
```
I seriously don't understand why they defined num_train_epochs as a float in the originial tf code.
I Will change it at the end to avoir merge conflicts for now.
```
  391a4ec2
- fix optimization_test · 0d8d2285
  thomwolf authored Nov 03, 2018
  
  0d8d2285
- removing f-string · 45efc9d8
  thomwolf authored Nov 03, 2018
  
  45efc9d8
02 Nov, 2018 10 commits
- Move command-line argparse arguments into main() function · 3ff2ec5e
  Tim Rault authored Nov 02, 2018
  
  3ff2ec5e
- Quick fix metrics evaluation on run_classif_pytorch · 98b9771d
  VictorSanh authored Nov 02, 2018
  
  98b9771d
- Quick fix on eval accuracy · b54de837
  VictorSanh authored Nov 02, 2018
  
  b54de837
- Fix cuda compability for evaluation · 1d53f9cb
  VictorSanh authored Nov 02, 2018
  
  1d53f9cb
- FIX small bugs in `run_classifier_pytorch.py` · 1d8511f8
  VictorSanh authored Nov 02, 2018
  
  1d8511f8
- FIX small bugs in `run_classifier_pytorch.py` · 936eb4c3
  VictorSanh authored Nov 02, 2018
  
  936eb4c3
- working on squad · 8e81e5e6
  thomwolf authored Nov 02, 2018
  
  8e81e5e6
- various fixes · dee09a40
  thomwolf authored Nov 02, 2018
  
  dee09a40
- small tweaks · 2c731fd1
  thomwolf authored Nov 02, 2018
  
  2c731fd1
- model training loop working – still have to check that everything is exactly same · 9343a231
  thomwolf authored Nov 02, 2018
  
  9343a231
01 Nov, 2018 1 commit
- run_classifier WIP + added classifier head and initialization to the model · f690f0e1
  thomwolf authored Nov 02, 2018
  
  f690f0e1