GitLab

* change to torchrun

* change ubuntu 20.04

* change format

* update

* fix build error

* use latest

* fall back

* upgrade nvcr

* fallback

* fall back cu117

* add example

* remove duplicate cmd

* fix urllib

---------
Co-authored-by: jixh <jixh@dp.tech>
Co-authored-by: Guolin Ke <guolin.ke@outlook.com>

* add wandb support

* code clean

* Update adam_kernel.cu

* Update adam_kernel.cu

allow --keep-last-checkpoints == 0
Co-authored-by: zhougm <zhougm@dp.com>

* fix log

* fix log

* add torch 1.13.1

* add torch2.0.0

* fix typo and exclude some cases

* fix cuda install

* exclude some case

* fix typo

* remove torch 1.11.0

* add setup flag

* use sys argv rather than env variable

* add readme

* refine  code & readme

* refine

* valid with ema

* save ema model

* update ema

* rm model_fp32

* rm ordered names

* load ema

* emapy

* Update unicore/trainer.py
Co-authored-by: Guolin Ke <guolin.ke@outlook.com>