Commits · 37bba2a32d2742a10216ffd925bb8f145a732ce1 · chenpangpang / transformers

13 May, 2024 1 commit

CI: update to ROCm 6.0.2 and test MI300 (#30266) · 37bba2a3

fxmarty authored May 13, 2024



* update to ROCm 6.0.2 and test MI300

* add callers for mi300

* update dockerfile

* fix trainer tests

* remove apex

* style

* Update tests/trainer/test_trainer_seq2seq.py

* Update tests/trainer/test_trainer_seq2seq.py

* Update tests/trainer/test_trainer_seq2seq.py

* Update tests/trainer/test_trainer_seq2seq.py

* update to torch 2.3

* add workflow dispatch target

* we may need branches: mi300-ci after all

* nit

* fix docker build

* nit

* add check runner

* remove docker-gpu

* fix issues

* fix

---------
Co-authored-by: Yih-Dar <2521628+ydshieh@users.noreply.github.com>
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

37bba2a3

24 Apr, 2024 1 commit

consistent job / pytest report / artifact name correspondence (#30392) · fbb41cd4

Yih-Dar authored Apr 24, 2024



* better names

* run better names

* update

* update

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

fbb41cd4

15 Apr, 2024 1 commit
- update github actions packages' version to suppress warnings (#30249) · 440bd3c3
  Yih-Dar authored Apr 15, 2024
```
update
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  440bd3c3
31 Jan, 2024 1 commit
- Add artifact name in job step to maintain job / artifact correspondence (#28682) · 95346e9d
  Yih-Dar authored Jan 31, 2024
```
* avoid using job name

* apply to other files

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  95346e9d
10 Jan, 2024 1 commit

[Whisper] Fix slow test (#28407) · cbbe3074

Patrick von Platen authored Jan 10, 2024



* [Whisper] Fix slow test

* update

* update

* update

* update

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

cbbe3074

11 Dec, 2023 1 commit

Add deepspeed test to amd scheduled CI (#27633) · 39acfe84

Ella Charlaix authored Dec 11, 2023



* add deepspeed scheduled test for amd

* fix image

* add dockerfile

* add comment

* enable tests

* trigger

* remove trigger for this branch

* trigger

* change runner env to trigger the docker build image test

* use new docker image

* remove test suffix from docker image tag

* replace test docker image with original image

* push new image

* Trigger

* add back amd tests

* fix typo

* add amd tests back

* fix

* comment until docker image build scheduled test fix

* remove deprecated deepspeed build option

* upgrade torch

* update docker & make tests pass

* Update docker/transformers-pytorch-deepspeed-amd-gpu/Dockerfile

* fix

* tmp disable test

* precompile deepspeed to avoid timeout during tests

* fix comment

* trigger deepspeed tests with new image

* comment tests

* trigger

* add sklearn dependency to fix slow tests

* enable back other tests

* final update

---------
Co-authored-by: Felix Marty <felix@hf.co>
Co-authored-by: Félix Marty <9808326+fxmarty@users.noreply.github.com>
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

39acfe84

04 Dec, 2023 1 commit
- restructure AMD scheduled CI (#27743) · e0d2e695
  Yih-Dar authored Dec 04, 2023
```
* fix

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  e0d2e695
21 Nov, 2023 1 commit

Add RoCm scheduled CI & upgrade RoCm CI to PyTorch 2.1 (#26940) · f93c1e9e

fxmarty authored Nov 21, 2023



* add scheduled ci on amdgpu

* fix likely typo

* more tests, avoid parallelism

* precise comment

* fix report channel

* trigger docker build on this branch

* fix

* fix

* run rocm scheduled ci

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

f93c1e9e

15 Nov, 2023 1 commit
- Make some jobs run on the GitHub Actions runners (#27512) · 64e21ca2
  Yih-Dar authored Nov 15, 2023
```
fix
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  64e21ca2
10 Nov, 2023 1 commit

At most 2 GPUs for CI (#27435) · 00dc8562

Yih-Dar authored Nov 10, 2023



At most 2 GPUs
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

00dc8562

31 Oct, 2023 1 commit

Disable CI runner check (#27170) · 9dc4ce9e

Yih-Dar authored Oct 31, 2023



Disable runner check
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

9dc4ce9e

27 Sep, 2023 1 commit

Update `runs-on` in workflow files (#26435) · 6ae71ec8

Yih-Dar authored Sep 27, 2023



* update

* fix

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

6ae71ec8

28 Jun, 2023 1 commit
- Unpin DeepSpeed and require DS >= 0.9.3 (#24541) · 11cb6e0f
  Yih-Dar authored Jun 28, 2023
```
* fix

* fix

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  11cb6e0f
05 Jun, 2023 1 commit
- Pin `deepspeed` to `0.9.2` for now (#24024) · 7631db0f
  Yih-Dar authored Jun 05, 2023
```
fix
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  7631db0f
22 May, 2023 1 commit

Update workflow files (#23658) · e69feab8

Yih-Dar authored May 22, 2023



* fix

* fix

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

e69feab8

20 Apr, 2023 1 commit

Change schedule CI time (#22884) · aa431675

Yih-Dar authored Apr 20, 2023



* fix

* Update .github/workflows/self-nightly-past-ci-caller.yml
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

aa431675

19 Apr, 2023 1 commit
- Show diff between 2 CI runs on Slack reports (#22798) · 648bd5a8
  Yih-Dar authored Apr 19, 2023
```
fix
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  648bd5a8
13 Apr, 2023 1 commit
- Remove `DS_BUILD_AIO=1` (#22741) · 656d41ab
  Yih-Dar authored Apr 13, 2023
```
fix
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  656d41ab
30 Mar, 2023 1 commit

(Re-)Enable Nightly + Past CI (#22393) · 0fe6c6bd

Yih-Dar authored Mar 30, 2023



* Enable Nightly + Past CI

* put schedule

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

0fe6c6bd

28 Feb, 2023 1 commit

Make Slack CI reporting stronger (#21823) · aab895c3

Yih-Dar authored Feb 28, 2023



* Use token

* Avoid failure

* better error

* Fix

* fix style

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

aab895c3

06 Dec, 2022 1 commit

Update some GH action versions (#20537) · bf9a5882

Yih-Dar authored Dec 06, 2022



* update actions versions

* update actions versions

* update actions versions

* update actions versions
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

bf9a5882

05 Dec, 2022 1 commit
- Replace `set-output` by `$GITHUB_OUTPUT` (#20547) · 67d32f46
  Yih-Dar authored Dec 05, 2022
```
* remove set-output
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  67d32f46
29 Nov, 2022 1 commit
- extract warnings in GH workflows (#20487) · e8d448ed
  Yih-Dar authored Nov 29, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  e8d448ed
17 Nov, 2022 1 commit
- Add missing report button for Example test (#20293) · 700e0cd6
  Yih-Dar authored Nov 17, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  700e0cd6
04 Nov, 2022 1 commit
- Show installed libraries and their versions in GA jobs (#20069) · c06d5556
  Yih-Dar authored Nov 04, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  c06d5556
07 Oct, 2022 1 commit

Rework pipeline tests (#19366) · 9ac586b3

Sylvain Gugger authored Oct 07, 2022

* Rework pipeline tests

* Try to fix Flax tests

* Try to put it before

* Use a new decorator instead

* Remove ignore marker since it doesn't work

* Filter pipeline tests

* Woopsie

* Use the fitlered list

* Clean up and fake modif

* Remove init

* Revert fake modif

9ac586b3

19 Sep, 2022 1 commit
- Add runner availability check (#19054) · ba7f2173
  Yih-Dar authored Sep 19, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  ba7f2173
07 Sep, 2022 1 commit

Add checks for more workflow jobs (#18905) · 7a811894

Yih-Dar authored Sep 07, 2022



* add check for scheduled CI

* Add check to other CIs
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

7a811894

06 Sep, 2022 1 commit
- unpin slack_sdk version (#18901) · 7d5fde99
  Yih-Dar authored Sep 06, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  7d5fde99
02 Sep, 2022 2 commits
- Remove cached torch_extensions on CI runners (#18868) · ecdf9b06
  Yih-Dar authored Sep 02, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  ecdf9b06
- pin Slack SDK to 3.18.1 to avoid failing issue (#18869) · 0ab465a5
  Yih-Dar authored Sep 02, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  0ab465a5
04 Aug, 2022 1 commit
- Add machine type in the artifact of Examples directory job (#18459) · d2704c41
  Yih-Dar authored Aug 04, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  d2704c41
17 Jun, 2022 1 commit

Enable PyTorch nightly build CI (#17335) · ca169dbd

Yih-Dar authored Jun 17, 2022



* nightly build pytorch CI

* fix working dir

* change time and event name
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

ca169dbd

09 Jun, 2022 1 commit

Pre-build DeepSpeed (#17607) · da0bed5f

Yih-Dar authored Jun 09, 2022



* pre-build deepspeed
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

da0bed5f

07 Jun, 2022 1 commit
- Use latest stable PyTorch/DeepSpeed for Push & Scheduled CI (#17417) · 9aa230aa
  Yih-Dar authored Jun 07, 2022
```
* update versions
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  9aa230aa
02 Jun, 2022 1 commit

Print more library versions in CI (#17384) · 659b27fd

Yih-Dar authored Jun 02, 2022



* print more lib. versions and just befor test runs

* update print_env_pt.py

* rename to print_env

* Disable warning + better job name

* print python version
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

659b27fd

17 May, 2022 1 commit

Fix missing job action button in CI report (#17270) · 1ac2b8fa

Yih-Dar authored May 17, 2022



* use matrix.machine_type

* fix job names used in job_link
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

1ac2b8fa

13 May, 2022 3 commits

Fix push CI channel (#17242) · 506899d1
Yih-Dar authored May 13, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
506899d1
fix --gpus option for docker (#17235) · 993553b2
Yih-Dar authored May 13, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
993553b2

Update self-push workflow (#17177) · 38043d84

Yih-Dar authored May 13, 2022



* update push ci

* install git-python

* update comment

* update deepspeed jobs

* fix report

* skip 2 more tests that require fairscale

* Fix changes in test_fetcher.py (to deal with `setup.py` is changed)

* set RUN_PT_TF_CROSS_TESTS=1 and final clean-up

* remove SIGOPT_API_TOKEN

* remove echo "$matrix_folders"
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

38043d84