Skip to content

GitLab

Switch branch/tag
  1. 11 Jan, 2024 1 commit
  3. 10 Jan, 2024 2 commits
  5. 03 Jan, 2024 1 commit
  7. 14 Dec, 2023 1 commit
  9. 11 Dec, 2023 2 commits
    • Ella Charlaix's avatar
      Add deepspeed test to amd scheduled CI (#27633) · 39acfe84
      Ella Charlaix authored 
      

* add deepspeed scheduled test for amd

* fix image

* add dockerfile

* add comment

* enable tests

* trigger

* remove trigger for this branch

* trigger

* change runner env to trigger the docker build image test

* use new docker image

* remove test suffix from docker image tag

* replace test docker image with original image

* push new image

* Trigger

* add back amd tests

* fix typo

* add amd tests back

* fix

* comment until docker image build scheduled test fix

* remove deprecated deepspeed build option

* upgrade torch

* update docker & make tests pass

* Update docker/transformers-pytorch-deepspeed-amd-gpu/Dockerfile

* fix

* tmp disable test

* precompile deepspeed to avoid timeout during tests

* fix comment

* trigger deepspeed tests with new image

* comment tests

* trigger

* add sklearn dependency to fix slow tests

* enable back other tests

* final update

---------
Co-authored-by: default avatarFelix Marty <felix@hf.co>
Co-authored-by: default avatarFélix Marty <9808326+fxmarty@users.noreply.github.com>
Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
      39acfe84
    • Yih-Dar's avatar
      Fix AMD scheduled CI not triggered (#27951) · 0f59d2f1
      Yih-Dar authored 
      

fix
Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
      0f59d2f1
  11. 07 Dec, 2023 1 commit
  13. 06 Dec, 2023 1 commit
  15. 04 Dec, 2023 1 commit
  17. 30 Nov, 2023 1 commit
  19. 28 Nov, 2023 1 commit
  21. 27 Nov, 2023 1 commit
  23. 21 Nov, 2023 1 commit
  25. 17 Nov, 2023 1 commit
  27. 16 Nov, 2023 1 commit
  29. 15 Nov, 2023 1 commit
  31. 10 Nov, 2023 1 commit
  33. 08 Nov, 2023 1 commit
  35. 06 Nov, 2023 1 commit
  37. 31 Oct, 2023 1 commit
  39. 25 Oct, 2023 1 commit
  41. 20 Oct, 2023 1 commit
  43. 16 Oct, 2023 1 commit
  45. 11 Oct, 2023 1 commit
  47. 03 Oct, 2023 1 commit
    • Funtowicz Morgan's avatar
      [AMD] Add initial version for run_tests_multi_gpu (#26346) · 3632fb3c
      Funtowicz Morgan authored 
      

* Add initial version for run_tests_multi_gpu

* Trigger change in BERT

* fix typo setup -> setup_gpu

* Add tag mi210

* Enable multi-gpu jobs

* One more

* Use dynamic device allocation

* Attempt to fix syntax for docker create

* fix script path

* fix

* temp machine type

* fix label

* Enable multi-gpu tests

* Rename multi-amd-gpu to multi-gpu

* Let's not be lazy dude

* Update rocm-smi output

* Add gpu_flavour in the matrix

* Fix typos

* merge single/multi dispatch into the matrix

* Format.

* Revert BERT's change

---------
Co-authored-by: default avatarGuillaume LEGENDRE <glegendre01@gmail.com>
      3632fb3c
  49. 27 Sep, 2023 1 commit
  51. 20 Sep, 2023 1 commit
    • Funtowicz Morgan's avatar
      Integrate AMD GPU in CI/CD environment (#26007) · 2d71307d
      Funtowicz Morgan authored 
      

* Add a Dockerfile for PyTorch + ROCm based on official AMD released artifact

* Add a new artifact single-amdgpu testing on main

* Attempt to test the workflow without merging.

* Changed BERT to check if things are triggered

* Meet the dependencies graph on workflow

* Revert BERT changes

* Add check_runners_amdgpu to correctly mount and check availability

* Rename setup to setup_gpu for CUDA and add setup_amdgpu for AMD

* Fix all the needs.setup -> needs.setup_[gpu|amdgpu] dependencies

* Fix setup dependency graph to use check_runner_amdgpu

* Let's do the runner status check only on AMDGPU target

* Update the Dockerfile.amd to put ourselves in / rather than /var/lib

* Restore the whole setup for CUDA too.

* Let's redisable them

* Change BERT to trigger tests

* Restore BERT

* Add torchaudio with rocm 5.6 to AMD Dockerfile (#26050)

fix dockerfile
Co-authored-by: default avatarFelix Marty <felix@hf.co>

* Place AMD GPU tests in a separate workflow (correct branch) (#26105)

AMDGPU CI lives in an other workflow

* Fix invalid job name is dependencies.

* Remove tests multi-amdgpu for now.

* Use single-amdgpu

* Use --net=host for now.

* Remote host networking.

* Removed duplicated check_runners_amdgpu step

* Let's tag machine-types with mi210 for now.

* Machine type should be only mi210

* Remove unnecessary push.branches item

* Apply review suggestions moving from `x-amdgpu` to `x-gpu` introducing `amd-gpu` and `miXXX` labels.

* Remove amdgpu from step names.

* finalize

* delete

---------
Co-authored-by: default avatarfxmarty <9808326+fxmarty@users.noreply.github.com>
Co-authored-by: default avatarFelix Marty <felix@hf.co>
Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
      2d71307d
  53. 30 Aug, 2023 2 commits
  55. 23 Aug, 2023 2 commits
  57. 17 Aug, 2023 1 commit
    • Sylvain Gugger's avatar
      More utils doc (#25457) · 2defb6b0
      Sylvain Gugger authored 
      * Document and clean more utils.

* More documentation and fixes

* Switch to Lysandre's token

* Address review comments

* Actually put else
      2defb6b0
  59. 17 Jul, 2023 1 commit
  61. 28 Jun, 2023 2 commits
  63. 20 Jun, 2023 1 commit
  65. 19 Jun, 2023 1 commit
  67. 16 Jun, 2023 1 commit
  69. 07 Jun, 2023 1 commit