Skip to content

GitLab

Switch branch/tag
  1. 08 Nov, 2023 1 commit
  3. 06 Nov, 2023 1 commit
  5. 31 Oct, 2023 1 commit
  7. 25 Oct, 2023 1 commit
  9. 20 Oct, 2023 1 commit
  11. 16 Oct, 2023 1 commit
  13. 11 Oct, 2023 1 commit
  15. 03 Oct, 2023 1 commit
    • Funtowicz Morgan's avatar
      [AMD] Add initial version for run_tests_multi_gpu (#26346) · 3632fb3c
      Funtowicz Morgan authored 
      

* Add initial version for run_tests_multi_gpu

* Trigger change in BERT

* fix typo setup -> setup_gpu

* Add tag mi210

* Enable multi-gpu jobs

* One more

* Use dynamic device allocation

* Attempt to fix syntax for docker create

* fix script path

* fix

* temp machine type

* fix label

* Enable multi-gpu tests

* Rename multi-amd-gpu to multi-gpu

* Let's not be lazy dude

* Update rocm-smi output

* Add gpu_flavour in the matrix

* Fix typos

* merge single/multi dispatch into the matrix

* Format.

* Revert BERT's change

---------
Co-authored-by: default avatarGuillaume LEGENDRE <glegendre01@gmail.com>
      3632fb3c
  17. 27 Sep, 2023 1 commit
  19. 20 Sep, 2023 1 commit
    • Funtowicz Morgan's avatar
      Integrate AMD GPU in CI/CD environment (#26007) · 2d71307d
      Funtowicz Morgan authored 
      

* Add a Dockerfile for PyTorch + ROCm based on official AMD released artifact

* Add a new artifact single-amdgpu testing on main

* Attempt to test the workflow without merging.

* Changed BERT to check if things are triggered

* Meet the dependencies graph on workflow

* Revert BERT changes

* Add check_runners_amdgpu to correctly mount and check availability

* Rename setup to setup_gpu for CUDA and add setup_amdgpu for AMD

* Fix all the needs.setup -> needs.setup_[gpu|amdgpu] dependencies

* Fix setup dependency graph to use check_runner_amdgpu

* Let's do the runner status check only on AMDGPU target

* Update the Dockerfile.amd to put ourselves in / rather than /var/lib

* Restore the whole setup for CUDA too.

* Let's redisable them

* Change BERT to trigger tests

* Restore BERT

* Add torchaudio with rocm 5.6 to AMD Dockerfile (#26050)

fix dockerfile
Co-authored-by: default avatarFelix Marty <felix@hf.co>

* Place AMD GPU tests in a separate workflow (correct branch) (#26105)

AMDGPU CI lives in an other workflow

* Fix invalid job name is dependencies.

* Remove tests multi-amdgpu for now.

* Use single-amdgpu

* Use --net=host for now.

* Remote host networking.

* Removed duplicated check_runners_amdgpu step

* Let's tag machine-types with mi210 for now.

* Machine type should be only mi210

* Remove unnecessary push.branches item

* Apply review suggestions moving from `x-amdgpu` to `x-gpu` introducing `amd-gpu` and `miXXX` labels.

* Remove amdgpu from step names.

* finalize

* delete

---------
Co-authored-by: default avatarfxmarty <9808326+fxmarty@users.noreply.github.com>
Co-authored-by: default avatarFelix Marty <felix@hf.co>
Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
      2d71307d
  21. 30 Aug, 2023 2 commits
  23. 23 Aug, 2023 2 commits
  25. 17 Aug, 2023 1 commit
    • Sylvain Gugger's avatar
      More utils doc (#25457) · 2defb6b0
      Sylvain Gugger authored 
      * Document and clean more utils.

* More documentation and fixes

* Switch to Lysandre's token

* Address review comments

* Actually put else
      2defb6b0
  27. 17 Jul, 2023 1 commit
  29. 28 Jun, 2023 2 commits
  31. 20 Jun, 2023 1 commit
  33. 19 Jun, 2023 1 commit
  35. 16 Jun, 2023 1 commit
  37. 07 Jun, 2023 2 commits
  39. 05 Jun, 2023 1 commit
  41. 01 Jun, 2023 2 commits
  43. 22 May, 2023 1 commit
  45. 19 May, 2023 2 commits
  47. 17 May, 2023 1 commit
  49. 11 May, 2023 1 commit
  51. 10 May, 2023 1 commit
  53. 09 May, 2023 2 commits
    • Sylvain Gugger's avatar
      Revert "[Doctests] Refactor doctests + add CI" (#23245) · 69ee4624
      Sylvain Gugger authored 
      Revert "[Doctests] Refactor doctests + add CI (#22987)"

This reverts commit 627f4479.
      69ee4624
    • Arthur's avatar
      [Doctests] Refactor doctests + add CI (#22987) · 627f4479
      Arthur authored 
      

* intiial commit

* new styling

* update

* just run doctest in CI

* remove more test for fast dev

* update

* update refs

* update path and fetch upstream

* update documentatyion trests

* typo

* parse pwd

* don't check for files that are in hidden folders

* just give paths relative to transformers

* update

* update

* update

* major refactoring

* make sure options is ok

* lest test that mdx is tested

* doctest glob

* nits

* update doctest nightly

* some cleaning

* run correct test on diff

* debug

* run on a single worker

* skip_cuda_test tampkate

* updates

* add rA and continue on failure

* test options

* parse `py` codeblock?

* we don't need to replace ignore results, don't remember whyu I put it

* cleanup

* more cleaning

* fix arg

* more cleaning

* clean an todo

* more pre-processing

* doctest-module has none so extra `- ` is needed

* remove logs

* nits

* doctest-modules ....

* oups

* let's use sugar

* make dataset go quiet

* add proper timeout

* nites

* spleling timeout

* update

* properly skip tests that have CUDSA

* proper skipping

* cleaning main and get tests to run

* remove make report?

* remove tee

* some updates

* tee was removed but is the full output still available?

* [all-test]

* only our tests

* don't  touch tee in this PR

* no atee-sys

* proper sub

* monkey

* only replace call

* fix sub

* nits

* nits

* fix invalid syntax

* add skip cuda doctest env variable

* make sure all packages are installed

* move file

* update check repo

* revert changes

* nit

* finish cleanup

* fix re

* findall

* update don't test init files

* ignore pycache

* `-ignore-pycache` when running pytests

* try to fix the import missmatch error

* install dec

* pytest is required as doctest_utils imports things from it

* the only log issues were dataset, ignore results should work

* more cleaning

* Update .circleci/create_circleci_config.py
Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Apply suggestions from code review
Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>

* [ydshieh] empty string if cuda is found

* [ydshieh] fix condition

* style

* [ydshieh] fix

* Add comment

* style

* style

* show failure

* trigger CI

---------
Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: default avatarYih-Dar <2521628+ydshieh@users.noreply.github.com>
Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
      627f4479
  55. 24 Apr, 2023 1 commit
  57. 20 Apr, 2023 1 commit
  59. 19 Apr, 2023 1 commit
  61. 18 Apr, 2023 1 commit
  63. 17 Apr, 2023 1 commit
    • Sylvain Gugger's avatar
      Simplify update metadata job (#22811) · e13d6ef7
      Sylvain Gugger authored 
      * Simplify update metadata job

* Match more branch names

* Install all what is necessary

* Install all what is necessary

* Forgot the dev

* Install less stuff

* This syntax?
      e13d6ef7
  65. 13 Apr, 2023 1 commit