Commits · 5c7e11e01012112498ece9ee4ab3894c2a702195 · chenpangpang / transformers

05 Dec, 2023 1 commit

Update CUDA versions for DeepSpeed (#27853) · acd65316

Zach Mueller authored Dec 05, 2023

* Update CUDA versions

* For testing

* Allow for workflow dispatch

* Use newer image

* Revert workflow

* Revert workflow

* Push

* Other docker image

acd65316

05 Oct, 2023 1 commit
- Fix `transformers-pytorch-gpu` docker build (#26615) · 9d206012
  Yih-Dar authored Oct 05, 2023
```
Fix
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  9d206012
17 May, 2023 1 commit
- Update 3 docker files to use cu118 (#23406) · 22a07699
  Yih-Dar authored May 17, 2023
```
* fix

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  22a07699
11 May, 2023 1 commit

unpin tf prob (#23293) · ba71d9e9

Yih-Dar authored May 11, 2023



* unpin tf prob

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

ba71d9e9

24 Mar, 2023 1 commit

Update docker files to use official torch 2.0.0 (#22357) · 01203475

Yih-Dar authored Mar 24, 2023



* update docker files to use official torch 2.0.0

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

01203475

17 Mar, 2023 2 commits
- Revert "Use `dash==2.8.1` for now for daily CI" (#22233) · bec07561
  Yih-Dar authored Mar 17, 2023
```
Revert "Use `dash==2.8.1` for now for daily CI (#22227)"

This reverts commit 53218671.
```
  bec07561
- Use `dash==2.8.1` for now for daily CI (#22227) · 53218671
  Yih-Dar authored Mar 17, 2023
```
Use dash 2.8.1 for now
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  53218671
13 Mar, 2023 1 commit
- Prepare daily CI for torch 2.0.0 (#22135) · ba9e0191
  Yih-Dar authored Mar 13, 2023
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  ba9e0191
02 Feb, 2023 1 commit

Use torch `1.13.1` in push/schedule CI (#21421) · db572b38

Yih-Dar authored Feb 02, 2023



Use torch 1.13.1 in push/scheduled CI
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

db572b38

15 Dec, 2022 1 commit
- Install video dependency for pipeline CI (#20777) · b1706f69
  Yih-Dar authored Dec 15, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  b1706f69
12 Dec, 2022 1 commit
- Update CI to torch 1.13.0 (#20687) · d4bf9ee1
  Yih-Dar authored Dec 12, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  d4bf9ee1
26 Oct, 2022 1 commit

Change the import of kenlm from github to pypi (#19770) · 7829c890

raghavanone authored Oct 26, 2022

* Change the import of kenlm from github to pypi

* Change the import of kenlm from github to pypi in circleci config

* Fix code quality issues

* Fix isort issue, add kenlm in extras for audio

* Add kenlm to deps

* Add kenlm to deps

* Commit 'make fixup' changes

* Remove version from kenlm deps

* commit make fixup changes

* Remove manual installation of kenlm

* Remove manual installation of kenlm

* Remove manual installation of kenlm

7829c890

23 Aug, 2022 1 commit
- Unpin detectron2 (#18727) · 84beb8a4
  Yih-Dar authored Aug 23, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  84beb8a4
19 Aug, 2022 1 commit
- [Hotfix] pin detectron2 5aeb252 to avoid test fix (#18701) · 30992ef0
  Yih-Dar authored Aug 20, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  30992ef0
16 Aug, 2022 1 commit
- Change scheduled CIs to use torch 1.12.1 (#18644) · 510c2a0b
  Yih-Dar authored Aug 16, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  510c2a0b
29 Jun, 2022 2 commits
- PyTorch 1.12.0 for scheduled CI (#17949) · b089cca3
  Yih-Dar authored Jun 29, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  b089cca3
- Use explicit torch version in deepspeed CI (#17942) · 9fe2403b
  Yih-Dar authored Jun 29, 2022
```
* use explicit torch version
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  9fe2403b
07 Jun, 2022 1 commit
- Use latest stable PyTorch/DeepSpeed for Push & Scheduled CI (#17417) · 9aa230aa
  Yih-Dar authored Jun 07, 2022
```
* update versions
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  9aa230aa
25 Mar, 2022 1 commit
- Rename master to main for notebooks links and leftovers (#16397) · 867f3950
  Sylvain Gugger authored Mar 25, 2022
  
  867f3950
14 Mar, 2022 1 commit
- Dcoker images runtime -> devel (#16141) · c1000e70
  Lysandre Debut authored Mar 14, 2022
```
* Runtime -> Devel

* Torch before DeepSpeed
```
  c1000e70
01 Mar, 2022 2 commits

Scatter should run on CUDA (#15872) · 7ff9d450
Lysandre Debut authored Mar 01, 2022

7ff9d450

Add PT + TF automatic builds (#15860) · 54f0db40

Lysandre Debut authored Mar 01, 2022



* Add PT + TF automatic builds

* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Wrap up
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

54f0db40

23 Feb, 2022 1 commit
- [Test refactor 5/5] Build docker images (#15729) · a0e34806
  Lysandre Debut authored Feb 23, 2022
  
  a0e34806
06 Oct, 2020 1 commit

Docker GPU Images: Add NVIDIA/apex to the cuda images with pytorch (#7598) · 98fb7185

Adrien David-Sivelle authored Oct 06, 2020

- Use cuda:10.2 image instead of 10.1 (to address version mismatch
  warning with pytorch)
- Use devel version that is built on the runtime and includes headers
  and development tools (was otherwise failing to build apex)

98fb7185

04 Mar, 2020 1 commit

Adding Docker images for transformers + notebooks (#3051) · 71c87119

Funtowicz Morgan authored Mar 04, 2020



* Added transformers-pytorch-cpu and gpu Docker images
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added automatic jupyter launch for Docker image.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Move image from alpine to Ubuntu to align with NVidia container images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added TRANSFORMERS_VERSION argument to Dockerfile.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added Pytorch-GPU based Docker image
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added Tensorflow images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Use python 3.7 as Tensorflow doesnt provide 3.8 compatible wheel.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Remove double FROM instructions on transformers-pytorch-cpu image.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added transformers-tensorflow-gpu Docker image.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* use the correct ubuntu version for tensorflow-gpu
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added pipelines example notebook
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added transformers-cpu and transformers-gpu (including both PyTorch and TensorFlow) images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Docker images doesnt start jupyter notebook by default.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Tokenizers notebook
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Update images links
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Update Docker images to python 3.7.6 and transformers 2.5.1
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added 02-transformers notebook.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Trying to realign 02-transformers notebook ?
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added Transformer image schema

* Some tweaks on tokenizers notebook

* Removed old notebooks.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Attempt to provide table of content for each notebooks
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Second attempt.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Reintroduce transformer image.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Keep trying
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* It's going to fly !
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Remaining of the Table of Content
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Fix inlined elements for the table of content
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Removed anaconda dependencies for Docker images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Removing notebooks ToC
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added LABEL to each docker image.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Removed old Dockerfile
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Directly use the context and include transformers from here.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Reduce overall size of compiled Docker images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Install jupyter by default and use CMD for easier launching of the images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Reduce number of layers in the images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added README.md for notebooks.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Fix notebooks link in README
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Fix some wording issues.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added blog notebooks too.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Addressing spelling errors in review comments.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
Co-authored-by: MOI Anthony <xn1t0x@gmail.com>

71c87119