Skip to content

GitLab

Commit ad596b37 authored by DanilBaibak's avatar DanilBaibak Committed by Facebook GitHub Bot
Browse files

Switch to nova Linux Wheel build (#2896) 

Summary:
Switch to Nova Linux Wheel build.

- [x] Disable the CircleCI builds for Linux Wheel.
- [x] Enable the Nova workflow for Linux Wheel.

~The Linux Wheel Python3.8 build has been kept because it is a dependency for the `docstring_parameters_sync` job.~ As Omkar pointed out, Docstring Parameters Sync also runs on GHA (https://github.com/pytorch/audio/actions/runs/3638187635/jobs/6140090209). So, we completely switched to the Nova Linux Wheel build.

Pull Request resolved: https://github.com/pytorch/audio/pull/2896

Reviewed By: mthrok

Differential Revision: D41994993

Pulled By: DanilBaibak

fbshipit-source-id: 2bafdbe1b62ef8fa194ce96f4d4667a3ed3dc44f
parent cbd35438
Hide whitespace changes
Inline Side-by-side
Showing with 8 additions and 1016 deletions
.circleci/config.yml
View file @ ad596b37
...@@ -929,274 +929,6 @@ workflows: ...@@ -929,274 +929,6 @@ workflows:
python_version: foo python_version: foo
requires: requires:
- download_third_parties - download_third_parties
- binary_linux_wheel:
cuda_version: cpu
name: binary_linux_wheel_py3.7_cpu
python_version: '3.7'
requires:
- build_ffmpeg_linux
- smoke_test_linux_pip:
cuda_version: cpu
name: binary_linux_wheel_py3.7_cpu_smoke_test_pip
python_version: '3.7'
requires:
- binary_linux_wheel_py3.7_cpu
- binary_linux_wheel:
cuda_version: cu116
name: binary_linux_wheel_py3.7_cu116
python_version: '3.7'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda116
- smoke_test_linux_pip:
cuda_version: cu116
name: binary_linux_wheel_py3.7_cu116_smoke_test_pip
python_version: '3.7'
requires:
- binary_linux_wheel_py3.7_cu116
- binary_linux_wheel:
cuda_version: cu117
name: binary_linux_wheel_py3.7_cu117
python_version: '3.7'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda117
- smoke_test_linux_pip:
cuda_version: cu117
name: binary_linux_wheel_py3.7_cu117_smoke_test_pip
python_version: '3.7'
requires:
- binary_linux_wheel_py3.7_cu117
- binary_linux_wheel:
cuda_version: rocm5.2
name: binary_linux_wheel_py3.7_rocm5.2
python_version: '3.7'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.2
- smoke_test_linux_pip:
cuda_version: rocm5.2
name: binary_linux_wheel_py3.7_rocm5.2_smoke_test_pip
python_version: '3.7'
requires:
- binary_linux_wheel_py3.7_rocm5.2
- binary_linux_wheel:
cuda_version: rocm5.3
name: binary_linux_wheel_py3.7_rocm5.3
python_version: '3.7'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.3
- smoke_test_linux_pip:
cuda_version: rocm5.3
name: binary_linux_wheel_py3.7_rocm5.3_smoke_test_pip
python_version: '3.7'
requires:
- binary_linux_wheel_py3.7_rocm5.3
- binary_linux_wheel:
cuda_version: cpu
filters:
branches:
only:
- /.*/
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: binary_linux_wheel_py3.8_cpu
python_version: '3.8'
requires:
- build_ffmpeg_linux
- smoke_test_linux_pip:
cuda_version: cpu
filters:
branches:
only:
- /.*/
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: binary_linux_wheel_py3.8_cpu_smoke_test_pip
python_version: '3.8'
requires:
- binary_linux_wheel_py3.8_cpu
- binary_linux_wheel:
cuda_version: cu116
name: binary_linux_wheel_py3.8_cu116
python_version: '3.8'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda116
- smoke_test_linux_pip:
cuda_version: cu116
name: binary_linux_wheel_py3.8_cu116_smoke_test_pip
python_version: '3.8'
requires:
- binary_linux_wheel_py3.8_cu116
- binary_linux_wheel:
cuda_version: cu117
name: binary_linux_wheel_py3.8_cu117
python_version: '3.8'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda117
- smoke_test_linux_pip:
cuda_version: cu117
name: binary_linux_wheel_py3.8_cu117_smoke_test_pip
python_version: '3.8'
requires:
- binary_linux_wheel_py3.8_cu117
- binary_linux_wheel:
cuda_version: rocm5.2
name: binary_linux_wheel_py3.8_rocm5.2
python_version: '3.8'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.2
- smoke_test_linux_pip:
cuda_version: rocm5.2
name: binary_linux_wheel_py3.8_rocm5.2_smoke_test_pip
python_version: '3.8'
requires:
- binary_linux_wheel_py3.8_rocm5.2
- binary_linux_wheel:
cuda_version: rocm5.3
name: binary_linux_wheel_py3.8_rocm5.3
python_version: '3.8'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.3
- smoke_test_linux_pip:
cuda_version: rocm5.3
name: binary_linux_wheel_py3.8_rocm5.3_smoke_test_pip
python_version: '3.8'
requires:
- binary_linux_wheel_py3.8_rocm5.3
- binary_linux_wheel:
cuda_version: cpu
name: binary_linux_wheel_py3.9_cpu
python_version: '3.9'
requires:
- build_ffmpeg_linux
- smoke_test_linux_pip:
cuda_version: cpu
name: binary_linux_wheel_py3.9_cpu_smoke_test_pip
python_version: '3.9'
requires:
- binary_linux_wheel_py3.9_cpu
- binary_linux_wheel:
cuda_version: cu116
name: binary_linux_wheel_py3.9_cu116
python_version: '3.9'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda116
- smoke_test_linux_pip:
cuda_version: cu116
name: binary_linux_wheel_py3.9_cu116_smoke_test_pip
python_version: '3.9'
requires:
- binary_linux_wheel_py3.9_cu116
- binary_linux_wheel:
cuda_version: cu117
name: binary_linux_wheel_py3.9_cu117
python_version: '3.9'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda117
- smoke_test_linux_pip:
cuda_version: cu117
name: binary_linux_wheel_py3.9_cu117_smoke_test_pip
python_version: '3.9'
requires:
- binary_linux_wheel_py3.9_cu117
- binary_linux_wheel:
cuda_version: rocm5.2
name: binary_linux_wheel_py3.9_rocm5.2
python_version: '3.9'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.2
- smoke_test_linux_pip:
cuda_version: rocm5.2
name: binary_linux_wheel_py3.9_rocm5.2_smoke_test_pip
python_version: '3.9'
requires:
- binary_linux_wheel_py3.9_rocm5.2
- binary_linux_wheel:
cuda_version: rocm5.3
name: binary_linux_wheel_py3.9_rocm5.3
python_version: '3.9'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.3
- smoke_test_linux_pip:
cuda_version: rocm5.3
name: binary_linux_wheel_py3.9_rocm5.3_smoke_test_pip
python_version: '3.9'
requires:
- binary_linux_wheel_py3.9_rocm5.3
- binary_linux_wheel:
cuda_version: cpu
name: binary_linux_wheel_py3.10_cpu
python_version: '3.10'
requires:
- build_ffmpeg_linux
- smoke_test_linux_pip:
cuda_version: cpu
name: binary_linux_wheel_py3.10_cpu_smoke_test_pip
python_version: '3.10'
requires:
- binary_linux_wheel_py3.10_cpu
- binary_linux_wheel:
cuda_version: cu116
name: binary_linux_wheel_py3.10_cu116
python_version: '3.10'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda116
- smoke_test_linux_pip:
cuda_version: cu116
name: binary_linux_wheel_py3.10_cu116_smoke_test_pip
python_version: '3.10'
requires:
- binary_linux_wheel_py3.10_cu116
- binary_linux_wheel:
cuda_version: cu117
name: binary_linux_wheel_py3.10_cu117
python_version: '3.10'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda117
- smoke_test_linux_pip:
cuda_version: cu117
name: binary_linux_wheel_py3.10_cu117_smoke_test_pip
python_version: '3.10'
requires:
- binary_linux_wheel_py3.10_cu117
- binary_linux_wheel:
cuda_version: rocm5.2
name: binary_linux_wheel_py3.10_rocm5.2
python_version: '3.10'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.2
- smoke_test_linux_pip:
cuda_version: rocm5.2
name: binary_linux_wheel_py3.10_rocm5.2_smoke_test_pip
python_version: '3.10'
requires:
- binary_linux_wheel_py3.10_rocm5.2
- binary_linux_wheel:
cuda_version: rocm5.3
name: binary_linux_wheel_py3.10_rocm5.3
python_version: '3.10'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.3
- smoke_test_linux_pip:
cuda_version: rocm5.3
name: binary_linux_wheel_py3.10_rocm5.3_smoke_test_pip
python_version: '3.10'
requires:
- binary_linux_wheel_py3.10_rocm5.3
- binary_macos_wheel: - binary_macos_wheel:
cuda_version: cpu cuda_version: cpu
name: binary_macos_wheel_py3.7_cpu name: binary_macos_wheel_py3.7_cpu
...@@ -1737,11 +1469,6 @@ workflows: ...@@ -1737,11 +1469,6 @@ workflows:
python_version: '3.8' python_version: '3.8'
requires: requires:
- build_docs - build_docs
- docstring_parameters_sync:
name: docstring_parameters_sync
python_version: '3.8'
requires:
- binary_linux_wheel_py3.8_cpu
unittest: unittest:
jobs: jobs:
- download_third_parties: - download_third_parties:
...@@ -1863,742 +1590,6 @@ workflows: ...@@ -1863,742 +1590,6 @@ workflows:
python_version: foo python_version: foo
requires: requires:
- download_third_parties - download_third_parties
- binary_linux_wheel:
cuda_version: cpu
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_cpu
python_version: '3.7'
requires:
- build_ffmpeg_linux
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_cpu_upload
requires:
- nightly_binary_linux_wheel_py3.7_cpu
subfolder: cpu/
- smoke_test_linux_pip:
cuda_version: cpu
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_cpu_smoke_test_pip
python_version: '3.7'
requires:
- nightly_binary_linux_wheel_py3.7_cpu
- binary_linux_wheel:
cuda_version: cu116
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_cu116
python_version: '3.7'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda116
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_cu116_upload
requires:
- nightly_binary_linux_wheel_py3.7_cu116
subfolder: cu116/
- smoke_test_linux_pip:
cuda_version: cu116
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_cu116_smoke_test_pip
python_version: '3.7'
requires:
- nightly_binary_linux_wheel_py3.7_cu116
- binary_linux_wheel:
cuda_version: cu117
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_cu117
python_version: '3.7'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda117
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_cu117_upload
requires:
- nightly_binary_linux_wheel_py3.7_cu117
subfolder: cu117/
- smoke_test_linux_pip:
cuda_version: cu117
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_cu117_smoke_test_pip
python_version: '3.7'
requires:
- nightly_binary_linux_wheel_py3.7_cu117
- binary_linux_wheel:
cuda_version: rocm5.2
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_rocm5.2
python_version: '3.7'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.2
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_rocm5.2_upload
requires:
- nightly_binary_linux_wheel_py3.7_rocm5.2
subfolder: rocm5.2/
- smoke_test_linux_pip:
cuda_version: rocm5.2
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_rocm5.2_smoke_test_pip
python_version: '3.7'
requires:
- nightly_binary_linux_wheel_py3.7_rocm5.2
- binary_linux_wheel:
cuda_version: rocm5.3
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_rocm5.3
python_version: '3.7'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.3
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_rocm5.3_upload
requires:
- nightly_binary_linux_wheel_py3.7_rocm5.3
subfolder: rocm5.3/
- smoke_test_linux_pip:
cuda_version: rocm5.3
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_rocm5.3_smoke_test_pip
python_version: '3.7'
requires:
- nightly_binary_linux_wheel_py3.7_rocm5.3
- binary_linux_wheel:
cuda_version: cpu
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_cpu
python_version: '3.8'
requires:
- build_ffmpeg_linux
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_cpu_upload
requires:
- nightly_binary_linux_wheel_py3.8_cpu
subfolder: cpu/
- smoke_test_linux_pip:
cuda_version: cpu
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_cpu_smoke_test_pip
python_version: '3.8'
requires:
- nightly_binary_linux_wheel_py3.8_cpu
- binary_linux_wheel:
cuda_version: cu116
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_cu116
python_version: '3.8'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda116
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_cu116_upload
requires:
- nightly_binary_linux_wheel_py3.8_cu116
subfolder: cu116/
- smoke_test_linux_pip:
cuda_version: cu116
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_cu116_smoke_test_pip
python_version: '3.8'
requires:
- nightly_binary_linux_wheel_py3.8_cu116
- binary_linux_wheel:
cuda_version: cu117
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_cu117
python_version: '3.8'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda117
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_cu117_upload
requires:
- nightly_binary_linux_wheel_py3.8_cu117
subfolder: cu117/
- smoke_test_linux_pip:
cuda_version: cu117
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_cu117_smoke_test_pip
python_version: '3.8'
requires:
- nightly_binary_linux_wheel_py3.8_cu117
- binary_linux_wheel:
cuda_version: rocm5.2
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_rocm5.2
python_version: '3.8'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.2
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_rocm5.2_upload
requires:
- nightly_binary_linux_wheel_py3.8_rocm5.2
subfolder: rocm5.2/
- smoke_test_linux_pip:
cuda_version: rocm5.2
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_rocm5.2_smoke_test_pip
python_version: '3.8'
requires:
- nightly_binary_linux_wheel_py3.8_rocm5.2
- binary_linux_wheel:
cuda_version: rocm5.3
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_rocm5.3
python_version: '3.8'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.3
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_rocm5.3_upload
requires:
- nightly_binary_linux_wheel_py3.8_rocm5.3
subfolder: rocm5.3/
- smoke_test_linux_pip:
cuda_version: rocm5.3
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_rocm5.3_smoke_test_pip
python_version: '3.8'
requires:
- nightly_binary_linux_wheel_py3.8_rocm5.3
- binary_linux_wheel:
cuda_version: cpu
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_cpu
python_version: '3.9'
requires:
- build_ffmpeg_linux
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_cpu_upload
requires:
- nightly_binary_linux_wheel_py3.9_cpu
subfolder: cpu/
- smoke_test_linux_pip:
cuda_version: cpu
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_cpu_smoke_test_pip
python_version: '3.9'
requires:
- nightly_binary_linux_wheel_py3.9_cpu
- binary_linux_wheel:
cuda_version: cu116
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_cu116
python_version: '3.9'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda116
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_cu116_upload
requires:
- nightly_binary_linux_wheel_py3.9_cu116
subfolder: cu116/
- smoke_test_linux_pip:
cuda_version: cu116
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_cu116_smoke_test_pip
python_version: '3.9'
requires:
- nightly_binary_linux_wheel_py3.9_cu116
- binary_linux_wheel:
cuda_version: cu117
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_cu117
python_version: '3.9'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda117
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_cu117_upload
requires:
- nightly_binary_linux_wheel_py3.9_cu117
subfolder: cu117/
- smoke_test_linux_pip:
cuda_version: cu117
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_cu117_smoke_test_pip
python_version: '3.9'
requires:
- nightly_binary_linux_wheel_py3.9_cu117
- binary_linux_wheel:
cuda_version: rocm5.2
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_rocm5.2
python_version: '3.9'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.2
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_rocm5.2_upload
requires:
- nightly_binary_linux_wheel_py3.9_rocm5.2
subfolder: rocm5.2/
- smoke_test_linux_pip:
cuda_version: rocm5.2
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_rocm5.2_smoke_test_pip
python_version: '3.9'
requires:
- nightly_binary_linux_wheel_py3.9_rocm5.2
- binary_linux_wheel:
cuda_version: rocm5.3
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_rocm5.3
python_version: '3.9'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.3
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_rocm5.3_upload
requires:
- nightly_binary_linux_wheel_py3.9_rocm5.3
subfolder: rocm5.3/
- smoke_test_linux_pip:
cuda_version: rocm5.3
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_rocm5.3_smoke_test_pip
python_version: '3.9'
requires:
- nightly_binary_linux_wheel_py3.9_rocm5.3
- binary_linux_wheel:
cuda_version: cpu
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_cpu
python_version: '3.10'
requires:
- build_ffmpeg_linux
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_cpu_upload
requires:
- nightly_binary_linux_wheel_py3.10_cpu
subfolder: cpu/
- smoke_test_linux_pip:
cuda_version: cpu
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_cpu_smoke_test_pip
python_version: '3.10'
requires:
- nightly_binary_linux_wheel_py3.10_cpu
- binary_linux_wheel:
cuda_version: cu116
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_cu116
python_version: '3.10'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda116
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_cu116_upload
requires:
- nightly_binary_linux_wheel_py3.10_cu116
subfolder: cu116/
- smoke_test_linux_pip:
cuda_version: cu116
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_cu116_smoke_test_pip
python_version: '3.10'
requires:
- nightly_binary_linux_wheel_py3.10_cu116
- binary_linux_wheel:
cuda_version: cu117
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_cu117
python_version: '3.10'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-cuda117
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_cu117_upload
requires:
- nightly_binary_linux_wheel_py3.10_cu117
subfolder: cu117/
- smoke_test_linux_pip:
cuda_version: cu117
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_cu117_smoke_test_pip
python_version: '3.10'
requires:
- nightly_binary_linux_wheel_py3.10_cu117
- binary_linux_wheel:
cuda_version: rocm5.2
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_rocm5.2
python_version: '3.10'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.2
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_rocm5.2_upload
requires:
- nightly_binary_linux_wheel_py3.10_rocm5.2
subfolder: rocm5.2/
- smoke_test_linux_pip:
cuda_version: rocm5.2
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_rocm5.2_smoke_test_pip
python_version: '3.10'
requires:
- nightly_binary_linux_wheel_py3.10_rocm5.2
- binary_linux_wheel:
cuda_version: rocm5.3
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_rocm5.3
python_version: '3.10'
requires:
- build_ffmpeg_linux
wheel_docker_image: pytorch/manylinux-rocm:5.3
- binary_wheel_upload:
context: org-member
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_rocm5.3_upload
requires:
- nightly_binary_linux_wheel_py3.10_rocm5.3
subfolder: rocm5.3/
- smoke_test_linux_pip:
cuda_version: rocm5.3
filters:
branches:
only:
- nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_rocm5.3_smoke_test_pip
python_version: '3.10'
requires:
- nightly_binary_linux_wheel_py3.10_rocm5.3
- binary_macos_wheel: - binary_macos_wheel:
cuda_version: cpu cuda_version: cpu
filters: filters:
......
.circleci/regenerate.py
View file @ ad596b37
...@@ -42,20 +42,22 @@ def build_workflows(prefix="", upload=False, filter_branch=None, indentation=6): ...@@ -42,20 +42,22 @@ def build_workflows(prefix="", upload=False, filter_branch=None, indentation=6):
for python_version in PYTHON_VERSIONS: for python_version in PYTHON_VERSIONS:
for cu_version in CU_VERSIONS_DICT[os_type]: for cu_version in CU_VERSIONS_DICT[os_type]:
fb = filter_branch fb = filter_branch
if cu_version.startswith("rocm") and btype == "conda": if (cu_version.startswith("rocm") and btype == "conda") or (
os_type == "linux" and btype == "wheel"
):
continue continue
if not fb and ( if not fb and (
os_type == "linux" and btype == "wheel" and python_version == "3.8" and cu_version == "cpu" os_type == "linux" and btype == "wheel" and python_version == "3.8" and cu_version == "cpu"
): ):
# the fields must match the build_docs "requires" dependency # the fields must match the build_docs "requires" dependency
fb = "/.*/" fb = "/.*/"
w += build_workflow_pair(btype, os_type, python_version, cu_version, fb, prefix, upload) w += build_workflow_pair(btype, os_type, python_version, cu_version, fb, prefix, upload)
if not filter_branch: if not filter_branch:
# Build on every pull request, but upload only on nightly and tags # Build on every pull request, but upload only on nightly and tags
w += build_doc_job("/.*/") w += build_doc_job("/.*/")
w += upload_doc_job("nightly") w += upload_doc_job("nightly")
w += docstring_parameters_sync_job(None)
return indent(indentation, w) return indent(indentation, w)
...@@ -89,7 +91,6 @@ def build_workflow_pair(btype, os_type, python_version, cu_version, filter_branc ...@@ -89,7 +91,6 @@ def build_workflow_pair(btype, os_type, python_version, cu_version, filter_branc
w.append(generate_base_workflow(base_workflow_name, python_version, cu_version, filter_branch, os_type, btype)) w.append(generate_base_workflow(base_workflow_name, python_version, cu_version, filter_branch, os_type, btype))
if upload: if upload:
w.append(generate_upload_workflow(base_workflow_name, filter_branch, os_type, btype, cu_version)) w.append(generate_upload_workflow(base_workflow_name, filter_branch, os_type, btype, cu_version))
if os_type != "macos": if os_type != "macos":
......
.github/workflows/build_wheels_linux.yml
View file @ ad596b37
...@@ -24,21 +24,21 @@ jobs: ...@@ -24,21 +24,21 @@ jobs:
- repository: pytorch/audio - repository: pytorch/audio
pre-script: packaging/pre_build_script.sh pre-script: packaging/pre_build_script.sh
post-script: packaging/post_build_script.sh post-script: packaging/post_build_script.sh
smoke-test-script: test/smoke_test/smoke_test.py
package-name: torchaudio package-name: torchaudio
name: ${{ matrix.repository }} name: ${{ matrix.repository }}
uses: pytorch/test-infra/.github/workflows/build_wheels_linux.yml@main uses: pytorch/test-infra/.github/workflows/build_wheels_linux.yml@main
with: with:
repository: ${{ matrix.repository }} repository: ${{ matrix.repository }}
ref: nightly ref: ""
test-infra-repository: pytorch/test-infra test-infra-repository: pytorch/test-infra
test-infra-ref: main test-infra-ref: main
build-matrix: ${{ needs.generate-matrix.outputs.matrix }} build-matrix: ${{ needs.generate-matrix.outputs.matrix }}
pre-script: ${{ matrix.pre-script }} pre-script: ${{ matrix.pre-script }}
post-script: ${{ matrix.post-script }} post-script: ${{ matrix.post-script }}
smoke-test-script: ${{ matrix.smoke-test-script }}
package-name: ${{ matrix.package-name }} package-name: ${{ matrix.package-name }}
# Using "development" as trigger event so these binaries are not uploaded trigger-event: ${{ github.event_name }}
# to official channels yet
trigger-event: development
secrets: secrets:
AWS_PYTORCH_UPLOADER_ACCESS_KEY_ID: ${{ secrets.AWS_PYTORCH_UPLOADER_ACCESS_KEY_ID }} AWS_PYTORCH_UPLOADER_ACCESS_KEY_ID: ${{ secrets.AWS_PYTORCH_UPLOADER_ACCESS_KEY_ID }}
AWS_PYTORCH_UPLOADER_SECRET_ACCESS_KEY: ${{ secrets.AWS_PYTORCH_UPLOADER_SECRET_ACCESS_KEY }} AWS_PYTORCH_UPLOADER_SECRET_ACCESS_KEY: ${{ secrets.AWS_PYTORCH_UPLOADER_SECRET_ACCESS_KEY }}
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment