Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "034f989d8f6950778275c9170daae8c0215cd089"
Unverified Commit 4a310f26 authored by Omkar Salpekar's avatar Omkar Salpekar Committed by GitHub
Browse files

[Nova] Disable Linux Wheels Builds from CircleCI (#6954) 

* [Nova] Disable Linux Wheels Builds from CircleCI

* remove old comment
parent c00b9531
Hide whitespace changes
Inline Side-by-side
Showing with 14 additions and 466 deletions
.circleci/config.yml
View file @ 4a310f26
...@@ -1130,90 +1130,6 @@ workflows: ...@@ -1130,90 +1130,6 @@ workflows:
name: binary_linux_wheel_py3.7_rocm5.2 name: binary_linux_wheel_py3.7_rocm5.2
python_version: '3.7' python_version: '3.7'
wheel_docker_image: pytorch/manylinux-rocm:5.2 wheel_docker_image: pytorch/manylinux-rocm:5.2
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cpu
cu_version: cpu
name: binary_linux_wheel_py3.8_cpu
python_version: '3.8'
wheel_docker_image: pytorch/manylinux-cpu
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cuda116
cu_version: cu116
name: binary_linux_wheel_py3.8_cu116
python_version: '3.8'
wheel_docker_image: pytorch/manylinux-cuda116
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cuda117
cu_version: cu117
name: binary_linux_wheel_py3.8_cu117
python_version: '3.8'
wheel_docker_image: pytorch/manylinux-cuda117
- binary_linux_wheel:
cu_version: rocm5.1.1
name: binary_linux_wheel_py3.8_rocm5.1.1
python_version: '3.8'
wheel_docker_image: pytorch/manylinux-rocm:5.1.1
- binary_linux_wheel:
cu_version: rocm5.2
name: binary_linux_wheel_py3.8_rocm5.2
python_version: '3.8'
wheel_docker_image: pytorch/manylinux-rocm:5.2
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cpu
cu_version: cpu
name: binary_linux_wheel_py3.9_cpu
python_version: '3.9'
wheel_docker_image: pytorch/manylinux-cpu
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cuda116
cu_version: cu116
name: binary_linux_wheel_py3.9_cu116
python_version: '3.9'
wheel_docker_image: pytorch/manylinux-cuda116
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cuda117
cu_version: cu117
name: binary_linux_wheel_py3.9_cu117
python_version: '3.9'
wheel_docker_image: pytorch/manylinux-cuda117
- binary_linux_wheel:
cu_version: rocm5.1.1
name: binary_linux_wheel_py3.9_rocm5.1.1
python_version: '3.9'
wheel_docker_image: pytorch/manylinux-rocm:5.1.1
- binary_linux_wheel:
cu_version: rocm5.2
name: binary_linux_wheel_py3.9_rocm5.2
python_version: '3.9'
wheel_docker_image: pytorch/manylinux-rocm:5.2
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cpu
cu_version: cpu
name: binary_linux_wheel_py3.10_cpu
python_version: '3.10'
wheel_docker_image: pytorch/manylinux-cpu
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cuda116
cu_version: cu116
name: binary_linux_wheel_py3.10_cu116
python_version: '3.10'
wheel_docker_image: pytorch/manylinux-cuda116
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cuda117
cu_version: cu117
name: binary_linux_wheel_py3.10_cu117
python_version: '3.10'
wheel_docker_image: pytorch/manylinux-cuda117
- binary_linux_wheel:
cu_version: rocm5.1.1
name: binary_linux_wheel_py3.10_rocm5.1.1
python_version: '3.10'
wheel_docker_image: pytorch/manylinux-rocm:5.1.1
- binary_linux_wheel:
cu_version: rocm5.2
name: binary_linux_wheel_py3.10_rocm5.2
python_version: '3.10'
wheel_docker_image: pytorch/manylinux-rocm:5.2
- binary_macos_wheel: - binary_macos_wheel:
conda_docker_image: pytorch/conda-builder:cpu conda_docker_image: pytorch/conda-builder:cpu
cu_version: cpu cu_version: cpu
...@@ -1756,17 +1672,6 @@ workflows: ...@@ -1756,17 +1672,6 @@ workflows:
name: nightly_binary_linux_wheel_py3.7_cpu name: nightly_binary_linux_wheel_py3.7_cpu
python_version: '3.7' python_version: '3.7'
wheel_docker_image: pytorch/manylinux-cpu wheel_docker_image: pytorch/manylinux-cpu
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_cpu_upload
requires:
- nightly_binary_linux_wheel_py3.7_cpu
subfolder: cpu/
- binary_linux_wheel: - binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cuda116 conda_docker_image: pytorch/conda-builder:cuda116
cu_version: cu116 cu_version: cu116
...@@ -1778,17 +1683,6 @@ workflows: ...@@ -1778,17 +1683,6 @@ workflows:
name: nightly_binary_linux_wheel_py3.7_cu116 name: nightly_binary_linux_wheel_py3.7_cu116
python_version: '3.7' python_version: '3.7'
wheel_docker_image: pytorch/manylinux-cuda116 wheel_docker_image: pytorch/manylinux-cuda116
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_cu116_upload
requires:
- nightly_binary_linux_wheel_py3.7_cu116
subfolder: cu116/
- binary_linux_wheel: - binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cuda117 conda_docker_image: pytorch/conda-builder:cuda117
cu_version: cu117 cu_version: cu117
...@@ -1800,17 +1694,6 @@ workflows: ...@@ -1800,17 +1694,6 @@ workflows:
name: nightly_binary_linux_wheel_py3.7_cu117 name: nightly_binary_linux_wheel_py3.7_cu117
python_version: '3.7' python_version: '3.7'
wheel_docker_image: pytorch/manylinux-cuda117 wheel_docker_image: pytorch/manylinux-cuda117
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_cu117_upload
requires:
- nightly_binary_linux_wheel_py3.7_cu117
subfolder: cu117/
- binary_linux_wheel: - binary_linux_wheel:
cu_version: rocm5.1.1 cu_version: rocm5.1.1
filters: filters:
...@@ -1821,17 +1704,6 @@ workflows: ...@@ -1821,17 +1704,6 @@ workflows:
name: nightly_binary_linux_wheel_py3.7_rocm5.1.1 name: nightly_binary_linux_wheel_py3.7_rocm5.1.1
python_version: '3.7' python_version: '3.7'
wheel_docker_image: pytorch/manylinux-rocm:5.1.1 wheel_docker_image: pytorch/manylinux-rocm:5.1.1
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_rocm5.1.1_upload
requires:
- nightly_binary_linux_wheel_py3.7_rocm5.1.1
subfolder: rocm5.1.1/
- binary_linux_wheel: - binary_linux_wheel:
cu_version: rocm5.2 cu_version: rocm5.2
filters: filters:
...@@ -1842,341 +1714,6 @@ workflows: ...@@ -1842,341 +1714,6 @@ workflows:
name: nightly_binary_linux_wheel_py3.7_rocm5.2 name: nightly_binary_linux_wheel_py3.7_rocm5.2
python_version: '3.7' python_version: '3.7'
wheel_docker_image: pytorch/manylinux-rocm:5.2 wheel_docker_image: pytorch/manylinux-rocm:5.2
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.7_rocm5.2_upload
requires:
- nightly_binary_linux_wheel_py3.7_rocm5.2
subfolder: rocm5.2/
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cpu
cu_version: cpu
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_cpu
python_version: '3.8'
wheel_docker_image: pytorch/manylinux-cpu
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_cpu_upload
requires:
- nightly_binary_linux_wheel_py3.8_cpu
subfolder: cpu/
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cuda116
cu_version: cu116
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_cu116
python_version: '3.8'
wheel_docker_image: pytorch/manylinux-cuda116
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_cu116_upload
requires:
- nightly_binary_linux_wheel_py3.8_cu116
subfolder: cu116/
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cuda117
cu_version: cu117
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_cu117
python_version: '3.8'
wheel_docker_image: pytorch/manylinux-cuda117
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_cu117_upload
requires:
- nightly_binary_linux_wheel_py3.8_cu117
subfolder: cu117/
- binary_linux_wheel:
cu_version: rocm5.1.1
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_rocm5.1.1
python_version: '3.8'
wheel_docker_image: pytorch/manylinux-rocm:5.1.1
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_rocm5.1.1_upload
requires:
- nightly_binary_linux_wheel_py3.8_rocm5.1.1
subfolder: rocm5.1.1/
- binary_linux_wheel:
cu_version: rocm5.2
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_rocm5.2
python_version: '3.8'
wheel_docker_image: pytorch/manylinux-rocm:5.2
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.8_rocm5.2_upload
requires:
- nightly_binary_linux_wheel_py3.8_rocm5.2
subfolder: rocm5.2/
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cpu
cu_version: cpu
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_cpu
python_version: '3.9'
wheel_docker_image: pytorch/manylinux-cpu
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_cpu_upload
requires:
- nightly_binary_linux_wheel_py3.9_cpu
subfolder: cpu/
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cuda116
cu_version: cu116
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_cu116
python_version: '3.9'
wheel_docker_image: pytorch/manylinux-cuda116
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_cu116_upload
requires:
- nightly_binary_linux_wheel_py3.9_cu116
subfolder: cu116/
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cuda117
cu_version: cu117
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_cu117
python_version: '3.9'
wheel_docker_image: pytorch/manylinux-cuda117
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_cu117_upload
requires:
- nightly_binary_linux_wheel_py3.9_cu117
subfolder: cu117/
- binary_linux_wheel:
cu_version: rocm5.1.1
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_rocm5.1.1
python_version: '3.9'
wheel_docker_image: pytorch/manylinux-rocm:5.1.1
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_rocm5.1.1_upload
requires:
- nightly_binary_linux_wheel_py3.9_rocm5.1.1
subfolder: rocm5.1.1/
- binary_linux_wheel:
cu_version: rocm5.2
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_rocm5.2
python_version: '3.9'
wheel_docker_image: pytorch/manylinux-rocm:5.2
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.9_rocm5.2_upload
requires:
- nightly_binary_linux_wheel_py3.9_rocm5.2
subfolder: rocm5.2/
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cpu
cu_version: cpu
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_cpu
python_version: '3.10'
wheel_docker_image: pytorch/manylinux-cpu
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_cpu_upload
requires:
- nightly_binary_linux_wheel_py3.10_cpu
subfolder: cpu/
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cuda116
cu_version: cu116
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_cu116
python_version: '3.10'
wheel_docker_image: pytorch/manylinux-cuda116
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_cu116_upload
requires:
- nightly_binary_linux_wheel_py3.10_cu116
subfolder: cu116/
- binary_linux_wheel:
conda_docker_image: pytorch/conda-builder:cuda117
cu_version: cu117
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_cu117
python_version: '3.10'
wheel_docker_image: pytorch/manylinux-cuda117
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_cu117_upload
requires:
- nightly_binary_linux_wheel_py3.10_cu117
subfolder: cu117/
- binary_linux_wheel:
cu_version: rocm5.1.1
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_rocm5.1.1
python_version: '3.10'
wheel_docker_image: pytorch/manylinux-rocm:5.1.1
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_rocm5.1.1_upload
requires:
- nightly_binary_linux_wheel_py3.10_rocm5.1.1
subfolder: rocm5.1.1/
- binary_linux_wheel:
cu_version: rocm5.2
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_rocm5.2
python_version: '3.10'
wheel_docker_image: pytorch/manylinux-rocm:5.2
- binary_wheel_upload:
context: org-member
filters:
branches:
only: nightly
tags:
only: /v[0-9]+(\.[0-9]+)*-rc[0-9]+/
name: nightly_binary_linux_wheel_py3.10_rocm5.2_upload
requires:
- nightly_binary_linux_wheel_py3.10_rocm5.2
subfolder: rocm5.2/
- binary_macos_wheel: - binary_macos_wheel:
conda_docker_image: pytorch/conda-builder:cpu conda_docker_image: pytorch/conda-builder:cpu
cu_version: cpu cu_version: cpu
......
.circleci/regenerate.py
View file @ 4a310f26
...@@ -59,6 +59,14 @@ def build_workflows(prefix="", filter_branch=None, upload=False, indentation=6, ...@@ -59,6 +59,14 @@ def build_workflows(prefix="", filter_branch=None, upload=False, indentation=6,
): ):
# the fields must match the build_docs "requires" dependency # the fields must match the build_docs "requires" dependency
fb = "/.*/" fb = "/.*/"
# Disable all Linux Wheels Workflows from CircleCI
# since those will now be done through Nova. We'll keep
# around the py3.7 Linux Wheels build since the docs
# job depends on it.
if os_type == "linux" and btype == "wheel" and python_version != "3.7":
continue
w += workflow_pair( w += workflow_pair(
btype, os_type, python_version, cu_version, unicode, prefix, upload, filter_branch=fb btype, os_type, python_version, cu_version, unicode, prefix, upload, filter_branch=fb
) )
...@@ -82,6 +90,11 @@ def workflow_pair(btype, os_type, python_version, cu_version, unicode, prefix="" ...@@ -82,6 +90,11 @@ def workflow_pair(btype, os_type, python_version, cu_version, unicode, prefix=""
) )
) )
# For the remaining py3.7 Linux Wheels job left around for the docs build,
# we'll disable uploads.
if os_type == "linux" and btype == "wheel":
upload = False
if upload: if upload:
w.append(generate_upload_workflow(base_workflow_name, os_type, btype, cu_version, filter_branch=filter_branch)) w.append(generate_upload_workflow(base_workflow_name, os_type, btype, cu_version, filter_branch=filter_branch))
# disable smoke tests, they are broken and needs to be fixed # disable smoke tests, they are broken and needs to be fixed
......
.github/workflows/build-wheels-linux.yml
View file @ 4a310f26
...@@ -38,9 +38,7 @@ jobs: ...@@ -38,9 +38,7 @@ jobs:
post-script: ${{ matrix.post-script }} post-script: ${{ matrix.post-script }}
package-name: ${{ matrix.package-name }} package-name: ${{ matrix.package-name }}
smoke-test-script: ${{ matrix.smoke-test-script }} smoke-test-script: ${{ matrix.smoke-test-script }}
# Using "development" as trigger event so these binaries are not uploaded trigger-event: ${{ github.event_name }}
# to official channels yet
trigger-event: development
secrets: secrets:
AWS_PYTORCH_UPLOADER_ACCESS_KEY_ID: ${{ secrets.AWS_PYTORCH_UPLOADER_ACCESS_KEY_ID }} AWS_PYTORCH_UPLOADER_ACCESS_KEY_ID: ${{ secrets.AWS_PYTORCH_UPLOADER_ACCESS_KEY_ID }}
AWS_PYTORCH_UPLOADER_SECRET_ACCESS_KEY: ${{ secrets.AWS_PYTORCH_UPLOADER_SECRET_ACCESS_KEY }} AWS_PYTORCH_UPLOADER_SECRET_ACCESS_KEY: ${{ secrets.AWS_PYTORCH_UPLOADER_SECRET_ACCESS_KEY }}
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment