Skip to content

GitLab

You need to sign in or sign up before continuing.
Commit d5d94b7e authored by Omkar Salpekar's avatar Omkar Salpekar Committed by Facebook GitHub Bot
Browse files

Delete CCI Linux and MacOS Unittest Jobs (#3391) 

Summary:
Deprecates the Linux and MacOS Unittest jobs now that they've been running on Nova for over a week.

Aside: There was also a stylecheck job that was dependent on the Linux Unittest job. I also put up https://github.com/pytorch/audio/pull/3390 to move that stylecheck job to Nova. I'm happy to reintroduce the CCI stylecheck job standalone in CCI if we want the Nova version to run on main for a week.

Pull Request resolved: https://github.com/pytorch/audio/pull/3391

Reviewed By: mthrok

Differential Revision: D46324198

Pulled By: osalpekar

fbshipit-source-id: 2115748e153c5dee1a38db2b6230acebc4f56927
parent f7cb6c68
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 249 deletions
.circleci/config.yml
View file @ d5d94b7e
......@@ -241,95 +241,6 @@ jobs:
paths:
- ffmpeg
unittest_linux_cpu:
<<: *binary_common
docker:
- image: pytorch/torchaudio_unittest_base:manylinux-20210121
resource_class: 2xlarge+
steps:
- checkout
- attach_workspace:
at: third_party
- designate_upload_channel
- load_conda_channel_flags
- run:
name: Setup
command: .circleci/unittest/linux/scripts/setup_env.sh
- run:
name: Install torchaudio
command: .circleci/unittest/linux/scripts/install.sh
environment:
USE_FFMPEG: true
- run:
name: Run tests
command: .circleci/unittest/linux/scripts/run_test.sh
environment:
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CUDA: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_HW_ACCEL: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_ON_PYTHON_310: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_AUDIO_OUT_DEVICE: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_MACOS: true
- store_test_results:
path: test-results
- store_artifacts:
path: test/htmlcov
unittest_macos_cpu:
<<: *binary_common
macos:
xcode: "14.0"
resource_class: large
steps:
- checkout
- load_conda_channel_flags
- attach_workspace:
at: third_party
- designate_upload_channel
- run:
name: Setup
command: .circleci/unittest/linux/scripts/setup_env.sh
- run:
name: Install torchaudio
command: .circleci/unittest/linux/scripts/install.sh
environment:
USE_FFMPEG: true
USE_OPENMP: false
- run:
name: Run tests
command: .circleci/unittest/linux/scripts/run_test.sh
environment:
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_APPLY_CMVN_SLIDING: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_FBANK_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_KALDI_PITCH_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_MFCC_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_SPECTROGRAM_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CUDA: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_HW_ACCEL: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_QUANTIZATION: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_ON_PYTHON_310: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_MOD_sentencepiece: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_AUDIO_OUT_DEVICE: true
- store_test_results:
path: test-results
- store_artifacts:
path: test/htmlcov
stylecheck:
<<: *binary_common
docker:
- image: "pytorch/torchaudio_unittest_base:manylinux"
resource_class: medium
steps:
- checkout
- designate_upload_channel
- load_conda_channel_flags
- run:
name: Setup
command: .circleci/unittest/linux/scripts/setup_env.sh
- run:
name: Run style check
command: .circleci/unittest/linux/scripts/run_style_checks.sh
workflows:
lint:
jobs:
......@@ -337,39 +248,3 @@ workflows:
unittest:
jobs:
- circleci_consistency
- download_third_parties:
name: download_third_parties
- unittest_linux_cpu:
cuda_version: cpu
name: unittest_linux_cpu_py3.8
python_version: '3.8'
requires:
- download_third_parties
- stylecheck:
cuda_version: cpu
name: stylecheck_py3.8
python_version: '3.8'
- unittest_linux_cpu:
cuda_version: cpu
name: unittest_linux_cpu_py3.9
python_version: '3.9'
requires:
- download_third_parties
- unittest_linux_cpu:
cuda_version: cpu
name: unittest_linux_cpu_py3.10
python_version: '3.10'
requires:
- download_third_parties
- unittest_linux_cpu:
cuda_version: cpu
name: unittest_linux_cpu_py3.11
python_version: '3.11'
requires:
- download_third_parties
- unittest_macos_cpu:
cuda_version: cpu
name: unittest_macos_cpu_py3.8
python_version: '3.8'
requires:
- download_third_parties
.circleci/config.yml.in
View file @ d5d94b7e
......@@ -241,95 +241,6 @@ jobs:
paths:
- ffmpeg
unittest_linux_cpu:
<<: *binary_common
docker:
- image: pytorch/torchaudio_unittest_base:manylinux-20210121
resource_class: 2xlarge+
steps:
- checkout
- attach_workspace:
at: third_party
- designate_upload_channel
- load_conda_channel_flags
- run:
name: Setup
command: .circleci/unittest/linux/scripts/setup_env.sh
- run:
name: Install torchaudio
command: .circleci/unittest/linux/scripts/install.sh
environment:
USE_FFMPEG: true
- run:
name: Run tests
command: .circleci/unittest/linux/scripts/run_test.sh
environment:
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CUDA: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_HW_ACCEL: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_ON_PYTHON_310: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_AUDIO_OUT_DEVICE: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_MACOS: true
- store_test_results:
path: test-results
- store_artifacts:
path: test/htmlcov
unittest_macos_cpu:
<<: *binary_common
macos:
xcode: "14.0"
resource_class: large
steps:
- checkout
- load_conda_channel_flags
- attach_workspace:
at: third_party
- designate_upload_channel
- run:
name: Setup
command: .circleci/unittest/linux/scripts/setup_env.sh
- run:
name: Install torchaudio
command: .circleci/unittest/linux/scripts/install.sh
environment:
USE_FFMPEG: true
USE_OPENMP: false
- run:
name: Run tests
command: .circleci/unittest/linux/scripts/run_test.sh
environment:
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_APPLY_CMVN_SLIDING: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_FBANK_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_KALDI_PITCH_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_MFCC_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_SPECTROGRAM_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CUDA: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_HW_ACCEL: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_QUANTIZATION: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_ON_PYTHON_310: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_MOD_sentencepiece: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_AUDIO_OUT_DEVICE: true
- store_test_results:
path: test-results
- store_artifacts:
path: test/htmlcov
stylecheck:
<<: *binary_common
docker:
- image: "pytorch/torchaudio_unittest_base:manylinux"
resource_class: medium
steps:
- checkout
- designate_upload_channel
- load_conda_channel_flags
- run:
name: Setup
command: .circleci/unittest/linux/scripts/setup_env.sh
- run:
name: Run style check
command: .circleci/unittest/linux/scripts/run_style_checks.sh
workflows:
lint:
jobs:
......@@ -337,4 +248,3 @@ workflows:
unittest:
jobs:
- circleci_consistency
{{ unittest_workflows() }}
.circleci/regenerate.py
View file @ d5d94b7e
......@@ -71,35 +71,6 @@ def unittest_python_versions(os):
}.get(os)
def unittest_workflows(indentation=6):
jobs = []
jobs += build_download_job(None)
for os_type in ["linux", "macos"]:
for device_type in ["cpu"]:
for i, python_version in enumerate(unittest_python_versions(os_type)):
job = {
"name": f"unittest_{os_type}_{device_type}_py{python_version}",
"python_version": python_version,
"cuda_version": "cpu" if device_type == "cpu" else "cu118",
"requires": ["download_third_parties"],
}
jobs.append({f"unittest_{os_type}_{device_type}": job})
if i == 0 and os_type == "linux" and device_type == "cpu":
jobs.append(
{
"stylecheck": {
"name": f"stylecheck_py{python_version}",
"python_version": python_version,
"cuda_version": "cpu",
}
}
)
return indent(indentation, jobs)
if __name__ == "__main__":
d = os.path.dirname(__file__)
env = jinja2.Environment(
......@@ -109,9 +80,5 @@ if __name__ == "__main__":
)
with open(os.path.join(d, "config.yml"), "w") as f:
f.write(
env.get_template("config.yml.in").render(
unittest_workflows=unittest_workflows,
)
)
f.write(env.get_template("config.yml.in").render())
f.write("\n")
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment