Skip to content

GitLab

Commit d5d94b7e authored by Omkar Salpekar's avatar Omkar Salpekar Committed by Facebook GitHub Bot
Browse files

Delete CCI Linux and MacOS Unittest Jobs (#3391) 

Summary:
Deprecates the Linux and MacOS Unittest jobs now that they've been running on Nova for over a week.

Aside: There was also a stylecheck job that was dependent on the Linux Unittest job. I also put up https://github.com/pytorch/audio/pull/3390 to move that stylecheck job to Nova. I'm happy to reintroduce the CCI stylecheck job standalone in CCI if we want the Nova version to run on main for a week.

Pull Request resolved: https://github.com/pytorch/audio/pull/3391

Reviewed By: mthrok

Differential Revision: D46324198

Pulled By: osalpekar

fbshipit-source-id: 2115748e153c5dee1a38db2b6230acebc4f56927
parent f7cb6c68
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 249 deletions
.circleci/config.yml
View file @ d5d94b7e
......@@ -241,95 +241,6 @@ jobs:
paths:
- ffmpeg
unittest_linux_cpu:
<<: *binary_common
docker:
- image: pytorch/torchaudio_unittest_base:manylinux-20210121
resource_class: 2xlarge+
steps:
- checkout
- attach_workspace:
at: third_party
- designate_upload_channel
- load_conda_channel_flags
- run:
name: Setup
command: .circleci/unittest/linux/scripts/setup_env.sh
- run:
name: Install torchaudio
command: .circleci/unittest/linux/scripts/install.sh
environment:
USE_FFMPEG: true
- run:
name: Run tests
command: .circleci/unittest/linux/scripts/run_test.sh
environment:
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CUDA: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_HW_ACCEL: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_ON_PYTHON_310: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_AUDIO_OUT_DEVICE: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_MACOS: true
- store_test_results:
path: test-results
- store_artifacts:
path: test/htmlcov
unittest_macos_cpu:
<<: *binary_common
macos:
xcode: "14.0"
resource_class: large
steps:
- checkout
- load_conda_channel_flags
- attach_workspace:
at: third_party
- designate_upload_channel
- run:
name: Setup
command: .circleci/unittest/linux/scripts/setup_env.sh
- run:
name: Install torchaudio
command: .circleci/unittest/linux/scripts/install.sh
environment:
USE_FFMPEG: true
USE_OPENMP: false
- run:
name: Run tests
command: .circleci/unittest/linux/scripts/run_test.sh
environment:
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_APPLY_CMVN_SLIDING: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_FBANK_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_KALDI_PITCH_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_MFCC_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_SPECTROGRAM_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CUDA: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_HW_ACCEL: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_QUANTIZATION: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_ON_PYTHON_310: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_MOD_sentencepiece: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_AUDIO_OUT_DEVICE: true
- store_test_results:
path: test-results
- store_artifacts:
path: test/htmlcov
stylecheck:
<<: *binary_common
docker:
- image: "pytorch/torchaudio_unittest_base:manylinux"
resource_class: medium
steps:
- checkout
- designate_upload_channel
- load_conda_channel_flags
- run:
name: Setup
command: .circleci/unittest/linux/scripts/setup_env.sh
- run:
name: Run style check
command: .circleci/unittest/linux/scripts/run_style_checks.sh
workflows:
lint:
jobs:
......@@ -337,39 +248,3 @@ workflows:
unittest:
jobs:
- circleci_consistency
- download_third_parties:
name: download_third_parties
- unittest_linux_cpu:
cuda_version: cpu
name: unittest_linux_cpu_py3.8
python_version: '3.8'
requires:
- download_third_parties
- stylecheck:
cuda_version: cpu
name: stylecheck_py3.8
python_version: '3.8'
- unittest_linux_cpu:
cuda_version: cpu
name: unittest_linux_cpu_py3.9
python_version: '3.9'
requires:
- download_third_parties
- unittest_linux_cpu:
cuda_version: cpu
name: unittest_linux_cpu_py3.10
python_version: '3.10'
requires:
- download_third_parties
- unittest_linux_cpu:
cuda_version: cpu
name: unittest_linux_cpu_py3.11
python_version: '3.11'
requires:
- download_third_parties
- unittest_macos_cpu:
cuda_version: cpu
name: unittest_macos_cpu_py3.8
python_version: '3.8'
requires:
- download_third_parties
.circleci/config.yml.in
View file @ d5d94b7e
......@@ -241,95 +241,6 @@ jobs:
paths:
- ffmpeg
unittest_linux_cpu:
<<: *binary_common
docker:
- image: pytorch/torchaudio_unittest_base:manylinux-20210121
resource_class: 2xlarge+
steps:
- checkout
- attach_workspace:
at: third_party
- designate_upload_channel
- load_conda_channel_flags
- run:
name: Setup
command: .circleci/unittest/linux/scripts/setup_env.sh
- run:
name: Install torchaudio
command: .circleci/unittest/linux/scripts/install.sh
environment:
USE_FFMPEG: true
- run:
name: Run tests
command: .circleci/unittest/linux/scripts/run_test.sh
environment:
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CUDA: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_HW_ACCEL: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_ON_PYTHON_310: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_AUDIO_OUT_DEVICE: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_MACOS: true
- store_test_results:
path: test-results
- store_artifacts:
path: test/htmlcov
unittest_macos_cpu:
<<: *binary_common
macos:
xcode: "14.0"
resource_class: large
steps:
- checkout
- load_conda_channel_flags
- attach_workspace:
at: third_party
- designate_upload_channel
- run:
name: Setup
command: .circleci/unittest/linux/scripts/setup_env.sh
- run:
name: Install torchaudio
command: .circleci/unittest/linux/scripts/install.sh
environment:
USE_FFMPEG: true
USE_OPENMP: false
- run:
name: Run tests
command: .circleci/unittest/linux/scripts/run_test.sh
environment:
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_APPLY_CMVN_SLIDING: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_FBANK_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_KALDI_PITCH_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_MFCC_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CMD_COMPUTE_SPECTROGRAM_FEATS: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CUDA: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_HW_ACCEL: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_QUANTIZATION: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_ON_PYTHON_310: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_MOD_sentencepiece: true
TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_AUDIO_OUT_DEVICE: true
- store_test_results:
path: test-results
- store_artifacts:
path: test/htmlcov
stylecheck:
<<: *binary_common
docker:
- image: "pytorch/torchaudio_unittest_base:manylinux"
resource_class: medium
steps:
- checkout
- designate_upload_channel
- load_conda_channel_flags
- run:
name: Setup
command: .circleci/unittest/linux/scripts/setup_env.sh
- run:
name: Run style check
command: .circleci/unittest/linux/scripts/run_style_checks.sh
workflows:
lint:
jobs:
......@@ -337,4 +248,3 @@ workflows:
unittest:
jobs:
- circleci_consistency
{{ unittest_workflows() }}
.circleci/regenerate.py
View file @ d5d94b7e
......@@ -71,35 +71,6 @@ def unittest_python_versions(os):
}.get(os)
def unittest_workflows(indentation=6):
jobs = []
jobs += build_download_job(None)
for os_type in ["linux", "macos"]:
for device_type in ["cpu"]:
for i, python_version in enumerate(unittest_python_versions(os_type)):
job = {
"name": f"unittest_{os_type}_{device_type}_py{python_version}",
"python_version": python_version,
"cuda_version": "cpu" if device_type == "cpu" else "cu118",
"requires": ["download_third_parties"],
}
jobs.append({f"unittest_{os_type}_{device_type}": job})
if i == 0 and os_type == "linux" and device_type == "cpu":
jobs.append(
{
"stylecheck": {
"name": f"stylecheck_py{python_version}",
"python_version": python_version,
"cuda_version": "cpu",
}
}
)
return indent(indentation, jobs)
if __name__ == "__main__":
d = os.path.dirname(__file__)
env = jinja2.Environment(
......@@ -109,9 +80,5 @@ if __name__ == "__main__":
)
with open(os.path.join(d, "config.yml"), "w") as f:
f.write(
env.get_template("config.yml.in").render(
unittest_workflows=unittest_workflows,
)
)
f.write(env.get_template("config.yml.in").render())
f.write("\n")
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment