Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ColossalAI
Commits
03e52ecb
Unverified
Commit
03e52ecb
authored
Jun 10, 2022
by
Frank Lee
Committed by
GitHub
Jun 10, 2022
Browse files
[workflow] added regular 8 GPU testing (#1099)
* [workflow] added regular 8 GPU testing * polish workflow
parent
7f2d2b2b
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
39 additions
and
12 deletions
+39
-12
.github/workflows/build_gpu_8.yml
.github/workflows/build_gpu_8.yml
+37
-0
.github/workflows/release_nightly.yml
.github/workflows/release_nightly.yml
+2
-12
No files found.
.github/workflows/build_gpu_8.yml
0 → 100644
View file @
03e52ecb
name
:
Build on 8 GPUs
on
:
schedule
:
# run at 00:00 of every Sunday
-
cron
:
'
0
0
*
*
*'
workflow_dispatch
:
jobs
:
build
:
name
:
Build and Test Colossal-AI
if
:
|
github.event.pull_request.base.repo.full_name == 'hpcaitech/ColossalAI'
runs-on
:
[
self-hosted
,
8-gpu
]
container
:
image
:
hpcaitech/pytorch-cuda:1.10.1-11.3.0
options
:
--gpus all --rm -v /data/scratch/cifar-10:/data/scratch/cifar-10
timeout-minutes
:
40
steps
:
-
uses
:
actions/checkout@v2
with
:
ssh-key
:
${{ secrets.SSH_KEY_FOR_CI }}
-
name
:
Install Colossal-AI
run
:
|
[ ! -z "$(ls -A /github/home/cuda_ext_cache/)" ] && cp -r /github/home/cuda_ext_cache/* /__w/ColossalAI/ColossalAI/
pip install -r requirements/requirements.txt
pip install -v -e .
cp -r /__w/ColossalAI/ColossalAI/build /github/home/cuda_ext_cache/
cp /__w/ColossalAI/ColossalAI/*.so /github/home/cuda_ext_cache/
pip install -r requirements/requirements-test.txt
-
name
:
Unit Testing
run
:
|
gpu_used=$(nvidia-smi -i 0 --query-gpu=memory.used --format=csv,noheader,nounits)
[ "$gpu_used" -gt "100" ] && PYTHONPATH=$PWD pytest tests
env
:
DATA
:
/data/scratch/cifar-10
\ No newline at end of file
.github/workflows/release_nightly.yml
View file @
03e52ecb
...
@@ -5,16 +5,7 @@ on:
...
@@ -5,16 +5,7 @@ on:
# run at 00:00 of every Sunday
# run at 00:00 of every Sunday
-
cron
:
'
0
0
*
*
6'
-
cron
:
'
0
0
*
*
6'
workflow_dispatch
:
workflow_dispatch
:
inputs
:
cuda_version
:
type
:
choice
description
:
CUDA Version
default
:
"
all"
required
:
true
options
:
-
"
all"
-
"
11.3"
-
"
10.2"
jobs
:
jobs
:
matrix_preparation
:
matrix_preparation
:
name
:
Prepare Container List
name
:
Prepare Container List
...
@@ -24,8 +15,7 @@ jobs:
...
@@ -24,8 +15,7 @@ jobs:
steps
:
steps
:
-
id
:
set-matrix
-
id
:
set-matrix
run
:
|
run
:
|
[ "${{github.event.inputs.cuda_version}}" != "all" ] && matrix="[\"hpcaitech/cuda-conda:${{github.event.inputs.cuda_version}}\"]"
matrix="[\"hpcaitech/cuda-conda:11.3\", \"hpcaitech/cuda-conda:10.2\"]"
[ "${{github.event.inputs.cuda_version}}" == "all" || "${{github.event.inputs.cuda_version}}" == "" ] && matrix="[\"hpcaitech/cuda-conda:11.3\", \"hpcaitech/cuda-conda:10.2\"]"
echo $matrix
echo $matrix
echo "::set-output name=matrix::{\"container\":$(echo $matrix)}"
echo "::set-output name=matrix::{\"container\":$(echo $matrix)}"
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment