Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ColossalAI
Commits
e8dfa2e2
Unverified
Commit
e8dfa2e2
authored
Jan 04, 2023
by
Frank Lee
Committed by
GitHub
Jan 04, 2023
Browse files
[workflow] rebuild cuda kernels when kernel-related files change (#2317)
parent
db6eea35
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
22 additions
and
3 deletions
+22
-3
.github/workflows/build.yml
.github/workflows/build.yml
+22
-3
No files found.
.github/workflows/build.yml
View file @
e8dfa2e2
...
@@ -23,22 +23,37 @@ jobs:
...
@@ -23,22 +23,37 @@ jobs:
repository
:
hpcaitech/TensorNVMe
repository
:
hpcaitech/TensorNVMe
ssh-key
:
${{ secrets.SSH_KEY_FOR_CI }}
ssh-key
:
${{ secrets.SSH_KEY_FOR_CI }}
path
:
TensorNVMe
path
:
TensorNVMe
-
name
:
Install tensornvme
-
name
:
Install tensornvme
run
:
|
run
:
|
cd TensorNVMe
cd TensorNVMe
conda install cmake
conda install cmake
pip install -r requirements.txt
pip install -r requirements.txt
pip install -v .
pip install -v .
-
uses
:
actions/checkout@v2
-
uses
:
actions/checkout@v2
with
:
with
:
ssh-key
:
${{ secrets.SSH_KEY_FOR_CI }}
ssh-key
:
${{ secrets.SSH_KEY_FOR_CI }}
-
name
:
Install Colossal-AI
-
name
:
Find the changed files
id
:
find-changed-files
uses
:
tj-actions/changed-files@v34
with
:
files
:
|
op_builder/**
colossalai/kernel/**
setup.py
-
name
:
Restore cache
if
:
steps.find-changed-files.outputs.any_changed != 'true'
run
:
|
run
:
|
[ ! -z "$(ls -A /github/home/cuda_ext_cache/)" ] && cp -r /github/home/cuda_ext_cache/* /__w/ColossalAI/ColossalAI/
[ ! -z "$(ls -A /github/home/cuda_ext_cache/)" ] && cp -r /github/home/cuda_ext_cache/* /__w/ColossalAI/ColossalAI/
pip install -r requirements/requirements.txt
-
name
:
Install Colossal-AI
run
:
|
pip install -v -e .
pip install -v -e .
cp -r /__w/ColossalAI/ColossalAI/build /github/home/cuda_ext_cache/
pip install -r requirements/requirements-test.txt
pip install -r requirements/requirements-test.txt
-
name
:
Unit Testing
-
name
:
Unit Testing
run
:
|
run
:
|
PYTHONPATH=$PWD pytest tests
PYTHONPATH=$PWD pytest tests
...
@@ -46,3 +61,7 @@ jobs:
...
@@ -46,3 +61,7 @@ jobs:
DATA
:
/data/scratch/cifar-10
DATA
:
/data/scratch/cifar-10
NCCL_SHM_DISABLE
:
1
NCCL_SHM_DISABLE
:
1
LD_LIBRARY_PATH
:
/github/home/.tensornvme/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
LD_LIBRARY_PATH
:
/github/home/.tensornvme/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
-
name
:
Store Cache
run
:
|
cp -r /__w/ColossalAI/ColossalAI/build /github/home/cuda_ext_cache/
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment