Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
69d5ae38
Unverified
Commit
69d5ae38
authored
Jul 22, 2024
by
Kevin H. Luu
Committed by
GitHub
Jul 22, 2024
Browse files
[ci] Use different sccache bucket for CUDA 11.8 wheel build (#6656)
Signed-off-by:
kevin
<
kevin@anyscale.com
>
parent
fea59c77
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
8 additions
and
2 deletions
+8
-2
.buildkite/release-pipeline.yaml
.buildkite/release-pipeline.yaml
+3
-1
Dockerfile
Dockerfile
+5
-1
No files found.
.buildkite/release-pipeline.yaml
View file @
69d5ae38
...
@@ -3,13 +3,15 @@ steps:
...
@@ -3,13 +3,15 @@ steps:
agents
:
agents
:
queue
:
cpu_queue
queue
:
cpu_queue
commands
:
commands
:
-
"
DOCKER_BUILDKIT=1
docker
build
--build-arg
max_jobs=16
--build-arg
USE_SCCACHE=1
--build-arg
CUDA_VERSION={{matrix.cuda_version}}
--tag
vllm-ci:build-image
--target
build
--progress
plain
."
-
"
DOCKER_BUILDKIT=1
docker
build
--build-arg
max_jobs=16
--build-arg
buildkite_commit=$BUILDKITE_COMMIT
--build-arg
USE_SCCACHE=1
--build-arg
CUDA_VERSION={{matrix.cuda_version}}
--tag
vllm-ci:build-image
--target
build
--progress
plain
."
-
"
mkdir
artifacts"
-
"
mkdir
artifacts"
-
"
docker
run
--rm
-v
$(pwd)/artifacts:/artifacts_host
vllm-ci:build-image
bash
-c
'cp
-r
dist
/artifacts_host
&&
chmod
-R
a+rw
/artifacts_host'"
-
"
docker
run
--rm
-v
$(pwd)/artifacts:/artifacts_host
vllm-ci:build-image
bash
-c
'cp
-r
dist
/artifacts_host
&&
chmod
-R
a+rw
/artifacts_host'"
# rename the files to change linux -> manylinux1
# rename the files to change linux -> manylinux1
-
"
for
f
in
artifacts/dist/*.whl;
do
mv
--
\"
$$f
\"
\"
$${f/linux/manylinux1}
\"
;
done"
-
"
for
f
in
artifacts/dist/*.whl;
do
mv
--
\"
$$f
\"
\"
$${f/linux/manylinux1}
\"
;
done"
-
"
aws
s3
cp
--recursive
artifacts/dist
s3://vllm-wheels/$BUILDKITE_COMMIT/"
-
"
aws
s3
cp
--recursive
artifacts/dist
s3://vllm-wheels/$BUILDKITE_COMMIT/"
-
"
aws
s3
cp
--recursive
artifacts/dist
s3://vllm-wheels/nightly/"
-
"
aws
s3
cp
--recursive
artifacts/dist
s3://vllm-wheels/nightly/"
env
:
DOCKER_BUILDKIT
:
"
1"
matrix
:
matrix
:
setup
:
setup
:
cuda_version
:
cuda_version
:
...
...
Dockerfile
View file @
69d5ae38
...
@@ -103,7 +103,11 @@ RUN --mount=type=cache,target=/root/.cache/pip \
...
@@ -103,7 +103,11 @@ RUN --mount=type=cache,target=/root/.cache/pip \
&&
tar
-xzf
sccache.tar.gz
\
&&
tar
-xzf
sccache.tar.gz
\
&&
sudo mv
sccache-v0.8.1-x86_64-unknown-linux-musl/sccache /usr/bin/sccache
\
&&
sudo mv
sccache-v0.8.1-x86_64-unknown-linux-musl/sccache /usr/bin/sccache
\
&&
rm
-rf
sccache.tar.gz sccache-v0.8.1-x86_64-unknown-linux-musl
\
&&
rm
-rf
sccache.tar.gz sccache-v0.8.1-x86_64-unknown-linux-musl
\
&&
export
SCCACHE_BUCKET
=
vllm-build-sccache
\
&&
if
[
"
$CUDA_VERSION
"
=
"11.8.0"
]
;
then
\
export
SCCACHE_BUCKET
=
vllm-build-sccache-2
;
\
else
\
export
SCCACHE_BUCKET
=
vllm-build-sccache
;
\
fi
\
&&
export
SCCACHE_REGION
=
us-west-2
\
&&
export
SCCACHE_REGION
=
us-west-2
\
&&
export
CMAKE_BUILD_TYPE
=
Release
\
&&
export
CMAKE_BUILD_TYPE
=
Release
\
&&
sccache
--show-stats
\
&&
sccache
--show-stats
\
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment