Skip to content

GitLab

Unverified Commit 016e3676 authored by Liangfu Chen's avatar Liangfu Chen Committed by GitHub
Browse files

[CI] add docker volume prune to neuron CI (#12291) 


Signed-off-by: default avatarLiangfu Chen <liangfc@amazon.com>
parent 64ea24d0
Hide whitespace changes
Inline Side-by-side
Showing with 4 additions and 1 deletion
.buildkite/run-neuron-test.sh
View file @ 016e3676
...@@ -25,8 +25,11 @@ if [ -f /tmp/neuron-docker-build-timestamp ]; then ...@@ -25,8 +25,11 @@ if [ -f /tmp/neuron-docker-build-timestamp ]; then
last_build=$(cat /tmp/neuron-docker-build-timestamp) last_build=$(cat /tmp/neuron-docker-build-timestamp)
current_time=$(date +%s) current_time=$(date +%s)
if [ $((current_time - last_build)) -gt 86400 ]; then if [ $((current_time - last_build)) -gt 86400 ]; then
# Remove dangling images (those that are not tagged and not used by any container)
docker image prune -f docker image prune -f
docker system prune -f # Remove unused volumes / force the system prune for old images as well.
docker volume prune -f && docker system prune -f
# Remove huggingface model artifacts and compiler cache
rm -rf "${HF_MOUNT:?}/*" rm -rf "${HF_MOUNT:?}/*"
rm -rf "${NEURON_COMPILE_CACHE_MOUNT:?}/*" rm -rf "${NEURON_COMPILE_CACHE_MOUNT:?}/*"
echo "$current_time" > /tmp/neuron-docker-build-timestamp echo "$current_time" > /tmp/neuron-docker-build-timestamp
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment