Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
d565e097
Unverified
Commit
d565e097
authored
May 19, 2025
by
Liangfu Chen
Committed by
GitHub
May 19, 2025
Browse files
[neuron] fix authorization issue (#18364)
Signed-off-by:
Liangfu Chen
<
liangfc@amazon.com
>
parent
258bf621
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
1 deletion
+3
-1
.buildkite/scripts/hardware_ci/run-neuron-test.sh
.buildkite/scripts/hardware_ci/run-neuron-test.sh
+3
-1
No files found.
.buildkite/scripts/hardware_ci/run-neuron-test.sh
View file @
d565e097
...
...
@@ -11,13 +11,14 @@ container_name="neuron_$(tr -dc A-Za-z0-9 < /dev/urandom | head -c 10; echo)"
HF_CACHE
=
"
$(
realpath
~
)
/huggingface"
mkdir
-p
"
${
HF_CACHE
}
"
HF_MOUNT
=
"/root/.cache/huggingface"
HF_TOKEN
=
$(
aws secretsmanager get-secret-value
--secret-id
"ci/vllm-neuron/hf-token"
--region
us-west-2
--query
'SecretString'
--output
text | jq
-r
.VLLM_NEURON_CI_HF_TOKEN
)
NEURON_COMPILE_CACHE_URL
=
"
$(
realpath
~
)
/neuron_compile_cache"
mkdir
-p
"
${
NEURON_COMPILE_CACHE_URL
}
"
NEURON_COMPILE_CACHE_MOUNT
=
"/root/.cache/neuron_compile_cache"
# Try building the docker image
aws ecr get-login-password
--region
us-
w
est-
2
| docker login
--username
AWS
--password-stdin
763104351884.dkr.ecr.us-west-2.amazonaws.com
aws ecr
-public
get-login-password
--region
us-e
a
st-
1
| docker login
--username
AWS
--password-stdin
public.ecr.aws
# prune old image and containers to save disk space, and only once a day
# by using a timestamp file in tmp.
...
...
@@ -47,6 +48,7 @@ trap remove_docker_container EXIT
docker run
--rm
-it
--device
=
/dev/neuron0
--network
bridge
\
-v
"
${
HF_CACHE
}
:
${
HF_MOUNT
}
"
\
-e
"HF_HOME=
${
HF_MOUNT
}
"
\
-e
"HF_TOKEN=
${
HF_TOKEN
}
"
\
-v
"
${
NEURON_COMPILE_CACHE_URL
}
:
${
NEURON_COMPILE_CACHE_MOUNT
}
"
\
-e
"NEURON_COMPILE_CACHE_URL=
${
NEURON_COMPILE_CACHE_MOUNT
}
"
\
--name
"
${
container_name
}
"
\
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment