Unverified Commit 498e6668 authored by Alec's avatar Alec Committed by GitHub
Browse files

fix: add hf secret to guide (#3384)


Signed-off-by: default avataralec-flowers <aflowers@nvidia.com>
parent dcbf9df2
......@@ -53,6 +53,12 @@ Each backend has deployment examples and configuration options:
export NAMESPACE=dynamo-cloud
kubectl create namespace ${NAMESPACE}
# to pull model from HF
export HF_TOKEN=<Token-Here>
kubectl create secret generic hf-token-secret \
--from-literal=HF_TOKEN="$HF_TOKEN" \
-n ${NAMESPACE};
# Deploy any example (this uses vLLM with Qwen model using aggregated serving)
kubectl apply -f components/backends/vllm/deploy/agg.yaml -n ${NAMESPACE}
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment