Skip to content

GitLab

"tests/nn/git@developer.sourcefind.cn:OpenDAS/fairscale.git" did not exist on "30f5009a7d70520dd800d201c43c9dfbece5240f"
Unverified Commit 3e455b01 authored by Yineng Zhang's avatar Yineng Zhang Committed by GitHub
Browse files

misc: replace deprecated variable HUGGING_FACE_HUB_TOKEN with HF_TOKEN (#752)

parent 8628ab9c
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ 3e455b01
...@@ -65,7 +65,7 @@ Repalce `<secret>` below with your huggingface hub [token](https://huggingface.c ...@@ -65,7 +65,7 @@ Repalce `<secret>` below with your huggingface hub [token](https://huggingface.c
docker run --gpus all \ docker run --gpus all \
-p 30000:30000 \ -p 30000:30000 \
-v ~/.cache/huggingface:/root/.cache/huggingface \ -v ~/.cache/huggingface:/root/.cache/huggingface \
--env "HUGGING_FACE_HUB_TOKEN=<secret>" \ --env "HF_TOKEN=<secret>" \
--ipc=host \ --ipc=host \
lmsysorg/sglang:latest \ lmsysorg/sglang:latest \
python3 -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct --host 0.0.0.0 --port 30000 python3 -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct --host 0.0.0.0 --port 30000
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment