Skip to content

GitLab

"...git@developer.sourcefind.cn:2222/OpenDAS/vllm_cscc.git" did not exist on "506eb0f45454a07a21bf6d8731475be2a279277b"
Unverified Commit 20ad730c authored by Anish's avatar Anish Committed by GitHub
Browse files

fix: Update gpt-oss.md w/ HF CLI pip install (#2431) 


Signed-off-by: default avatarAnish <80174047+athreesh@users.noreply.github.com>
parent da1bf521
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
components/backends/trtllm/gpt-oss.md
View file @ 20ad730c
...@@ -82,6 +82,9 @@ docker build -f container/Dockerfile.tensorrt_llm_prebuilt . \ ...@@ -82,6 +82,9 @@ docker build -f container/Dockerfile.tensorrt_llm_prebuilt . \
```bash ```bash
export MODEL_PATH=<LOCAL_MODEL_DIRECTORY> export MODEL_PATH=<LOCAL_MODEL_DIRECTORY>
export HF_TOKEN=<INSERT_TOKEN_HERE>
pip install -U "huggingface_hub[cli]"
huggingface-cli download openai/gpt-oss-120b --exclude "original/*" --exclude "metal/*" --local-dir $MODEL_PATH huggingface-cli download openai/gpt-oss-120b --exclude "original/*" --exclude "metal/*" --local-dir $MODEL_PATH
``` ```
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment