Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "7439924891496025edf60c9da6a782f362a50c70"
Unverified Commit a71a44f2 authored by Lianmin Zheng's avatar Lianmin Zheng Committed by GitHub
Browse files

Update setup_github_runner.md (#1952)

parent 691808d5
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 3 deletions
docs/developer/setup_github_runner.md
View file @ a71a44f2
# Set Up Self-hosted Runners for GitHub Action # Set Up Self-Hosted Runners for GitHub Action
## Add a Runner ## Add a Runner
...@@ -9,9 +9,9 @@ You can mount a folder for the shared huggingface model weights cache. The comma ...@@ -9,9 +9,9 @@ You can mount a folder for the shared huggingface model weights cache. The comma
``` ```
docker pull nvidia/cuda:12.1.1-devel-ubuntu22.04 docker pull nvidia/cuda:12.1.1-devel-ubuntu22.04
# Nvidia # Nvidia
docker run --shm-size 64g -it -v /tmp/huggingface:/hf_home --gpus all nvidia/cuda:12.1.1-devel-ubuntu22.04 /bin/bash docker run --shm-size 128g -it -v /tmp/huggingface:/hf_home --gpus all nvidia/cuda:12.1.1-devel-ubuntu22.04 /bin/bash
# AMD # AMD
docker run --rm --device=/dev/kfd --device=/dev/dri --group-add video --shm-size 64g -it -v /tmp/huggingface:/hf_home henryx/haisgl:sgl0.3.1.post3_vllm0.6.0_triton3.0.0_rocm6.2.1 /bin/bash docker run --rm --device=/dev/kfd --device=/dev/dri --group-add video --shm-size 128g -it -v /tmp/huggingface:/hf_home henryx/haisgl:sgl0.3.1.post3_vllm0.6.0_triton3.0.0_rocm6.2.1 /bin/bash
``` ```
### Step 2: Configure the runner by `config.sh` ### Step 2: Configure the runner by `config.sh`
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment