Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
89f23a51
Unverified
Commit
89f23a51
authored
Aug 12, 2024
by
Yineng Zhang
Committed by
GitHub
Aug 12, 2024
Browse files
docs: update setup github runner (#1050)
parent
cb99ba4f
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
89 additions
and
34 deletions
+89
-34
docs/en/setup_github_runner.md
docs/en/setup_github_runner.md
+89
-0
docs/en/setup_runner.md
docs/en/setup_runner.md
+0
-34
No files found.
docs/en/setup_github_runner.md
0 → 100644
View file @
89f23a51
# Set up self hosted runner for GitHub Action
## Config Runner
```
bash
# https://github.com/sgl-project/sglang/settings/actions/runners/new?arch=x64&os=linux
# Involves some TOKEN and other private information, click the link to view specific steps.
```
## Start Runner
add
`/lib/systemd/system/e2e.service`
```
[Unit]
StartLimitIntervalSec=0
[Service]
Environment="CUDA_VISIBLE_DEVICES=7"
Environment="XDG_CACHE_HOME=/data/.cache"
Environment="HF_TOKEN=hf_xx"
Environment="OPENAI_API_KEY=sk-xx"
Environment="HOME=/data/zhyncs/runner-v1"
Environment="SGLANG_IS_IN_CI=true"
Restart=always
RestartSec=1
ExecStart=/data/zhyncs/runner-v1/actions-runner/run.sh
[Install]
WantedBy=multi-user.target
```
add
`/lib/systemd/system/unit.service`
```
[Unit]
StartLimitIntervalSec=0
[Service]
Environment="CUDA_VISIBLE_DEVICES=6"
Environment="XDG_CACHE_HOME=/data/.cache"
Environment="HF_TOKEN=hf_xx"
Environment="OPENAI_API_KEY=sk-xx"
Environment="HOME=/data/zhyncs/runner-v2"
Environment="SGLANG_IS_IN_CI=true"
Restart=always
RestartSec=1
ExecStart=/data/zhyncs/runner-v2/actions-runner/run.sh
[Install]
WantedBy=multi-user.target
```
add
`/lib/systemd/system/accuracy.service`
```
[Unit]
StartLimitIntervalSec=0
[Service]
Environment="CUDA_VISIBLE_DEVICES=5"
Environment="XDG_CACHE_HOME=/data/.cache"
Environment="HF_TOKEN=hf_xx"
Environment="OPENAI_API_KEY=sk-xx"
Environment="HOME=/data/zhyncs/runner-v3"
Environment="SGLANG_IS_IN_CI=true"
Restart=always
RestartSec=1
ExecStart=/data/zhyncs/runner-v3/actions-runner/run.sh
[Install]
WantedBy=multi-user.target
```
```
bash
cd
/data/zhyncs/runner-v1
python3
-m
venv venv
cd
/data/zhyncs/runner-v2
python3
-m
venv venv
cd
/data/zhyncs/runner-v3
python3
-m
venv venv
sudo
systemctl daemon-reload
sudo
systemctl start e2e
sudo
systemctl
enable
e2e
sudo
systemctl status e2e
sudo
systemctl start unit
sudo
systemctl
enable
unit
sudo
systemctl status unit
sudo
systemctl start accuracy
sudo
systemctl
enable
accuracy
sudo
systemctl status accuracy
```
docs/en/setup_runner.md
deleted
100644 → 0
View file @
cb99ba4f
# Set up self hosted runner for GitHub Action
## Config Runner
```
bash
# https://github.com/sgl-project/sglang/settings/actions/runners/new?arch=x64&os=linux
# Involves some TOKEN and other private information, click the link to view specific steps.
```
## Start Runner
add
`/lib/systemd/system/runner.service`
```
[Unit]
StartLimitIntervalSec=0
[Service]
Environment="CUDA_VISIBLE_DEVICES=7"
Environment="XDG_CACHE_HOME=/data/.cache"
Environment="HF_TOKEN=hf_**"
Environment="OPENAI_API_KEY=sk-**"
Environment="HOME=/data/zhyncs"
Restart=always
RestartSec=1
ExecStart=/data/zhyncs/actions-runner/run.sh
[Install]
WantedBy=multi-user.target
```
```
bash
sudo
systemctl daemon-reload
sudo
systemctl start runner
sudo
systemctl
enable
runner
sudo
systemctl status runner
```
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment