Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
12ce3bef
"vscode:/vscode.git/clone" did not exist on "e102543b5fbfffc1ed10ccb9be088ec6a22192d4"
Unverified
Commit
12ce3bef
authored
Aug 01, 2024
by
Liangsheng Yin
Committed by
GitHub
Aug 01, 2024
Browse files
Update runner docs (#879)
parent
4013a4e1
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
5 additions
and
1 deletion
+5
-1
.github/workflows/pr-e2e-test.yml
.github/workflows/pr-e2e-test.yml
+4
-1
docs/en/setup_runner.md
docs/en/setup_runner.md
+1
-0
No files found.
.github/workflows/pr-e2e-test.yml
View file @
12ce3bef
...
@@ -19,6 +19,9 @@ jobs:
...
@@ -19,6 +19,9 @@ jobs:
pr-e2e-test
:
pr-e2e-test
:
runs-on
:
self-hosted
runs-on
:
self-hosted
env
:
HF_TOKEN
:
${{ secrets.HF_TOKEN }}
steps
:
steps
:
-
name
:
Checkout code
-
name
:
Checkout code
uses
:
actions/checkout@v3
uses
:
actions/checkout@v3
...
@@ -35,7 +38,7 @@ jobs:
...
@@ -35,7 +38,7 @@ jobs:
-
name
:
Benchmark Serving
-
name
:
Benchmark Serving
run
:
|
run
:
|
cd /data/zhyncs/venv && source ./bin/activate && cd -
cd /data/zhyncs/venv && source ./bin/activate && cd -
python3 -m sglang.launch_server --model
/data/zhyncs
/Meta-Llama-3.1-8B-Instruct --port 8413 --disable-radix-cache &
python3 -m sglang.launch_server --model
meta-llama
/Meta-Llama-3.1-8B-Instruct --port 8413 --disable-radix-cache &
echo "Waiting for server to start..."
echo "Waiting for server to start..."
for i in {1..120}; do
for i in {1..120}; do
...
...
docs/en/setup_runner.md
View file @
12ce3bef
...
@@ -15,6 +15,7 @@ add `/lib/systemd/system/runner.service`
...
@@ -15,6 +15,7 @@ add `/lib/systemd/system/runner.service`
StartLimitIntervalSec=0
StartLimitIntervalSec=0
[Service]
[Service]
Environment="CUDA_VISIBLE_DEVICES=7"
Environment="CUDA_VISIBLE_DEVICES=7"
Environment="XDG_CACHE_HOME=/data/.cache"
Restart=always
Restart=always
RestartSec=1
RestartSec=1
ExecStart=/data/zhyncs/actions-runner/run.sh
ExecStart=/data/zhyncs/actions-runner/run.sh
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment