Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
6f3cf129
"git@developer.sourcefind.cn:OpenDAS/pytorch3d.git" did not exist on "eeb6bd3b09762c2285610323ad47657ea5b6191b"
Unverified
Commit
6f3cf129
authored
Sep 22, 2024
by
Ying Sheng
Committed by
GitHub
Sep 22, 2024
Browse files
[CI, AMD] Add AMD tests to CI (#1491)
parent
13f1357e
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
26 additions
and
1 deletion
+26
-1
.github/workflows/pr-test.yml
.github/workflows/pr-test.yml
+22
-0
docs/en/setup_github_runner.md
docs/en/setup_github_runner.md
+4
-1
No files found.
.github/workflows/pr-test.yml
View file @
6f3cf129
...
@@ -246,6 +246,28 @@ jobs:
...
@@ -246,6 +246,28 @@ jobs:
cd test/srt
cd test/srt
python3 test_data_parallelism.py
python3 test_data_parallelism.py
accuracy-test-1-gpu-amd
:
if
:
github.repository == 'sgl-project/sglang' || github.event_name == 'pull_request'
runs-on
:
1-gpu-runner-amd
steps
:
-
name
:
Checkout code
uses
:
actions/checkout@v3
-
name
:
Install dependencies
run
:
|
pip install --upgrade pip
pip install -e "python[all]" --no-deps
git clone https://github.com/merrymercy/human-eval.git
cd human-eval
pip install -e .
-
name
:
Evaluate Accuracy
timeout-minutes
:
20
run
:
|
cd test/srt
python3 test_eval_accuracy_large.py
finish
:
finish
:
needs
:
[
needs
:
[
unit-test-frontend
,
unit-test-backend-part-1
,
unit-test-backend-part-2
,
unit-test-backend-part-3
,
unit-test-frontend
,
unit-test-backend-part-1
,
unit-test-backend-part-2
,
unit-test-backend-part-3
,
...
...
docs/en/setup_github_runner.md
View file @
6f3cf129
...
@@ -8,7 +8,10 @@ You can mount a folder for the shared huggingface model weights cache. The comma
...
@@ -8,7 +8,10 @@ You can mount a folder for the shared huggingface model weights cache. The comma
```
```
docker pull nvidia/cuda:12.1.1-devel-ubuntu22.04
docker pull nvidia/cuda:12.1.1-devel-ubuntu22.04
# Nvidia
docker run --shm-size 64g -it -v /tmp/huggingface:/hf_home --gpus all nvidia/cuda:12.1.1-devel-ubuntu22.04 /bin/bash
docker run --shm-size 64g -it -v /tmp/huggingface:/hf_home --gpus all nvidia/cuda:12.1.1-devel-ubuntu22.04 /bin/bash
# AMD
docker run --rm --device=/dev/kfd --device=/dev/dri --group-add video --shm-size 64g -it -v /tmp/huggingface:/hf_home henryx/haisgl:sgl0.3.1.post3_vllm0.6.0_triton3.0.0_rocm6.2.1 /bin/bash
```
```
### Step 2: Configure the runner by `config.sh`
### Step 2: Configure the runner by `config.sh`
...
@@ -41,4 +44,4 @@ export CUDA_VISIBLE_DEVICES=0
...
@@ -41,4 +44,4 @@ export CUDA_VISIBLE_DEVICES=0
-
Run it forever
-
Run it forever
```
```
while true; do ./run.sh; echo "Restarting..."; sleep 2; done
while true; do ./run.sh; echo "Restarting..."; sleep 2; done
```
```
\ No newline at end of file
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment