Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
02f7f3e4
".github/vscode:/vscode.git/clone" did not exist on "7bfe923ce8d7b9791b7f392c7f0b6754f203261c"
Unverified
Commit
02f7f3e4
authored
Oct 16, 2024
by
Lianmin Zheng
Committed by
GitHub
Oct 16, 2024
Browse files
Update the transformers version in CI (#1690)
parent
2782132b
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
11 additions
and
9 deletions
+11
-9
.github/workflows/pr-test.yml
.github/workflows/pr-test.yml
+9
-9
python/sglang/srt/server.py
python/sglang/srt/server.py
+2
-0
No files found.
.github/workflows/pr-test.yml
View file @
02f7f3e4
...
...
@@ -29,7 +29,7 @@ jobs:
run
:
|
pip install --upgrade pip
pip install -e "python[dev]"
pip install transformers==4.4
4
pip install transformers==4.4
5.2
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
-
name
:
Run test
...
...
@@ -49,7 +49,7 @@ jobs:
run
:
|
pip install --upgrade pip
pip install -e "python[dev]"
pip install transformers==4.4
4
pip install transformers==4.4
5.2
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
-
name
:
Run test
...
...
@@ -69,7 +69,7 @@ jobs:
run
:
|
pip install --upgrade pip
pip install -e "python[dev]"
pip install transformers==4.4
4
pip install transformers==4.4
5.2
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
-
name
:
Run test
...
...
@@ -89,7 +89,7 @@ jobs:
run
:
|
pip install --upgrade pip
pip install -e "python[dev]"
pip install transformers==4.4
4
pip install transformers==4.4
5.2
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
-
name
:
Run test
...
...
@@ -109,7 +109,7 @@ jobs:
run
:
|
pip install --upgrade pip
pip install -e "python[all]"
pip install transformers==4.4
4
pip install transformers==4.4
5.2
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
-
name
:
Benchmark Single Latency
...
...
@@ -147,7 +147,7 @@ jobs:
run
:
|
pip install --upgrade pip
pip install -e "python[all]"
pip install transformers==4.4
4
pip install transformers==4.4
5.2
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
-
name
:
Benchmark Offline Throughput (w/o RadixAttention)
...
...
@@ -179,7 +179,7 @@ jobs:
run
:
|
pip install --upgrade pip
pip install -e "python[all]"
pip install transformers==4.4
4
pip install transformers==4.4
5.2
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
-
name
:
Benchmark Offline Throughput (TP=2)
...
...
@@ -211,7 +211,7 @@ jobs:
run
:
|
pip install --upgrade pip
pip install -e "python[all]"
pip install transformers==4.4
4
pip install transformers==4.4
5.2
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
git clone https://github.com/merrymercy/human-eval.git
...
...
@@ -235,7 +235,7 @@ jobs:
run
:
|
pip install --upgrade pip
pip install -e "python[all]"
pip install transformers==4.4
4
pip install transformers==4.4
5.2
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
git clone https://github.com/merrymercy/human-eval.git
...
...
python/sglang/srt/server.py
View file @
02f7f3e4
...
...
@@ -432,9 +432,11 @@ def launch_server(
LOGGING_CONFIG
[
"formatters"
][
"default"
][
"fmt"
]
=
"[%(asctime)s] %(levelprefix)s %(message)s"
LOGGING_CONFIG
[
"formatters"
][
"default"
][
"datefmt"
]
=
"%Y-%m-%d %H:%M:%S"
LOGGING_CONFIG
[
"formatters"
][
"access"
][
"fmt"
]
=
'[%(asctime)s] %(levelprefix)s %(client_addr)s - "%(request_line)s" %(status_code)s'
LOGGING_CONFIG
[
"formatters"
][
"access"
][
"datefmt"
]
=
"%Y-%m-%d %H:%M:%S"
uvicorn
.
run
(
app
,
host
=
server_args
.
host
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment