Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
ffb15744
"vscode:/vscode.git/clone" did not exist on "2194b7dfa6afe351022467408efd2598ac8116db"
Unverified
Commit
ffb15744
authored
Aug 06, 2024
by
yichuan~
Committed by
GitHub
Aug 06, 2024
Browse files
Support multiple args options (#941)
parent
a9c833d5
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
0 deletions
+4
-0
python/sglang/srt/server_args.py
python/sglang/srt/server_args.py
+4
-0
No files found.
python/sglang/srt/server_args.py
View file @
ffb15744
...
...
@@ -264,6 +264,7 @@ class ServerArgs:
help
=
"How conservative the schedule policy is. A larger value means more conservative scheduling. Use a larger value if you see requests being retracted frequently."
,
)
parser
.
add_argument
(
"--tensor-parallel-size"
,
"--tp-size"
,
type
=
int
,
default
=
ServerArgs
.
tp_size
,
...
...
@@ -318,6 +319,7 @@ class ServerArgs:
# Data parallelism
parser
.
add_argument
(
"--data-parallel-size"
,
"--dp-size"
,
type
=
int
,
default
=
ServerArgs
.
dp_size
,
...
...
@@ -413,6 +415,8 @@ class ServerArgs:
@
classmethod
def
from_cli_args
(
cls
,
args
:
argparse
.
Namespace
):
args
.
tp_size
=
args
.
tensor_parallel_size
args
.
dp_size
=
args
.
data_parallel_size
attrs
=
[
attr
.
name
for
attr
in
dataclasses
.
fields
(
cls
)]
return
cls
(
**
{
attr
:
getattr
(
args
,
attr
)
for
attr
in
attrs
})
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment