Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
1ab14c4c
Unverified
Commit
1ab14c4c
authored
May 12, 2025
by
Stefan He
Committed by
GitHub
May 12, 2025
Browse files
[VERL Use Case] Add torch_memory_saver into deps (#6247)
parent
3c32895c
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
1 addition
and
2 deletions
+1
-2
python/pyproject.toml
python/pyproject.toml
+1
-1
scripts/ci_install_dependency.sh
scripts/ci_install_dependency.sh
+0
-1
No files found.
python/pyproject.toml
View file @
1ab14c4c
...
@@ -103,7 +103,7 @@ test = [
...
@@ -103,7 +103,7 @@ test = [
"accelerate"
,
"accelerate"
,
"peft"
,
"peft"
,
]
]
all
=
["sglang[srt]
", "
sglang
[openai]
", "
sglang
[anthropic]
", "
sglang
[litellm]"]
all
=
["sglang[srt]
", "
sglang
[openai]
", "
sglang
[anthropic]
", "
sglang
[litellm]
"
, "
sglang
[torch_memory_saver]"
]
all_hip
=
["sglang[srt_hip]
", "
sglang
[openai]
", "
sglang
[anthropic]
", "
sglang
[litellm]"]
all_hip
=
["sglang[srt_hip]
", "
sglang
[openai]
", "
sglang
[anthropic]
", "
sglang
[litellm]"]
all_xpu
=
["sglang[srt_xpu]
", "
sglang
[openai]
", "
sglang
[anthropic]
", "
sglang
[litellm]"]
all_xpu
=
["sglang[srt_xpu]
", "
sglang
[openai]
", "
sglang
[anthropic]
", "
sglang
[litellm]"]
all_hpu
=
["sglang[srt_hpu]
", "
sglang
[openai]
", "
sglang
[anthropic]
", "
sglang
[litellm]"]
all_hpu
=
["sglang[srt_hpu]
", "
sglang
[openai]
", "
sglang
[anthropic]
", "
sglang
[litellm]"]
...
...
scripts/ci_install_dependency.sh
View file @
1ab14c4c
...
@@ -19,7 +19,6 @@ rm -rf /usr/local/lib/python3.10/dist-packages/sgl_kernel*
...
@@ -19,7 +19,6 @@ rm -rf /usr/local/lib/python3.10/dist-packages/sgl_kernel*
pip
install
-e
"python[all]"
pip
install
-e
"python[all]"
# Install additional dependencies
# Install additional dependencies
pip
install
torch_memory_saver
pip
install
transformers
==
4.51.0 timm
torchaudio
==
2.6.0 sentence_transformers accelerate peft pandas datasets mooncake-transfer-engine
==
0.3.0
pip
install
transformers
==
4.51.0 timm
torchaudio
==
2.6.0 sentence_transformers accelerate peft pandas datasets mooncake-transfer-engine
==
0.3.0
# For compiling xgrammar kernels
# For compiling xgrammar kernels
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment