Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
39bb49d1
Unverified
Commit
39bb49d1
authored
Sep 22, 2024
by
Lianmin Zheng
Committed by
GitHub
Sep 22, 2024
Browse files
Update dockerfile to include datamodel_code_generator (#1492)
parent
6f3cf129
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
4 additions
and
1 deletion
+4
-1
docker/Dockerfile
docker/Dockerfile
+3
-0
python/sglang/srt/model_executor/cuda_graph_runner.py
python/sglang/srt/model_executor/cuda_graph_runner.py
+1
-1
No files found.
docker/Dockerfile
View file @
39bb49d1
...
@@ -18,6 +18,9 @@ RUN echo 'tzdata tzdata/Areas select America' | debconf-set-selections \
...
@@ -18,6 +18,9 @@ RUN echo 'tzdata tzdata/Areas select America' | debconf-set-selections \
&&
rm
-rf
/var/lib/apt/lists/
*
\
&&
rm
-rf
/var/lib/apt/lists/
*
\
&&
apt clean
&&
apt clean
# For openbmb/MiniCPM models
RUN
pip3
install
datamodel_code_generator
WORKDIR
/sgl-workspace
WORKDIR
/sgl-workspace
RUN
python3
-m
pip
install
--upgrade
pip setuptools wheel html5lib six
\
RUN
python3
-m
pip
install
--upgrade
pip setuptools wheel html5lib six
\
...
...
python/sglang/srt/model_executor/cuda_graph_runner.py
View file @
39bb49d1
...
@@ -150,7 +150,7 @@ class CudaGraphRunner:
...
@@ -150,7 +150,7 @@ class CudaGraphRunner:
f
"Capture cuda graph failed:
{
e
}
\n
"
f
"Capture cuda graph failed:
{
e
}
\n
"
"Possible solutions:
\n
"
"Possible solutions:
\n
"
"1. disable cuda graph by --disable-cuda-graph
\n
"
"1. disable cuda graph by --disable-cuda-graph
\n
"
"2. set --mem-fraction-static to a smaller value
\n
"
"2. set --mem-fraction-static to a smaller value
(e.g., 0.8 or 0.7)
\n
"
"3. disable torch compile by not using --enable-torch-compile
\n
"
"3. disable torch compile by not using --enable-torch-compile
\n
"
"Open an issue on GitHub https://github.com/sgl-project/sglang/issues/new/choose
\n
"
"Open an issue on GitHub https://github.com/sgl-project/sglang/issues/new/choose
\n
"
)
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment