Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
001b0bdd
Unverified
Commit
001b0bdd
authored
Aug 02, 2024
by
Ying Sheng
Committed by
GitHub
Aug 02, 2024
Browse files
Update the base image of the docker (#900)
parent
b906c015
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
7 additions
and
3 deletions
+7
-3
.github/workflows/release-docker.yml
.github/workflows/release-docker.yml
+3
-0
docker/Dockerfile
docker/Dockerfile
+4
-3
No files found.
.github/workflows/release-docker.yml
View file @
001b0bdd
...
@@ -16,6 +16,9 @@ jobs:
...
@@ -16,6 +16,9 @@ jobs:
matrix
:
matrix
:
cuda_version
:
[
'
12.1.1'
,
'
12.4.1'
]
cuda_version
:
[
'
12.1.1'
,
'
12.4.1'
]
steps
:
steps
:
-
name
:
Delete huge unnecessary tools folder
run
:
rm -rf /opt/hostedtoolcache
-
name
:
Checkout repository
-
name
:
Checkout repository
uses
:
actions/checkout@v3
uses
:
actions/checkout@v3
...
...
docker/Dockerfile
View file @
001b0bdd
ARG
CUDA_VERSION=12.1.1
ARG
CUDA_VERSION=12.1.1
FROM
nvidia/cuda:${CUDA_VERSION}-devel-ubuntu2
2
.04
FROM
nvidia/cuda:${CUDA_VERSION}-devel-ubuntu2
0
.04
ARG
PYTHON_VERSION=3
ARG
PYTHON_VERSION=3
...
@@ -12,7 +12,7 @@ RUN echo 'tzdata tzdata/Areas select America' | debconf-set-selections \
...
@@ -12,7 +12,7 @@ RUN echo 'tzdata tzdata/Areas select America' | debconf-set-selections \
&&
apt-get
install
-y
ccache software-properties-common
\
&&
apt-get
install
-y
ccache software-properties-common
\
&&
add-apt-repository ppa:deadsnakes/ppa
\
&&
add-apt-repository ppa:deadsnakes/ppa
\
&&
apt-get update
-y
\
&&
apt-get update
-y
\
&&
apt-get
install
-y
python
${
PYTHON_VERSION
}
python
${
PYTHON_VERSION
}
-dev
python
${
PYTHON_VERSION
}
-venv
python
3
-pip
\
&&
apt-get
install
-y
python
${
PYTHON_VERSION
}
python
${
PYTHON_VERSION
}
-dev
python
${
PYTHON_VERSION
}
-venv
python
${
PYTHON_VERSION
}
-pip
\
&&
if
[
"
${
PYTHON_VERSION
}
"
!=
"3"
]
;
then
update-alternatives
--install
/usr/bin/python3 python3 /usr/bin/python
${
PYTHON_VERSION
}
1
;
fi
\
&&
if
[
"
${
PYTHON_VERSION
}
"
!=
"3"
]
;
then
update-alternatives
--install
/usr/bin/python3 python3 /usr/bin/python
${
PYTHON_VERSION
}
1
;
fi
\
&&
python3
--version
\
&&
python3
--version
\
&&
python3
-m
pip
--version
\
&&
python3
-m
pip
--version
\
...
@@ -25,9 +25,10 @@ RUN apt-get update -y \
...
@@ -25,9 +25,10 @@ RUN apt-get update -y \
WORKDIR
/sgl-workspace
WORKDIR
/sgl-workspace
RUN
pip3
--no-cache-dir
install
--upgrade
pip
\
RUN
pip3
--no-cache-dir
install
--upgrade
pip
\
&&
pip3
--no-cache-dir
install
--upgrade
setuptools wheel
\
&&
git clone
--depth
=
1 https://github.com/sgl-project/sglang.git
\
&&
git clone
--depth
=
1 https://github.com/sgl-project/sglang.git
\
&&
cd
sglang
\
&&
cd
sglang
\
&&
pip
3
--no-cache-dir
install
-e
"python[all]"
\
&&
pip
--no-cache-dir
install
-e
"python[all]"
\
&&
pip3
--no-cache-dir
install
flashinfer
-i
https://flashinfer.ai/whl/cu121/torch2.3/
&&
pip3
--no-cache-dir
install
flashinfer
-i
https://flashinfer.ai/whl/cu121/torch2.3/
ENV
DEBIAN_FRONTEND=interactive
ENV
DEBIAN_FRONTEND=interactive
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment