"test/git@developer.sourcefind.cn:zhaoyu6/sglang.git" did not exist on "ebaba8565586623e274552e7848822575b5ce58a"
README.md 1.19 KB
Newer Older
1
2
3
To ease the process of installing all the dependencies, we provide a Dockerfile and a simple guideline to build a Docker image with all of above installed. The Docker image is built on top of Ubuntu 20.04, and it contains all the dependencies required to run the experiments. We only provide the Dockerfile for NVIDIA GPU, and the Dockerfile for AMD GPU will be provided upon request.

```bash
4
git clone --recursive https://github.com/tile-ai/tilelang TileLang
5
6
cd TileLang/docker
# build the image, this may take a while (around 10+ minutes on our test machine)
7
# replace the version number cu124 with the one you want to use
8
9
# replace .cu** with .rocm for AMD GPU
docker build -t tilelang_workspace -f Dockerfile.cu124 .
10
# run the container
Zhiwen Mo's avatar
Zhiwen Mo committed
11
# if it's nvidia
12
docker run -it --cap-add=SYS_ADMIN --network=host --gpus all --cap-add=SYS_PTRACE --shm-size=4G --security-opt seccomp=unconfined --security-opt apparmor=unconfined --name tilelang_test tilelang_workspace bash
Zhiwen Mo's avatar
Zhiwen Mo committed
13
14
# if it's amd
docker run -it --cap-add=SYS_ADMIN --network=host --device=/dev/kfd --device=/dev/dri  --cap-add=SYS_PTRACE --shm-size=4G --security-opt seccomp=unconfined --security-opt apparmor=unconfined --name tilelang_test tilelang_workspace bash
15
```