@@ -170,6 +170,18 @@ To build vLLM using an existing PyTorch installation:
...
@@ -170,6 +170,18 @@ To build vLLM using an existing PyTorch installation:
$ pip install -e . --no-build-isolation
$ pip install -e . --no-build-isolation
Use the local cutlass for compilation
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Currently, before starting the build process, vLLM fetches cutlass code from GitHub. However, there may be scenarios where you want to use a local version of cutlass instead.
To achieve this, you can set the environment variable VLLM_CUTLASS_SRC_DIR to point to your local cutlass directory.