Unverified Commit 206e2577 authored by Harry Mellor's avatar Harry Mellor Committed by GitHub
Browse files

Move requirements into their own directory (#12547)


Signed-off-by: default avatarHarry Mellor <19981378+hmellor@users.noreply.github.com>
parent e02883c4
...@@ -23,7 +23,7 @@ Check out the [building from source](#build-from-source) documentation for detai ...@@ -23,7 +23,7 @@ Check out the [building from source](#build-from-source) documentation for detai
## Testing ## Testing
```bash ```bash
pip install -r requirements-dev.txt pip install -r requirements/dev.txt
# Linting, formatting and static type checking # Linting, formatting and static type checking
pre-commit install --hook-type pre-commit --hook-type commit-msg pre-commit install --hook-type pre-commit --hook-type commit-msg
......
...@@ -63,7 +63,7 @@ To build and install vLLM from source, run: ...@@ -63,7 +63,7 @@ To build and install vLLM from source, run:
```console ```console
git clone https://github.com/vllm-project/vllm.git git clone https://github.com/vllm-project/vllm.git
cd vllm cd vllm
pip install -r requirements-hpu.txt pip install -r requirements/hpu.txt
python setup.py develop python setup.py develop
``` ```
...@@ -73,7 +73,7 @@ Currently, the latest features and performance optimizations are developed in Ga ...@@ -73,7 +73,7 @@ Currently, the latest features and performance optimizations are developed in Ga
git clone https://github.com/HabanaAI/vllm-fork.git git clone https://github.com/HabanaAI/vllm-fork.git
cd vllm-fork cd vllm-fork
git checkout habana_main git checkout habana_main
pip install -r requirements-hpu.txt pip install -r requirements/hpu.txt
python setup.py develop python setup.py develop
``` ```
......
...@@ -116,7 +116,7 @@ Once neuronx-cc and transformers-neuronx packages are installed, we will be able ...@@ -116,7 +116,7 @@ Once neuronx-cc and transformers-neuronx packages are installed, we will be able
```console ```console
git clone https://github.com/vllm-project/vllm.git git clone https://github.com/vllm-project/vllm.git
cd vllm cd vllm
pip install -U -r requirements-neuron.txt pip install -U -r requirements/neuron.txt
VLLM_TARGET_DEVICE="neuron" pip install . VLLM_TARGET_DEVICE="neuron" pip install .
``` ```
......
...@@ -32,7 +32,7 @@ Second, clone vLLM and install prerequisites for the vLLM OpenVINO backend insta ...@@ -32,7 +32,7 @@ Second, clone vLLM and install prerequisites for the vLLM OpenVINO backend insta
```console ```console
git clone https://github.com/vllm-project/vllm.git git clone https://github.com/vllm-project/vllm.git
cd vllm cd vllm
pip install -r requirements-build.txt --extra-index-url https://download.pytorch.org/whl/cpu pip install -r requirements/build.txt --extra-index-url https://download.pytorch.org/whl/cpu
``` ```
Finally, install vLLM with OpenVINO backend: Finally, install vLLM with OpenVINO backend:
......
...@@ -151,7 +151,7 @@ pip uninstall torch torch-xla -y ...@@ -151,7 +151,7 @@ pip uninstall torch torch-xla -y
Install build dependencies: Install build dependencies:
```bash ```bash
pip install -r requirements-tpu.txt pip install -r requirements/tpu.txt
sudo apt-get install libopenblas-base libopenmpi-dev libomp-dev sudo apt-get install libopenblas-base libopenmpi-dev libomp-dev
``` ```
......
...@@ -25,7 +25,7 @@ After installation of XCode and the Command Line Tools, which include Apple Clan ...@@ -25,7 +25,7 @@ After installation of XCode and the Command Line Tools, which include Apple Clan
```console ```console
git clone https://github.com/vllm-project/vllm.git git clone https://github.com/vllm-project/vllm.git
cd vllm cd vllm
pip install -r requirements-cpu.txt pip install -r requirements/cpu.txt
pip install -e . pip install -e .
``` ```
......
...@@ -18,7 +18,7 @@ Third, install Python packages for vLLM CPU backend building: ...@@ -18,7 +18,7 @@ Third, install Python packages for vLLM CPU backend building:
```console ```console
pip install --upgrade pip pip install --upgrade pip
pip install "cmake>=3.26" wheel packaging ninja "setuptools-scm>=8" numpy pip install "cmake>=3.26" wheel packaging ninja "setuptools-scm>=8" numpy
pip install -v -r requirements-cpu.txt --extra-index-url https://download.pytorch.org/whl/cpu pip install -v -r requirements/cpu.txt --extra-index-url https://download.pytorch.org/whl/cpu
``` ```
Finally, build and install vLLM CPU backend: Finally, build and install vLLM CPU backend:
......
...@@ -148,7 +148,7 @@ To build vLLM using an existing PyTorch installation: ...@@ -148,7 +148,7 @@ To build vLLM using an existing PyTorch installation:
git clone https://github.com/vllm-project/vllm.git git clone https://github.com/vllm-project/vllm.git
cd vllm cd vllm
python use_existing_torch.py python use_existing_torch.py
pip install -r requirements-build.txt pip install -r requirements/build.txt
pip install -e . --no-build-isolation pip install -e . --no-build-isolation
``` ```
......
...@@ -84,7 +84,7 @@ Currently, there are no pre-built ROCm wheels. ...@@ -84,7 +84,7 @@ Currently, there are no pre-built ROCm wheels.
# Install dependencies # Install dependencies
$ pip install --upgrade numba scipy huggingface-hub[cli,hf_transfer] setuptools_scm $ pip install --upgrade numba scipy huggingface-hub[cli,hf_transfer] setuptools_scm
$ pip install "numpy<2" $ pip install "numpy<2"
$ pip install -r requirements-rocm.txt $ pip install -r requirements/rocm.txt
# Build vLLM for MI210/MI250/MI300. # Build vLLM for MI210/MI250/MI300.
$ export PYTORCH_ROCM_ARCH="gfx90a;gfx942" $ export PYTORCH_ROCM_ARCH="gfx90a;gfx942"
......
...@@ -25,7 +25,7 @@ Currently, there are no pre-built XPU wheels. ...@@ -25,7 +25,7 @@ Currently, there are no pre-built XPU wheels.
```console ```console
source /opt/intel/oneapi/setvars.sh source /opt/intel/oneapi/setvars.sh
pip install --upgrade pip pip install --upgrade pip
pip install -v -r requirements-xpu.txt pip install -v -r requirements/xpu.txt
``` ```
- Finally, build and install vLLM XPU backend: - Finally, build and install vLLM XPU backend:
......
#!/bin/bash #!/bin/bash
echo "vLLM linting system has been moved from format.sh to pre-commit hook." echo "vLLM linting system has been moved from format.sh to pre-commit hook."
echo "Please run 'pip install -r requirements-lint.txt', followed by" echo "Please run 'pip install -r requirements/lint.txt', followed by"
echo "'pre-commit install --hook-type pre-commit --hook-type commit-msg' to install the pre-commit hook." echo "'pre-commit install --hook-type pre-commit --hook-type commit-msg' to install the pre-commit hook."
echo "Then linters will run automatically before each commit." echo "Then linters will run automatically before each commit."
[build-system] [build-system]
# Should be mirrored in requirements-build.txt # Should be mirrored in requirements/build.txt
requires = [ requires = [
"cmake>=3.26", "cmake>=3.26",
"ninja", "ninja",
......
# Common dependencies # Common dependencies
-r requirements-common.txt -r common.txt
# Dependencies for CPUs # Dependencies for CPUs
torch==2.5.1+cpu; platform_machine != "ppc64le" and platform_machine != "aarch64" and platform_system != "Darwin" and platform_machine != "s390x" torch==2.5.1+cpu; platform_machine != "ppc64le" and platform_machine != "aarch64" and platform_system != "Darwin" and platform_machine != "s390x"
......
# Common dependencies # Common dependencies
-r requirements-common.txt -r common.txt
numba == 0.60.0 # v0.61 doesn't support Python 3.9. Required for N-gram speculative decoding numba == 0.60.0 # v0.61 doesn't support Python 3.9. Required for N-gram speculative decoding
......
-r requirements-lint.txt -r lint.txt
-r requirements-test.txt -r test.txt
# Avoid adding requirements directly to this file. # Avoid adding requirements directly to this file.
# Instead, modify the two files referenced above. # Instead, modify the two files referenced above.
# Common dependencies # Common dependencies
-r requirements-common.txt -r common.txt
# Dependencies for HPU code # Dependencies for HPU code
ray ray
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment