Skip to content

GitLab

Unverified Commit fc645f1a authored by Harry Mellor's avatar Harry Mellor Committed by GitHub
Browse files

Add structure to `requirements/` directory (#39024) 


Signed-off-by: default avatarHarry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: default avatarRobert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
parent 2d80cf9d
Expand all Hide whitespace changes
Inline Side-by-side
Showing with 273 additions and 267 deletions
docs/getting_started/installation/cpu.arm.inc.md
View file @ fc645f1a
......@@ -96,14 +96,14 @@ cd vllm_source
Third, install required dependencies:
```bash
uv pip install -r requirements/cpu-build.txt --torch-backend cpu
uv pip install -r requirements/build/cpu.txt --torch-backend cpu
uv pip install -r requirements/cpu.txt --torch-backend cpu
```
??? console "pip"
```bash
pip install --upgrade pip
pip install -v -r requirements/cpu-build.txt --extra-index-url https://download.pytorch.org/whl/cpu
pip install -v -r requirements/build/cpu.txt --extra-index-url https://download.pytorch.org/whl/cpu
pip install -v -r requirements/cpu.txt --extra-index-url https://download.pytorch.org/whl/cpu
```
......
docs/getting_started/installation/cpu.s390x.inc.md
View file @ fc645f1a
......@@ -46,10 +46,10 @@ Execute the following commands to build and install vLLM from source.
Please build the following dependencies, `torchvision`, `pyarrow` from source before building vLLM.
```bash
sed -i '/^torch/d' requirements/build.txt # remove torch from requirements/build.txt since we use nightly builds
sed -i '/^torch/d' requirements/build/cuda.txt # remove torch from requirements/build/cuda.txt since we use nightly builds
uv pip install -v \
--torch-backend auto \
-r requirements/build.txt \
-r requirements/build/cuda.txt \
-r requirements/cpu.txt \
VLLM_TARGET_DEVICE=cpu python setup.py bdist_wheel && \
uv pip install dist/*.whl
......@@ -57,10 +57,10 @@ Execute the following commands to build and install vLLM from source.
??? console "pip"
```bash
sed -i '/^torch/d' requirements/build.txt # remove torch from requirements/build.txt since we use nightly builds
sed -i '/^torch/d' requirements/build/cuda.txt # remove torch from requirements/build/cuda.txt since we use nightly builds
pip install -v \
--extra-index-url https://download.pytorch.org/whl/nightly/cpu \
-r requirements/build.txt \
-r requirements/build/cuda.txt \
-r requirements/cpu.txt \
VLLM_TARGET_DEVICE=cpu python setup.py bdist_wheel && \
pip install dist/*.whl
......
docs/getting_started/installation/cpu.x86.inc.md
View file @ fc645f1a
......@@ -88,14 +88,14 @@ cd vllm_source
Install the required dependencies:
```bash
uv pip install -r requirements/cpu-build.txt --torch-backend cpu
uv pip install -r requirements/build/cpu.txt --torch-backend cpu
uv pip install -r requirements/cpu.txt --torch-backend cpu
```
??? console "pip"
```bash
pip install --upgrade pip
pip install -v -r requirements/cpu-build.txt --extra-index-url https://download.pytorch.org/whl/cpu
pip install -v -r requirements/build/cpu.txt --extra-index-url https://download.pytorch.org/whl/cpu
pip install -v -r requirements/cpu.txt --extra-index-url https://download.pytorch.org/whl/cpu
```
......
docs/getting_started/installation/gpu.cuda.inc.md
View file @ fc645f1a
......@@ -162,7 +162,7 @@ To build vLLM using an existing PyTorch installation:
git clone https://github.com/vllm-project/vllm.git
cd vllm
python use_existing_torch.py
uv pip install -r requirements/build.txt
uv pip install -r requirements/build/cuda.txt
uv pip install --no-build-isolation -e .
```
......
docs/mkdocs/hooks/generate_argparse.py
View file @ fc645f1a
......@@ -46,7 +46,7 @@ mock_if_no_torch(
# Mock any version checks by reading from compiled CI requirements
with open(ROOT_DIR / "requirements/test.txt") as f:
with open(ROOT_DIR / "requirements/test/cuda.txt") as f:
VERSIONS = dict(line.strip().split("==") for line in f if "==" in line)
importlib.metadata.version = lambda name: VERSIONS.get(name) or "0.0.0"
......
pyproject.toml
View file @ fc645f1a
[build-system]
# Should be mirrored in requirements/build.txt
# Should be mirrored in requirements/build/cuda.txt
requires = [
"cmake>=3.26.1",
"ninja",
......
requirements/rocm-build.txt → requirements/build/rocm.txt
View file @ fc645f1a
# Common dependencies
-r common.txt
-r ../common.txt
--extra-index-url https://download.pytorch.org/whl/rocm7.1
......
requirements/dev.txt
View file @ fc645f1a
-r lint.txt
-r test.txt
-r test/cuda.txt
# Avoid adding requirements directly to this file.
# Instead, modify the two files referenced above.
requirements/test.txt → requirements/test/cuda.txt
View file @ fc645f1a
# This file was autogenerated by uv via the following command:
# uv pip compile requirements/test.in -c requirements/common.txt -o requirements/test.txt --index-strategy unsafe-best-match --torch-backend cu130 --python-platform x86_64-manylinux_2_28 --python-version 3.12
# uv pip compile requirements/test/cuda.in -c requirements/cuda.txt -o requirements/test/cuda.txt --index-strategy unsafe-best-match --torch-backend cu130 --python-platform x86_64-manylinux_2_28 --python-version 3.12
absl-py==2.1.0
# via
# rouge-score
......@@ -29,7 +29,7 @@ albucore==0.0.16
# via terratorch
albumentations==1.4.6
# via
# -r requirements/test.in
# -r requirements/test/cuda.in
# terratorch
alembic==1.16.4
# via optuna
......@@ -46,7 +46,7 @@ anyio==4.6.2.post1
# httpx
# starlette
arctic-inference==0.1.1
# via -r requirements/test.in
# via -r requirements/test/cuda.in
argcomplete==3.5.1
# via datamodel-code-generator
arrow==1.3.0
......@@ -64,7 +64,7 @@ attrs==24.2.0
audioread==3.0.1
# via librosa
av==16.1.0
# via -r requirements/test.in
# via -r requirements/test/cuda.in
azure-core==1.38.2
# via
# azure-identity
......@@ -75,16 +75,16 @@ azure-storage-blob==12.28.0
# via runai-model-streamer-azure
backoff==2.2.1
# via
# -r requirements/test.in
# -r requirements/test/cuda.in
# schemathesis
bitsandbytes==0.49.2
# via
# -r requirements/test.in
# -r requirements/test/cuda.in
# lightning
black==24.10.0
# via datamodel-code-generator
blobfile==3.0.0
# via -r requirements/test.in
# via -r requirements/test/cuda.in
bm25s==0.2.13
# via mteb
boto3==1.35.57
......@@ -98,7 +98,7 @@ botocore==1.35.57
bounded-pool-executor==0.0.3
# via pqdm
buildkite-test-collector==0.1.9
# via -r requirements/test.in
# via -r requirements/test/cuda.in
cachetools==5.5.2
# via google-auth
certifi==2024.8.30
......@@ -176,21 +176,21 @@ cupy-cuda12x==13.6.0
cycler==0.12.1
# via matplotlib
datamodel-code-generator==0.26.3
# via -r requirements/test.in
# via -r requirements/test/cuda.in
dataproperty==1.0.1
# via
# pytablewriter
# tabledata
datasets==3.3.0
# via
# -r requirements/test.in
# -r requirements/test/cuda.in
# evaluate
# lm-eval
# mteb
decorator==5.1.1
# via librosa
decord==0.6.0
# via -r requirements/test.in
# via -r requirements/test/cuda.in
diffusers==0.36.0
# via terratorch
dill==0.3.8
......@@ -211,7 +211,7 @@ docstring-parser==0.17.0
# via jsonargparse
einops==0.8.1
# via
# -r requirements/test.in
# -r requirements/test/cuda.in
# encodec
# terratorch
# torchgeo
......@@ -236,7 +236,9 @@ fastparquet==2024.11.0
fastrlock==0.8.2
# via cupy-cuda12x
fastsafetensors==0.2.2
# via -r requirements/test.in
# via
# -c requirements/cuda.txt
# -r requirements/test/cuda.in
filelock==3.16.1
# via
# -c requirements/common.txt
......@@ -273,7 +275,7 @@ fsspec==2024.12.0
ftfy==6.3.1
# via open-clip-torch
genai-perf==0.0.16
# via -r requirements/test.in
# via -r requirements/test/cuda.in
genson==1.3.0
# via datamodel-code-generator
geopandas==1.0.1
......@@ -306,19 +308,19 @@ google-resumable-media==2.7.2
googleapis-common-protos==1.70.0
# via google-api-core
gpt-oss==0.0.8
# via -r requirements/test.in
# via -r requirements/test/cuda.in
graphql-core==3.2.6
# via hypothesis-graphql
greenlet==3.2.3
# via sqlalchemy
grpcio==1.78.0
# via
# -r requirements/test.in
# -r requirements/test/cuda.in
# grpcio-reflection
# ray
# tensorboard
grpcio-reflection==1.78.0
# via -r requirements/test.in
# via -r requirements/test/cuda.in
h11==0.14.0
# via
# httpcore
......@@ -341,7 +343,7 @@ httpcore==1.0.6
# via httpx
httpx==0.27.2
# via
# -r requirements/test.in
# -r requirements/test/cuda.in
# diffusers
# perceptron
# schemathesis
......@@ -386,7 +388,7 @@ idna==3.10
# requests
# yarl
imagehash==4.3.2
# via -r requirements/test.in
# via -r requirements/test/cuda.in
imageio==2.37.0
# via scikit-image
importlib-metadata==8.7.0
......@@ -400,7 +402,7 @@ inflect==5.6.2
iniconfig==2.0.0
# via pytest
instanttensor==0.1.5
# via -r requirements/test.in
# via -r requirements/test/cuda.in
isodate==0.7.2
# via azure-storage-blob
isoduration==20.11.0
......@@ -414,7 +416,7 @@ jinja2==3.1.6
# lm-eval
# torch
jiwer==3.0.5
# via -r requirements/test.in
# via -r requirements/test/cuda.in
jmespath==1.0.1
# via
# boto3
......@@ -445,7 +447,7 @@ jsonschema-specifications==2024.10.1
junit-xml==1.9
# via schemathesis
kaldi-native-fbank==1.22.3
# via -r requirements/test.in
# via -r requirements/test/cuda.in
kaleido==0.2.1
# via genai-perf
kiwisolver==1.4.7
......@@ -461,7 +463,7 @@ lazy-loader==0.4
libnacl==2.1.0
# via tensorizer
librosa==0.10.2.post1
# via -r requirements/test.in
# via -r requirements/test/cuda.in
lightly==1.5.22
# via
# terratorch
......@@ -480,7 +482,7 @@ lightning-utilities==0.14.3
llvmlite==0.44.0
# via numba
lm-eval==0.4.11
# via -r requirements/test.in
# via -r requirements/test/cuda.in
lxml==5.3.0
# via
# blobfile
......@@ -499,7 +501,7 @@ markupsafe==3.0.1
# werkzeug
matplotlib==3.9.2
# via
# -r requirements/test.in
# -r requirements/test/cuda.in
# lightning
# pycocotools
# torchgeo
......@@ -513,7 +515,7 @@ mdurl==0.1.2
mistral-common==1.11.0
# via
# -c requirements/common.txt
# -r requirements/test.in
# -r requirements/test/cuda.in
more-itertools==10.5.0
# via lm-eval
mpmath==1.3.0
......@@ -529,7 +531,7 @@ msgpack==1.1.0
# librosa
# ray
mteb==2.8.3
# via -r requirements/test.in
# via -r requirements/test/cuda.in
multidict==6.1.0
# via
# aiohttp
......@@ -547,15 +549,16 @@ networkx==3.2.1
nltk==3.9.1
# via rouge-score
num2words==0.5.14
# via -r requirements/test.in
# via -r requirements/test/cuda.in
numba==0.61.2
# via
# -r requirements/test.in
# -c requirements/cuda.txt
# -r requirements/test/cuda.in
# librosa
# resampy
numpy==2.2.6
# via
# -r requirements/test.in
# -r requirements/test/cuda.in
# accelerate
# albucore
# albumentations
......@@ -661,7 +664,7 @@ omegaconf==2.3.0
# hydra-core
# lightning
open-clip-torch==2.32.0
# via -r requirements/test.in
# via -r requirements/test/cuda.in
openai-harmony==0.0.4
# via
# -c requirements/common.txt
......@@ -673,12 +676,12 @@ opencensus-context==0.1.3
opencv-python-headless==4.13.0.90
# via
# -c requirements/common.txt
# -r requirements/test.in
# -r requirements/test/cuda.in
# albucore
# albumentations
# mistral-common
openpyxl==3.1.5
# via -r requirements/test.in
# via -r requirements/test/cuda.in
opentelemetry-api==1.35.0
# via
# -c requirements/common.txt
......@@ -754,9 +757,9 @@ pathvalidate==3.2.1
patsy==1.0.1
# via statsmodels
peft==0.16.0
# via -r requirements/test.in
# via -r requirements/test/cuda.in
perceptron==0.1.4
# via -r requirements/test.in
# via -r requirements/test/cuda.in
perf-analyzer==0.1.0
# via genai-perf
pillow==10.4.0
......@@ -782,7 +785,7 @@ platformdirs==4.3.6
# wandb
plotly==5.24.1
# via
# -r requirements/test.in
# -r requirements/test/cuda.in
# genai-perf
pluggy==1.5.0
# via
......@@ -795,7 +798,7 @@ pooch==1.8.2
portalocker==2.10.1
# via sacrebleu
pqdm==0.2.0
# via -r requirements/test.in
# via -r requirements/test/cuda.in
prometheus-client==0.22.0
# via
# -c requirements/common.txt
......@@ -852,7 +855,7 @@ pycryptodomex==3.22.0
pydantic==2.12.0
# via
# -c requirements/common.txt
# -r requirements/test.in
# -r requirements/test/cuda.in
# albumentations
# datamodel-code-generator
# fastapi
......@@ -891,7 +894,7 @@ pytablewriter==1.2.0
# via lm-eval
pytest==8.3.5
# via
# -r requirements/test.in
# -r requirements/test/cuda.in
# buildkite-test-collector
# genai-perf
# pytest-asyncio
......@@ -904,21 +907,21 @@ pytest==8.3.5
# pytest-timeout
# schemathesis
pytest-asyncio==0.24.0
# via -r requirements/test.in
# via -r requirements/test/cuda.in
pytest-cov==6.3.0
# via -r requirements/test.in
# via -r requirements/test/cuda.in
pytest-forked==1.6.0
# via -r requirements/test.in
# via -r requirements/test/cuda.in
pytest-mock==3.14.0
# via genai-perf
pytest-rerunfailures==14.0
# via -r requirements/test.in
# via -r requirements/test/cuda.in
pytest-shard==0.1.2
# via -r requirements/test.in
# via -r requirements/test/cuda.in
pytest-subtests==0.14.1
# via schemathesis
pytest-timeout==2.3.1
# via -r requirements/test.in
# via -r requirements/test/cuda.in
python-box==7.3.2
# via terratorch
python-dateutil==2.9.0.post0
......@@ -972,7 +975,7 @@ rasterio==1.4.3
# terratorch
# torchgeo
ray==2.48.0
# via -r requirements/test.in
# via -r requirements/test/cuda.in
redis==5.2.0
# via tensorizer
referencing==0.35.1
......@@ -1015,7 +1018,7 @@ requests==2.32.3
# transformers
# wandb
resampy==0.4.3
# via -r requirements/test.in
# via -r requirements/test/cuda.in
responses==0.25.3
# via genai-perf
rfc3339-validator==0.1.4
......@@ -1043,7 +1046,7 @@ rsa==4.9.1
rtree==1.4.0
# via torchgeo
runai-model-streamer==0.15.7
# via -r requirements/test.in
# via -r requirements/test/cuda.in
runai-model-streamer-azure==0.15.7
# via runai-model-streamer
runai-model-streamer-gcs==0.15.7
......@@ -1064,7 +1067,7 @@ safetensors==0.4.5
# timm
# transformers
schemathesis==3.39.15
# via -r requirements/test.in
# via -r requirements/test/cuda.in
scikit-image==0.25.2
# via
# albumentations
......@@ -1091,12 +1094,12 @@ scipy==1.13.1
# vocos
segmentation-models-pytorch==0.5.0
# via
# -r requirements/test.in
# -r requirements/test/cuda.in
# terratorch
# torchgeo
sentence-transformers==5.2.0
# via
# -r requirements/test.in
# -r requirements/test/cuda.in
# mteb
sentry-sdk==2.52.0
# via wandb
......@@ -1136,7 +1139,7 @@ sortedcontainers==2.4.0
# via hypothesis
soundfile==0.12.1
# via
# -r requirements/test.in
# -r requirements/test/cuda.in
# genai-perf
# librosa
# mistral-common
......@@ -1172,7 +1175,7 @@ tabulate==0.9.0
tacoreader==0.5.6
# via terratorch
tblib==3.1.0
# via -r requirements/test.in
# via -r requirements/test/cuda.in
tcolorpy==0.1.6
# via pytablewriter
tenacity==9.1.2
......@@ -1187,13 +1190,13 @@ tensorboard-data-server==0.7.2
tensorboardx==2.6.4
# via lightning
tensorizer==2.10.1
# via -r requirements/test.in
# via -r requirements/test/cuda.in
termcolor==3.1.0
# via
# gpt-oss
# terratorch
terratorch==1.2.2
# via -r requirements/test.in
# via -r requirements/test/cuda.in
threadpoolctl==3.5.0
# via scikit-learn
tifffile==2025.3.30
......@@ -1208,7 +1211,7 @@ tiktoken==0.12.0
# mistral-common
timm==1.0.17
# via
# -r requirements/test.in
# -r requirements/test/cuda.in
# open-clip-torch
# segmentation-models-pytorch
# terratorch
......@@ -1216,7 +1219,7 @@ timm==1.0.17
tokenizers==0.22.0
# via
# -c requirements/common.txt
# -r requirements/test.in
# -r requirements/test/cuda.in
# transformers
tomli==2.2.1
# via schemathesis
......@@ -1224,7 +1227,8 @@ tomli-w==1.2.0
# via schemathesis
torch==2.11.0+cu130
# via
# -r requirements/test.in
# -c requirements/cuda.txt
# -r requirements/test/cuda.in
# accelerate
# bitsandbytes
# encodec
......@@ -1249,7 +1253,8 @@ torch==2.11.0+cu130
# vocos
torchaudio==2.11.0+cu130
# via
# -r requirements/test.in
# -c requirements/cuda.txt
# -r requirements/test/cuda.in
# encodec
# vocos
torchgeo==0.7.0
......@@ -1262,7 +1267,8 @@ torchmetrics==1.7.4
# torchgeo
torchvision==0.26.0+cu130
# via
# -r requirements/test.in
# -c requirements/cuda.txt
# -r requirements/test/cuda.in
# lightly
# open-clip-torch
# segmentation-models-pytorch
......@@ -1292,17 +1298,17 @@ tqdm==4.67.3
transformers==4.57.5
# via
# -c requirements/common.txt
# -r requirements/test.in
# -r requirements/test/cuda.in
# genai-perf
# peft
# sentence-transformers
# transformers-stream-generator
transformers-stream-generator==0.0.5
# via -r requirements/test.in
# via -r requirements/test/cuda.in
triton==3.6.0
# via torch
tritonclient==2.64.0
# via -r requirements/test.in
# via -r requirements/test/cuda.in
typepy==1.3.2
# via
# dataproperty
......@@ -1371,11 +1377,11 @@ urllib3==2.2.3
uvicorn==0.35.0
# via gpt-oss
vector-quantize-pytorch==1.21.2
# via -r requirements/test.in
# via -r requirements/test/cuda.in
virtualenv==20.31.2
# via ray
vocos==0.1.0
# via -r requirements/test.in
# via -r requirements/test/cuda.in
wandb==0.24.2
# via terratorch
wcwidth==0.2.13
......
requirements/rocm-test.in → requirements/test/rocm.in
View file @ fc645f1a
-r common.txt
-r ../common.txt
# testing
pytest
......@@ -78,7 +78,7 @@ datasets>=3.3.0,<=3.6.0
openpyxl # required for perf comparison excel report
plotly # required for perf comparison html report
# ROCm-specific extras (not in CUDA test.in)
# ROCm-specific extras (not in CUDA cuda.in)
rapidfuzz
torchgeo==0.7.0
multiprocess==0.70.16
......
requirements/xpu-test.txt → requirements/test/xpu.txt
View file @ fc645f1a
# This file was autogenerated by uv via the following command:
# uv pip compile requirements/xpu-test.in -o requirements/xpu-test.txt -c requirements/xpu.txt --python-version 3.12 --index-strategy unsafe-best-match
# uv pip compile requirements/test/xpu.in -c requirements/xpu.txt -o requirements/test/xpu.txt --index-strategy unsafe-best-match --torch-backend xpu --python-platform x86_64-manylinux_2_39 --python-version 3.12
absl-py==2.4.0
# via
# -r requirements/xpu-test.in
# -r requirements/test/xpu.in
# rouge-score
accelerate==1.13.0
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
aiohappyeyeballs==2.6.1
# via aiohttp
aiohttp==3.13.4
......@@ -17,7 +17,7 @@ aiohttp==3.13.4
aiosignal==1.4.0
# via aiohttp
albumentations==1.4.6
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
annotated-doc==0.0.4
# via fastapi
annotated-types==0.7.0
......@@ -27,7 +27,7 @@ anyio==4.13.0
# httpx
# starlette
arctic-inference==0.1.1
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
attrs==26.1.0
# via
# aiohttp
......@@ -36,13 +36,13 @@ attrs==26.1.0
# referencing
audioread==3.0.1
# via
# -r requirements/xpu-test.in
# -r requirements/test/xpu.in
# librosa
blobfile==3.0.0
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
bm25s==0.2.13
# via
# -r requirements/xpu-test.in
# -r requirements/test/xpu.in
# mteb
bounded-pool-executor==0.0.3
# via pqdm
......@@ -90,7 +90,7 @@ docker==7.1.0
# via gpt-oss
docopt==0.6.2
# via num2words
dpcpp-cpp-rt==2025.3.1
dpcpp-cpp-rt==2025.3.2
# via
# onemkl-sycl-blas
# onemkl-sycl-dft
......@@ -124,7 +124,7 @@ fsspec==2026.2.0
# huggingface-hub
# torch
gpt-oss==0.0.8
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
graphql-core==3.2.8
# via hypothesis-graphql
h11==0.16.0
......@@ -134,7 +134,7 @@ h11==0.16.0
harfile==0.4.0
# via schemathesis
hf-transfer==0.1.9
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
hf-xet==1.4.2
# via huggingface-hub
html2text==2025.4.15
......@@ -171,27 +171,27 @@ idna==3.11
# yarl
imageio==2.37.3
# via scikit-image
impi-rt==2021.17.0
impi-rt==2021.17.2
# via
# oneccl
# torch
iniconfig==2.3.0
# via pytest
intel-cmplr-lib-rt==2025.3.1
intel-cmplr-lib-rt==2025.3.2
# via
# intel-sycl-rt
# torch
intel-cmplr-lib-ur==2025.3.1
intel-cmplr-lib-ur==2025.3.2
# via
# intel-openmp
# intel-sycl-rt
# torch
intel-cmplr-lic-rt==2025.3.1
intel-cmplr-lic-rt==2025.3.2
# via
# intel-opencl-rt
# intel-sycl-rt
# torch
intel-opencl-rt==2025.3.1
intel-opencl-rt==2025.3.2
# via
# dpcpp-cpp-rt
# onemkl-sycl-blas
......@@ -200,14 +200,14 @@ intel-opencl-rt==2025.3.1
# onemkl-sycl-rng
# onemkl-sycl-sparse
# torch
intel-openmp==2025.3.1
intel-openmp==2025.3.2
# via
# dpcpp-cpp-rt
# mkl
# torch
intel-pti==0.15.0
intel-pti==0.16.0
# via torch
intel-sycl-rt==2025.3.1
intel-sycl-rt==2025.3.2
# via
# dpcpp-cpp-rt
# oneccl
......@@ -218,7 +218,7 @@ jinja2==3.1.6
# lm-eval
# torch
jiwer==4.0.0
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
joblib==1.5.3
# via
# librosa
......@@ -242,11 +242,11 @@ lazy-loader==0.5
# librosa
# scikit-image
librosa==0.10.2.post1
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
llvmlite==0.44.0
# via numba
lm-eval==0.4.11
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
lxml==6.0.2
# via
# blobfile
......@@ -265,11 +265,11 @@ mbstrdecoder==1.1.4
# typepy
mdurl==0.1.2
# via markdown-it-py
mistral-common==1.10.0
mistral-common==1.11.0
# via
# -c requirements/common.txt
# -r requirements/xpu-test.in
mkl==2025.3.0
# -r requirements/test/xpu.in
mkl==2025.3.1
# via
# onemkl-sycl-blas
# onemkl-sycl-dft
......@@ -278,7 +278,7 @@ mkl==2025.3.0
# onemkl-sycl-sparse
# torch
modelscope==1.35.3
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
more-itertools==10.8.0
# via lm-eval
mpmath==1.3.0
......@@ -286,7 +286,7 @@ mpmath==1.3.0
msgpack==1.1.2
# via librosa
mteb==2.12.7
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
multidict==6.7.1
# via
# aiohttp
......@@ -302,7 +302,7 @@ networkx==3.6.1
nltk==3.9.4
# via rouge-score
num2words==0.5.14
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
numba==0.61.2
# via
# -c requirements/xpu.txt
......@@ -334,28 +334,28 @@ numpy==2.2.6
# tifffile
# torchvision
# transformers
oneccl==2021.17.1
oneccl==2021.17.2
# via
# oneccl-devel
# torch
oneccl-devel==2021.17.1
oneccl-devel==2021.17.2
# via torch
onemkl-license==2025.3.0
onemkl-license==2025.3.1
# via
# mkl
# torch
onemkl-sycl-blas==2025.3.0
onemkl-sycl-blas==2025.3.1
# via
# onemkl-sycl-lapack
# onemkl-sycl-sparse
# torch
onemkl-sycl-dft==2025.3.0
onemkl-sycl-dft==2025.3.1
# via torch
onemkl-sycl-lapack==2025.3.0
onemkl-sycl-lapack==2025.3.1
# via torch
onemkl-sycl-rng==2025.3.0
onemkl-sycl-rng==2025.3.1
# via torch
onemkl-sycl-sparse==2025.3.0
onemkl-sycl-sparse==2025.3.1
# via torch
openai-harmony==0.0.8
# via
......@@ -405,12 +405,12 @@ polars-runtime-32==1.39.3
# via polars
pooch==1.8.2
# via
# -r requirements/xpu-test.in
# -r requirements/test/xpu.in
# librosa
portalocker==3.2.0
# via sacrebleu
pqdm==0.2.0
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
propcache==0.4.1
# via
# aiohttp
......@@ -451,13 +451,13 @@ pyrate-limiter==4.1.0
# via schemathesis
pystemmer==3.0.0
# via
# -r requirements/xpu-test.in
# -r requirements/test/xpu.in
# mteb
pytablewriter==1.2.1
# via lm-eval
pytest==9.0.2
# via
# -r requirements/xpu-test.in
# -r requirements/test/xpu.in
# pytest-asyncio
# pytest-cov
# pytest-forked
......@@ -466,17 +466,17 @@ pytest==9.0.2
# pytest-timeout
# schemathesis
pytest-asyncio==1.3.0
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
pytest-cov==6.3.0
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
pytest-forked==1.6.0
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
pytest-rerunfailures==14.0
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
pytest-shard==0.1.2
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
pytest-timeout==2.3.1
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
python-dateutil==2.9.0.post0
# via
# pandas
......@@ -496,7 +496,7 @@ pyyaml==6.0.3
# transformers
rapidfuzz==3.12.1
# via
# -r requirements/xpu-test.in
# -r requirements/test/xpu.in
# jiwer
referencing==0.37.0
# via
......@@ -543,7 +543,7 @@ safetensors==0.7.0
# timm
# transformers
schemathesis==4.14.2
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
scikit-image==0.26.0
# via albumentations
scikit-learn==1.8.0
......@@ -582,12 +582,12 @@ sortedcontainers==2.4.0
# via hypothesis
soundfile==0.13.1
# via
# -r requirements/xpu-test.in
# -r requirements/test/xpu.in
# librosa
# mistral-common
soxr==0.5.0.post1
# via
# -r requirements/xpu-test.in
# -r requirements/test/xpu.in
# librosa
# mistral-common
sqlitedict==2.1.0
......@@ -606,13 +606,13 @@ tabledata==1.3.4
# via pytablewriter
tabulate==0.10.0
# via sacrebleu
tbb==2022.3.0
tbb==2022.3.1
# via
# intel-opencl-rt
# mkl
# torch
tblib==3.1.0
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
tcmlib==1.4.1
# via
# tbb
......@@ -638,12 +638,12 @@ tiktoken==0.12.0
# lm-eval
# mistral-common
timm==1.0.17
# via -r requirements/xpu-test.in
# via -r requirements/test/xpu.in
tokenizers==0.22.2
# via
# -c requirements/common.txt
# transformers
torch==2.10.0+xpu
torch==2.11.0+xpu
# via
# -c requirements/xpu.txt
# accelerate
......@@ -651,7 +651,7 @@ torch==2.10.0+xpu
# sentence-transformers
# timm
# torchvision
torchvision==0.25.0+xpu
torchvision==0.26.0+xpu
# via timm
tqdm==4.67.3
# via
......@@ -669,7 +669,7 @@ transformers==4.57.6
# via
# -c requirements/common.txt
# sentence-transformers
triton-xpu==3.6.0
triton-xpu==3.7.0
# via torch
typepy==1.3.4
# via
......@@ -704,7 +704,7 @@ typing-inspection==0.4.2
# via
# fastapi
# pydantic
umf==1.0.2
umf==1.0.3
# via
# intel-cmplr-lib-ur
# torch
......
tests/standalone_tests/pytorch_nightly_dependency.sh
View file @ fc645f1a
......@@ -28,8 +28,8 @@ uv pip freeze | grep -E '^torch|^torchvision|^torchaudio' | sort > before.txt
echo "Before:"
cat before.txt
echo ">>> Installing requirements/nightly_torch_test.txt"
uv pip install --quiet -r requirements/nightly_torch_test.txt
echo ">>> Installing requirements/test/nightly-torch.txt"
uv pip install --quiet -r requirements/test/nightly-torch.txt
echo ">>> Capturing torch-related versions after requirements install"
uv pip freeze | grep -E '^torch|^torchvision|^torchaudio' | sort > after.txt
......@@ -40,7 +40,7 @@ echo ">>> Comparing versions"
if diff before.txt after.txt; then
echo "torch version not overridden."
else
echo "torch version overridden by nightly_torch_test.txt, \
echo "torch version overridden by test/nightly-torch.txt, \
if the dependency is not triggered by the pytorch nightly test,\
please add the dependency to the list 'white_list' in tools/pre_commit/generate_nightly_torch_test.py"
exit 1
......
tools/generate_cmake_presets.py
View file @ fc645f1a
......@@ -128,7 +128,7 @@ def generate_presets(output_path="CMakeUserPresets.json", force_overwrite=False)
presets = {
"version": 6,
# Keep in sync with CMakeLists.txt and requirements/build.txt
# Keep in sync with CMakeLists.txt and requirements/build/cuda.txt
"cmakeMinimumRequired": {"major": 3, "minor": 26, "patch": 1},
"configurePresets": [configure_preset],
"buildPresets": [
......
tools/pre_commit/generate_nightly_torch_test.py
View file @ fc645f1a
......@@ -3,15 +3,15 @@
"""
Generates specialized requirements files for nightly PyTorch testing.
This script reads the main test requirements input file (`requirements/test.in`)
This script reads the main test requirements input file (`requirements/test/cuda.in`)
and splits its content into two files:
1. `requirements/nightly_torch_test.txt`: Contains dependencies
1. `requirements/test/nightly-torch.txt`: Contains dependencies
except PyTorch-related.
2. `torch_nightly_test.txt`: Contains only PyTorch-related packages.
"""
input_file = "requirements/test.in"
output_file = "requirements/nightly_torch_test.txt"
input_file = "requirements/test/cuda.in"
output_file = "requirements/test/nightly-torch.txt"
# white list of packages that are not compatible with PyTorch nightly directly
# with pip install. Please add your package to this list if it is not compatible
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment