Unverified Commit ba625d50 authored by Woosuk Kwon's avatar Woosuk Kwon Committed by GitHub
Browse files

Upgrade to torch 2.3.1 (#5)

parent a3dd38d9
...@@ -49,7 +49,7 @@ jobs: ...@@ -49,7 +49,7 @@ jobs:
matrix: matrix:
os: ['ubuntu-20.04'] os: ['ubuntu-20.04']
python-version: ['3.8', '3.9', '3.10', '3.11'] python-version: ['3.8', '3.9', '3.10', '3.11']
pytorch-version: ['2.3.0'] # Must be the most recent version that meets requirements-cuda.txt. pytorch-version: ['2.3.1'] # Should be synced with setup.py.
cuda-version: ['12.1'] cuda-version: ['12.1']
steps: steps:
......
#!/bin/bash #!/bin/bash
# A simple build script for local testing.
# NOTE: This script is not used for the actual build process.
eval "$(conda shell.bash hook)" PYTORCH_VERSION="2.3.1"
PYTORCH_VERSION="2.3.0" pip install packaging ninja;
pip install torch==${PYTORCH_VERSION};
for PYTHON_VERSION in 38 39 310 311; do time python setup.py bdist_wheel --dist-dir=dist;
source ~/.bashrc;
conda activate vllm-flash-py${PYTHON_VERSION};
conda env list;
pip install packaging ninja;
pip install torch==${PYTORCH_VERSION};
time python setup.py bdist_wheel --dist-dir=dist;
done
...@@ -263,7 +263,7 @@ class NinjaBuildExtension(BuildExtension): ...@@ -263,7 +263,7 @@ class NinjaBuildExtension(BuildExtension):
super().__init__(*args, **kwargs) super().__init__(*args, **kwargs)
PYTORCH_VERSION = "2.3.0" PYTORCH_VERSION = "2.3.1"
CUDA_VERSION = "12.1" CUDA_VERSION = "12.1"
setup( setup(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment