Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
flash-attention
Commits
ba625d50
"INSTALL.md" did not exist on "5ded39f5622e8ec400d05570454e8bd31c1227d4"
Unverified
Commit
ba625d50
authored
Jun 06, 2024
by
Woosuk Kwon
Committed by
GitHub
Jun 06, 2024
Browse files
Upgrade to torch 2.3.1 (#5)
parent
a3dd38d9
Changes
3
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
8 additions
and
13 deletions
+8
-13
.github/workflows/publish.yml
.github/workflows/publish.yml
+1
-1
build.sh
build.sh
+6
-11
setup.py
setup.py
+1
-1
No files found.
.github/workflows/publish.yml
View file @
ba625d50
...
...
@@ -49,7 +49,7 @@ jobs:
matrix
:
os
:
[
'
ubuntu-20.04'
]
python-version
:
[
'
3.8'
,
'
3.9'
,
'
3.10'
,
'
3.11'
]
pytorch-version
:
[
'
2.3.
0
'
]
#
Must be the most recent version that meets requirements-cuda.txt
.
pytorch-version
:
[
'
2.3.
1
'
]
#
Should be synced with setup.py
.
cuda-version
:
[
'
12.1'
]
steps
:
...
...
build.sh
View file @
ba625d50
#!/bin/bash
# A simple build script for local testing.
# NOTE: This script is not used for the actual build process.
eval
"
$(
conda shell.bash hook
)
"
PYTORCH_VERSION
=
"2.3.1
"
PYTORCH_VERSION
=
"2.3.0"
for
PYTHON_VERSION
in
38 39 310 311
;
do
source
~/.bashrc
;
conda activate vllm-flash-py
${
PYTHON_VERSION
}
;
conda
env
list
;
pip
install
packaging ninja
;
pip
install
torch
==
${
PYTORCH_VERSION
}
;
time
python setup.py bdist_wheel
--dist-dir
=
dist
;
done
pip
install
packaging ninja
;
pip
install
torch
==
${
PYTORCH_VERSION
}
;
time
python setup.py bdist_wheel
--dist-dir
=
dist
;
setup.py
View file @
ba625d50
...
...
@@ -263,7 +263,7 @@ class NinjaBuildExtension(BuildExtension):
super
().
__init__
(
*
args
,
**
kwargs
)
PYTORCH_VERSION
=
"2.3.
0
"
PYTORCH_VERSION
=
"2.3.
1
"
CUDA_VERSION
=
"12.1"
setup
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment