Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
flash-attention
Commits
ba625d50
Unverified
Commit
ba625d50
authored
Jun 06, 2024
by
Woosuk Kwon
Committed by
GitHub
Jun 06, 2024
Browse files
Upgrade to torch 2.3.1 (#5)
parent
a3dd38d9
Changes
3
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
8 additions
and
13 deletions
+8
-13
.github/workflows/publish.yml
.github/workflows/publish.yml
+1
-1
build.sh
build.sh
+6
-11
setup.py
setup.py
+1
-1
No files found.
.github/workflows/publish.yml
View file @
ba625d50
...
@@ -49,7 +49,7 @@ jobs:
...
@@ -49,7 +49,7 @@ jobs:
matrix
:
matrix
:
os
:
[
'
ubuntu-20.04'
]
os
:
[
'
ubuntu-20.04'
]
python-version
:
[
'
3.8'
,
'
3.9'
,
'
3.10'
,
'
3.11'
]
python-version
:
[
'
3.8'
,
'
3.9'
,
'
3.10'
,
'
3.11'
]
pytorch-version
:
[
'
2.3.
0
'
]
#
Must be the most recent version that meets requirements-cuda.txt
.
pytorch-version
:
[
'
2.3.
1
'
]
#
Should be synced with setup.py
.
cuda-version
:
[
'
12.1'
]
cuda-version
:
[
'
12.1'
]
steps
:
steps
:
...
...
build.sh
View file @
ba625d50
#!/bin/bash
#!/bin/bash
# A simple build script for local testing.
# NOTE: This script is not used for the actual build process.
eval
"
$(
conda shell.bash hook
)
"
PYTORCH_VERSION
=
"2.3.1
"
PYTORCH_VERSION
=
"2.3.0"
pip
install
packaging ninja
;
pip
install
torch
==
${
PYTORCH_VERSION
}
;
for
PYTHON_VERSION
in
38 39 310 311
;
do
time
python setup.py bdist_wheel
--dist-dir
=
dist
;
source
~/.bashrc
;
conda activate vllm-flash-py
${
PYTHON_VERSION
}
;
conda
env
list
;
pip
install
packaging ninja
;
pip
install
torch
==
${
PYTORCH_VERSION
}
;
time
python setup.py bdist_wheel
--dist-dir
=
dist
;
done
setup.py
View file @
ba625d50
...
@@ -263,7 +263,7 @@ class NinjaBuildExtension(BuildExtension):
...
@@ -263,7 +263,7 @@ class NinjaBuildExtension(BuildExtension):
super
().
__init__
(
*
args
,
**
kwargs
)
super
().
__init__
(
*
args
,
**
kwargs
)
PYTORCH_VERSION
=
"2.3.
0
"
PYTORCH_VERSION
=
"2.3.
1
"
CUDA_VERSION
=
"12.1"
CUDA_VERSION
=
"12.1"
setup
(
setup
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment