Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
flash-attention
Commits
4040256b
Commit
4040256b
authored
Nov 15, 2022
by
Tri Dao
Browse files
Update pip install instructions, bump to 0.2
parent
56aa4903
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
10 additions
and
5 deletions
+10
-5
README.md
README.md
+8
-3
setup.py
setup.py
+2
-2
No files found.
README.md
View file @
4040256b
...
...
@@ -24,9 +24,14 @@ and experiment with. The notations in the Triton implementation are also closer
to what's used in our paper.
##
Alph
a release (0.
1
).
##
Bet
a release (0.
2
).
To compile (requiring CUDA 11, NVCC, and an Turing or Ampere GPU):
To install (requiring CUDA 11, NVCC, and an Turing or Ampere GPU):
```
sh
pip
install
flash-attn
```
Alternatively you can compile from source:
```
python setup.py install
```
...
...
@@ -44,7 +49,7 @@ FlashAttention currently supports:
3.
Head dimensions that are multiples of 8, up to 128 (e.g., 8, 16, 24, ..., 128). Head dim > 64 backward requires A100.
Our tentative roadmap:
1.
[Jun 2022] Make package pip-installable.
1.
~~
[Jun 2022] Make package pip-installable
~~[Done, thanks to lucidrains]
.
2.
~~[Jun 2022] Support SM86 GPUs (e.g., RTX 3080, 3090)~~[Done].
3.
[Jun 2022] Refactor to use Cutlass.
4.
~~[Jun 2022] Support SM75 GPUs (e.g. T4)~~[Done].
...
...
setup.py
View file @
4040256b
...
...
@@ -152,7 +152,7 @@ ext_modules.append(
setup
(
name
=
"flash_attn"
,
version
=
"0.
1
"
,
version
=
"0.
2
"
,
packages
=
find_packages
(
exclude
=
(
"build"
,
"csrc"
,
"include"
,
"tests"
,
"dist"
,
"docs"
,
"benchmarks"
,
"flash_attn.egg-info"
,)
),
...
...
@@ -164,7 +164,7 @@ setup(
url
=
"https://github.com/HazyResearch/flash-attention"
,
classifiers
=
[
"Programming Language :: Python :: 3"
,
"License :: OSI Approved ::
Apache Software
License"
,
"License :: OSI Approved ::
BSD
License"
,
"Operating System :: Unix"
,
],
ext_modules
=
ext_modules
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment