Commits · 8c6609ae1a6841263d56bcbdef2d2949de1d46ad · gaoqiong / flash-attention

09 Dec, 2022 1 commit
- [LayerNorm] Support all dimensions up to 6k (if divisible by 8) · 8c6609ae
  Tri Dao authored Dec 08, 2022
  
  8c6609ae
17 Nov, 2022 1 commit
- [LayerNorm] Compile for both sm70 and sm80 · 39ed597b
  Tri Dao authored Nov 17, 2022
  
  39ed597b
14 Nov, 2022 1 commit
- Add fused_dense and dropout_add_layernorm CUDA extensions · fa6d1ce4
  Tri Dao authored Nov 13, 2022
  
  fa6d1ce4
13 Nov, 2022 1 commit
- Add fused cross entropy loss · 7c995381
  Tri Dao authored Nov 12, 2022
  
  7c995381
05 Nov, 2022 1 commit
- Implement rotary embedding in CUDA · ca81f32e
  Tri Dao authored Nov 04, 2022
  
  ca81f32e
05 Oct, 2022 1 commit
- Add C++17 arg to compiler, since C++17 features are used, fixes windows build · 9b1b011b
  Eric Engelhart authored Oct 03, 2022
  
  9b1b011b
03 Jul, 2022 1 commit
- Add einops installation to setup.py · 440e9c49
  Gustaf authored Jul 03, 2022
  
  440e9c49
03 Jun, 2022 1 commit
- Support Turing mma instructions · 2712aa4c
  Tri Dao authored Jun 02, 2022
  
  2712aa4c
02 Jun, 2022 2 commits
- Add Cutlass as submodule · 512c98ee
  Tri Dao authored Jun 02, 2022
  
  512c98ee
- Rename src -> flash_attn · 5a61cb77
  Tri Dao authored Jun 01, 2022
  
  5a61cb77
26 May, 2022 1 commit
- Rename, add benchmarking script · 9dbc491a
  Tri Dao authored May 26, 2022
  
  9dbc491a
20 May, 2022 1 commit
- First release · 1fcbe6f0
  Tri Dao authored May 20, 2022
  
  1fcbe6f0