Commits · 50896ec57424f3ebe7977c0f10067887ec40b627 · gaoqiong / flash-attention

"LinuxGUI/Ventoy2Disk/QT/Ventoy2Disk.pro.user" did not exist on "dd2411d7d47fd72be78802cb28d6f0ef73785e9e"

14 Mar, 2024 1 commit
- Make nvcc threads configurable via environment variable (#885) · 50896ec5
  Chirag Jain authored Mar 14, 2024
  
  50896ec5
31 Mar, 2023 1 commit
- [LayerNorm] Implement LN with parallel residual, support dim 8k · 393882bc
  Tri Dao authored Mar 29, 2023
  
  393882bc
15 Mar, 2023 1 commit
- Support H100 for other CUDA extensions · dc08ea1c
  Tri Dao authored Mar 15, 2023
  
  dc08ea1c
09 Dec, 2022 1 commit
- [LayerNorm] Support all dimensions up to 6k (if divisible by 8) · 8c6609ae
  Tri Dao authored Dec 08, 2022
  
  8c6609ae
17 Nov, 2022 1 commit
- [LayerNorm] Compile for both sm70 and sm80 · 39ed597b
  Tri Dao authored Nov 17, 2022
  
  39ed597b
14 Nov, 2022 1 commit
- Add fused_dense and dropout_add_layernorm CUDA extensions · fa6d1ce4
  Tri Dao authored Nov 13, 2022
  
  fa6d1ce4
13 Nov, 2022 1 commit
- Add fused cross entropy loss · 7c995381
  Tri Dao authored Nov 12, 2022
  
  7c995381
05 Nov, 2022 1 commit
- Implement rotary embedding in CUDA · ca81f32e
  Tri Dao authored Nov 04, 2022
  
  ca81f32e
05 Oct, 2022 1 commit
- Add C++17 arg to compiler, since C++17 features are used, fixes windows build · 9b1b011b
  Eric Engelhart authored Oct 03, 2022
  
  9b1b011b
03 Jul, 2022 1 commit
- Add einops installation to setup.py · 440e9c49
  Gustaf authored Jul 03, 2022
  
  440e9c49
03 Jun, 2022 1 commit
- Support Turing mma instructions · 2712aa4c
  Tri Dao authored Jun 02, 2022
  
  2712aa4c
02 Jun, 2022 2 commits
- Add Cutlass as submodule · 512c98ee
  Tri Dao authored Jun 02, 2022
  
  512c98ee
- Rename src -> flash_attn · 5a61cb77
  Tri Dao authored Jun 01, 2022
  
  5a61cb77
26 May, 2022 1 commit
- Rename, add benchmarking script · 9dbc491a
  Tri Dao authored May 26, 2022
  
  9dbc491a
20 May, 2022 1 commit
- First release · 1fcbe6f0
  Tri Dao authored May 20, 2022
  
  1fcbe6f0