Commits · 8a733cbd538ef59aacfd60bc44a5262dbe8f5768 · gaoqiong / flash-attention

09 Sep, 2023 1 commit
- Inverse state dict for BERT (#527) · 4c91621a
  Kevin Hu authored Sep 09, 2023
  
  4c91621a
22 Aug, 2023 1 commit
- [GPT] Fix loading weights from HF hub · ef6d8c75
  Tri Dao authored Aug 21, 2023
  
  ef6d8c75
19 Aug, 2023 1 commit
- Run isort and black on test files · 0e8c46ae
  Tri Dao authored Aug 18, 2023
  
  0e8c46ae
18 Jan, 2023 1 commit
- [FusedDense] Support relu, rename FusedDenseGeluDense -> FusedMLP · 88173a1a
  Tri Dao authored Jan 17, 2023
  
  88173a1a
27 Dec, 2022 1 commit
- Tweak CrossEntropyLoss to take process_group in init · c6ecd40a
  Tri Dao authored Dec 27, 2022
  
  c6ecd40a
20 Dec, 2022 1 commit
- Implement last_layer_subset optimization for BERT · 13cdceb3
  Tri Dao authored Dec 19, 2022
  
  13cdceb3
19 Dec, 2022 1 commit
- Implement BERT · 5fb6df0e
  Tri Dao authored Dec 18, 2022
  
  5fb6df0e