Commits · 780e8eeabb84fe3f41e8244f04521743b032ba35 · gaoqiong / flash-attention

16 Jan, 2023 3 commits
- [ViT] Support timm checkpoint, add tests · 780e8eea
  Tri Dao authored Jan 16, 2023
  
  780e8eea
- [ViT] Fix extra norm_0, use new LN order in Block · ef085cfc
  Tri Dao authored Jan 15, 2023
  
  ef085cfc
- Reorder LN in Block, support OPT · ff34123b
  Tri Dao authored Jan 15, 2023
  
  ff34123b
07 Jan, 2023 1 commit
- [TP] Implement TensorParallel without sequence parallel · 93383bd5
  Tri Dao authored Jan 07, 2023
  
  93383bd5
25 Dec, 2022 1 commit
- Implement Tensor Parallel for transformer Block · a8cfe515
  Tri Dao authored Dec 25, 2022
  
  a8cfe515
19 Dec, 2022 1 commit
- Implement BERT · 5fb6df0e
  Tri Dao authored Dec 18, 2022
  
  5fb6df0e
14 Nov, 2022 1 commit
- Add MLP, MHA, Block, Embedding modules · d4b320b3
  Tri Dao authored Nov 13, 2022
  
  d4b320b3