Commits · 6ac8e63a85acdf717783873c67eb4cb648c621a4 · gaoqiong / flash-attention

28 Mar, 2024 1 commit
- flash_attn -> vllm_flash_attn · 6ac8e63a
  Woosuk Kwon authored Mar 28, 2024
  
  6ac8e63a
18 Aug, 2023 1 commit
- Run isort and black on python files · f1a73d07
  Tri Dao authored Aug 18, 2023
  
  f1a73d07
16 Jan, 2023 1 commit
- Reorder LN in Block, support OPT · ff34123b
  Tri Dao authored Jan 15, 2023
  
  ff34123b
07 Jan, 2023 1 commit
- [TP] Implement TensorParallel without sequence parallel · 93383bd5
  Tri Dao authored Jan 07, 2023
  
  93383bd5
02 Jan, 2023 1 commit
- [TP] Put parallel embeddings in separate modules · 4cab4de5
  Tri Dao authored Jan 02, 2023
  
  4cab4de5
25 Dec, 2022 1 commit
- Implement Tensor Parallel for GPT2Embeddings · 78225c53
  Tri Dao authored Dec 25, 2022
  
  78225c53
19 Dec, 2022 1 commit
- Implement BERT · 5fb6df0e
  Tri Dao authored Dec 18, 2022
  
  5fb6df0e
14 Nov, 2022 1 commit
- Add MLP, MHA, Block, Embedding modules · d4b320b3
  Tri Dao authored Nov 13, 2022
  
  d4b320b3