Commits · 78b7a1dc1869e03a39cf3d2e2d9e5dbb1f669810 · gaoqiong / flash-attention

23 Jan, 2023 1 commit
- [OPT] Load fp16 weights on CPU before moving to GPU · 78b7a1dc
  Tri Dao authored Jan 22, 2023
  
  78b7a1dc
18 Jan, 2023 1 commit
- [Gen] Add OPT to generation test · f68d41ec
  Tri Dao authored Jan 17, 2023
  
  f68d41ec
15 Jan, 2023 1 commit
- [Gen] Make generation work with Tensor Parallel · 7c219154
  Tri Dao authored Jan 15, 2023
  
  7c219154
07 Jan, 2023 1 commit
- [Gen] Test generation with rotary embedding · 11be742a
  Tri Dao authored Jan 07, 2023
  
  11be742a
27 Dec, 2022 1 commit
- Tweak CrossEntropyLoss to take process_group in init · c6ecd40a
  Tri Dao authored Dec 27, 2022
  
  c6ecd40a