Commits · 5018ac6ac531aabdb05c8af1ba3d98a2235bdbde · gaoqiong / flash-attention

"megatron/mpu/transformer.py" did not exist on "93ab4bea59dc5cbf97c079d313741866af4deac9"

26 Apr, 2024 1 commit
- [CrossEntropy] Change ignored_index -> ignore_index · ec6d2214
  Tri Dao authored Apr 26, 2024
  
  ec6d2214
21 Jan, 2024 1 commit
- return z_loss (#768) · d8aacc51
  Curtis "Fjord" Hawthorne authored Jan 21, 2024
  
  d8aacc51
17 Dec, 2023 1 commit
- [CrossEntropy] Implement logit_scale option · 08124c8f
  Tri Dao authored Dec 16, 2023
  
  08124c8f
16 Sep, 2023 1 commit
- [CE] Implement CrossEntropyLoss in Triton · 5400fdc4
  Tri Dao authored Sep 15, 2023
  
  5400fdc4
18 Aug, 2023 1 commit
- Run isort and black on python files · f1a73d07
  Tri Dao authored Aug 18, 2023
  
  f1a73d07
27 Dec, 2022 1 commit
- Tweak CrossEntropyLoss to take process_group in init · c6ecd40a
  Tri Dao authored Dec 27, 2022
  
  c6ecd40a
23 Dec, 2022 1 commit
- Add smoothing for CrossEntropyParallel, rename to CrossEntropyLoss · dff68c2b
  Tri Dao authored Dec 23, 2022
  
  dff68c2b