- 10 Jan, 2024 1 commit
-
-
Tri Dao authored
-
- 05 Jan, 2024 2 commits
- 04 Jan, 2024 1 commit
-
-
Tri Dao authored
-
- 20 Dec, 2023 1 commit
-
-
Tri Dao authored
-
- 17 Dec, 2023 1 commit
-
-
Tri Dao authored
-
- 01 Dec, 2023 1 commit
-
-
Tri Dao authored
-
- 20 Nov, 2023 2 commits
- 14 Nov, 2023 1 commit
-
-
Tri Dao authored
-
- 13 Nov, 2023 1 commit
-
-
Tri Dao authored
-
- 24 Oct, 2023 1 commit
-
-
Tri Dao authored
-
- 16 Sep, 2023 1 commit
-
-
Tri Dao authored
-
- 11 Sep, 2023 1 commit
-
-
Tri Dao authored
-
- 06 Sep, 2023 1 commit
-
-
Tri Dao authored
-
- 05 Sep, 2023 1 commit
-
-
Kyeongpil Kang authored
-
- 04 Sep, 2023 2 commits
- 03 Sep, 2023 3 commits
- 30 Aug, 2023 1 commit
-
-
GAOXinyu authored
when using checkpoint_lvl=2, we all_gather_raw(x) without async_op=True. So we don't need to wait for handle. Just skip.
-
- 18 Aug, 2023 2 commits
-
-
Tri Dao authored
-
Xuechen Li authored
* uneql rank. * trim. * enable passing in number of heads for each rank. * simplify. * simplify. * cleanup. * fix col parallel. * fix bug with row parallel. * fit out proj. * refac. * fix sharding logic. * refac sharding. * refac. * support multiple of. * make fn reuseable. * fix bug in dimensions. * scaffold. * test uneven heads. * fix test by adding barrier. * refac. * reuse code. * clean up.
-
- 17 Aug, 2023 2 commits
- 04 Jul, 2023 1 commit
-
-
Tri Dao authored
-
- 19 Apr, 2023 1 commit
-
-
Tri Dao authored
-
- 18 Apr, 2023 1 commit
-
-
Tri Dao authored
-
- 13 Apr, 2023 1 commit
-
-
Tri Dao authored
-
- 31 Mar, 2023 1 commit
-
-
Tri Dao authored
-
- 15 Mar, 2023 1 commit
-
-
Tri Dao authored
-
- 19 Jan, 2023 1 commit
-
-
Tri Dao authored
-
- 18 Jan, 2023 1 commit
-
-
Tri Dao authored
-
- 07 Jan, 2023 2 commits
- 02 Jan, 2023 1 commit
-
-
Tri Dao authored
-
- 01 Jan, 2023 1 commit
-
-
Tri Dao authored
-
- 25 Dec, 2022 1 commit
-
-
Tri Dao authored
-
- 24 Dec, 2022 1 commit
-
-
Tri Dao authored
-
