Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
flash-attention
Commits
8e9820a55bc7d610d942cf5453838197869393e2
Switch branch/tag
flash-attention
tests
models
test_llama.py
26 Jul, 2023
1 commit
[Rotary] Fix tests when loading state dict with rotary inv_freqs
· 8e9820a5
Tri Dao
authored
Jul 26, 2023
8e9820a5
02 Jul, 2023
1 commit
[Rotary] Make sure frequency calculation is in fp32
· 62e98144
Tri Dao
authored
Jul 02, 2023
62e98144
05 May, 2023
1 commit
[LLaMa] Fix last norm layer to use RMSNorm instead of LayerNorm
· a9a4b4e4
Tri Dao
authored
May 04, 2023
a9a4b4e4
19 Apr, 2023
1 commit
Implement LLaMa
· 96d10f65
Tri Dao
authored
Apr 18, 2023
96d10f65
