Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
flash-attention
0bf5e50038ee341ece03bfd0c8ff45a6c57aed5a
0bf5e50038ee341ece03bfd0c8ff45a6c57aed5a
Switch branch/tag
flash-attention
training
configs
scheduler
invsqrt.yaml
Find file
Normal view
History
Permalink
invsqrt.yaml
90 Bytes
Edit
Web IDE
Newer
Older
Release training code
Tri Dao
committed
Nov 28, 2022
1
2
3
# @package train.scheduler
_target_
:
src.optim.lr_scheduler.InvSqrt
num_warmup_steps
:
???