Skip to content

GitLab

Unverified Commit d205aaeb authored by Rick Ho's avatar Rick Ho Committed by GitHub
Browse files

Merge pull request #41 from laekov/hidden-hidden-size-arg 

Add hidden hidden size args
parents 4d59a9db f9ce8e09
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
fmoe/megatron/utils.py
View file @ d205aaeb
......@@ -9,5 +9,6 @@ def add_fmoe_args(parser):
group.add_argument("--top-k", type=int, default=2)
group.add_argument("--balance-loss-weight", type=float, default=1)
group.add_argument("--balance-strategy", type=str, default=None)
group.add_argument("--hidden-hidden-size", type=int, default=None)
return parser
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment