Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
jerrrrry
infinilm
Commits
591dc159
Commit
591dc159
authored
Jul 22, 2025
by
PanZezhong
Browse files
fix jiuge.py
parent
359c0db9
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
1 deletion
+6
-1
scripts/jiuge.py
scripts/jiuge.py
+6
-1
No files found.
scripts/jiuge.py
View file @
591dc159
...
...
@@ -95,7 +95,12 @@ class JiugeMetaFromLlama(JiugeMetaCStruct):
self
.
scale_output
=
1.0
self
.
scale_o
=
1.0
self
.
scale_down
=
1.0
if
"fm9g"
==
config
[
"model_type"
]:
if
(
"fm9g"
==
config
[
"model_type"
]
and
"scale_emb"
in
config
and
"scale_depth"
in
config
and
"dim_model_base"
in
config
):
self
.
scale_input
=
config
[
"scale_emb"
]
self
.
scale_output
=
config
[
"hidden_size"
]
//
config
[
"dim_model_base"
]
self
.
scale_o
=
config
[
"scale_depth"
]
/
math
.
sqrt
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment