Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
InternLM_2.5_pytorch
Commits
479027f2
Commit
479027f2
authored
Feb 24, 2025
by
dcuai
Browse files
Update model.properties
parent
91d25f14
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
model.properties
model.properties
+1
-1
No files found.
model.properties
View file @
479027f2
# 模型唯一标识
modelCode
=
990
# 模型名称
modelName
=
Intern
lm
_2.5_pytorch
modelName
=
Intern
LM
_2.5_pytorch
# 模型描述
modelDescription
=
Internlm2.5与Internlm2模型结构相同,但取得更好效果,Internlm2采用LLama和GQA结构,相较于Internlm改进了Wqkv的权重矩阵进行交错重排,不再简单堆叠每个头的Wk、Wq和Wv矩阵。此交织重排操作大概能提高5%的训练效率。
# 应用场景
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment