Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
InternLM_2.5_pytorch
Commits
4815d9c5
Commit
4815d9c5
authored
Sep 06, 2024
by
zhougaofeng
Browse files
Update model.properties
parent
cd9c5b1c
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
11 additions
and
0 deletions
+11
-0
model.properties
model.properties
+11
-0
No files found.
model.properties
0 → 100644
View file @
4815d9c5
# 模型唯一标识
modelCode
=
990
# 模型名称
modelName
=
internlm_2.5_pytorch
# 模型描述
modelDescription
=
Internlm2.5与Internlm2模型结构相同,但取得更好效果,Internlm2采用LLama和GQA结构,相较于Internlm改进了Wqkv的权重矩阵进行交错重排,不再简单堆叠每个头的Wk、Wq和Wv矩阵。此交织重排操作大概能提高5%的训练效率。
# 应用场景
appScenario
=
推理,训练,对话问答,科研,教育,政府,金融
# 框架类型
frameType
=
Pytorch
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment