Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Telechat_pytorch
Commits
19866d44
Commit
19866d44
authored
Nov 11, 2024
by
lvzhen
Browse files
Update README.md
parent
6b806c10
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
0 deletions
+3
-0
README.md
README.md
+3
-0
No files found.
README.md
View file @
19866d44
...
...
@@ -4,6 +4,9 @@
[
TeleChat Technical Report
](
https://arxiv.org/abs/2401.03804
)
## 算法原理
TeleChat 是一个基于 Transformer 架构的语义大模型,拥有千亿级别的参数量。它采用了先进的预训练技术,通过对大量高质量文本数据的学习,使得模型具备了强大的语义理解和生成能力。在模型结构上,TeleChat 借鉴了GPT等生成式预训练模型的成功经验,同时结合了中国电信的实际需求进行了优化,从而实现了更高的性能和更广泛的应用场景。
## 模型结构
采用标准的
`Decoder-only`
结构设计了
**TeleChat**
模型,并在模型维度做了如下的一些改进:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment